tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.iGzb6dKW5r', fmt=raw size=1073741824 worker1 # Disk image does not exist, creating the virtualisation disk image... client # mke2fs 1.47.4 (6-Mar-2025) client: QEMU running (pid 51) worker2 # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 50) worker1: QEMU running (pid 52) lb # Disk image does not exist, creating the virtualisation disk image... worker2 # Formatting '/build/vm-state-worker2/tmp.w7OelWcnYP', fmt=raw size=1073741824 client # Discarding device blocks: 0/262144 done lb # Formatting '/build/vm-state-lb/tmp.c6s0mKF66g', fmt=raw size=1073741824 worker2 # mke2fs 1.47.4 (6-Mar-2025) client # Creating filesystem with 262144 4k blocks and 65536 inodes lb # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done client # Filesystem UUID: 112807a0-6577-416e-bbb1-4b8788bb94f2 lb # Discarding device blocks: 0/262144 done worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Superblock backups stored on blocks: lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Filesystem UUID: cfd7f4f4-4147-4be4-a1ab-49c6973fa371 client # 32768, 98304, 163840, 229376 lb # Filesystem UUID: 4151e13b-0aee-489f-86a7-16af63ca6460 worker2 # Superblock backups stored on blocks: client # lb # Superblock backups stored on blocks: worker2 # 32768, 98304, 163840, 229376 client # Allocating group tables: 0/8 done lb # 32768, 98304, 163840, 229376 worker2 # client # Writing inode tables: 0/8 done lb # worker2 # Allocating group tables: 0/8 done client # Creating journal (8192 blocks): done lb # Allocating group tables: 0/8 done worker2 # Writing inode tables: 0/8 done client # Writing superblocks and filesystem accounting information: 0/8 done lb # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done client # lb # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # Virtualisation disk image created. lb # Writing superblocks and filesystem accounting information: 0/8 done worker2 # worker1 # Formatting '/build/vm-state-worker1/tmp.NQY9K4IbN2', fmt=raw size=1073741824 lb: QEMU running (pid 49) lb # worker2 # Virtualisation disk image created. lb # Virtualisation disk image created. (finished: start all VMs, in 0.68 seconds) worker1 # mke2fs 1.47.4 (6-Mar-2025) client: waiting for unit network-addresses-eth1.service client: waiting for the VM to finish booting worker1 # Discarding device blocks: 0/262144 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: 5810dfc5-862c-40e4-b6a0-0fc393131a27 worker1 # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 worker1 # worker1 # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # worker1 # Virtualisation disk image created. client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] KASLR enabled client # [ 0.000000] random: crng init done client # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] Zone ranges: worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] DMA32 empty worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] Normal empty worker2 # [ 0.000000] Zone ranges: client # [ 0.000000] Device empty client # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] DMA32 empty client # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] Normal empty worker2 # [ 0.000000] Device empty client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] Early memory node ranges client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/mxjjcdp3piiw7m6ki3ycv2085q5nmrdz-nixos-system-client-test/init regInfo=/nix/store/f1h6zzz9lalh4vd08pfs1d8rys1abxi0-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/f1h6zzz9lalh4vd08pfs1d8rys1abxi0-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lwjwr69nvgic4id2a0liqvrxsl7xi5q5-nixos-system-worker2-test/init regInfo=/nix/store/40cgfsvljmvjcgvggnq2nfs8gid2ii8f-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/40cgfsvljmvjcgvggnq2nfs8gid2ii8f-closure-info/registration", will be passed to user space. client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] Policy zone: DMA client # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] KASLR enabled client # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] random: crng init done worker2 # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] DMA32 empty worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] Normal empty worker1 # [ 0.000000] Device empty client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] Early memory node ranges client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] KASLR enabled worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] random: crng init done worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] Zone ranges: worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] DMA32 empty worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] Normal empty lb # [ 0.000000] Device empty client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] Movable zone start for each node client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000048] arm-pv: using stolen time PV worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rbrvibrmg6njs73xdbl40qs6xvcpzckr-nixos-system-worker1-test/init regInfo=/nix/store/wz2yndnwkwz68zbyqp12dqpnc5i811j8-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000631] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000844] Console: colour dummy device 80x25 worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000852] printk: legacy console [tty0] enabled worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/wz2yndnwkwz68zbyqp12dqpnc5i811j8-closure-info/registration", will be passed to user space. worker2 # [ 0.000037] arm-pv: using stolen time PV lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000653] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.001069] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000864] Console: colour dummy device 80x25 worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.001076] pid_max: default: 32768 minimum: 301 lb # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000872] printk: legacy console [tty0] enabled client # [ 0.001148] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.001315] landlock: Up and running. lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.001317] Yama: becoming mindful. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.001068] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.002003] LSM support for eBPF active worker1 # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.001075] pid_max: default: 32768 minimum: 301 lb # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.002163] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.001159] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.001321] landlock: Up and running. client # [ 0.002207] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.001323] Yama: becoming mindful. worker1 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.001956] LSM support for eBPF active client # [ 0.003459] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.004381] rcu: Hierarchical SRCU implementation. worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.002170] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000000] Policy zone: DMA client # [ 0.004386] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.002205] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.005687] fsl-mc MSI: its@8080000 domain created lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.005781] EFI services will not be available. worker2 # [ 0.003476] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.005854] smp: Bringing up secondary CPUs ... worker2 # [ 0.004377] rcu: Hierarchical SRCU implementation. worker1 # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.005863] smp: Brought up 1 node, 1 CPU worker2 # [ 0.004382] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space. client # [ 0.005866] SMP: Total of 1 processors activated. worker2 # [ 0.005623] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.005872] CPU: All CPU(s) started at EL1 lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.005716] EFI services will not be available. worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.005884] CPU features: detected: Branch Target Identification worker2 # [ 0.005816] smp: Bringing up secondary CPUs ... worker1 # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.005825] smp: Brought up 1 node, 1 CPU client # [ 0.005889] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.005829] SMP: Total of 1 processors activated. lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.005836] CPU: All CPU(s) started at EL1 client # [ 0.005893] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.005847] CPU features: detected: Branch Target Identification lb # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.005896] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.005853] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.005900] CPU features: detected: Common not Private translations worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.005903] CPU features: detected: CRC32 instructions lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.005856] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.005906] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.005860] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] Policy zone: DMA client # [ 0.005910] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.005864] CPU features: detected: Common not Private translations worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.005867] CPU features: detected: CRC32 instructions client # [ 0.005913] CPU features: detected: Data independent timing control (DIT) client # [ 0.005916] CPU features: detected: E0PD lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.005870] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.005919] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.005873] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.005922] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.005877] CPU features: detected: Data independent timing control (DIT) lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.005925] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.005880] CPU features: detected: E0PD lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.005928] CPU features: detected: Fine Grained Traps lb # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.005882] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.005932] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.005885] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.005938] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.005889] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.005941] CPU features: detected: LSE atomic instructions worker2 # [ 0.005892] CPU features: detected: Fine Grained Traps lb # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.005944] CPU features: detected: Privileged Access Never worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.005896] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.005946] CPU features: detected: PMUv3 lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.005901] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.005949] CPU features: detected: RAS Extension Support lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.005904] CPU features: detected: LSE atomic instructions worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 worker2 # [ 0.005908] CPU features: detected: Privileged Access Never lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.005952] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.005910] CPU features: detected: PMUv3 worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 client # [ 0.005955] CPU features: detected: Random Number Generator lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.005914] CPU features: detected: RAS Extension Support worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.005957] CPU features: detected: Speculation barrier (SB) lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.005961] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.005916] CPU features: detected: RASv1p1 Extension Support lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.005964] CPU features: detected: TLB range maintenance instructions lb # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.005919] CPU features: detected: Random Number Generator lb # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.005969] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.005922] CPU features: detected: Speculation barrier (SB) lb # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.006013] alternatives: applying system-wide alternatives worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.005924] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.009143] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.005928] CPU features: detected: TLB range maintenance instructions lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000034] arm-pv: using stolen time PV lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.005933] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.006003] alternatives: applying system-wide alternatives client # [ 0.009371] Memory: 1406504K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker1 # [ 0.000487] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.009820] devtmpfs: initialized worker1 # [ 0.000667] Console: colour dummy device 80x25 worker2 # [ 0.009081] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.011768] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.000676] printk: legacy console [tty0] enabled lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.011793] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.009310] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.000864] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.009730] devtmpfs: initialized client # [ 0.012020] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.000871] pid_max: default: 32768 minimum: 301 lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.012025] 0 pages in range for non-PLT usage worker1 # [ 0.000941] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.011701] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.001089] landlock: Up and running. client # [ 0.012026] 508288 pages in range for PLT usage lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.001092] Yama: becoming mindful. worker2 # [ 0.011725] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.012129] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.001576] LSM support for eBPF active client # [ 0.012900] DMI not present or invalid. worker2 # [ 0.011915] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.001728] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.016778] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.011919] 0 pages in range for non-PLT usage lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.011920] 508288 pages in range for PLT usage worker1 # [ 0.001762] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.019208] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.012029] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.012863] DMI not present or invalid. worker1 # [ 0.002949] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.019400] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.003729] rcu: Hierarchical SRCU implementation. worker2 # [ 0.016801] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.019617] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.003734] rcu: Max phase no-delay instances is 1000. lb # [ 0.000031] arm-pv: using stolen time PV worker2 # [ 0.019278] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.004950] fsl-mc MSI: its@8080000 domain created client # [ 0.019646] audit: initializing netlink subsys (disabled) worker1 # [ 0.005041] EFI services will not be available. worker2 # [ 0.019465] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.020282] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.000410] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.005125] smp: Bringing up secondary CPUs ... lb # [ 0.000577] Console: colour dummy device 80x25 client # [ 0.020285] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.005134] smp: Brought up 1 node, 1 CPU worker2 # [ 0.019674] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.000586] printk: legacy console [tty0] enabled worker1 # [ 0.005137] SMP: Total of 1 processors activated. client # [ 0.020289] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.019701] audit: initializing netlink subsys (disabled) worker1 # [ 0.005143] CPU: All CPU(s) started at EL1 client # [ 0.020294] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.020343] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.005153] CPU features: detected: Branch Target Identification lb # [ 0.000785] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.020297] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.020345] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.000792] pid_max: default: 32768 minimum: 301 worker1 # [ 0.005158] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.000864] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.020349] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.020325] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.001004] landlock: Up and running. worker1 # [ 0.005162] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.020334] cpuidle: using governor ladder worker2 # [ 0.020355] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.001007] Yama: becoming mindful. client # [ 0.020339] cpuidle: using governor menu lb # [ 0.001495] LSM support for eBPF active worker2 # [ 0.020358] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.005166] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.020540] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.005169] CPU features: detected: Common not Private translations lb # [ 0.001643] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.020387] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.020557] ASID allocator initialised with 65536 entries worker1 # [ 0.005173] CPU features: detected: CRC32 instructions worker2 # [ 0.020396] cpuidle: using governor ladder client # [ 0.021867] Serial: AMBA PL011 UART driver lb # [ 0.001679] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.020402] cpuidle: using governor menu worker1 # [ 0.005175] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.002843] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.027336] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.020614] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.003663] rcu: Hierarchical SRCU implementation. worker1 # [ 0.005179] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.027558] printk: console [ttyAMA0] enabled worker2 # [ 0.020632] ASID allocator initialised with 65536 entries lb # [ 0.003668] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.005183] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.021946] Serial: AMBA PL011 UART driver lb # [ 0.004911] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.005186] CPU features: detected: E0PD lb # [ 0.005008] EFI services will not be available. worker2 # [ 0.027422] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.005188] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.005086] smp: Bringing up secondary CPUs ... worker2 # [ 0.027570] printk: console [ttyAMA0] enabled lb # [ 0.005095] smp: Brought up 1 node, 1 CPU worker1 # [ 0.005191] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.005098] SMP: Total of 1 processors activated. worker1 # [ 0.005194] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.005105] CPU: All CPU(s) started at EL1 worker1 # [ 0.005197] CPU features: detected: Fine Grained Traps lb # [ 0.005116] CPU features: detected: Branch Target Identification worker1 # [ 0.005200] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.005122] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.005205] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.005125] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.005208] CPU features: detected: LSE atomic instructions worker1 # [ 0.005211] CPU features: detected: Privileged Access Never lb # [ 0.005128] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.005214] CPU features: detected: PMUv3 lb # [ 0.005132] CPU features: detected: Common not Private translations worker1 # [ 0.005217] CPU features: detected: RAS Extension Support lb # [ 0.005135] CPU features: detected: CRC32 instructions worker1 # [ 0.005220] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.005222] CPU features: detected: Random Number Generator client # [ 0.151096] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.005138] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.005225] CPU features: detected: Speculation barrier (SB) client # [ 0.151119] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.005142] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.005228] CPU features: detected: Stage-2 Force Write-Back client # [ 0.151125] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.005145] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.005231] CPU features: detected: TLB range maintenance instructions lb # [ 0.005148] CPU features: detected: E0PD worker2 # [ 0.151579] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.151129] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.005236] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.005150] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.151602] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.151133] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.005275] alternatives: applying system-wide alternatives lb # [ 0.005153] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.151137] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.151608] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.008432] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.005156] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.151612] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.151142] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.005159] CPU features: detected: Fine Grained Traps worker2 # [ 0.151617] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.151146] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.008674] Memory: 1406560K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) lb # [ 0.005163] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.151621] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.009085] devtmpfs: initialized lb # [ 0.005168] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.151626] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.011040] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.005171] CPU features: detected: LSE atomic instructions client # [ 0.158709] fbcon: Taking over console worker2 # [ 0.151630] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.005174] CPU features: detected: Privileged Access Never client # [ 0.158728] ACPI: Interpreter disabled. worker1 # [ 0.011065] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.005177] CPU features: detected: PMUv3 worker1 # [ 0.011239] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.160674] iommu: Default domain type: Translated worker1 # [ 0.011244] 0 pages in range for non-PLT usage worker2 # [ 0.159088] fbcon: Taking over console client # [ 0.160684] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.005180] CPU features: detected: RAS Extension Support worker1 # [ 0.011245] 508288 pages in range for PLT usage worker2 # [ 0.159104] ACPI: Interpreter disabled. worker1 # [ 0.011371] pinctrl core: initialized pinctrl subsystem lb # [ 0.005182] CPU features: detected: RASv1p1 Extension Support client # [ 0.162351] SCSI subsystem initialized worker1 # [ 0.012215] DMI not present or invalid. worker2 # [ 0.160989] iommu: Default domain type: Translated lb # [ 0.005185] CPU features: detected: Random Number Generator worker1 # [ 0.015864] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.005187] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.161001] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.018242] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.005190] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.005193] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.018434] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.005198] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.018645] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.005237] alternatives: applying system-wide alternatives worker1 # [ 0.018670] audit: initializing netlink subsys (disabled) lb # [ 0.008341] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.167632] usbcore: registered new interface driver usbfs worker1 # [ 0.019310] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.167666] usbcore: registered new interface driver hub worker1 # [ 0.019311] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.008591] Memory: 1406524K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) client # [ 0.167685] usbcore: registered new device driver usb lb # [ 0.009015] devtmpfs: initialized worker1 # [ 0.019315] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.168105] SCSI subsystem initialized client # [ 0.167962] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.019321] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.010835] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.167968] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.019324] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.168807] usbcore: registered new interface driver usbfs lb # [ 0.010858] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.167979] PTP clock support registered worker2 # [ 0.168839] usbcore: registered new interface driver hub client # [ 0.168027] EDAC MC: Ver: 3.0.0 worker1 # [ 0.019350] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.011044] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.168857] usbcore: registered new device driver usb lb # [ 0.011049] 0 pages in range for non-PLT usage worker1 # [ 0.019358] cpuidle: using governor ladder client # [ 0.172680] scmi_core: SCMI protocol bus registered worker1 # [ 0.019364] cpuidle: using governor menu worker2 # [ 0.169129] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.011050] 508288 pages in range for PLT usage lb # [ 0.011150] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.019564] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.173625] FPGA manager framework worker2 # [ 0.169135] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.011977] DMI not present or invalid. client # [ 0.174601] vgaarb: loaded worker1 # [ 0.019581] ASID allocator initialised with 65536 entries worker2 # [ 0.169145] PTP clock support registered worker1 # [ 0.020851] Serial: AMBA PL011 UART driver lb # [ 0.015362] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.169198] EDAC MC: Ver: 3.0.0 client # [ 0.175236] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.017670] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.173795] scmi_core: SCMI protocol bus registered worker1 # [ 0.026156] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.026327] printk: console [ttyAMA0] enabled lb # [ 0.017921] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.174750] FPGA manager framework worker2 # [ 0.175690] vgaarb: loaded lb # [ 0.018129] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.018157] audit: initializing netlink subsys (disabled) worker2 # [ 0.176384] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.018854] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.018856] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.018861] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.018866] thermal_sys: Registered thermal governor 'user_space' client # [ 0.181376] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.179593] VFS: Disk quotas dquot_6.6.0 lb # [ 0.018869] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.181427] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.179631] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.018898] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.183137] netfs: FS-Cache loaded lb # [ 0.018907] cpuidle: using governor ladder client # [ 0.183720] pnp: PnP ACPI: disabled lb # [ 0.018913] cpuidle: using governor menu lb # [ 0.019108] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.146851] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.019126] ASID allocator initialised with 65536 entries worker2 # [ 0.183498] netfs: FS-Cache loaded lb # [ 0.020479] Serial: AMBA PL011 UART driver worker2 # [ 0.183648] pnp: PnP ACPI: disabled worker1 # [ 0.146873] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.146878] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.025945] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.026097] printk: console [ttyAMA0] enabled worker1 # [ 0.146882] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.146887] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.146891] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.146895] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.187710] NET: Registered PF_INET protocol family worker1 # [ 0.146900] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.188012] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.187314] NET: Registered PF_INET protocol family client # [ 0.187611] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.154440] fbcon: Taking over console worker1 # [ 0.154457] ACPI: Interpreter disabled. lb # [ 0.148038] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.148061] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.148067] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.148071] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.148076] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.148080] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.163031] iommu: Default domain type: Translated lb # [ 0.148085] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.163043] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.148089] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.163411] SCSI subsystem initialized worker1 # [ 0.165397] usbcore: registered new interface driver usbfs lb # [ 0.155715] fbcon: Taking over console worker1 # [ 0.165430] usbcore: registered new interface driver hub lb # [ 0.155732] ACPI: Interpreter disabled. worker1 # [ 0.165448] usbcore: registered new device driver usb worker1 # [ 0.165743] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.165749] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.165759] PTP clock support registered worker1 # [ 0.165837] EDAC MC: Ver: 3.0.0 worker1 # [ 0.170479] scmi_core: SCMI protocol bus registered worker1 # [ 0.171504] FPGA manager framework worker1 # [ 0.172536] vgaarb: loaded worker1 # [ 0.173197] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.164358] iommu: Default domain type: Translated lb # [ 0.164372] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.164781] SCSI subsystem initialized lb # [ 0.166903] usbcore: registered new interface driver usbfs worker1 # [ 0.177921] VFS: Disk quotas dquot_6.6.0 lb # [ 0.166937] usbcore: registered new interface driver hub worker1 # [ 0.177982] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.166957] usbcore: registered new device driver usb worker1 # [ 0.179692] netfs: FS-Cache loaded lb # [ 0.167298] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.179811] pnp: PnP ACPI: disabled lb # [ 0.167305] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.167316] PTP clock support registered lb # [ 0.167381] EDAC MC: Ver: 3.0.0 lb # [ 0.172158] scmi_core: SCMI protocol bus registered lb # [ 0.173182] FPGA manager framework lb # [ 0.174222] vgaarb: loaded worker1 # [ 0.183833] NET: Registered PF_INET protocol family lb # [ 0.174878] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.184124] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.218377] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.218437] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.218008] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.179275] VFS: Disk quotas dquot_6.6.0 lb # [ 0.179325] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.218473] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.218065] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.180971] netfs: FS-Cache loaded worker2 # [ 0.218561] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.218098] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.181100] pnp: PnP ACPI: disabled worker2 # [ 0.218705] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.218184] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.218801] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.218330] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.218839] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.218434] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.218877] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.218476] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.218986] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.218516] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.219045] NET: Registered PF_XDP protocol family client # [ 0.218611] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.219065] PCI: CLS 0 bytes, default 64 lb # [ 0.185135] NET: Registered PF_INET protocol family client # [ 0.218659] NET: Registered PF_XDP protocol family worker2 # [ 0.219327] Trying to unpack rootfs image as initramfs... client # [ 0.218680] PCI: CLS 0 bytes, default 64 lb # [ 0.185425] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.218932] Trying to unpack rootfs image as initramfs... worker2 # [ 0.234275] kvm [1]: HYP mode not available client # [ 0.237239] kvm [1]: HYP mode not available worker1 # [ 0.215269] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.215332] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.215366] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.215458] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.215601] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.215700] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.215740] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.215791] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.215883] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.215942] NET: Registered PF_XDP protocol family worker1 # [ 0.215961] PCI: CLS 0 bytes, default 64 worker1 # [ 0.216235] Trying to unpack rootfs image as initramfs... worker1 # [ 0.231137] kvm [1]: HYP mode not available lb # [ 0.216857] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.216917] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.216952] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.217042] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.217187] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.217286] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.217349] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.217389] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.217494] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.217526] NET: Registered PF_XDP protocol family lb # [ 0.217546] PCI: CLS 0 bytes, default 64 lb # [ 0.217811] Trying to unpack rootfs image as initramfs... lb # [ 0.232805] kvm [1]: HYP mode not available client # [ 0.364326] Initialise system trusted keyrings client # [ 0.365072] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.366357] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.367142] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.369024] Initialise system trusted keyrings worker2 # [ 0.369773] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.371125] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.371909] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.357862] Initialise system trusted keyrings client # [ 0.395848] Key type asymmetric registered client # [ 0.395879] Asymmetric key parser 'x509' registered worker1 # [ 0.358655] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.395962] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.398136] io scheduler mq-deadline registered worker1 # [ 0.360047] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.398148] io scheduler kyber registered worker1 # [ 0.360841] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.400559] Key type asymmetric registered worker2 # [ 0.400590] Asymmetric key parser 'x509' registered worker2 # [ 0.400667] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.402803] io scheduler mq-deadline registered worker2 # [ 0.402815] io scheduler kyber registered lb # [ 0.357073] Initialise system trusted keyrings lb # [ 0.357848] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.359190] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.407432] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.359983] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.412583] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.408877] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.409265] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.409284] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.413986] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.409295] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.414361] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.409304] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.414379] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.409323] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.414392] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.409347] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.409432] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.414401] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.409441] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.414429] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.409448] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.414453] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.409453] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.414535] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.409458] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.414544] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.409518] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.414550] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.389529] Key type asymmetric registered client # [ 0.409945] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.414556] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.389560] Asymmetric key parser 'x509' registered client # [ 0.410127] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.414561] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.389634] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.410143] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.391828] io scheduler mq-deadline registered worker2 # [ 0.414621] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.410172] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.391840] io scheduler kyber registered client # [ 0.410188] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.415064] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.415252] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.410631] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.383949] Key type asymmetric registered worker2 # [ 0.415269] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.410810] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.415299] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.383979] Asymmetric key parser 'x509' registered client # [ 0.410826] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.415316] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.384058] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.410855] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.386222] io scheduler mq-deadline registered worker2 # [ 0.415765] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.411340] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.386233] io scheduler kyber registered worker2 # [ 0.415950] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.411545] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.415966] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.411568] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.415999] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.411598] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.412071] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.435900] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.412259] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.436088] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.412276] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.436105] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.401321] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.412311] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.436136] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.412766] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.412944] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.439771] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.412960] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.439961] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.402725] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.412989] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.439978] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.403134] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.440010] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.413432] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.403153] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.413612] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.413628] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.403166] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.413657] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.403174] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.414104] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.403198] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.414283] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.399758] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.414299] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.403223] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.414327] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.403302] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.414343] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.403311] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.403318] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.414822] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.415006] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.403323] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.415036] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.403328] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.448549] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.403390] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.448769] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.401118] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.403838] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.448786] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.401541] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.404030] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.448817] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.404046] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.401559] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.449341] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.404076] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.401572] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.449531] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.404093] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.449548] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.401581] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.404555] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.449580] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.404746] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.401601] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.450107] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.404762] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.450297] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.401623] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.404792] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.450315] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.401702] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.450344] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.401711] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.459653] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.450362] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.401717] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.459897] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.401722] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.450839] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.459927] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.451033] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.401728] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.460337] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.451063] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.401791] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.460520] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.451537] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.402241] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.460783] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.451735] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.402439] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.461096] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.451765] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.402455] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.461114] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.402485] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.452162] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.461143] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.402502] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.452348] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.461609] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.403012] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.461797] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.403206] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.461813] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.403222] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.461843] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.403253] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.462429] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.469504] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.403755] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.462440] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.403958] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.469806] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.429289] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.469824] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.462446] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.403974] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.429502] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.469855] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.404005] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.429519] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.462490] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.429550] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.470360] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.404471] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.462537] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.470551] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.404661] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.430062] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.462584] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.470568] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.404677] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.430253] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.470597] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.462631] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.404713] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.430269] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.471185] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.462681] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.405200] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.430303] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.405390] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.471196] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.462729] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.430764] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.405406] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.430946] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.471202] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.462778] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.405436] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.430963] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.471249] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.462825] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.405933] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.430993] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.471298] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.406127] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.462873] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.431459] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.406144] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.471346] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.431642] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.462953] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.406176] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.431657] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.471394] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.462999] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.431689] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.406642] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.471441] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.463022] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.406836] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.432144] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.463043] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.471488] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.406852] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.432329] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.463065] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.471536] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.432347] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.463090] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.471585] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.432377] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.463112] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.432394] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.471632] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.463134] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.432866] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.471708] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.463156] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.433053] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.471755] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.463179] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.433083] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.471777] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.463201] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.433559] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.471799] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.463224] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.433748] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.471821] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.433802] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.471846] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.471868] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.434205] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.434391] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.471890] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.471912] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.434640] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.434913] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.471934] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.446916] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.434932] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.471956] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.446946] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.434962] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.471980] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.447465] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.435433] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.472002] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.447666] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.435618] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.472024] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.447697] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.435634] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.472045] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.435665] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.472067] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.448173] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.472089] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.448368] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.436260] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.472110] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.448398] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.436272] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.472132] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.448797] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.436278] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.472154] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.503309] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.448989] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.436325] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.472179] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.503358] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.449239] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.472202] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.436373] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.503381] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.449533] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.472229] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.503404] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.436420] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.449550] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.472239] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.503427] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.436467] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.449581] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.472244] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.503450] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.436514] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.450066] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.503473] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.450256] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.436560] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.503497] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.450272] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.503520] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.436607] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.450302] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.503543] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.436655] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.503577] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.436702] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.503587] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.503591] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.436770] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.504789] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.436853] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.436876] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.436897] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.436919] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.436944] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.436969] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.517543] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.436992] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.437016] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.437039] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.470966] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.437061] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.470990] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.437084] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.470996] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.437106] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.437128] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.471082] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.437150] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.471132] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.437171] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.471179] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.471228] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.471276] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.471325] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.471374] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.471445] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.471494] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.471640] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.471689] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.471711] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.471733] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.471755] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.535307] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.471781] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.537590] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.471803] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.471826] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.471848] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.538607] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.501254] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.471871] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.501356] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.471893] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.501383] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.471917] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.501407] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.501435] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.471940] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.501458] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.471963] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.501499] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.471984] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.501509] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.472007] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.501514] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.472029] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.502770] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.472051] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.472073] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.472095] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.547531] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.472117] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.550266] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.472139] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.472168] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.472178] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.549300] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.472182] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.551609] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.473374] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.555636] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.561632] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.564437] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.566796] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.530994] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.567962] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.570140] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.526653] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.580935] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.541387] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.584267] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.544723] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.586424] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.536485] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.547035] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.585097] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.587575] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.590131] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.557280] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.547702] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.597124] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.592235] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.560277] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.550039] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.553851] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.572143] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.561332] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.612357] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.610419] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.615137] msm_serial: driver initialized worker1 # [ 0.575657] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.615913] SuperH (H)SCI(F) driver initialized worker2 # [ 0.616896] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.615970] STM32 USART driver initialized lb # [ 0.571661] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.585508] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.587616] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.625954] msm_serial: driver initialized worker2 # [ 0.626148] SuperH (H)SCI(F) driver initialized worker2 # [ 0.626211] STM32 USART driver initialized worker1 # [ 0.591647] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) lb # [ 0.579647] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.581953] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.592338] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.595800] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.614535] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.655542] loop: module loaded client # [ 0.655768] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.609257] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.656622] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.617301] msm_serial: driver initialized worker1 # [ 0.617448] SuperH (H)SCI(F) driver initialized worker1 # [ 0.617503] STM32 USART driver initialized lb # [ 0.611927] msm_serial: driver initialized worker2 # [ 0.659646] loop: module loaded lb # [ 0.612088] SuperH (H)SCI(F) driver initialized worker2 # [ 0.659886] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.612145] STM32 USART driver initialized worker2 # [ 0.660901] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.664149] megasas: 07.734.00.00-rc1 client # [ 0.664906] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.667014] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.667042] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.669181] megasas: 07.734.00.00-rc1 worker2 # [ 0.670016] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.668867] Using buffer write method client # [ 0.668933] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.672134] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.672185] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.670923] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.670980] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.680312] Using buffer write method client # [ 0.680373] Concatenating MTD devices: client # [ 0.680377] (0): "0.flash" client # [ 0.680381] (1): "0.flash" client # [ 0.680384] into device "0.flash" worker1 # [ 0.648318] loop: module loaded worker1 # [ 0.648537] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.650533] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.685684] Using buffer write method worker2 # [ 0.685809] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.687697] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.687747] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.693078] Using buffer write method worker2 # [ 0.693126] Concatenating MTD devices: worker2 # [ 0.693129] (0): "0.flash" worker2 # [ 0.693133] (1): "0.flash" worker2 # [ 0.693137] into device "0.flash" lb # [ 0.648118] loop: module loaded lb # [ 0.648315] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.649106] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.662015] megasas: 07.734.00.00-rc1 lb # [ 0.655709] megasas: 07.734.00.00-rc1 worker1 # [ 0.662754] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.656475] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.665175] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.658833] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.665263] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.658860] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.666875] Using buffer write method worker1 # [ 0.666946] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.668722] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.668755] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.667997] Using buffer write method lb # [ 0.668082] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.687488] Using buffer write method worker1 # [ 0.687535] Concatenating MTD devices: worker1 # [ 0.687540] (0): "0.flash" worker1 # [ 0.687546] (1): "0.flash" worker1 # [ 0.687550] into device "0.flash" lb # [ 0.679478] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.679552] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.681077] Using buffer write method lb # [ 0.681110] Concatenating MTD devices: lb # [ 0.681115] (0): "0.flash" lb # [ 0.681119] (1): "0.flash" lb # [ 0.681122] into device "0.flash" client # [ 0.950928] Freeing initrd memory: 26160K client # [ 0.957055] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.960926] thunder_xcv, ver 1.0 client # [ 0.960976] thunder_bgx, ver 1.0 client # [ 0.960998] nicpf, ver 1.0 client # [ 0.961537] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.961544] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.961568] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.961577] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.961606] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.961612] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.961635] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.961641] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.961771] sky2: driver version 1.30 client # [ 0.964069] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.964096] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.964352] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.971790] Freeing initrd memory: 26148K client # [ 0.974064] usbcore: registered new interface driver usb-storage client # [ 0.974216] usbcore: registered new interface driver usbserial_generic client # [ 0.974232] usbserial: USB Serial support registered for generic client # [ 0.974867] hv_vmbus: registering driver hyperv_keyboard client # [ 0.975302] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.975639] hub 1-0:1.0: USB hub found worker2 # [ 0.977855] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.975661] hub 1-0:1.0: 6 ports detected client # [ 0.981131] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.981166] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:46:31 UTC (1789908391) client # [ 0.981508] i2c_dev: i2c /dev entries driver worker2 # [ 0.982010] thunder_xcv, ver 1.0 client # [ 0.986560] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.982063] thunder_bgx, ver 1.0 client # [ 0.986570] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.982088] nicpf, ver 1.0 worker2 # [ 0.982654] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.986835] Synopsys Designware Multimedia Card Interface Driver client # [ 0.987197] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.982663] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.982689] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.982700] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.982730] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.982736] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.982758] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.991720] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.982764] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.991973] usbcore: registered new interface driver usbhid worker2 # [ 0.982895] sky2: driver version 1.30 client # [ 0.991980] usbhid: USB HID core driver worker2 # [ 0.985206] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.985239] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.994902] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.985517] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.997559] drop_monitor: Initializing network drop monitor service client # [ 0.997766] NET: Registered PF_INET6 protocol family worker2 # [ 0.995332] usbcore: registered new interface driver usb-storage client # [ 0.999946] Segment Routing with IPv6 worker2 # [ 0.995393] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.960464] Freeing initrd memory: 26148K client # [ 0.999967] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.995407] usbserial: USB Serial support registered for generic client # [ 0.999998] NET: Registered PF_PACKET protocol family worker2 # [ 0.996005] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.996452] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.996865] hub 1-0:1.0: USB hub found worker2 # [ 0.996888] hub 1-0:1.0: 6 ports detected client # [ 1.001613] 9pnet: Installing 9P2000 support worker1 # [ 0.966693] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 1.002493] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 1.002530] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:46:31 UTC (1789908391) worker2 # [ 1.002867] i2c_dev: i2c /dev entries driver client # [ 1.004540] Key type dns_resolver registered worker2 # [ 1.007880] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.962482] Freeing initrd memory: 26140K worker2 # [ 1.007895] sdhci: Copyright(c) Pierre Ossman client # [ 1.010959] registered taskstats version 1 worker2 # [ 1.008158] Synopsys Designware Multimedia Card Interface Driver client # [ 1.011131] Loading compiled-in X.509 certificates worker1 # [ 0.970600] thunder_xcv, ver 1.0 worker1 # [ 0.970643] thunder_bgx, ver 1.0 worker1 # [ 0.970671] nicpf, ver 1.0 worker1 # [ 0.971223] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.971230] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.971254] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 1.010648] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.971265] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 1.012363] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.971298] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 1.012617] usbcore: registered new interface driver usbhid lb # [ 0.968719] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.971304] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 1.012625] usbhid: USB HID core driver worker1 # [ 0.971329] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.971334] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 1.016263] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.971466] sky2: driver version 1.30 worker1 # [ 0.973079] usbcore: registered new interface driver usb-storage client # [ 1.019954] Demotion targets for Node 0: null worker1 # [ 0.973146] usbcore: registered new interface driver usbserial_generic client # [ 1.020069] Key type .fscrypt registered worker2 # [ 1.018932] drop_monitor: Initializing network drop monitor service worker1 # [ 0.973160] usbserial: USB Serial support registered for generic client # [ 1.020076] Key type fscrypt-provisioning registered worker2 # [ 1.019104] NET: Registered PF_INET6 protocol family worker1 # [ 0.974015] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 1.020172] ima: No TPM chip found, activating TPM-bypass! client # [ 1.020192] ima: Allocated hash algorithm: sha1 worker1 # [ 0.974042] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 1.021335] Segment Routing with IPv6 client # [ 1.020216] ima: No architecture policies found worker2 # [ 1.021359] In-situ OAM (IOAM) with IPv6 lb # [ 0.972562] thunder_xcv, ver 1.0 worker2 # [ 1.021395] NET: Registered PF_PACKET protocol family lb # [ 0.972610] thunder_bgx, ver 1.0 worker1 # [ 0.974357] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.972634] nicpf, ver 1.0 client # [ 1.024704] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.985696] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.973198] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.986106] hub 1-0:1.0: USB hub found lb # [ 0.973207] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 1.023034] 9pnet: Installing 9P2000 support worker1 # [ 0.986123] hub 1-0:1.0: 6 ports detected lb # [ 0.973231] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.973240] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.973270] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.989486] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.973276] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.973300] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 1.026016] Key type dns_resolver registered worker1 # [ 0.991100] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.973306] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.973447] sky2: driver version 1.30 worker1 # [ 0.991130] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:46:31 UTC (1789908391) lb # [ 0.975633] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 0.991435] i2c_dev: i2c /dev entries driver lb # [ 0.975660] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 0.975865] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.996437] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.996448] sdhci: Copyright(c) Pierre Ossman lb # [ 0.985513] usbcore: registered new interface driver usb-storage worker1 # [ 0.996713] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.985627] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.997090] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.985644] usbserial: USB Serial support registered for generic worker2 # [ 1.032394] registered taskstats version 1 lb # [ 0.986256] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 1.032585] Loading compiled-in X.509 certificates lb # [ 0.986949] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.987322] hub 1-0:1.0: USB hub found lb # [ 0.987403] hub 1-0:1.0: 6 ports detected worker1 # [ 1.001514] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 1.001786] usbcore: registered new interface driver usbhid worker1 # [ 1.001793] usbhid: USB HID core driver lb # [ 0.992724] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 1.042304] clk: Disabling unused clocks lb # [ 0.992759] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:46:31 UTC (1789908391) worker1 # [ 1.004781] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 1.041377] Demotion targets for Node 0: null client # [ 1.042337] PM: genpd: Disabling unused power domains lb # [ 0.993120] i2c_dev: i2c /dev entries driver worker2 # [ 1.041501] Key type .fscrypt registered worker2 # [ 1.041509] Key type fscrypt-provisioning registered worker2 # [ 1.041610] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 1.007411] drop_monitor: Initializing network drop monitor service worker2 # [ 1.041630] ima: Allocated hash algorithm: sha1 worker1 # [ 1.007593] NET: Registered PF_INET6 protocol family worker2 # [ 1.041655] ima: No architecture policies found client # [ 1.046669] Freeing unused kernel memory: 4736K lb # [ 0.998119] sdhci: Secure Digital Host Controller Interface driver client # [ 1.046857] Run /init as init process worker1 # [ 1.009904] Segment Routing with IPv6 lb # [ 0.998131] sdhci: Copyright(c) Pierre Ossman worker1 # [ 1.009924] In-situ OAM (IOAM) with IPv6 worker2 # [ 1.046278] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.998401] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 1.009960] NET: Registered PF_PACKET protocol family lb # [ 0.998773] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 1.011574] 9pnet: Installing 9P2000 support lb # [ 1.003207] hid: raw HID events driver (C) Jiri Kosina lb # [ 1.003476] usbcore: registered new interface driver usbhid lb # [ 1.003483] usbhid: USB HID core driver worker1 # [ 1.014397] Key type dns_resolver registered lb # [ 1.006407] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 1.009129] drop_monitor: Initializing network drop monitor service lb # [ 1.009323] NET: Registered PF_INET6 protocol family worker1 # [ 1.020827] registered taskstats version 1 worker1 # [ 1.020985] Loading compiled-in X.509 certificates lb # [ 1.011591] Segment Routing with IPv6 lb # [ 1.011616] In-situ OAM (IOAM) with IPv6 lb # [ 1.011655] NET: Registered PF_PACKET protocol family client # [ 1.061598] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.013320] 9pnet: Installing 9P2000 support lb # [ 1.016184] Key type dns_resolver registered worker1 # [ 1.029878] Demotion targets for Node 0: null worker1 # [ 1.030002] Key type .fscrypt registered worker1 # [ 1.030008] Key type fscrypt-provisioning registered worker2 # [ 1.065594] clk: Disabling unused clocks worker1 # [ 1.030111] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 1.065635] PM: genpd: Disabling unused power domains worker1 # [ 1.030130] ima: Allocated hash algorithm: sha1 lb # [ 1.022599] registered taskstats version 1 worker1 # [ 1.030156] ima: No architecture policies found lb # [ 1.022762] Loading compiled-in X.509 certificates worker2 # [ 1.070035] Freeing unused kernel memory: 4736K worker2 # [ 1.070215] Run /init as init process worker1 # [ 1.034647] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 1.031467] Demotion targets for Node 0: null lb # [ 1.031587] Key type .fscrypt registered lb # [ 1.031594] Key type fscrypt-provisioning registered lb # [ 1.031697] ima: No TPM chip found, activating TPM-bypass! lb # [ 1.031718] ima: Allocated hash algorithm: sha1 lb # [ 1.031743] ima: No architecture policies found lb # [ 1.036270] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 1.087274] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.053680] clk: Disabling unused clocks worker1 # [ 1.053713] PM: genpd: Disabling unused power domains worker1 # [ 1.058147] Freeing unused kernel memory: 4736K worker1 # [ 1.058328] Run /init as init process lb # [ 1.054946] clk: Disabling unused clocks lb # [ 1.054979] PM: genpd: Disabling unused power domains lb # [ 1.059335] Freeing unused kernel memory: 4736K lb # [ 1.059546] Run /init as init process worker1 # [ 1.075604] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.077397] systemd[1]: Successfully made /usr/ read-only. client # [ 1.223330] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.244471] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.233282] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.235014] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.375277] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.398933] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.396567] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.408805] systemd[1]: Detected virtualization qemu. client # [ 1.410884] systemd[1]: Detected architecture arm64. client # [ 1.412953] systemd[1]: Running in initrd. client # [ 1.415668] systemd[1]: Initializing machine ID from random generator. client # [ 1.418608] systemd[1]: Hostname set to . worker1 # [ 1.391724] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.422365] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.434784] systemd[1]: Detected virtualization qemu. worker2 # [ 1.436998] systemd[1]: Detected architecture arm64. lb # [ 1.387327] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.438983] systemd[1]: Running in initrd. worker2 # [ 1.441673] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.444599] systemd[1]: Hostname set to . worker1 # [ 1.410708] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.422932] systemd[1]: Detected virtualization qemu. worker1 # [ 1.424962] systemd[1]: Detected architecture arm64. worker1 # [ 1.426992] systemd[1]: Running in initrd. client # [ 1.463588] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.429724] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.432654] systemd[1]: Hostname set to . lb # [ 1.412407] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.424836] systemd[1]: Detected virtualization qemu. lb # [ 1.427019] systemd[1]: Detected architecture arm64. lb # [ 1.428966] systemd[1]: Running in initrd. lb # [ 1.431732] systemd[1]: Initializing machine ID from random generator. lb # [ 1.434708] systemd[1]: Hostname set to . worker2 # [ 1.496702] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.477542] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.479300] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.587334] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.620549] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.601245] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.602932] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.709604] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.735515] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.743682] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.746359] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker1 # [ 1.729100] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.774187] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.777802] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.790179] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.750728] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.761509] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.802040] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.803114] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.804372] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.764755] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.805350] systemd[1]: Reached target Path Units. client # [ 1.806049] systemd[1]: Reached target Slice Units. client # [ 1.806759] systemd[1]: Reached target Swaps. client # [ 1.807433] systemd[1]: Reached target Timer Units. client # [ 1.808359] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.809434] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.810392] systemd[1]: Listening on Journal Sockets. client # [ 1.811223] systemd[1]: Listening on udev Control Socket. client # [ 1.812187] systemd[1]: Listening on udev Kernel Socket. client # [ 1.812213] systemd[1]: Reached target Socket Units. client # [ 1.815295] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.763629] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.819072] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.769373] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.823561] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.824744] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.830403] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.830970] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.832096] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.833362] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.833401] systemd[1]: Reached target Path Units. worker2 # [ 1.833421] systemd[1]: Reached target Slice Units. worker2 # [ 1.833441] systemd[1]: Reached target Swaps. worker2 # [ 1.833461] systemd[1]: Reached target Timer Units. worker2 # [ 1.833659] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.833803] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.833930] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.834093] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.834201] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.834220] systemd[1]: Reached target Socket Units. worker2 # [ 1.844187] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.846767] systemd[1]: Starting Journal Service... worker2 # [ 1.852617] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.853689] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.822347] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.859869] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.867753] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.831516] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.868160] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.832682] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.834059] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.835017] systemd[1]: Reached target Path Units. worker1 # [ 1.835837] systemd[1]: Reached target Slice Units. worker1 # [ 1.836579] systemd[1]: Reached target Swaps. worker1 # [ 1.837302] systemd[1]: Reached target Timer Units. worker1 # [ 1.838271] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.839383] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.840427] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.841357] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.842311] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.843137] systemd[1]: Reached target Socket Units. worker2 # [ 1.875578] systemd[1]: Starting Journal Service... worker1 # [ 1.849452] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.852318] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.853432] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.896938] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.861394] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.899572] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.900593] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.905635] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.865874] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.882130] systemd[1]: Starting Journal Service... worker2 # [ 1.921056] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.922175] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.877355] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.889493] systemd[1]: Starting Load Kernel Modules... lb # [ 1.878577] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.879972] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.890388] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.881010] systemd[1]: Reached target Path Units. lb # [ 1.881802] systemd[1]: Reached target Slice Units. client # [ 1.927465] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.882633] systemd[1]: Reached target Swaps. client # [ 1.928662] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.883525] systemd[1]: Reached target Timer Units. client # [ 1.929012] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.884541] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.885744] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.932810] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.886924] systemd[1]: Listening on Journal Sockets. lb # [ 1.887946] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.934723] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.888973] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.889852] systemd[1]: Reached target Socket Units. client # [ 1.938068] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.892464] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.905554] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.947751] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.903166] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.904431] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.955426] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.952737] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.953461] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.921387] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.911863] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.923351] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.960821] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.963499] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.963758] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.963770] [drm] features: -context_init client # [ 1.964569] [drm] number of scanouts: 1 client # [ 1.964591] [drm] number of cap sets: 0 worker1 # [ 1.933733] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.934201] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.927354] systemd[1]: Starting Journal Service... client # [ 1.977662] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.941650] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.987653] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.987677] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.996204] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.951101] systemd[1]: Starting Load Kernel Modules... lb # [ 1.951244] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.962884] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.968447] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.963498] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 2.012512] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 2.017291] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker2 # [ 2.017540] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 2.017550] [drm] features: -context_init worker2 # [ 2.018293] [drm] number of scanouts: 1 worker2 # [ 2.018314] [drm] number of cap sets: 0 worker1 # [ 1.985579] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 2.023756] Console: switching to colour frame buffer device 160x50 client # [ 2.028524] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 1.993749] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.994026] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.994035] [drm] features: -context_init client # [ 2.032028] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.994762] [drm] number of scanouts: 1 worker1 # [ 1.994781] [drm] number of cap sets: 0 worker2 # [ 2.033122] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 2.035710] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 2.035837] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.987049] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.988370] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.988709] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.988963] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 2.040812] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 2.040839] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.999320] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 2.009994] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 2.012653] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 2.012161] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 2.063597] systemd[1]: Finished Load Kernel Modules. client # [ 2.067460] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.021530] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 2.023402] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 2.021557] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 2.072745] Console: switching to colour frame buffer device 160x50 lb # [ 2.035269] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 2.045531] Console: switching to colour frame buffer device 160x50 lb # [ 2.043008] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 2.052576] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 2.043263] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 2.043272] [drm] features: -context_init lb # [ 2.044051] [drm] number of scanouts: 1 lb # [ 2.044070] [drm] number of cap sets: 0 worker2 # [ 2.095024] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.095227] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 2.095254] systemd[1]: Reached target Local File Systems. worker2 # [ 2.099315] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.103663] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 2.103955] systemd[1]: Reached target Preparation for Local File Systems. client # [ 2.103994] systemd[1]: Reached target Local File Systems. client # [ 2.109482] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.063711] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 2.109118] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 2.066516] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 2.066544] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 2.077966] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.100514] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.078210] systemd[1]: Reached target Preparation for Local File Systems. client # [ 2.100478] systemd-modules-load[75]: Inserted module 'dm_mod' worker2 # [ 2.102219] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.078246] systemd[1]: Reached target Local File Systems. client # [ 2.101832] systemd-modules-load[75]: Module 'virtio_balloon' is built in worker2 # [ 2.103310] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.103173] systemd-modules-load[75]: Module 'virtio_console' is built in worker2 # [ 2.121524] systemd[1]: Started Journal Service. worker1 # [ 2.085872] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.109288] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.127514] systemd[1]: Started Journal Service. worker2 # [ 2.112325] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.079554] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 2.116593] systemd-modules-load[75]: Inserted module 'virtio_gpu' client # [ 2.117688] systemd-modules-load[75]: Module 'virtio_rng' is built in worker2 # [ 2.120121] systemd[1]: Finished Load Kernel Modules. client # [ 2.121600] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.105901] systemd[1]: Finished Load Kernel Modules. lb # [ 2.096069] Console: switching to colour frame buffer device 160x50 worker2 # [ 2.137504] systemd[1]: Starting Apply Kernel Variables... client # [ 2.140938] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.117796] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.131620] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 2.163208] systemd[1]: Starting Create System Files and Directories... lb # [ 2.133949] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 2.136986] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.137039] systemd[1]: Reached target Local File Systems. lb # [ 2.142055] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 2.161451] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.163403] systemd[1]: Started Journal Service. worker1 # [ 2.149414] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.155133] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.187808] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker2 # [ 2.189710] systemd-udevd[79]: Using default interface naming scheme 'v261'. client # [ 2.191096] systemd[1]: Finished Create System Files and Directories. lb # [ 2.163039] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.164466] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.165622] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.166608] systemd-modules-load[74]: Module 'virtio_rng' is built in worker1 # [ 2.167605] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.204581] systemd[1]: Finished Create System Files and Directories. lb # [ 2.171311] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.207239] systemd[1]: Finished Apply Kernel Variables. client # [ 2.222017] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.232395] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.205690] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 2.204565] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.217756] systemd[1]: Finished Create System Files and Directories. lb # [ 2.220665] systemd[1]: Started Journal Service. lb # [ 2.209293] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.210449] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.211649] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.239957] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.228443] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.229600] systemd[1]: Starting Create System Files and Directories... client # [ 2.285857] systemd[1]: Starting Virtual Console Setup... lb # [ 2.242832] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.296147] systemd[1]: Starting Virtual Console Setup... lb # [ 2.263013] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 2.277848] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.304770] systemd[1]: Starting Virtual Console Setup... client # [ 2.336590] systemd-vconsole-setup[105]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.340232] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.344621] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.302520] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.348292] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.360617] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.364252] systemd[1]: Finished Virtual Console Setup. lb # [ 2.372154] systemd[1]: Starting Virtual Console Setup... lb # [ 2.420650] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.424193] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.945459] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.947092] systemd[1]: Reached target System Initialization. worker2 # [ 2.952177] systemd[1]: Reached target Basic System. worker1 # [ 2.948058] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.981112] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.983007] systemd[1]: Reached target System Initialization. worker1 # [ 2.952160] systemd[1]: Reached target System Initialization. client # [ 2.984893] systemd[1]: Reached target Basic System. worker1 # [ 2.953046] systemd[1]: Reached target Basic System. worker2 # [ 3.087928] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.068544] systemd[1]: Finished Coldplug All udev Devices. lb # [ 3.072090] systemd[1]: Reached target System Initialization. lb # [ 3.073017] systemd[1]: Reached target Basic System. worker2 # [ 3.119155] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.087764] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.130393] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.151065] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.120814] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.128924] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.166313] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.176776] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.193115] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.199393] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.203946] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.233559] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.235868] systemd[1]: Reached target Initrd Root Device. client # [ 3.241286] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.207594] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.221995] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.226082] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.259182] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.228254] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.268169] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.270830] systemd[1]: Mounting /sysroot... client # [ 3.287777] systemd-fsck[114]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.299315] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.261066] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.277695] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.310695] systemd[1]: Mounting /sysroot... lb # [ 3.267082] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.328147] EXT4-fs (vda): mounted filesystem cfd7f4f4-4147-4be4-a1ab-49c6973fa371 r/w with ordered data mode. Quota mode: none. worker1 # [ 3.283709] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.317772] systemd[1]: Mounted /sysroot. worker2 # [ 3.321346] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.288754] systemd[1]: Mounting /sysroot... worker2 # [ 3.325646] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.365415] EXT4-fs (vda): mounted filesystem 112807a0-6577-416e-bbb1-4b8788bb94f2 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.352243] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.353599] systemd[1]: Mounted /sysroot. client # [ 3.355998] systemd[1]: Reached target Initrd Root File System. client # [ 3.361165] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.362102] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.342246] EXT4-fs (vda): mounted filesystem 5810dfc5-862c-40e4-b6a0-0fc393131a27 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.364655] systemd[1]: Reloading... worker1 # [ 3.334636] systemd[1]: Mounted /sysroot. worker1 # [ 3.337368] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.342288] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.388302] systemd-sysroot-fstab-check[122]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.344966] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.345973] systemd[1]: Reached target Initrd Root Device. lb # [ 3.348939] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.393018] systemd[1]: Reload requested from client PID 122 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.399725] systemd[1]: Reloading... worker1 # [ 3.375645] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.380055] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.384916] systemd[1]: Reloading... lb # [ 3.401536] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.409859] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.414892] systemd[1]: Mounting /sysroot... lb # [ 3.474825] EXT4-fs (vda): mounted filesystem 4151e13b-0aee-489f-86a7-16af63ca6460 r/w with ordered data mode. Quota mode: none. lb # [ 3.466306] systemd[1]: Mounted /sysroot. lb # [ 3.468141] systemd[1]: Reached target Initrd Root File System. lb # [ 3.469674] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.495825] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.503272] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.510334] systemd[1]: Reloading... worker2 # [ 3.592171] systemd[1]: Reloading finished in 230 ms. client # [ 3.617162] systemd[1]: Reloading finished in 222 ms. worker2 # [ 3.627043] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.631017] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... worker1 # [ 3.603537] systemd[1]: Reloading finished in 217 ms. worker2 # [ 3.638924] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.640112] systemd-sysroot-fstab-check[122]: Requesting initrd-fs.target/start/replace... client # [ 3.644391] systemd-sysroot-fstab-check[122]: Requesting swap.target/start/replace... worker2 # [ 3.648693] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.651230] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.651047] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.653590] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.653544] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.657730] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.660284] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.638401] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.641477] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker2 # [ 3.675941] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 3.677583] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.647249] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.652876] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.655588] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.687642] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.689526] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.658016] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.681058] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.683058] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.732624] systemd[1]: Reloading finished in 224 ms. lb # [ 3.767514] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... lb # [ 3.772910] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.776201] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.780234] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.784308] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.786199] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.812250] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.813599] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.886697] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.906548] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.910943] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.910186] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.922280] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.928147] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.936657] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.912087] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.956093] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.930281] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.936772] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.969720] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.981746] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.988226] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.991135] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.964161] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.953803] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 4.008893] systemd[1]: Mounted /sysroot/run. lb # [ 3.966032] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.981215] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 4.016002] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.981799] systemd[1]: Mounting /sysroot/run... worker2 # [ 4.027859] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.031573] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.035281] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 4.038193] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 4.040186] systemd[1]: Mounted /sysroot/run. lb # [ 3.998021] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 4.017163] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 4.049863] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 4.022867] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 4.057858] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 4.066707] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.068257] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.028894] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 4.042842] systemd[1]: Mounted /sysroot/run. worker2 # [ 4.077872] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.079952] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.050081] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 4.084946] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.043441] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 4.097078] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.065998] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.075964] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.074538] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.078737] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 4.131918] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.134390] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.103672] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.138125] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.105371] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.149645] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.109919] systemd[1]: Mounted /sysroot/run. lb # [ 4.114553] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 4.122289] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.135800] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.137790] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.139660] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.184845] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.207974] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.208974] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.210218] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.187015] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.189931] systemd[1]: Reached target Initrd File Systems. lb # [ 4.195439] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.243479] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.245008] systemd[1]: Stopped target Basic System. worker2 # [ 4.246595] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.247639] systemd[1]: Stopped target Path Units. lb # [ 4.206726] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.252164] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.254478] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.257128] systemd[1]: Stopped target Slice Units. worker2 # [ 4.259168] systemd[1]: Stopped target Socket Units. worker2 # [ 4.262220] systemd[1]: Stopped target System Initialization. worker2 # [ 4.264391] systemd[1]: Stopped target Swaps. worker2 # [ 4.269289] systemd[1]: Stopped target Timer Units. worker2 # [ 4.270138] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.271777] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.277378] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.278502] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.279210] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 4.283447] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.244126] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.290856] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.291867] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.293999] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.299674] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.304194] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.307029] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 4.263071] systemd[1]: Finished Find NixOS closure. lb # [ 4.267219] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.319429] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.274736] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.328440] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.329564] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.330435] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.331425] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 4.342136] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.344468] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 4.347243] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.348612] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.349374] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.350349] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.306312] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.351283] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.309408] systemd[1]: Stopped target Basic System. lb # [ 4.310958] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.312544] systemd[1]: Stopped target Path Units. worker2 # [ 4.357740] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.358670] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 4.359673] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 4.316971] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.364621] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.319519] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.365616] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.367233] systemd[1]: systemd-udevd.service: Consumed 1.070s CPU time over 2.272s wall clock time, 17.8M memory peak. worker2 # [ 4.368983] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.370023] systemd[1]: Closed udev Control Socket. lb # [ 4.325501] systemd[1]: Stopped target Slice Units. worker2 # [ 4.370748] systemd[1]: Starting Cleanup udev Database... worker2 # [ 4.371506] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.372717] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.373611] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.329323] systemd[1]: Stopped target Socket Units. worker2 # [ 4.374725] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.330716] systemd[1]: Stopped target System Initialization. worker2 # [ 4.375702] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.333389] systemd[1]: Stopped target Swaps. worker2 # [ 4.380280] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.336368] systemd[1]: Stopped target Timer Units. lb # [ 4.337879] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.341125] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.344802] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.348783] systemd[1]: Stopped Find NixOS closure. lb # [ 4.349590] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 4.352451] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.355821] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.359909] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.408605] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.411619] systemd[1]: Finished Cleanup udev Database. lb # [ 4.366828] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 4.367936] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.413343] systemd[1]: Reached target Switch Root. worker2 # [ 4.416529] systemd[1]: Starting NixOS Activation... lb # [ 4.379368] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 4.385957] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 4.387197] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.396390] systemd[1]: Stopped Create System Files and Directories. lb # [ 4.397409] systemd[1]: Stopped target Local File Systems. lb # [ 4.398199] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.399189] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.408403] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.409271] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.410310] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.411352] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.416495] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.417486] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.420228] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 4.421344] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 4.422811] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.423916] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.432267] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.434115] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.436099] systemd[1]: systemd-udevd.service: Consumed 1.022s CPU time over 2.303s wall clock time, 17M memory peak. lb # [ 4.440570] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.441669] systemd[1]: Closed udev Control Socket. lb # [ 4.444127] systemd[1]: Starting Cleanup udev Database... lb # [ 4.445094] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.446199] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.447088] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.448515] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.449509] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.450469] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.480362] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.483793] systemd[1]: Finished Cleanup udev Database. lb # [ 4.485248] systemd[1]: Reached target Switch Root. lb # [ 4.486479] systemd[1]: Starting NixOS Activation... worker1 # [ 4.514192] (udev-worker)[93]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.521628] (udev-worker)[93]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.550723] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.552618] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.556292] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.557235] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.589911] initrd-nixos-activation-start[172]: booting system configuration /nix/store/lwjwr69nvgic4id2a0liqvrxsl7xi5q5-nixos-system-worker2-test client # [ 4.596180] (udev-worker)[103]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.574038] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.575705] systemd[1]: Stopped Virtual Console Setup. client # [ 4.606243] (udev-worker)[103]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.584394] systemd[1]: Starting Virtual Console Setup... client # [ 4.633688] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.634886] systemd[1]: Stopped Virtual Console Setup. client # [ 4.636400] systemd[1]: Stopping Virtual Console Setup... client # [ 4.640971] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.609968] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.613492] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.648240] initrd-nixos-activation-start[172]: running activation script... client # [ 4.669999] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.672935] systemd[1]: Finished Virtual Console Setup. lb # [ 4.664687] initrd-nixos-activation-start[172]: booting system configuration /nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test lb # [ 4.737344] initrd-nixos-activation-start[172]: running activation script... client # [ 4.888513] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.914166] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.947417] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.950523] systemd[1]: Reached target Initrd File Systems. client # [ 4.956211] systemd[1]: Starting Find NixOS closure... client # [ 4.962527] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.981502] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.985138] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.990249] systemd[1]: Starting Find NixOS closure... client # [ 5.022947] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 5.024989] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 5.000490] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 5.037081] systemd[1]: Finished Find NixOS closure. client # [ 5.039262] systemd[1]: Reached target Initrd Default Target. client # [ 5.043690] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.081904] systemd[1]: Stopped target Initrd Default Target. client # [ 5.088705] systemd[1]: Stopped target Basic System. worker1 # [ 5.056174] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 5.089894] systemd[1]: Stopped target Initrd Root Device. client # [ 5.090944] systemd[1]: Stopped target Path Units. client # [ 5.091884] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.060336] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 5.094221] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.097930] systemd[1]: Stopped target Slice Units. client # [ 5.100242] systemd[1]: Stopped target Socket Units. worker2 # [ 5.102246] initrd-nixos-activation-start[195]: setting up /etc... client # [ 5.104315] systemd[1]: Stopped target System Initialization. client # [ 5.105471] systemd[1]: Stopped target Swaps. client # [ 5.106239] systemd[1]: Stopped target Timer Units. client # [ 5.108208] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.109758] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.078506] systemd[1]: Finished Find NixOS closure. client # [ 5.111898] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.082045] systemd[1]: Reached target Initrd Default Target. client # [ 5.116505] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.084275] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.121314] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.123273] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.128937] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.130013] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.130812] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.131824] systemd[1]: Stopped Load Kernel Modules. client # [ 5.146347] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.147730] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.155731] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.126939] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.128389] systemd[1]: Stopped target Basic System. worker1 # [ 5.129421] systemd[1]: Stopped target Initrd Root Device. client # [ 5.161529] systemd[1]: Stopped Create System Files and Directories. client # [ 5.162619] systemd[1]: Stopped target Local File Systems. client # [ 5.163462] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.132177] systemd[1]: Stopped target Path Units. worker1 # [ 5.135412] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.137108] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.170397] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.140234] systemd[1]: Stopped target Slice Units. worker1 # [ 5.144320] systemd[1]: Stopped target Socket Units. client # [ 5.176362] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.145354] systemd[1]: Stopped target System Initialization. worker1 # [ 5.146955] systemd[1]: Stopped target Swaps. client # [ 5.180691] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.149295] systemd[1]: Stopped target Timer Units. client # [ 5.181966] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.152205] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.184728] systemd[1]: Stopped Virtual Console Setup. client # [ 5.186336] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.155866] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.188183] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.158467] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.192333] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.193527] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.163674] systemd[1]: Stopped Find NixOS closure. client # [ 5.195768] systemd[1]: systemd-udevd.service: Consumed 1.490s CPU time over 3.079s wall clock time, 22.3M memory peak. client # [ 5.200332] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.201579] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.202477] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 5.171095] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.203803] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.204895] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.205911] systemd[1]: Closed udev Control Socket. client # [ 5.206644] systemd[1]: Starting Cleanup udev Database... client # [ 5.207465] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.176652] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.177634] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.178766] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.179552] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.213618] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.216269] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.220503] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.189243] systemd[1]: Stopped Load Kernel Modules. client # [ 5.221905] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.191312] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.224215] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.193712] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.194932] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.195980] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.205257] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.206125] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.207245] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.204359] initrd-nixos-activation-start[195]: setting up /etc... worker1 # [ 5.216665] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.217654] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.218753] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.219858] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.223553] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.226112] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.227232] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.228480] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.260436] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.262371] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.229893] systemd[1]: systemd-udevd.service: Consumed 1.424s CPU time over 3.118s wall clock time, 22.2M memory peak. worker1 # [ 5.231403] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.264940] systemd[1]: Reached target Switch Root. client # [ 5.267676] systemd[1]: Starting NixOS Activation... worker1 # [ 5.237956] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.238983] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.244656] systemd[1]: Closed udev Control Socket. worker1 # [ 5.245778] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.246607] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.252216] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.253319] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.254482] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.255474] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.260517] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.261447] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.262437] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.286571] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.290120] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.292820] systemd[1]: Reached target Switch Root. worker1 # [ 5.296754] systemd[1]: Starting NixOS Activation... worker2 # [ 5.349769] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.352908] systemd[1]: Finished NixOS Activation. worker2 # [ 5.354392] systemd[1]: Starting Switch Root... worker2 # [ 5.382546] systemd[1]: Switching root. client # [ 5.448762] initrd-nixos-activation-start[181]: booting system configuration /nix/store/mxjjcdp3piiw7m6ki3ycv2085q5nmrdz-nixos-system-client-test lb # [ 5.462502] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.465575] systemd[1]: Finished NixOS Activation. lb # [ 5.466850] systemd[1]: Starting Switch Root... worker1 # [ 5.481866] initrd-nixos-activation-start[183]: booting system configuration /nix/store/rbrvibrmg6njs73xdbl40qs6xvcpzckr-nixos-system-worker1-test client # [ 5.527043] initrd-nixos-activation-start[181]: running activation script... lb # [ 5.493788] systemd[1]: Switching root. worker2 # [ 5.563257] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 5.558229] initrd-nixos-activation-start[183]: running activation script... lb # [ 5.676019] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 5.987698] initrd-nixos-activation-start[204]: setting up /etc... worker1 # [ 6.009020] initrd-nixos-activation-start[206]: setting up /etc... worker2 # [ 6.131593] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.144354] systemd[1]: Detected virtualization qemu. worker2 # [ 6.147692] systemd[1]: Detected architecture arm64. worker2 # [ 6.151773] systemd[1]: Detected first boot. worker2 # [ 6.161164] systemd[1]: Initializing machine ID from random generator. client # [ 6.280075] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.283149] systemd[1]: Finished NixOS Activation. client # [ 6.284482] systemd[1]: Starting Switch Root... client # [ 6.309804] systemd[1]: Switching root. lb # [ 6.269871] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.279338] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 6.282672] systemd[1]: Detected virtualization qemu. worker1 # [ 6.282585] systemd[1]: Finished NixOS Activation. lb # [ 6.285763] systemd[1]: Detected architecture arm64. lb # [ 6.289113] systemd[1]: Detected first boot. worker1 # [ 6.283995] systemd[1]: Starting Switch Root... lb # [ 6.294628] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.309986] systemd[1]: Switching root. worker2 # [ 6.467255] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 6.503116] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.510202] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.657793] systemd[1]: Applying preset policy. lb # [ 6.623982] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 6.817245] systemd[1]: Applying preset policy. worker2 # [ 7.103262] systemd[1]: Populated /etc with preset unit settings. client # [ 7.101459] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 7.114634] systemd[1]: Detected virtualization qemu. client # [ 7.117851] systemd[1]: Detected architecture arm64. client # [ 7.121151] systemd[1]: Detected first boot. client # [ 7.130653] systemd[1]: Initializing machine ID from random generator. worker1 # [ 7.137841] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 7.150526] systemd[1]: Detected virtualization qemu. worker1 # [ 7.153824] systemd[1]: Detected architecture arm64. worker1 # [ 7.158010] systemd[1]: Detected first boot. worker1 # [ 7.165467] systemd[1]: Initializing machine ID from random generator. lb # [ 7.355918] systemd[1]: Populated /etc with preset unit settings. client # [ 7.458921] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 7.501177] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 7.584674] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.586094] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 7.590256] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 7.594343] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.596287] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.597570] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.600889] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.602426] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 7.603886] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.605552] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.607228] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.609570] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.611525] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.613771] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.616048] systemd[1]: Reached target Path Units. worker2 # [ 7.618330] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.620365] systemd[1]: Reached target Slice Units. worker2 # [ 7.622354] systemd[1]: Reached target Swaps. worker2 # [ 7.626676] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.631864] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.636227] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.640713] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.642089] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.649136] systemd[1]: Starting Journal Log Access Socket... client # [ 7.650574] systemd[1]: Applying preset policy. worker2 # [ 7.651108] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.655768] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.657800] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.659706] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.662871] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.675342] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.677092] systemd[1]: Listening on udev Control Socket. worker2 # [ 7.679156] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.684640] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.693223] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 7.704509] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.714767] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 7.733112] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 7.705360] systemd[1]: Applying preset policy. worker2 # [ 7.749655] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 7.750204] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 7.758725] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.764214] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.773286] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.793470] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 7.798343] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.864523] systemd[1]: Starting Journal Service... worker2 # [ 7.878384] systemd[1]: Starting Load Kernel Modules... worker2 # [ 7.899658] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.928654] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.931448] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.943761] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 7.951531] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 7.955378] systemd[1]: Mounted Huge Pages File System. worker2 # [ 7.958733] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 7.964903] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 7.967399] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 7.967928] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.935805] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 7.937220] systemd[1]: Stopped initrd-switch-root.service. lb # [ 7.940878] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 7.944812] systemd[1]: Created slice Slice /system/getty. lb # [ 7.946613] systemd[1]: Created slice User and Session Slice. lb # [ 7.948319] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 7.950204] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 7.952148] systemd[1]: Expecting device /dev/hvc0... lb # [ 7.954496] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 7.955744] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 7.958183] systemd[1]: Stopped target initrd-fs.target. lb # [ 7.960303] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 7.962292] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 7.964479] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 7.966600] systemd[1]: Reached target Path Units. lb # [ 7.968545] systemd[1]: Reached target Remote File Systems. lb # [ 7.970505] systemd[1]: Reached target Slice Units. lb # [ 7.972610] systemd[1]: Reached target Swaps. lb # [ 7.977402] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.026026] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 7.983081] systemd[1]: Listening on Process Core Dump Socket. lb # [ 7.987611] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.035631] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 7.991868] systemd[1]: Listening on Factory Reset Management. lb # [ 7.993181] systemd[1]: Listening on Hostname Service Socket. lb # [ 7.999861] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.002314] systemd[1]: Listening on Journal Audit Socket. lb # [ 8.008020] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.011284] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 8.013927] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.016891] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.068444] systemd[1]: Populated /etc with preset unit settings. lb # [ 8.030632] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.032269] systemd[1]: Listening on udev Control Socket. lb # [ 8.033958] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.038802] systemd[1]: Mounting Huge Pages File System... lb # [ 8.044437] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 8.096645] EXT4-fs (vda): re-mounted cfd7f4f4-4147-4be4-a1ab-49c6973fa371. lb # [ 8.054197] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 8.109168] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.111735] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 8.067127] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 8.113996] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.120527] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 8.122862] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.127894] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.082759] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 8.130472] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 8.135856] systemd[1]: Finished Load Kernel Modules. lb # [ 8.095564] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.097328] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.145275] systemd[1]: Starting Firewall... worker2 # [ 8.156982] systemd[1]: Starting Apply Kernel Variables... lb # [ 8.119534] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.122255] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 8.124247] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.174427] systemd-journald[267]: Collecting audit messages is enabled. worker2 # [ 8.214019] systemd[1]: Started Journal Service. worker2 # [ 8.230542] fuse: init (API version 7.45) worker2 # [ 8.217382] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.219069] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.220923] systemd-modules-load[268]: Module 'atkbd' is built in worker2 # [ 8.233693] systemd-modules-load[268]: Module 'loop' is built in lb # [ 8.205375] systemd[1]: Starting Load Kernel Module fuse... lb # [ 8.207462] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.247549] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 8.240815] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 8.267331] systemd-oomd[269]: No swap; memory pressure usage will be degraded lb # [ 8.241616] systemd[1]: Starting Journal Service... worker2 # [ 8.285217] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 8.300432] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.279239] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.309189] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.320413] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 8.328392] systemd[1]: Reached target First Boot Complete. lb # [ 8.306840] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.356350] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 8.375029] systemd-journald[267]: Received client request to flush runtime journal. lb # [ 8.331239] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 8.335918] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.343917] fuse: init (API version 7.45) lb # [ 8.362006] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.374390] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.385475] systemd-journald[267]: Collecting audit messages is enabled. lb # [ 8.397703] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.429921] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 8.404838] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 8.436856] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 8.396774] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.441814] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 8.412886] systemd[1]: Started Journal Service. lb # [ 8.406220] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.413326] systemd-modules-load[268]: Module 'atkbd' is built in lb # [ 8.420210] systemd-modules-load[268]: Module 'loop' is built in lb # [ 8.425105] systemd[1]: Mounted Kernel Debug File System. lb # [ 8.432578] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.437342] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.444548] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.450301] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 8.463268] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.464853] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 8.467042] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.476196] systemd[1]: Finished Load Kernel Modules. client # [ 8.540484] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 8.478440] systemd[1]: Mounting FUSE Control File System... client # [ 8.541991] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.545433] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.549656] systemd[1]: Created slice Slice /system/getty. lb # [ 8.500829] EXT4-fs (vda): re-mounted 4151e13b-0aee-489f-86a7-16af63ca6460. client # [ 8.552311] systemd[1]: Created slice User and Session Slice. client # [ 8.553648] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.555553] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.558107] systemd[1]: Expecting device /dev/hvc0... client # [ 8.559135] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.561607] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 8.544753] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 8.563387] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.501749] systemd[1]: Starting Firewall... worker2 # [ 8.546851] systemd[1]: Reached target Preparation for Local File Systems. client # [ 8.565078] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.566816] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.568721] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.570616] systemd[1]: Reached target Path Units. worker2 # [ 8.553950] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 8.572389] systemd[1]: Reached target Remote File Systems. client # [ 8.574114] systemd[1]: Reached target Slice Units. client # [ 8.575794] systemd[1]: Reached target Swaps. client # [ 8.579675] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.584359] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.519370] systemd[1]: Starting Apply Kernel Variables... client # [ 8.588226] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.592147] systemd[1]: Listening on Factory Reset Management. client # [ 8.594089] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 8.578018] systemd[1]: Mounting /run/wrappers... lb # [ 8.534631] systemd-oomd[270]: No swap; memory pressure usage will be degraded client # [ 8.599956] systemd[1]: Starting Journal Log Access Socket... client # [ 8.601583] systemd[1]: Listening on Journal Audit Socket. client # [ 8.605324] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 8.588432] systemd[1]: Mounting FUSE Control File System... client # [ 8.606917] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.608424] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.547967] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 8.610435] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.557723] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 8.621624] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.623034] systemd[1]: Listening on udev Control Socket. client # [ 8.624512] systemd[1]: Listening on udev Varlink Socket. client # [ 8.629030] systemd[1]: Mounting Huge Pages File System... client # [ 8.634155] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.642235] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.581867] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 8.647029] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 8.643434] systemd[1]: Mounted FUSE Control File System. client # [ 8.669393] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.613443] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 8.683849] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.687023] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.628598] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.632946] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 8.697832] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 8.682985] systemd[1]: Mounted /run/wrappers. client # [ 8.699156] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 8.684671] systemd[1]: Reached target Local File Systems. client # [ 8.702790] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.690305] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 8.650162] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 8.698847] systemd[1]: Starting register-nix-paths.service... lb # [ 8.657322] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.704437] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 8.724821] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 8.709719] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 8.726170] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.728336] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 8.734227] systemd[1]: Starting Create System Files and Directories... lb # [ 8.699859] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.713867] systemd[1]: Mounted FUSE Control File System. client # [ 8.805909] systemd[1]: Starting Journal Service... lb # [ 8.767065] systemd-journald[267]: Received client request to flush runtime journal. client # [ 8.837978] systemd[1]: Starting Load Kernel Modules... worker1 # [ 8.804772] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 8.806328] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.808275] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 8.813493] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.833890] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 8.815700] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.818127] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 8.820536] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.823097] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 8.825003] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.827016] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 8.839820] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 8.829043] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 8.831050] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.833024] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 8.835102] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.874035] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 8.837240] systemd[1]: Reached target Path Units. worker1 # [ 8.839177] systemd[1]: Reached target Remote File Systems. worker1 # [ 8.841153] systemd[1]: Reached target Slice Units. worker1 # [ 8.843087] systemd[1]: Reached target Swaps. worker1 # [ 8.847628] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.853171] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.857589] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 8.834472] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 8.835529] systemd[1]: Reached target First Boot Complete. worker1 # [ 8.862173] systemd[1]: Listening on Factory Reset Management. worker1 # [ 8.863508] systemd[1]: Listening on Hostname Service Socket. lb # [ 8.840727] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 8.870396] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.872720] systemd[1]: Listening on Journal Audit Socket. lb # [ 8.849289] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 8.850940] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 8.912488] fuse: init (API version 7.45) client # [ 8.916453] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.878285] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 8.881787] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.921734] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.884471] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.887348] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 8.898941] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.900360] systemd[1]: Listening on udev Control Socket. client # [ 8.939907] systemd-journald[275]: Collecting audit messages is enabled. worker1 # [ 8.902191] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.908033] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.912880] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.937102] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.938585] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 8.919495] systemd[1]: Mounting Kernel Debug File System... client # [ 8.961592] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 8.934397] systemd[1]: Mounting Kernel Trace File System... client # [ 8.981952] systemd[1]: Started Journal Service. worker1 # [ 8.951879] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.977377] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.935288] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 8.938760] systemd[1]: Reached target Preparation for Local File Systems. client # [ 8.979295] systemd[1]: Mounted Huge Pages File System. client # [ 8.986632] systemd[1]: Mounted POSIX Message Queue File System. client # [ 8.987558] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.991385] systemd[1]: Finished Create System Files and Directories. lb # [ 8.947502] systemd[1]: Mounting /run/wrappers... worker1 # [ 8.973087] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.952231] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.977182] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.995932] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 9.008367] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.003359] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 8.987973] systemd[1]: Mounting Kernel Configuration File System... client # [ 9.008816] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 8.991203] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.994762] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 9.015863] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 9.015949] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 9.020311] systemd[1]: Mounted Kernel Configuration File System. client # [ 9.021244] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 9.022156] systemd[1]: Finished Load Kernel Module fuse. client # [ 9.023009] systemd-modules-load[276]: Module 'atkbd' is built in client # [ 9.023870] systemd-modules-load[276]: Module 'loop' is built in client # [ 9.044863] EXT4-fs (vda): re-mounted 112807a0-6577-416e-bbb1-4b8788bb94f2. client # [ 9.039227] systemd[1]: Finished Load Kernel Modules. worker1 # [ 9.025251] systemd[1]: Starting Load Kernel Module fuse... client # [ 9.046291] systemd[1]: Mounting FUSE Control File System... worker1 # [ 9.029188] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 9.053433] systemd-udevd[306]: Using default interface naming scheme 'v261'. client # [ 9.056262] systemd[1]: Starting Apply Kernel Variables... client # [ 9.067463] systemd-oomd[277]: No swap; memory pressure usage will be degraded lb # [ 9.037337] systemd[1]: Mounted /run/wrappers. lb # [ 9.038747] systemd[1]: Reached target Local File Systems. client # [ 9.085701] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 9.092469] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 9.094625] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 9.055050] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.059091] systemd[1]: Starting register-nix-paths.service... worker1 # [ 9.084232] systemd[1]: Starting Journal Service... lb # [ 9.063970] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.072462] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.122402] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 9.126399] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.108392] systemd[1]: Starting Load Kernel Modules... client # [ 9.134216] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 9.136345] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 9.118179] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 9.151363] systemd[1]: Starting Load/Save OS Random Seed... client # [ 9.154182] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.134403] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 9.134847] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 9.103655] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.146971] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 9.152242] systemd[1]: Listening on Journal Log Access Socket. lb # [ 9.123097] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.161476] systemd[1]: Mounted Huge Pages File System. worker1 # [ 9.164108] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 9.166599] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 9.167098] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 9.167505] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 9.200403] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 9.204738] systemd[1]: Starting Update is Completed... client # [ 9.213297] systemd[1]: Finished Apply Kernel Variables. client # [ 9.227993] systemd[1]: Mounted FUSE Control File System. worker1 # [ 9.220323] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 9.230608] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 9.270876] systemd-journald[275]: Received client request to flush runtime journal. client # [ 9.309976] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.312894] systemd[1]: Reached target First Boot Complete. client # [ 9.316228] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 9.319012] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 9.320636] systemd[1]: Finished Update is Completed. lb # [ 9.275603] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.325324] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 9.313514] EXT4-fs (vda): re-mounted 5810dfc5-862c-40e4-b6a0-0fc393131a27. lb # [ 9.290543] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.331678] systemd[1]: Finished Load Kernel Modules. worker1 # [ 9.339664] systemd[1]: Starting Firewall... worker1 # [ 9.343132] systemd-journald[277]: Collecting audit messages is enabled. worker2 # [ 9.378354] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 9.361858] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 9.365946] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 9.369543] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 9.372243] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 9.383217] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 9.385791] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.389557] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 9.412897] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.394435] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 9.415719] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.418430] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 9.390324] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 9.404655] systemd[1]: Started Journal Service. worker1 # [ 9.409128] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 9.431081] systemd-modules-load[278]: Module 'atkbd' is built in lb # [ 9.419130] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.441412] systemd-modules-load[278]: Module 'loop' is built in lb # [ 9.433915] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 9.471392] fuse: init (API version 7.45) worker1 # [ 9.461598] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 9.459239] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.485553] systemd-oomd[279]: No swap; memory pressure usage will be degraded client # [ 9.524571] systemd[1]: Mounting /run/wrappers... client # [ 9.532612] systemd-udevd[307]: Using default interface naming scheme 'v261'. worker1 # [ 9.500310] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 9.488901] systemd-udevd[312]: Using default interface naming scheme 'v261'. worker1 # [ 9.515665] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 9.521010] systemd[1]: Finished Load Kernel Module fuse. client # [ 9.574756] systemd[1]: Mounted /run/wrappers. worker1 # [ 9.539191] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 9.545152] systemd[1]: Reached target First Boot Complete. client # [ 9.577691] systemd[1]: Reached target Local File Systems. client # [ 9.581415] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 9.565334] systemd-journald[277]: Received client request to flush runtime journal. client # [ 9.590977] systemd[1]: Starting register-nix-paths.service... client # [ 9.596186] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.597237] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.601667] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 9.628146] systemd[1]: Starting Create System Files and Directories... lb # [ 9.623746] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.640694] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 9.645882] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.648738] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.651958] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 9.726455] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 9.694432] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.739517] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 9.704214] systemd[1]: Starting Update is Completed... worker1 # [ 9.735368] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.736657] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 9.739264] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.806260] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.836279] systemd[1]: Finished Create System Files and Directories. lb # [ 9.792461] systemd[1]: Finished Update is Completed. worker1 # [ 9.799135] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.808194] systemd[1]: Mounting FUSE Control File System... lb # [ 9.795980] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.852088] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 9.843804] systemd[1]: Mounted FUSE Control File System. client # [ 9.878611] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 9.898763] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 9.901242] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 9.886313] systemd[1]: Mounted /run/wrappers. worker1 # [ 9.889368] systemd[1]: Reached target Local File Systems. worker1 # [ 9.896792] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 9.899332] systemd[1]: Starting register-nix-paths.service... worker1 # [ 9.908313] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 9.919843] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.927674] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.937632] systemd[1]: Starting Create System Files and Directories... client # [ 9.973969] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.959539] systemd-udevd[316]: Using default interface naming scheme 'v261'. client # [ 10.032567] systemd[1]: Finished Rebuild Journal Catalog. client # [ 10.040829] systemd[1]: Starting Update is Completed... worker1 # [ 10.020602] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 10.031619] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 10.093537] systemd[1]: Finished Update is Completed. worker1 # [ 10.160746] systemd[1]: Finished Create System Files and Directories. worker1 # [ 10.167786] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 10.181664] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 10.288216] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 10.321218] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 10.381677] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 10.389151] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 10.408121] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 10.412553] systemd[1]: Starting Update is Completed... client # [ 10.475871] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.477903] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 10.512131] systemd[1]: Finished Update is Completed. worker2 # [ 10.561934] systemd[1]: Finished Firewall. lb # [ 10.685750] systemd[1]: Finished register-nix-paths.service. worker2 # [ 10.732401] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.795163] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.873122] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 10.912808] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 10.943529] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.944890] systemd[1]: Reached target System Initialization. lb # [ 10.947392] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 10.952347] systemd[1]: Started niks3 garbage collection timer. lb # [ 10.957306] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 10.958379] systemd[1]: Reached target Timer Units. lb # [ 10.961134] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 11.007552] systemd[1]: Finished register-nix-paths.service. worker2 # [ 11.008753] systemd[1]: Reached target System Initialization. worker2 # [ 11.010549] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 10.967733] systemd[1]: Listening on niks3 server socket. lb # [ 10.970933] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.017013] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 11.020189] systemd[1]: Reached target Timer Units. lb # [ 10.974741] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 11.021166] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 10.987953] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 11.022241] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 10.990329] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 11.023719] systemd[1]: Listening on Nix worker-protocol over gRPC. lb # [ 10.979108] systemd[1]: Reached target Socket Units. lb # [ 10.984108] systemd[1]: Reached target Basic System. worker2 # [ 11.030800] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 10.986670] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 11.032521] systemd[1]: Reached target Socket Units. lb # [ 10.993331] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.046450] systemd[1]: Reached target Basic System. lb # [ 11.014213] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.060397] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 11.062504] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.074396] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 11.075782] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.085825] systemd[1]: Started Reset console on configuration changes. lb # [ 11.046060] systemd[1]: Started Reset console on configuration changes. worker2 # [ 11.094415] systemd[1]: Starting resolvconf update... worker2 # [ 11.101176] systemd[1]: Starting D-Bus System Message Bus... client # [ 11.119214] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 11.077390] systemd[1]: Starting resolvconf update... lb # [ 11.090051] systemd[1]: Started rustfs.service. worker2 # [ 11.182313] systemd[1]: Finished Post-Boot Actions. lb # [ 11.138844] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 11.220259] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.181916] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.226974] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.190897] nsncd[484]: Sep 20 12:46:41.703 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.234973] nsncd[490]: Sep 20 12:46:41.736 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.248713] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.204874] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.253668] systemd[1]: Starting User Login Management... lb # [ 11.212293] systemd[1]: Finished Firewall. worker2 # [ 11.272713] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.278618] systemd[1]: Finished register-nix-paths.service. client # [ 11.281531] systemd[1]: Reached target System Initialization. client # [ 11.285103] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.288413] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.290367] systemd[1]: Reached target Timer Units. client # [ 11.294204] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.297088] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.255705] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.300291] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.304757] systemd[1]: Reached target Socket Units. lb # [ 11.259953] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.306121] systemd[1]: Reached target Basic System. client # [ 11.308701] systemd[1]: Started backdoor.service. client # [ 11.311409] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.276321] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 11.326535] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.327010] systemd[1]: Starting nftables firewall... lb # [ 11.296520] systemd[1]: Starting User Login Management... client # [ 11.346197] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.348506] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' lb # [ 11.312269] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 11.350391] dbus-broker-launch[494]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.374004] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.392769] systemd[1]: Started D-Bus System Message Bus. client # [ 11.405958] systemd[1]: Started Reset console on configuration changes. worker2 # [ 11.428567] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 11.433321] systemd[1]: Stopping Host and Network Name Lookups... client # connecting to host... client # [ 11.438690] systemd[1]: Starting resolvconf update... worker2 # [ 11.435716] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 11.462254] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.467262] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 11.471479] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.479981] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 11.484540] systemd-logind[502]: New seat seat0. worker2 # [ 11.488411] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.492004] systemd[1]: Started User Login Management. client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 11.497798] systemd[1]: Starting linger-users.service... worker2 # [ 11.502198] dbus-broker-launch[494]: Ready client # [ 11.531721] systemd[1]: Finished Post-Boot Actions. client # [ 11.548719] nsncd[398]: Sep 20 12:46:42.082 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.559360] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.550697] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.563409] nsncd[556]: Sep 20 12:46:42.070 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client: connected to guest root shell worker2 # [ 11.571358] systemd[1]: Reached target Host and Network Name Lookups. client: (connecting took 11.99 seconds) worker2 # [ 11.574669] systemd[1]: Reached target User and Group Name Lookups. client: (finished: waiting for the VM to finish booting, in 11.99 seconds) worker2 # [ 11.580325] systemd[1]: linger-users.service: Deactivated successfully. client # [ 11.580304] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.581684] systemd[1]: Finished linger-users.service. client # [ 11.589539] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.605872] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 11.614784] systemd[1]: Finished resolvconf update. worker2 # [ 11.618982] systemd[1]: Reached target Preparation for Network. worker2 # [ 11.622080] systemd[1]: Starting DHCP Client... client # [ 11.620665] (udev-worker)[328]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.629425] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.596658] systemd[1]: Finished Firewall. lb # [ 11.585049] dbus-broker-launch[521]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.632246] (udev-worker)[384]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 11.634495] (udev-worker)[384]: Network interface NamePolicy= disabled on kernel command line. lb # [ 11.598172] systemd-logind[523]: New seat seat0. lb # [ 11.606382] systemd[1]: Started User Login Management. client # [ 11.654496] systemd[1]: Starting User Login Management... lb # [ 11.612474] dbus-broker-launch[521]: NSS returned no entry for 'systemd-timesync' client # [ 11.665803] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 11.621979] dbus-broker-launch[521]: Invalid user-name in /nix/store/r3k08synkldj3yxnxmc97ljig0y68d44-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.635677] systemd[1]: Starting linger-users.service... worker1 # [ 11.649969] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.663683] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.683162] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.692984] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.700986] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 11.719075] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 11.710678] systemd[1]: Stopping User and Group Name Lookups... lb # [ 11.716311] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.721085] systemd[1]: nscd.service: Deactivated successfully. lb # [ 11.730112] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.753557] dbus-broker-launch[521]: Ready lb # [ 11.767203] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.771380] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 11.776918] systemd[1]: Finished linger-users.service. client # [ 11.850876] dbus-broker-launch[429]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 11.862295] dhcpcd[591]: dhcpcd-10.3.2 starting client # [ 11.875002] dbus-broker-launch[429]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.881232] dhcpcd[632]: dev: loaded udev client # [ 11.881004] dbus-broker-launch[429]: Invalid user-name in /nix/store/i87y3v12qnxz4jgnndbs0w0ih92vmmjw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 11.887697] dhcpcd[632]: no valid interfaces found worker2 # [ 11.891552] dhcpcd[632]: no valid interfaces found worker2 # [ 11.894194] dhcpcd[632]: libudev: received NULL device worker2 # [ 11.897940] dhcpcd[632]: libudev: received NULL device lb # [ 11.879736] systemd[1]: Finished resolvconf update. worker2 # [ 11.930414] systemd[1]: Starting Virtual Console Setup... lb # [ 11.886022] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.930491] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.892760] nsncd[580]: Sep 20 12:46:42.406 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.907890] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 11.899098] systemd[1]: Reached target Preparation for Network. worker2 # [ 11.948688] systemd[1]: Finished Extra networking commands.. lb # [ 11.905144] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.907942] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.913802] systemd[1]: Starting DHCP Client... lb # [ 11.917250] systemd[1]: Starting Extra networking commands.... worker2 # [ 11.964518] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 11.963923] systemd-logind[433]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 11.967615] systemd[1]: Stopped Virtual Console Setup. client # [ 11.976447] systemd-logind[433]: New seat seat0. client # [ 11.978887] systemd[1]: Started User Login Management. worker2 # [ 11.981192] systemd[1]: Reached target Network. client # [ 11.984355] systemd[1]: Starting linger-users.service... worker1 # [ 11.953643] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 11.983847] systemd[1]: Starting Permit User Sessions... worker2 # [ 11.989059] systemd[1]: Starting Virtual Console Setup... client # [ 11.988360] dbus-broker-launch[429]: Ready worker2 # [ 12.010863] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 12.020562] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 12.026436] systemd[1]: Stopping Host and Network Name Lookups... client # [ 12.032647] systemd[1]: Stopped target User and Group Name Lookups. client # [ 12.040615] systemd[1]: Stopping User and Group Name Lookups... client # [ 12.044772] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 12.049578] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.018736] systemd[1]: Finished register-nix-paths.service. worker1 # [ 12.021239] systemd[1]: Reached target System Initialization. worker1 # [ 12.023288] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 12.051778] systemd[1]: nscd.service: Deactivated successfully. client # [ 12.058113] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 12.060429] systemd[1]: Started Getty on tty1. worker1 # [ 12.028859] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 12.062171] systemd[1]: Reached target Login Prompts. worker1 # [ 12.031413] systemd[1]: Reached target Timer Units. worker1 # [ 12.037303] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 12.074910] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 12.045069] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 12.047133] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 12.057618] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 12.068619] systemd[1]: Reached target Socket Units. client # [ 12.108737] systemd[1]: linger-users.service: Deactivated successfully. client # [ 12.116183] systemd[1]: Finished linger-users.service. worker1 # [ 12.075452] systemd[1]: Reached target Basic System. worker1 # [ 12.090797] systemd[1]: Started backdoor.service. worker1 # [ 12.098460] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 12.141713] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.110341] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 12.122061] systemd[1]: Starting Post-Boot Actions... worker1 # [ 12.132606] systemd[1]: Started Reset console on configuration changes. client # [ 12.174303] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 12.175644] nsncd[501]: Sep 20 12:46:42.711 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 12.147000] systemd[1]: Starting resolvconf update... client # [ 12.185169] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 12.157498] systemd[1]: Starting D-Bus System Message Bus... client # [ 12.192105] systemd[1]: Reached target User and Group Name Lookups. client # [ 12.197172] systemd[1]: Finished resolvconf update. client # [ 12.208850] systemd[1]: Starting DHCP Client... worker1 # [ 12.220505] systemd[1]: Finished Post-Boot Actions. lb # [ 12.223050] dhcpcd[611]: dhcpcd-10.3.2 starting lb # [ 12.238185] dhcpcd[650]: dev: loaded udev lb # [ 12.246197] dhcpcd[650]: no valid interfaces found lb # [ 12.248998] dhcpcd[650]: no valid interfaces found worker1 # [ 12.268233] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # connecting to host... worker1 # [ 12.279408] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 12.289726] nsncd[500]: Sep 20 12:46:42.794 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 12.291823] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 12.305942] systemd[1]: Starting User Login Management... worker1 # [ 12.313404] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 12.347224] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 12.322370] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 12.321351] systemd[1]: Finished Extra networking commands.. lb # [ 12.325878] systemd[1]: Reached target Network. client # [ 12.391657] mousedev: PS/2 mouse device common for all mice lb # [ 12.338077] systemd[1]: Starting PostgreSQL Server... worker2 # [ 12.390748] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 12.346684] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.397737] systemd[1]: Started backdoor.service. worker1 # [ 12.385018] dbus-broker-launch[504]: Looking up NSS user entry for 'systemd-timesync'... client # [ 12.425846] dhcpcd[533]: dhcpcd-10.3.2 starting client # [ 12.434712] systemd-logind[433]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 12.445829] dhcpcd[543]: dev: loaded udev worker1 # [ 12.410619] dbus-broker-launch[504]: NSS returned no entry for 'systemd-timesync' worker1 # [ 12.419815] dbus-broker-launch[504]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 12.472621] systemd[1]: Finished nftables firewall. client # [ 12.475313] systemd[1]: Reached target Preparation for Network. lb # [ 12.435002] systemd[1]: Finished Permit User Sessions. worker2 # [ 12.497030] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.483722] systemd[1]: Starting Address configuration of eth1... client # [ 12.510319] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.449266] systemd[1]: Started Getty on tty1. client # [ 12.494492] systemd[1]: Starting Extra networking commands.... worker1 # [ 12.462705] systemd[1]: Started D-Bus System Message Bus. lb # [ 12.452661] systemd[1]: Reached target Login Prompts. worker2 # connecting to host... worker1 # [ 12.502246] systemd-logind[523]: New seat seat0. worker1 # [ 12.513341] systemd[1]: Started User Login Management. worker1 # [ 12.516223] systemd[1]: Starting linger-users.service... worker1 # [ 12.528414] dbus-broker-launch[504]: Ready worker2 # [ 12.573981] (udev-worker)[655]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 12.542511] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 12.543627] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 12.595265] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.552987] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 12.586485] (udev-worker)[655]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.558923] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 12.559901] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 12.568272] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 12.573015] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 12.627619] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.580518] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 12.628149] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.633143] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.633475] cfg80211: failed to load regulatory.db worker2 # [ 12.622381] (udev-worker)[658]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.588854] (udev-worker)[378]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 12.623893] systemd-vconsole-setup[646]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 12.633090] systemd[1]: Finished Virtual Console Setup. client # [ 12.654259] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.610756] (udev-worker)[378]: Network interface NamePolicy= disabled on kernel command line. client # [ 12.671149] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 12.627731] (udev-worker)[374]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.643743] systemd[1]: linger-users.service: Deactivated successfully. client # [ 12.678991] network-addresses-eth1-start[547]: adding address 192.168.1.1/24... done worker1 # [ 12.647359] systemd[1]: Finished linger-users.service. client # [ 12.711784] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.712290] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.665737] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 12.669752] systemd[1]: Reached target Host and Network Name Lookups. client # [ 12.719174] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.719549] cfg80211: failed to load regulatory.db worker1 # [ 12.671021] nsncd[573]: Sep 20 12:46:43.189 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 12.704613] network-addresses-eth1-start[547]: adding address 2001:db8:1::1/64... done worker1 # [ 12.678134] systemd[1]: Reached target User and Group Name Lookups. client # [ 12.740522] systemd[1]: Finished Address configuration of eth1. worker1 # [ 12.717243] systemd[1]: Finished resolvconf update. worker1 # [ 12.718120] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.723423] systemd[1]: Starting DHCP Client... worker1 # [ 12.728536] systemd[1]: Starting Extra networking commands.... worker2 # [ 12.776435] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.781546] systemd[1]: Starting Address configuration of eth1... client # [ 12.796839] dhcpcd[597]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (551) - Operation not permitted client # [ 12.798754] dhcpcd[597]: .resolvconf-wrapped: clearing stale lock pid 551 lb # [ 12.762238] postgresql-pre-start[681]: The files belonging to this database system will be owned by user "postgres". lb # [ 12.765300] postgresql-pre-start[681]: This user must also own the server process. lb # [ 12.775583] postgresql-pre-start[681]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 12.784244] postgresql-pre-start[681]: The default database encoding has accordingly been set to "UTF8". lb # [ 12.785670] postgresql-pre-start[681]: The default text search configuration will be set to "english". lb # [ 12.786911] postgresql-pre-start[681]: Data page checksums are enabled. lb # [ 12.787803] postgresql-pre-start[681]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.798349] postgresql-pre-start[681]: creating subdirectories ... ok client # [ 12.864995] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 12.801139] postgresql-pre-start[681]: selecting dynamic shared memory implementation ... posix client # [ 12.849044] dhcpcd[543]: eth0: waiting for carrier client # [ 12.852742] dhcpcd[543]: eth0: carrier acquired client # [ 12.862767] systemd[1]: Finished Extra networking commands.. client # [ 12.867864] systemd[1]: Reached target Network. client # [ 12.872982] systemd[1]: Starting Permit User Sessions... worker1 # [ 12.842632] systemd-logind[523]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 12.891256] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.876730] dhcpcd[543]: DUID 00:01:00:01:32:42:92:33:52:54:00:12:34:56 worker2 # [ 12.878386] dhcpcd[632]: eth0: waiting for carrier client # [ 12.877738] dhcpcd[543]: eth0: IAID 00:12:34:56 client # [ 12.878379] dhcpcd[543]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.882483] dhcpcd[632]: eth0: carrier acquired worker2 # [ 12.910603] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 12.903190] dhcpcd[632]: DUID 00:01:00:01:32:42:92:33:52:54:00:12:34:56 worker2 # [ 12.905347] dhcpcd[632]: eth0: IAID 00:12:34:56 worker2 # [ 12.906907] dhcpcd[632]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.917537] network-addresses-eth1-start[679]: adding address 192.168.1.4/24... done worker2 # [ 12.931877] network-addresses-eth1-start[679]: adding address 2001:db8:1::4/64... done client # [ 12.938046] systemd[1]: Finished Permit User Sessions. client # [ 12.947036] systemd[1]: Started Getty on tty1. client # [ 12.947800] systemd[1]: Reached target Login Prompts. worker2 # [ 12.952335] systemd[1]: Finished Address configuration of eth1. worker2 # [ 12.955471] systemd-logind[502]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 12.951296] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.960743] systemd[1]: Starting Address configuration of eth1... client: (finished: waiting for unit network-addresses-eth1.service, in 13.42 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } worker1 # [ 12.994639] dhcpcd[609]: dhcpcd-10.3.2 starting lb # [ 12.989893] postgresql-pre-start[681]: selecting default "max_connections" ... 100 worker2 # [ 13.066390] mousedev: PS/2 mouse device common for all mice worker1 # [ 13.022196] dhcpcd[646]: dev: loaded udev client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.06 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting worker2 # [ 13.094692] systemd-logind[502]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 13.080233] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 13.098315] systemd[1]: Finished Extra networking commands.. worker1 # [ 13.101734] systemd[1]: Reached target Network. worker1 # [ 13.111580] systemd[1]: Starting Permit User Sessions... worker1 # [ 13.142614] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 13.183312] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 13.168735] postgresql-pre-start[681]: selecting default "shared_buffers" ... 128MB worker1 # [ 13.184675] network-addresses-eth1-start[634]: adding address 192.168.1.3/24... done worker1 # [ 13.222314] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 13.222848] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 13.228370] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 13.228728] cfg80211: failed to load regulatory.db worker1 # [ 13.224353] network-addresses-eth1-start[634]: adding address 2001:db8:1::3/64... done worker1 # [ 13.230559] systemd[1]: Finished Permit User Sessions. worker1 # [ 13.235627] systemd[1]: Started Getty on tty1. worker1 # [ 13.239810] systemd[1]: Reached target Login Prompts. worker1 # [ 13.268366] systemd[1]: Finished Address configuration of eth1. lb # [ 13.317399] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.350243] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 13.340146] dhcpcd[646]: eth0: waiting for carrier worker1 # [ 13.340988] dhcpcd[646]: eth0: carrier acquired worker1 # [ 13.358631] dhcpcd[646]: DUID 00:01:00:01:32:42:92:33:52:54:00:12:34:56 worker1 # [ 13.359666] dhcpcd[646]: eth0: IAID 00:12:34:56 worker1 # [ 13.362166] dhcpcd[646]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 13.393351] mousedev: PS/2 mouse device common for all mice lb # [ 13.382502] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 13.512406] systemd-logind[523]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 13.662329] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.650536] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 13.724405] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 13.733721] systemd[1]: Started backdoor.service. lb # [ 13.815847] 8021q: 802.1Q VLAN Support v1.8 lb # connecting to host... worker2 # [ 13.891339] dhcpcd[632]: eth0: soliciting a DHCP lease worker2 # [ 13.900529] dhcpcd[632]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 13.908191] dhcpcd[632]: eth0: probing address 10.0.2.15/24 lb # [ 13.866250] systemd-vconsole-setup[705]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 13.876937] systemd[1]: Finished Virtual Console Setup. lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.86 seconds) lb: (finished: waiting for the VM to finish booting, in 0.86 seconds) client # [ 13.989732] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 14.002290] systemd[1]: Starting Virtual Console Setup... lb # [ 13.973223] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 13.984928] (udev-worker)[692]: Network interface NamePolicy= disabled on kernel command line. client # [ 14.029158] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 14.032860] systemd[1]: Stopped Virtual Console Setup. lb # [ 13.996506] (udev-worker)[686]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 14.043449] systemd[1]: Starting Virtual Console Setup... lb # [ 14.002483] (udev-worker)[686]: Network interface NamePolicy= disabled on kernel command line. lb # [ 14.022356] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 14.025212] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 14.030698] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 14.032418] cfg80211: failed to load regulatory.db worker2 # [ 14.074819] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 14.075954] systemd[1]: Stopped Virtual Console Setup. client # [ 14.074780] systemd-logind[433]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 14.079116] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 14.083036] systemd[1]: Starting Virtual Console Setup... worker2 # [ 14.101100] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 14.112594] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 14.115084] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 14.120779] systemd[1]: Starting Virtual Console Setup... worker2 # [ 14.155756] systemd-logind[502]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 14.135883] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 14.216780] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 14.228130] systemd[1]: Starting Address configuration of eth1... lb # [ 14.338294] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 14.326684] dhcpcd[650]: eth0: waiting for carrier lb # [ 14.328668] dhcpcd[650]: eth0: carrier acquired client # [ 14.374648] dhcpcd[543]: eth0: soliciting a DHCP lease client # [ 14.380704] dhcpcd[543]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 14.388207] dhcpcd[543]: eth0: probing address 10.0.2.15/24 lb # [ 14.349306] dhcpcd[650]: DUID 00:01:00:01:32:42:92:34:52:54:00:12:34:56 lb # [ 14.350586] dhcpcd[650]: eth0: IAID 00:12:34:56 lb # [ 14.351248] dhcpcd[650]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 14.375108] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 14.379180] network-addresses-eth1-start[733]: adding address 192.168.1.2/24... done worker2 # [ 14.427181] systemd-vconsole-setup[702]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.431722] systemd[1]: Finished Virtual Console Setup. lb # [ 14.397113] network-addresses-eth1-start[733]: adding address 2001:db8:1::2/64... done client # [ 14.450933] systemd-vconsole-setup[649]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 14.455232] systemd[1]: Finished Virtual Console Setup. lb # [ 14.418100] systemd-logind[523]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 14.424573] systemd[1]: Finished Address configuration of eth1. worker1 # [ 14.446468] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 14.458436] systemd[1]: Starting Virtual Console Setup... worker1 # [ 14.484698] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 14.488317] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 14.490354] systemd[1]: Starting Virtual Console Setup... lb # [ 14.538676] mousedev: PS/2 mouse device common for all mice worker1 # [ 14.537001] dhcpcd[646]: eth0: soliciting a DHCP lease worker1 # [ 14.547546] systemd-logind[523]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 14.549530] dhcpcd[646]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 14.556491] dhcpcd[646]: eth0: probing address 10.0.2.15/24 worker2 # [ 14.672875] dhcpcd[632]: eth0: soliciting an IPv6 router worker2 # [ 14.676715] dhcpcd[632]: eth0: Router Advertisement from fe80::2 worker2 # [ 14.679413] dhcpcd[632]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 14.682432] dhcpcd[632]: eth0: adding route to fec0::/64 worker2 # [ 14.684751] dhcpcd[632]: eth0: adding default route via fe80::2 client # [ 14.695986] dhcpcd[543]: eth0: soliciting an IPv6 router client # [ 14.700350] dhcpcd[543]: eth0: Router Advertisement from fe80::2 client # [ 14.703002] dhcpcd[543]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 14.706185] dhcpcd[543]: eth0: adding route to fec0::/64 client # [ 14.708602] dhcpcd[543]: eth0: adding default route via fe80::2 lb # [ 14.701950] systemd-logind[523]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 14.927704] systemd-vconsole-setup[703]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.932402] systemd[1]: Finished Virtual Console Setup. lb # [ 15.089050] dhcpcd[650]: eth0: soliciting a DHCP lease lb # [ 15.099212] dhcpcd[650]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 15.104236] dhcpcd[650]: eth0: probing address 10.0.2.15/24 lb: (finished: waiting for unit network-addresses-eth1.service, in 2.18 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.07 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit niks3.service worker1 # [ 15.850205] dhcpcd[646]: eth0: soliciting an IPv6 router worker1 # [ 15.854305] dhcpcd[646]: eth0: Router Advertisement from fe80::2 worker1 # [ 15.857302] dhcpcd[646]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 15.860166] dhcpcd[646]: eth0: adding route to fec0::/64 worker1 # [ 15.862456] dhcpcd[646]: eth0: adding default route via fe80::2 lb # [ 16.044194] postgresql-pre-start[681]: selecting default time zone ... UTC lb # [ 16.051841] postgresql-pre-start[681]: creating configuration files ... ok lb # [ 16.450723] dhcpcd[650]: eth0: soliciting an IPv6 router lb # [ 16.460109] dhcpcd[650]: eth0: Router Advertisement from fe80::2 lb # [ 16.461161] dhcpcd[650]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 16.462087] dhcpcd[650]: eth0: adding route to fec0::/64 lb # [ 16.462845] dhcpcd[650]: eth0: adding default route via fe80::2 lb # [ 16.603920] postgresql-pre-start[681]: running bootstrap script ... ok lb # [ 16.815718] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 16.817757] systemd[1]: Stopped Virtual Console Setup. lb # [ 16.821223] systemd[1]: Stopping Virtual Console Setup... lb # [ 16.829253] systemd[1]: Starting Virtual Console Setup... lb # [ 16.889870] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 16.896840] systemd[1]: Stopped Virtual Console Setup. lb # [ 16.911443] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 16.920144] systemd[1]: Starting Virtual Console Setup... lb # [ 16.984885] systemd-logind[523]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 17.324585] systemd-vconsole-setup[798]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 17.333122] systemd[1]: Finished Virtual Console Setup. lb # [ 17.609312] postgresql-pre-start[681]: performing post-bootstrap initialization ... ok lb # [ 17.750333] postgresql-pre-start[681]: syncing data to disk ... ok lb # [ 17.752854] postgresql-pre-start[681]: initdb: warning: enabling "trust" authentication for local connections lb # [ 17.754318] postgresql-pre-start[681]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 17.756584] postgresql-pre-start[681]: Success. You can now start the database server using: lb # [ 17.757966] postgresql-pre-start[681]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 17.891099] postgres[805]: [805] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.895693] postgres[805]: [805] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.897242] postgres[805]: [805] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.899125] postgres[805]: [805] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.915026] postgres[814]: [814] LOG: database system was shut down at 2026-09-20 12:46:48 GMT lb # [ 17.921825] postgres[805]: [805] LOG: database system is ready to accept connections lb # [ 17.928068] systemd[1]: Started PostgreSQL Server. lb # [ 17.939277] systemd[1]: Starting PostgreSQL Setup Scripts... worker2 # [ 18.237796] dhcpcd[632]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 18.237953] dhcpcd[632]: eth0: adding route to 10.0.2.0/24 worker2 # [ 18.237999] dhcpcd[632]: eth0: adding default route via 10.0.2.2 lb # [ 18.205465] postgresql-setup-start[834]: CREATE DATABASE lb # [ 18.266625] postgresql-setup-start[839]: CREATE ROLE lb # [ 18.295049] postgresql-setup-start[841]: ALTER DATABASE lb # [ 18.303655] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 18.305730] systemd[1]: Reached target PostgreSQL. worker2 # [ 18.367321] systemd[1]: Started DHCP Client. worker2 # [ 18.369506] systemd[1]: Reached target Multi-User System. worker2 # [ 18.370361] systemd[1]: Startup finished in 1.058s (kernel) + 4.578s (initrd) + 12.732s (userspace) = 18.369s. lb # [ 19.618624] dhcpcd[650]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 19.622112] dhcpcd[650]: eth0: adding route to 10.0.2.0/24 lb # [ 19.622292] dhcpcd[650]: eth0: adding default route via 10.0.2.2 lb # [ 19.783814] systemd[1]: Started DHCP Client. lb # [ 19.788482] systemd[1]: Reached target Network is Online. lb # [ 19.792908] systemd[1]: Started Envoy reverse proxy. lb # [ 19.797978] systemd[1]: Started mock-oidc.service. lb # [ 19.902679] mock-oidc-server[914]: Mock OIDC Server running lb # [ 19.904747] mock-oidc-server[914]: OIDC Address: 192.168.1.2:8080 lb # [ 19.906411] mock-oidc-server[914]: Issue Address: 0.0.0.0:8081 lb # [ 19.907859] mock-oidc-server[914]: Issuer: http://192.168.1.2:8080/oidc lb # [ 19.909333] mock-oidc-server[914]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 19.911252] mock-oidc-server[914]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 19.913237] mock-oidc-server[914]: Issue tokens: http://0.0.0.0:8081/issue?sub=... client # [ 20.318033] dhcpcd[543]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 20.322430] dhcpcd[543]: eth0: adding route to 10.0.2.0/24 client # [ 20.325394] dhcpcd[543]: eth0: adding default route via 10.0.2.2 worker1 # [ 20.448740] dhcpcd[646]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 20.450611] dhcpcd[646]: eth0: adding route to 10.0.2.0/24 worker1 # [ 20.452800] dhcpcd[646]: eth0: adding default route via 10.0.2.2 client # [ 20.510916] systemd[1]: Started DHCP Client. client # [ 20.513318] systemd[1]: Reached target Multi-User System. client # [ 20.514685] systemd[1]: Startup finished in 1.032s (kernel) + 5.587s (initrd) + 13.894s (userspace) = 20.514s. lb # [ 20.501465] envoy[913]: [2026-09-20 12:46:51.021][913][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 20.503365] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 20.505020] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 20.507310] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 20.510530] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 20.513780] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 20.517705] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 20.521656] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 20.543446] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 20.545456] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 20.553194] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 20.556074] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 20.559260] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 20.564716] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 20.567610] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options worker1 # [ 20.586109] systemd[1]: Started DHCP Client. lb # [ 20.572697] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple worker1 # [ 20.588466] systemd[1]: Reached target Multi-User System. worker1 # [ 20.589357] systemd[1]: Startup finished in 1.049s (kernel) + 5.580s (initrd) + 13.957s (userspace) = 20.588s. lb # [ 20.575700] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 20.578868] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 20.583718] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 20.586123] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 20.589127] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 20.591109] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 20.596896] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 20.611194] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 20.613484] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 20.616928] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 20.623504] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 20.625993] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 20.628344] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 20.630602] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 20.633905] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 20.637062] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 20.639236] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 20.642087] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 20.643810] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 20.646437] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 20.650548] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 20.652507] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 20.655059] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 20.660230] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.662884] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 20.667578] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.670308] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 20.672567] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 20.675895] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 20.685639] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 20.687998] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 20.690403] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 20.694323] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.696990] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 20.700046] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 20.702698] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 20.710453] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 20.715723] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 20.725585] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 20.727968] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.731344] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 20.733949] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 20.736449] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 20.739352] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 20.742737] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 20.746933] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 20.750383] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 20.754455] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 20.760103] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 20.762235] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 20.770973] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 20.773027] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 20.778783] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 20.784764] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 20.789768] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 20.800222] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 20.835144] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 20.837595] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 20.839915] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 20.842422] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 20.848970] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 20.851882] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 20.858135] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 20.860959] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 20.863745] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 20.866934] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 20.875571] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 20.884118] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 20.888829] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 20.894340] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 20.901295] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 20.903809] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 20.909337] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 20.913218] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 20.916460] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 20.920273] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 20.924508] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 20.927768] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 20.931758] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 20.939853] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 20.942488] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 20.949900] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 20.953385] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 20.956503] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 20.958587] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 20.960963] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 20.964801] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 20.972241] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 20.974328] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 20.976770] envoy[913]: [2026-09-20 12:46:51.022][913][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 20.980992] envoy[913]: [2026-09-20 12:46:51.062][913][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 20.982527] envoy[913]: [2026-09-20 12:46:51.064][913][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 20.999635] envoy[913]: [2026-09-20 12:46:51.064][913][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 21.002436] envoy[913]: [2026-09-20 12:46:51.064][913][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 21.012586] envoy[913]: [2026-09-20 12:46:51.064][913][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 21.014510] envoy[913]: [2026-09-20 12:46:51.282][913][info][main] [source/server/server.cc:968] runtime: {} lb # [ 21.016424] envoy[913]: [2026-09-20 12:46:51.306][913][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. worker1 # [ 21.028856] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 21.018314] envoy[913]: [2026-09-20 12:46:51.306][913][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 21.020398] envoy[913]: [2026-09-20 12:46:51.306][913][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 21.022262] envoy[913]: [2026-09-20 12:46:51.317][913][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 21.024188] envoy[913]: [2026-09-20 12:46:51.317][913][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 21.029299] envoy[913]: [2026-09-20 12:46:51.317][913][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 21.031622] envoy[913]: [2026-09-20 12:46:51.549][913][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 21.077795] systemd[1]: Reached target Network is Online. lb # [ 21.043379] envoy[913]: [2026-09-20 12:46:51.565][913][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker2 # [ 21.090812] systemd[1]: Starting scheduler-token.service... lb # [ 21.046399] envoy[913]: [2026-09-20 12:46:51.567][913][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 21.050796] envoy[913]: [2026-09-20 12:46:51.568][913][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 21.221820] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 21.225951] systemd[1]: Finished scheduler-token.service. worker2 # [ 21.227336] systemd[1]: scheduler-token.service: Consumed 61ms CPU time over 134ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 21.238489] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 21.278130] nix-grpc-daemon[777]: ts=2026-09-20T12:46:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 21.291067] nix-grpc-daemon[777]: ts=2026-09-20T12:46:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 21.293938] nix-grpc-daemon[777]: ts=2026-09-20T12:46:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 21.348311] nix-grpc-daemon[777]: ts=2026-09-20T12:46:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 21.350239] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 21.382643] nix-grpc-daemon[777]: ts=2026-09-20T12:46:51Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 21.380276] envoy[913]: [2026-09-20 12:46:51.901][913][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 21.383212] envoy[913]: [2026-09-20 12:46:51.901][913][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 21.388343] envoy[913]: [2026-09-20 12:46:51.901][913][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 21.391079] envoy[913]: [2026-09-20 12:46:51.901][913][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 21.464307] nix-grpc-daemon[779]: ts=2026-09-20T12:46:51Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 21.478056] nix-grpc-daemon[779]: ts=2026-09-20T12:46:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 21.480708] nix-grpc-daemon[779]: ts=2026-09-20T12:46:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 21.518320] nix-grpc-daemon[779]: ts=2026-09-20T12:46:52Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 21.533863] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 21.568941] nix-grpc-daemon[779]: ts=2026-09-20T12:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.574616] nix-grpc-daemon[779]: ts=2026-09-20T12:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.584325] nix-grpc-daemon[777]: ts=2026-09-20T12:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 21.776040] nix-grpc-daemon[779]: ts=2026-09-20T12:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.779002] nix-grpc-daemon[779]: ts=2026-09-20T12:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.980994] nix-grpc-daemon[779]: ts=2026-09-20T12:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.986949] nix-grpc-daemon[779]: ts=2026-09-20T12:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.994673] nix-grpc-daemon[777]: ts=2026-09-20T12:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 22.188780] nix-grpc-daemon[779]: ts=2026-09-20T12:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.195087] nix-grpc-daemon[779]: ts=2026-09-20T12:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.396682] nix-grpc-daemon[779]: ts=2026-09-20T12:46:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.402365] nix-grpc-daemon[779]: ts=2026-09-20T12:46:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.607562] nix-grpc-daemon[779]: ts=2026-09-20T12:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.614733] nix-grpc-daemon[779]: ts=2026-09-20T12:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.808624] nix-grpc-daemon[779]: ts=2026-09-20T12:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.814355] nix-grpc-daemon[779]: ts=2026-09-20T12:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.796538] nix-grpc-daemon[777]: ts=2026-09-20T12:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.797390] nix-grpc-daemon[777]: ts=2026-09-20T12:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.015957] nix-grpc-daemon[779]: ts=2026-09-20T12:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.021905] nix-grpc-daemon[779]: ts=2026-09-20T12:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.998807] nix-grpc-daemon[777]: ts=2026-09-20T12:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.004827] nix-grpc-daemon[777]: ts=2026-09-20T12:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.223466] nix-grpc-daemon[779]: ts=2026-09-20T12:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.229334] nix-grpc-daemon[779]: ts=2026-09-20T12:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.205769] nix-grpc-daemon[777]: ts=2026-09-20T12:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.211498] nix-grpc-daemon[777]: ts=2026-09-20T12:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.430874] nix-grpc-daemon[779]: ts=2026-09-20T12:46:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.436825] nix-grpc-daemon[779]: ts=2026-09-20T12:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.412388] nix-grpc-daemon[777]: ts=2026-09-20T12:46:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.416411] nix-grpc-daemon[777]: ts=2026-09-20T12:46:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.640487] nix-grpc-daemon[779]: ts=2026-09-20T12:46:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.644831] nix-grpc-daemon[779]: ts=2026-09-20T12:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.617391] nix-grpc-daemon[777]: ts=2026-09-20T12:46:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.622138] nix-grpc-daemon[777]: ts=2026-09-20T12:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.842394] nix-grpc-daemon[779]: ts=2026-09-20T12:46:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.848172] nix-grpc-daemon[779]: ts=2026-09-20T12:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.825518] nix-grpc-daemon[777]: ts=2026-09-20T12:46:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.829827] nix-grpc-daemon[777]: ts=2026-09-20T12:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.049631] nix-grpc-daemon[779]: ts=2026-09-20T12:46:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.025556] nix-grpc-daemon[777]: ts=2026-09-20T12:46:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.055386] nix-grpc-daemon[779]: ts=2026-09-20T12:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.027967] nix-grpc-daemon[777]: ts=2026-09-20T12:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.257048] nix-grpc-daemon[779]: ts=2026-09-20T12:46:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.229278] nix-grpc-daemon[777]: ts=2026-09-20T12:46:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.262895] nix-grpc-daemon[779]: ts=2026-09-20T12:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.235113] nix-grpc-daemon[777]: ts=2026-09-20T12:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.464483] nix-grpc-daemon[779]: ts=2026-09-20T12:46:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.435661] nix-grpc-daemon[777]: ts=2026-09-20T12:46:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.438961] nix-grpc-daemon[777]: ts=2026-09-20T12:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.470133] nix-grpc-daemon[779]: ts=2026-09-20T12:46:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.673377] nix-grpc-daemon[779]: ts=2026-09-20T12:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.640219] nix-grpc-daemon[777]: ts=2026-09-20T12:46:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.678454] nix-grpc-daemon[779]: ts=2026-09-20T12:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.645772] nix-grpc-daemon[777]: ts=2026-09-20T12:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.879933] nix-grpc-daemon[779]: ts=2026-09-20T12:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.848743] nix-grpc-daemon[777]: ts=2026-09-20T12:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.852095] nix-grpc-daemon[777]: ts=2026-09-20T12:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.885489] nix-grpc-daemon[779]: ts=2026-09-20T12:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.050024] nix-grpc-daemon[777]: ts=2026-09-20T12:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.053311] nix-grpc-daemon[777]: ts=2026-09-20T12:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.087299] nix-grpc-daemon[779]: ts=2026-09-20T12:46:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.093174] nix-grpc-daemon[779]: ts=2026-09-20T12:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.254261] nix-grpc-daemon[777]: ts=2026-09-20T12:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.257772] nix-grpc-daemon[777]: ts=2026-09-20T12:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.294700] nix-grpc-daemon[779]: ts=2026-09-20T12:46:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.300464] nix-grpc-daemon[779]: ts=2026-09-20T12:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.458748] nix-grpc-daemon[777]: ts=2026-09-20T12:46:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.464761] nix-grpc-daemon[777]: ts=2026-09-20T12:46:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.502337] nix-grpc-daemon[779]: ts=2026-09-20T12:46:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.508265] nix-grpc-daemon[779]: ts=2026-09-20T12:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.665322] nix-grpc-daemon[777]: ts=2026-09-20T12:46:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.668664] nix-grpc-daemon[777]: ts=2026-09-20T12:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.711789] nix-grpc-daemon[779]: ts=2026-09-20T12:46:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.715098] nix-grpc-daemon[779]: ts=2026-09-20T12:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.871879] nix-grpc-daemon[777]: ts=2026-09-20T12:46:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.912718] nix-grpc-daemon[779]: ts=2026-09-20T12:46:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.876682] nix-grpc-daemon[777]: ts=2026-09-20T12:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.914900] nix-grpc-daemon[779]: ts=2026-09-20T12:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.073404] nix-grpc-daemon[777]: ts=2026-09-20T12:46:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.115931] nix-grpc-daemon[779]: ts=2026-09-20T12:46:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.079749] nix-grpc-daemon[777]: ts=2026-09-20T12:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.118398] nix-grpc-daemon[779]: ts=2026-09-20T12:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.280812] nix-grpc-daemon[777]: ts=2026-09-20T12:46:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.319594] nix-grpc-daemon[779]: ts=2026-09-20T12:46:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.322308] nix-grpc-daemon[779]: ts=2026-09-20T12:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.286810] nix-grpc-daemon[777]: ts=2026-09-20T12:46:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.487890] nix-grpc-daemon[777]: ts=2026-09-20T12:46:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.493619] nix-grpc-daemon[777]: ts=2026-09-20T12:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.524099] nix-grpc-daemon[779]: ts=2026-09-20T12:46:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.530255] nix-grpc-daemon[779]: ts=2026-09-20T12:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.695041] nix-grpc-daemon[777]: ts=2026-09-20T12:46:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.733377] nix-grpc-daemon[779]: ts=2026-09-20T12:46:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.704389] nix-grpc-daemon[777]: ts=2026-09-20T12:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.738655] nix-grpc-daemon[779]: ts=2026-09-20T12:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.903997] nix-grpc-daemon[777]: ts=2026-09-20T12:46:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.940292] nix-grpc-daemon[779]: ts=2026-09-20T12:46:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.908896] nix-grpc-daemon[777]: ts=2026-09-20T12:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.945969] nix-grpc-daemon[779]: ts=2026-09-20T12:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.104894] nix-grpc-daemon[777]: ts=2026-09-20T12:46:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.109230] nix-grpc-daemon[777]: ts=2026-09-20T12:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.147436] nix-grpc-daemon[779]: ts=2026-09-20T12:46:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.154037] nix-grpc-daemon[779]: ts=2026-09-20T12:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.309847] nix-grpc-daemon[777]: ts=2026-09-20T12:46:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.313612] nix-grpc-daemon[777]: ts=2026-09-20T12:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.355055] nix-grpc-daemon[779]: ts=2026-09-20T12:46:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.361257] nix-grpc-daemon[779]: ts=2026-09-20T12:46:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.514583] nix-grpc-daemon[777]: ts=2026-09-20T12:46:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.520856] nix-grpc-daemon[777]: ts=2026-09-20T12:46:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.563887] nix-grpc-daemon[779]: ts=2026-09-20T12:46:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.570724] nix-grpc-daemon[779]: ts=2026-09-20T12:46:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.721349] nix-grpc-daemon[777]: ts=2026-09-20T12:46:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.723903] nix-grpc-daemon[777]: ts=2026-09-20T12:46:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.774565] nix-grpc-daemon[779]: ts=2026-09-20T12:46:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.779087] nix-grpc-daemon[779]: ts=2026-09-20T12:46:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.929116] nix-grpc-daemon[777]: ts=2026-09-20T12:46:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.933599] nix-grpc-daemon[777]: ts=2026-09-20T12:46:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.975932] nix-grpc-daemon[779]: ts=2026-09-20T12:46:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.979865] nix-grpc-daemon[779]: ts=2026-09-20T12:46:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.128576] nix-grpc-daemon[777]: ts=2026-09-20T12:46:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.131891] nix-grpc-daemon[777]: ts=2026-09-20T12:46:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.181636] nix-grpc-daemon[779]: ts=2026-09-20T12:46:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.185989] nix-grpc-daemon[779]: ts=2026-09-20T12:46:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.334073] nix-grpc-daemon[777]: ts=2026-09-20T12:46:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.340553] nix-grpc-daemon[777]: ts=2026-09-20T12:46:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.387812] nix-grpc-daemon[779]: ts=2026-09-20T12:46:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.394362] nix-grpc-daemon[779]: ts=2026-09-20T12:46:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.541051] nix-grpc-daemon[777]: ts=2026-09-20T12:46:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.544281] nix-grpc-daemon[777]: ts=2026-09-20T12:46:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.594829] nix-grpc-daemon[779]: ts=2026-09-20T12:46:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.597147] nix-grpc-daemon[779]: ts=2026-09-20T12:46:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.745305] nix-grpc-daemon[777]: ts=2026-09-20T12:46:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.749054] nix-grpc-daemon[777]: ts=2026-09-20T12:46:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.799862] nix-grpc-daemon[779]: ts=2026-09-20T12:46:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.803336] nix-grpc-daemon[779]: ts=2026-09-20T12:46:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.950149] nix-grpc-daemon[777]: ts=2026-09-20T12:46:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.954839] nix-grpc-daemon[777]: ts=2026-09-20T12:46:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.005491] nix-grpc-daemon[779]: ts=2026-09-20T12:46:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.011619] nix-grpc-daemon[779]: ts=2026-09-20T12:46:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.156683] nix-grpc-daemon[777]: ts=2026-09-20T12:46:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.163080] nix-grpc-daemon[777]: ts=2026-09-20T12:46:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.212981] nix-grpc-daemon[779]: ts=2026-09-20T12:46:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.220754] nix-grpc-daemon[779]: ts=2026-09-20T12:46:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.364382] nix-grpc-daemon[777]: ts=2026-09-20T12:46:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.370561] nix-grpc-daemon[777]: ts=2026-09-20T12:46:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.420170] nix-grpc-daemon[779]: ts=2026-09-20T12:46:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.425849] nix-grpc-daemon[779]: ts=2026-09-20T12:46:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.572098] nix-grpc-daemon[777]: ts=2026-09-20T12:47:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.578182] nix-grpc-daemon[777]: ts=2026-09-20T12:47:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.623212] nix-grpc-daemon[779]: ts=2026-09-20T12:47:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.629172] nix-grpc-daemon[779]: ts=2026-09-20T12:47:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.779067] nix-grpc-daemon[777]: ts=2026-09-20T12:47:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.782902] nix-grpc-daemon[777]: ts=2026-09-20T12:47:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.833968] nix-grpc-daemon[779]: ts=2026-09-20T12:47:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.838594] nix-grpc-daemon[779]: ts=2026-09-20T12:47:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.990172] nix-grpc-daemon[777]: ts=2026-09-20T12:47:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.000635] nix-grpc-daemon[777]: ts=2026-09-20T12:47:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.035359] nix-grpc-daemon[779]: ts=2026-09-20T12:47:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.041648] nix-grpc-daemon[779]: ts=2026-09-20T12:47:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.188697] nix-grpc-daemon[777]: ts=2026-09-20T12:47:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.195024] nix-grpc-daemon[777]: ts=2026-09-20T12:47:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.242153] nix-grpc-daemon[779]: ts=2026-09-20T12:47:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.244514] nix-grpc-daemon[779]: ts=2026-09-20T12:47:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.395525] nix-grpc-daemon[777]: ts=2026-09-20T12:47:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.398333] nix-grpc-daemon[777]: ts=2026-09-20T12:47:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.446615] nix-grpc-daemon[779]: ts=2026-09-20T12:47:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.452892] nix-grpc-daemon[779]: ts=2026-09-20T12:47:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.599837] nix-grpc-daemon[777]: ts=2026-09-20T12:47:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.603082] nix-grpc-daemon[777]: ts=2026-09-20T12:47:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.654647] nix-grpc-daemon[779]: ts=2026-09-20T12:47:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.660587] nix-grpc-daemon[779]: ts=2026-09-20T12:47:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.805293] nix-grpc-daemon[777]: ts=2026-09-20T12:47:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.811828] nix-grpc-daemon[777]: ts=2026-09-20T12:47:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.863468] nix-grpc-daemon[779]: ts=2026-09-20T12:47:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.865968] nix-grpc-daemon[779]: ts=2026-09-20T12:47:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.015790] nix-grpc-daemon[777]: ts=2026-09-20T12:47:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.020506] nix-grpc-daemon[777]: ts=2026-09-20T12:47:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.064855] nix-grpc-daemon[779]: ts=2026-09-20T12:47:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.067740] nix-grpc-daemon[779]: ts=2026-09-20T12:47:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.216657] nix-grpc-daemon[777]: ts=2026-09-20T12:47:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.219718] nix-grpc-daemon[777]: ts=2026-09-20T12:47:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.270375] nix-grpc-daemon[779]: ts=2026-09-20T12:47:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.276623] nix-grpc-daemon[779]: ts=2026-09-20T12:47:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.421212] nix-grpc-daemon[777]: ts=2026-09-20T12:47:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.428979] nix-grpc-daemon[777]: ts=2026-09-20T12:47:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.478764] nix-grpc-daemon[779]: ts=2026-09-20T12:47:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.484932] nix-grpc-daemon[779]: ts=2026-09-20T12:47:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.630989] nix-grpc-daemon[777]: ts=2026-09-20T12:47:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.637245] nix-grpc-daemon[777]: ts=2026-09-20T12:47:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.685992] nix-grpc-daemon[779]: ts=2026-09-20T12:47:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.689992] nix-grpc-daemon[779]: ts=2026-09-20T12:47:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.838435] nix-grpc-daemon[777]: ts=2026-09-20T12:47:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.844464] nix-grpc-daemon[777]: ts=2026-09-20T12:47:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.894948] nix-grpc-daemon[779]: ts=2026-09-20T12:47:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.899568] nix-grpc-daemon[779]: ts=2026-09-20T12:47:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.047267] nix-grpc-daemon[777]: ts=2026-09-20T12:47:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.053426] nix-grpc-daemon[777]: ts=2026-09-20T12:47:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.096574] nix-grpc-daemon[779]: ts=2026-09-20T12:47:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.102547] nix-grpc-daemon[779]: ts=2026-09-20T12:47:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.254743] nix-grpc-daemon[777]: ts=2026-09-20T12:47:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.261034] nix-grpc-daemon[777]: ts=2026-09-20T12:47:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.304312] nix-grpc-daemon[779]: ts=2026-09-20T12:47:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.310344] nix-grpc-daemon[779]: ts=2026-09-20T12:47:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.462387] nix-grpc-daemon[777]: ts=2026-09-20T12:47:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.468836] nix-grpc-daemon[777]: ts=2026-09-20T12:47:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.511514] nix-grpc-daemon[779]: ts=2026-09-20T12:47:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.515463] nix-grpc-daemon[779]: ts=2026-09-20T12:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.669317] nix-grpc-daemon[777]: ts=2026-09-20T12:47:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.672077] nix-grpc-daemon[777]: ts=2026-09-20T12:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.716819] nix-grpc-daemon[779]: ts=2026-09-20T12:47:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.721031] nix-grpc-daemon[779]: ts=2026-09-20T12:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.873858] nix-grpc-daemon[777]: ts=2026-09-20T12:47:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.880144] nix-grpc-daemon[777]: ts=2026-09-20T12:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.925729] nix-grpc-daemon[779]: ts=2026-09-20T12:47:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.930421] nix-grpc-daemon[779]: ts=2026-09-20T12:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.084489] nix-grpc-daemon[777]: ts=2026-09-20T12:47:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.088895] nix-grpc-daemon[777]: ts=2026-09-20T12:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.125659] nix-grpc-daemon[779]: ts=2026-09-20T12:47:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.128367] nix-grpc-daemon[779]: ts=2026-09-20T12:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 33.252894] rustfs-bucket-start[1042]: mb s3://farm lb # [ 33.262608] systemd[1]: Finished rustfs-bucket.service. lb # [ 33.274337] systemd[1]: Starting niks3 server... worker1 # [ 33.285171] nix-grpc-daemon[777]: ts=2026-09-20T12:47:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.289053] nix-grpc-daemon[777]: ts=2026-09-20T12:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.330793] nix-grpc-daemon[779]: ts=2026-09-20T12:47:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.336956] nix-grpc-daemon[779]: ts=2026-09-20T12:47:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.489399] nix-grpc-daemon[777]: ts=2026-09-20T12:47:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.493266] nix-grpc-daemon[777]: ts=2026-09-20T12:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.538540] nix-grpc-daemon[779]: ts=2026-09-20T12:47:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.544841] nix-grpc-daemon[779]: ts=2026-09-20T12:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 33.539469] postgres[1058]: [1058] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 33.544577] postgres[1058]: [1058] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 33.602148] niks3-server[1051]: 2026/09/20 12:47:04 OK 20241026095416_initial_model.sql (28.87ms) lb # [ 33.607329] niks3-server[1051]: 2026/09/20 12:47:04 OK 20251210153512_drop_unused_gin_index.sql (3.3ms) lb # [ 33.614552] niks3-server[1051]: 2026/09/20 12:47:04 OK 20251218171726_add_pins.sql (7.18ms) lb # [ 33.621110] niks3-server[1051]: 2026/09/20 12:47:04 OK 20260628120000_add_object_size_and_stats.sql (6.5ms) lb # [ 33.627765] niks3-server[1051]: 2026/09/20 12:47:04 OK 20260905000000_add_claims.sql (6.59ms) lb # [ 33.633730] niks3-server[1051]: 2026/09/20 12:47:04 OK 20260920000000_drop_claims.sql (5.78ms) lb # [ 33.635036] niks3-server[1051]: 2026/09/20 12:47:04 goose: successfully migrated database to version: 20260920000000 lb # [ 33.641524] niks3-server[1051]: 2026/09/20 12:47:04 OK 1_commit_pending_closure.sql (7.8ms) lb # [ 33.645258] niks3-server[1051]: 2026/09/20 12:47:04 OK 2_object_stats_trigger.sql (3.56ms) lb # [ 33.646760] niks3-server[1051]: 2026/09/20 12:47:04 goose: up to current file version: 2 lb # [ 33.651796] niks3-server[1051]: 2026/09/20 12:47:04 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key worker1 # [ 33.693805] nix-grpc-daemon[777]: ts=2026-09-20T12:47:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.696439] nix-grpc-daemon[777]: ts=2026-09-20T12:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.747185] nix-grpc-daemon[779]: ts=2026-09-20T12:47:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.750140] nix-grpc-daemon[779]: ts=2026-09-20T12:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 33.706272] niks3-server[1051]: 2026/09/20 12:47:04 INFO Read proxy enabled — serving cache objects from S3 lb # [ 33.709207] niks3-server[1051]: 2026/09/20 12:47:04 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 33.717501] niks3-server[1051]: 2026/09/20 12:47:04 INFO systemd watchdog enabled interval=15s lb # [ 33.719424] niks3-server[1051]: 2026/09/20 12:47:04 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 33.722572] systemd[1]: Started niks3 server. lb # [ 33.726237] systemd[1]: Reached target Multi-User System. worker2 # [ 33.776366] nix-grpc-daemon[779]: ts=2026-09-20T12:47:04Z level=info event=scheduler_take_over lb # [ 33.731456] niks3-server[1051]: 2026/09/20 12:47:04 INFO lead: acquired remote=192.168.1.4:38562 lb # [ 33.737795] systemd[1]: Startup finished in 1.049s (kernel) + 4.732s (initrd) + 27.934s (userspace) = 33.716s. worker1 # [ 33.898205] nix-grpc-daemon[777]: ts=2026-09-20T12:47:04Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: waiting for unit niks3.service, in 18.38 seconds) worker1 # [ 33.904508] nix-grpc-daemon[777]: ts=2026-09-20T12:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: waiting for TCP port 5751 on localhost worker2 # [ 33.955401] nix-grpc-daemon[779]: ts=2026-09-20T12:47:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.960434] nix-grpc-daemon[779]: ts=2026-09-20T12:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.09 seconds) lb: waiting for TCP port 50051 on localhost worker1 # [ 34.106884] nix-grpc-daemon[777]: ts=2026-09-20T12:47:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.109834] nix-grpc-daemon[777]: ts=2026-09-20T12:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.157865] nix-grpc-daemon[779]: ts=2026-09-20T12:47:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.162663] nix-grpc-daemon[779]: ts=2026-09-20T12:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 34.134296] envoy[913]: conn peer=[::1]:56854 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=5 lb: (finished: waiting for TCP port 50051 on localhost, in 0.07 seconds) worker1 # [ 34.307854] nix-grpc-daemon[777]: ts=2026-09-20T12:47:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.310910] nix-grpc-daemon[777]: ts=2026-09-20T12:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.359634] nix-grpc-daemon[779]: ts=2026-09-20T12:47:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.365627] nix-grpc-daemon[779]: ts=2026-09-20T12:47:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.406603] systemd[1]: Starting scheduler-token.service... worker2 # [ 34.507765] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 34.510219] systemd[1]: Finished scheduler-token.service. worker2 # [ 34.514573] systemd[1]: scheduler-token.service: Consumed 39ms CPU time over 105ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy ??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 128 lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 34.512211] nix-grpc-daemon[777]: ts=2026-09-20T12:47:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.518959] nix-grpc-daemon[777]: ts=2026-09-20T12:47:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.566214] nix-grpc-daemon[779]: ts=2026-09-20T12:47:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.568569] nix-grpc-daemon[779]: ts=2026-09-20T12:47:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.13 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.14 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 34.719582] nix-grpc-daemon[777]: ts=2026-09-20T12:47:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.758989] nix-grpc-daemon[779]: ts=2026-09-20T12:47:05Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:54536 worker2 # [ 34.762022] nix-grpc-daemon[779]: ts=2026-09-20T12:47:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 34.769521] nix-grpc-daemon[779]: ts=2026-09-20T12:47:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.782527] nix-grpc-daemon[779]: ts=2026-09-20T12:47:05Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 34.784414] nix-grpc-daemon[779]: ts=2026-09-20T12:47:05Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:54536 worker2 # [ 34.787012] nix-grpc-daemon[779]: ts=2026-09-20T12:47:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.32 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 35.357918] nix-grpc-daemon[779]: ts=2026-09-20T12:47:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 35.381956] systemd[1]: Started Nix Daemon. worker2 # [ 35.692714] nix-daemon[848]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 35.743424] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5) worker2 # [ 35.769663] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 127 ms (attempt 2/5) worker2 # [ 35.899737] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 277 ms (attempt 3/5) worker2 # [ 36.180870] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 313 ms (attempt 4/5) worker2 # [ 36.506902] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 36.525730] nix-grpc-daemon[777]: ts=2026-09-20T12:47:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 36.547605] systemd[1]: Started Nix Daemon. worker1 # [ 36.945399] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 36.979707] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 1/5) worker1 # [ 37.031842] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 153 ms (attempt 2/5) worker1 # [ 37.190221] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 3/5) worker1 # [ 37.232364] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 260 ms (attempt 4/5) worker1 # [ 37.494645] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 37.505694] nix-grpc-daemon[777]: ts=2026-09-20T12:47:08Z level=debug event=path_info_miss path=mxjjcdp3piiw7m6ki3ycv2085q5nmrdz-nixos-system-client-test error="error: path '/nix/store/mxjjcdp3piiw7m6ki3ycv2085q5nmrdz-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 37.550521] nix-grpc-daemon[779]: ts=2026-09-20T12:47:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 37.570484] nix-grpc-daemon[779]: ts=2026-09-20T12:47:08Z level=debug event=path_info_miss path=mxjjcdp3piiw7m6ki3ycv2085q5nmrdz-nixos-system-client-test error="error: path '/nix/store/mxjjcdp3piiw7m6ki3ycv2085q5nmrdz-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds) client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds) worker2 # [ 38.098692] nix-grpc-daemon[779]: ts=2026-09-20T12:47:08Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:54540 worker1 # [ 38.107265] nix-grpc-daemon[777]: ts=2026-09-20T12:47:08Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 38.113454] nix-grpc-daemon[777]: ts=2026-09-20T12:47:08Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:53786 worker1 # [ 38.123980] nix-grpc-daemon[777]: ts=2026-09-20T12:47:08Z level=debug event=path_info_miss path=mxjjcdp3piiw7m6ki3ycv2085q5nmrdz-nixos-system-client-test error="error: path '/nix/store/mxjjcdp3piiw7m6ki3ycv2085q5nmrdz-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 38.164988] nix-grpc-daemon[779]: ts=2026-09-20T12:47:08Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:54540 worker2 # [ 38.182370] nix-grpc-daemon[779]: ts=2026-09-20T12:47:08Z level=debug event=path_info_miss path=mxjjcdp3piiw7m6ki3ycv2085q5nmrdz-nixos-system-client-test error="error: path '/nix/store/mxjjcdp3piiw7m6ki3ycv2085q5nmrdz-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.06 seconds) worker1 # [ 40.554331] nix-grpc-daemon[777]: ts=2026-09-20T12:47:11Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 40.901434] nix-grpc-daemon[779]: ts=2026-09-20T12:47:11Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.94 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 lb # [ 41.031951] envoy[913]: conn peer=[2001:db8:1::1]:54642 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2263 lb # [ 41.033109] envoy[913]: conn peer=[2001:db8:1::1]:54652 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=103 lb # [ 41.033360] envoy[913]: conn peer=[2001:db8:1::1]:54668 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=199 ms=25 lb # [ 41.033561] envoy[913]: conn peer=[2001:db8:1::1]:49076 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=13 worker2 # [ 41.192546] nix-grpc-daemon[779]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54540 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 41.209514] nix-grpc-daemon[779]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 41.270675] nix-grpc-daemon[779]: ts=2026-09-20T12:47:11Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 41.277563] nix-grpc-daemon[779]: ts=2026-09-20T12:47:11Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 41.293911] nix-grpc-daemon[777]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 41.326958] nix-grpc-daemon[777]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 client # copying 1 paths to 'lb:50051'... worker1 # [ 41.350233] nix-grpc-daemon[777]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 41.371356] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 41.396127] nix-grpc-daemon[777]: ts=2026-09-20T12:47:11Z level=info event=niks3_push_started pid=846 worker1 # [ 41.729507] nix-grpc-daemon[846]: time=2026-09-20T12:47:12.249Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 41.951297] nix-daemon[835]: accepted connection from pid 859, user nix-grpc-daemon (trusted) worker1 # [ 41.979944] nix-daemon[835]: reaped child process 862, status = succeeded worker1 # [ 42.198050] nix-daemon[835]: accepted connection from pid 864, user nix-grpc-daemon (trusted) worker1 # [ 42.221380] nix-daemon[835]: reaped child process 867, status = succeeded lb # [ 42.225718] niks3-server[1051]: 2026/09/20 12:47:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.277354] nix-grpc-daemon[846]: time=2026-09-20T12:47:12.797Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 42.279305] nix-grpc-daemon[846]: time=2026-09-20T12:47:12.798Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 42.346079] niks3-server[1051]: 2026/09/20 12:47:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 42.359864] niks3-server[1051]: 2026/09/20 12:47:12 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 42.402510] niks3-server[1051]: 2026/09/20 12:47:12 INFO Signed narinfos id=1 count=1 worker1 # [ 42.420296] nix-grpc-daemon[846]: time=2026-09-20T12:47:12.941Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.426921] niks3-server[1051]: 2026/09/20 12:47:12 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 42.437842] niks3-server[1051]: 2026/09/20 12:47:12 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 42.449506] niks3-server[1051]: 2026/09/20 12:47:12 INFO Completed upload id=1 worker1 # [ 42.462521] nix-grpc-daemon[846]: time=2026-09-20T12:47:12.984Z level=INFO msg="Upload complete. (723ms)" lb # [ 42.453449] niks3-server[1051]: 2026/09/20 12:47:12 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo worker1 # [ 42.478697] nix-grpc-daemon[777]: ts=2026-09-20T12:47:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=1 paths=1 nar_bytes_in=504 worker1 # [ 42.501290] nix-grpc-daemon[777]: ts=2026-09-20T12:47:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 42.513419] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 42.523012] nix-daemon[835]: reaped child process 844, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... worker1 # [ 42.538988] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv client # farm-a> LOG-farm-a-t1 worker1 # [ 43.369423] nix-daemon[835]: reaped child process 871, status = succeeded worker1 # [ 43.568558] nix-daemon[835]: accepted connection from pid 887, user nix-grpc-daemon (trusted) worker1 # [ 43.591214] nix-daemon[835]: reaped child process 890, status = succeeded lb # [ 43.593731] niks3-server[1051]: 2026/09/20 12:47:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.624894] nix-grpc-daemon[846]: time=2026-09-20T12:47:14.144Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 43.626875] nix-grpc-daemon[846]: time=2026-09-20T12:47:14.144Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 43.662272] niks3-server[1051]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 43.669775] niks3-server[1051]: 2026/09/20 12:47:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 43.671915] niks3-server[1051]: 2026/09/20 12:47:14 INFO Signed narinfos id=2 count=1 worker1 # [ 43.683516] nix-grpc-daemon[846]: time=2026-09-20T12:47:14.204Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.681769] niks3-server[1051]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 43.697722] niks3-server[1051]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 43.704000] niks3-server[1051]: 2026/09/20 12:47:14 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete worker1 # [ 43.714717] nix-grpc-daemon[846]: time=2026-09-20T12:47:14.236Z level=INFO msg="Upload complete. (358ms)" lb # [ 43.706116] niks3-server[1051]: 2026/09/20 12:47:14 INFO Completed upload id=2 lb # [ 43.709100] niks3-server[1051]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 43.729965] nix-grpc-daemon[777]: ts=2026-09-20T12:47:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker1 # [ 43.748269] nix-daemon[835]: reaped child process 869, status = succeeded worker2 # [ 43.781408] nix-grpc-daemon[779]: ts=2026-09-20T12:47:14Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 43.788088] nix-grpc-daemon[779]: ts=2026-09-20T12:47:14Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 43.804265] nix-grpc-daemon[777]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 43.830835] nix-grpc-daemon[777]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 43.856410] nix-grpc-daemon[846]: time=2026-09-20T12:47:14.378Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 43.873381] nix-grpc-daemon[777]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 43.898987] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 44.175746] nix-daemon[835]: accepted connection from pid 894, user nix-grpc-daemon (trusted) worker1 # [ 44.201065] nix-daemon[835]: reaped child process 897, status = succeeded worker1 # [ 44.419678] nix-daemon[835]: accepted connection from pid 899, user nix-grpc-daemon (trusted) worker1 # [ 44.443365] nix-daemon[835]: reaped child process 902, status = succeeded lb # [ 44.444162] niks3-server[1051]: 2026/09/20 12:47:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 44.472362] nix-grpc-daemon[846]: time=2026-09-20T12:47:14.993Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 44.475462] nix-grpc-daemon[846]: time=2026-09-20T12:47:14.993Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 44.498367] niks3-server[1051]: 2026/09/20 12:47:15 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 44.512465] niks3-server[1051]: 2026/09/20 12:47:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker1 # [ 44.532007] nix-grpc-daemon[846]: time=2026-09-20T12:47:15.053Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.523579] niks3-server[1051]: 2026/09/20 12:47:15 INFO Signed narinfos id=3 count=1 lb # [ 44.532206] niks3-server[1051]: 2026/09/20 12:47:15 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 44.545585] niks3-server[1051]: 2026/09/20 12:47:15 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 44.563111] niks3-server[1051]: 2026/09/20 12:47:15 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo lb # [ 44.572305] niks3-server[1051]: 2026/09/20 12:47:15 INFO Completed upload id=3 worker1 # [ 44.585224] nix-grpc-daemon[846]: time=2026-09-20T12:47:15.106Z level=INFO msg="Upload complete. (654ms)" worker1 # [ 44.597747] nix-grpc-daemon[777]: ts=2026-09-20T12:47:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 44.612778] nix-grpc-daemon[777]: ts=2026-09-20T12:47:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 44.632748] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 44.641725] nix-daemon[835]: reaped child process 892, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker1 # [ 44.656996] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-t1 worker1 # [ 45.887727] nix-daemon[835]: reaped child process 906, status = succeeded worker1 # [ 46.072399] nix-daemon[835]: accepted connection from pid 921, user nix-grpc-daemon (trusted) worker1 # [ 46.096433] nix-daemon[835]: reaped child process 924, status = succeeded lb # [ 46.099358] niks3-server[1051]: 2026/09/20 12:47:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 46.130102] nix-grpc-daemon[846]: time=2026-09-20T12:47:16.650Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 46.131937] nix-grpc-daemon[846]: time=2026-09-20T12:47:16.650Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 46.152526] niks3-server[1051]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 46.162110] niks3-server[1051]: 2026/09/20 12:47:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign worker1 # [ 46.178610] nix-grpc-daemon[846]: time=2026-09-20T12:47:16.699Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.169827] niks3-server[1051]: 2026/09/20 12:47:16 INFO Signed narinfos id=4 count=1 lb # [ 46.174258] niks3-server[1051]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 46.181667] niks3-server[1051]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 46.187417] niks3-server[1051]: 2026/09/20 12:47:16 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 46.193183] niks3-server[1051]: 2026/09/20 12:47:16 INFO Completed upload id=4 worker1 # [ 46.204159] nix-grpc-daemon[846]: time=2026-09-20T12:47:16.725Z level=INFO msg="Upload complete. (330ms)" lb # [ 46.194833] niks3-server[1051]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker1 # [ 46.212800] nix-grpc-daemon[777]: ts=2026-09-20T12:47:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker1 # [ 46.221587] nix-daemon[835]: reaped child process 904, status = succeeded worker2 # [ 46.257854] nix-grpc-daemon[779]: ts=2026-09-20T12:47:16Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 46.258519] nix-grpc-daemon[779]: ts=2026-09-20T12:47:16Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 46.270123] nix-grpc-daemon[777]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 46.288343] nix-grpc-daemon[777]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 46.305739] nix-grpc-daemon[846]: time=2026-09-20T12:47:16.827Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 46.319262] nix-grpc-daemon[777]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 46.345244] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 46.600297] nix-daemon[835]: accepted connection from pid 928, user nix-grpc-daemon (trusted) worker1 # [ 46.637857] nix-daemon[835]: reaped child process 931, status = succeeded worker1 # [ 46.868965] nix-daemon[835]: accepted connection from pid 933, user nix-grpc-daemon (trusted) worker1 # [ 46.892134] nix-daemon[835]: reaped child process 937, status = succeeded lb # [ 46.893317] niks3-server[1051]: 2026/09/20 12:47:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 46.918597] nix-grpc-daemon[846]: time=2026-09-20T12:47:17.440Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 46.921154] nix-grpc-daemon[846]: time=2026-09-20T12:47:17.442Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 46.922002] niks3-server[1051]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 46.928968] niks3-server[1051]: 2026/09/20 12:47:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 46.943961] nix-grpc-daemon[846]: time=2026-09-20T12:47:17.465Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.934471] niks3-server[1051]: 2026/09/20 12:47:17 INFO Signed narinfos id=5 count=1 lb # [ 46.935993] niks3-server[1051]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 46.944137] niks3-server[1051]: 2026/09/20 12:47:17 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete worker1 # [ 46.960064] nix-grpc-daemon[846]: time=2026-09-20T12:47:17.482Z level=INFO msg="Upload complete. (593ms)" lb # [ 46.949183] niks3-server[1051]: 2026/09/20 12:47:17 INFO Completed upload id=5 lb # [ 46.951970] niks3-server[1051]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 46.967783] nix-grpc-daemon[777]: ts=2026-09-20T12:47:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 46.979189] nix-grpc-daemon[777]: ts=2026-09-20T12:47:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 46.984527] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 46.989576] nix-daemon[835]: reaped child process 926, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... worker1 # [ 47.004328] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv client # farm-top> LOG-farm-top-t1 worker1 # [ 48.634458] nix-daemon[835]: reaped child process 941, status = succeeded worker1 # [ 48.822345] nix-daemon[835]: accepted connection from pid 956, user nix-grpc-daemon (trusted) worker1 # [ 48.849626] nix-daemon[835]: reaped child process 959, status = succeeded lb # [ 48.847244] niks3-server[1051]: 2026/09/20 12:47:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.872903] nix-grpc-daemon[846]: time=2026-09-20T12:47:19.394Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 48.876812] nix-grpc-daemon[846]: time=2026-09-20T12:47:19.396Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 48.879330] niks3-server[1051]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 48.887498] niks3-server[1051]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 48.897509] niks3-server[1051]: 2026/09/20 12:47:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker1 # [ 48.912894] nix-grpc-daemon[846]: time=2026-09-20T12:47:19.434Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.901787] niks3-server[1051]: 2026/09/20 12:47:19 INFO Signed narinfos id=6 count=1 lb # [ 48.904996] niks3-server[1051]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 48.911761] niks3-server[1051]: 2026/09/20 12:47:19 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 48.917110] niks3-server[1051]: 2026/09/20 12:47:19 INFO Completed upload id=6 worker1 # [ 48.929464] nix-grpc-daemon[846]: time=2026-09-20T12:47:19.451Z level=INFO msg="Upload complete. (314ms)" lb # [ 48.919040] niks3-server[1051]: 2026/09/20 12:47:19 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker1 # [ 48.936726] nix-grpc-daemon[777]: ts=2026-09-20T12:47:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker1 # [ 48.945780] nix-daemon[835]: reaped child process 939, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 8.08 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.76 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.32 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker2 # [ 50.550444] nix-grpc-daemon[779]: ts=2026-09-20T12:47:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54540 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 50.563326] nix-grpc-daemon[779]: ts=2026-09-20T12:47:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 50.601355] nix-grpc-daemon[779]: ts=2026-09-20T12:47:21Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.32 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb # [ 51.030637] envoy[913]: conn peer=[2001:db8:1::1]:49090 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9566 tx=3881 ms=7811 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.54 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 lb # [ 51.034867] envoy[913]: conn peer=[2001:db8:1::1]:49098 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=481 ms=78 client # don't know how to build these paths: worker1 # [ 51.765166] nix-grpc-daemon[777]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53786 client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 51.774905] nix-grpc-daemon[777]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 51.789717] nix-grpc-daemon[846]: time=2026-09-20T12:47:22.310Z level=INFO msg="All 2 paths already cached" worker2 # [ 51.843640] nix-grpc-daemon[779]: ts=2026-09-20T12:47:22Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 51.843939] nix-grpc-daemon[779]: ts=2026-09-20T12:47:22Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 51.859168] nix-grpc-daemon[777]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 51.878425] nix-grpc-daemon[777]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 51.894697] nix-grpc-daemon[846]: time=2026-09-20T12:47:22.416Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 51.903692] nix-grpc-daemon[777]: ts=2026-09-20T12:47:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker1 # [ 51.919253] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 52.134017] nix-daemon[835]: accepted connection from pid 976, user nix-grpc-daemon (trusted) worker1 # [ 52.155103] nix-daemon[835]: reaped child process 979, status = succeeded worker1 # [ 52.343423] nix-daemon[835]: accepted connection from pid 981, user nix-grpc-daemon (trusted) worker1 # [ 52.366789] nix-daemon[835]: reaped child process 984, status = succeeded lb # [ 52.370291] niks3-server[1051]: 2026/09/20 12:47:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.391569] nix-grpc-daemon[846]: time=2026-09-20T12:47:22.913Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 52.393402] nix-grpc-daemon[846]: time=2026-09-20T12:47:22.913Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 52.400539] niks3-server[1051]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 52.419494] niks3-server[1051]: 2026/09/20 12:47:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker1 # [ 52.439472] nix-grpc-daemon[846]: time=2026-09-20T12:47:22.961Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.434489] niks3-server[1051]: 2026/09/20 12:47:22 INFO Signed narinfos id=7 count=1 lb # [ 52.441143] niks3-server[1051]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 52.450900] niks3-server[1051]: 2026/09/20 12:47:22 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete worker1 # [ 52.471498] nix-grpc-daemon[846]: time=2026-09-20T12:47:22.993Z level=INFO msg="Upload complete. (534ms)" lb # [ 52.459776] niks3-server[1051]: 2026/09/20 12:47:22 INFO Completed upload id=7 worker1 # [ 52.476352] nix-grpc-daemon[777]: ts=2026-09-20T12:47:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 52.464137] niks3-server[1051]: 2026/09/20 12:47:22 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker1 # [ 52.482247] nix-grpc-daemon[777]: ts=2026-09-20T12:47:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 52.491333] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 52.494912] nix-daemon[835]: reaped child process 974, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... worker1 # [ 52.507394] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 53.331376] nix-daemon[835]: reaped child process 988, status = succeeded client # farm-top> LOG-farm-top-t1b worker1 # [ 53.482729] nix-daemon[835]: accepted connection from pid 1003, user nix-grpc-daemon (trusted) worker1 # [ 53.507141] nix-daemon[835]: reaped child process 1006, status = succeeded lb # [ 53.507361] niks3-server[1051]: 2026/09/20 12:47:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.633214] nix-grpc-daemon[846]: time=2026-09-20T12:47:24.152Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 53.645800] nix-grpc-daemon[846]: time=2026-09-20T12:47:24.152Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 53.664859] niks3-server[1051]: 2026/09/20 12:47:24 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 53.688645] nix-grpc-daemon[846]: time=2026-09-20T12:47:24.210Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.679722] niks3-server[1051]: 2026/09/20 12:47:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 53.689683] niks3-server[1051]: 2026/09/20 12:47:24 INFO Signed narinfos id=8 count=1 lb # [ 53.696783] niks3-server[1051]: 2026/09/20 12:47:24 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 53.711043] niks3-server[1051]: 2026/09/20 12:47:24 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 53.718489] niks3-server[1051]: 2026/09/20 12:47:24 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 53.725063] niks3-server[1051]: 2026/09/20 12:47:24 INFO Completed upload id=8 worker1 # [ 53.736106] nix-grpc-daemon[846]: time=2026-09-20T12:47:24.257Z level=INFO msg="Upload complete. (420ms)" lb # [ 53.734091] niks3-server[1051]: 2026/09/20 12:47:24 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker1 # [ 53.747542] nix-grpc-daemon[777]: ts=2026-09-20T12:47:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker1 # [ 53.764180] nix-daemon[835]: reaped child process 986, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.38 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.25 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.06 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 54.373861] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 5785f0228dec41649651beae59d2697e client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup worker2 # [ 54.643500] nix-grpc-daemon[779]: ts=2026-09-20T12:47:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54540 client # [ 54.652691] nix[882]: don't know how to build these paths: client # [ 54.654004] nix[882]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 54.670138] nix-grpc-daemon[779]: ts=2026-09-20T12:47:25Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 54.679305] nix-grpc-daemon[779]: ts=2026-09-20T12:47:25Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 54.719488] nix-grpc-daemon[779]: ts=2026-09-20T12:47:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 54.744749] nix-grpc-daemon[779]: ts=2026-09-20T12:47:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54540 client # [ 54.760306] nix[882]: copying 1 paths to 'lb:50051'... worker2 # [ 54.761975] nix-grpc-daemon[779]: ts=2026-09-20T12:47:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54540 client # [ 54.763690] nix[882]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 54.778962] nix-daemon[848]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 54.798829] nix-grpc-daemon[779]: ts=2026-09-20T12:47:25Z level=info event=niks3_push_started pid=900 worker2 # [ 55.048292] nix-grpc-daemon[900]: time=2026-09-20T12:47:25.560Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 55.251638] nix-daemon[848]: accepted connection from pid 913, user nix-grpc-daemon (trusted) worker2 # [ 55.275619] nix-daemon[848]: reaped child process 916, status = succeeded worker2 # [ 55.469745] nix-daemon[848]: accepted connection from pid 918, user nix-grpc-daemon (trusted) worker2 # [ 55.491254] nix-daemon[848]: reaped child process 921, status = succeeded lb # [ 55.457872] niks3-server[1051]: 2026/09/20 12:47:25 INFO Received uploads request method=POST path=/api/pending_closures client # [ 55.502647] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. worker2 # [ 55.523034] nix-grpc-daemon[900]: time=2026-09-20T12:47:26.036Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 55.526759] nix-grpc-daemon[900]: time=2026-09-20T12:47:26.038Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.15 seconds) lb # [ 55.507869] niks3-server[1051]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst lb # [ 55.523090] niks3-server[1051]: 2026/09/20 12:47:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker2 # [ 55.577182] nix-grpc-daemon[900]: time=2026-09-20T12:47:26.090Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.534017] niks3-server[1051]: 2026/09/20 12:47:26 INFO Signed narinfos id=9 count=1 lb # [ 55.545297] niks3-server[1051]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 55.559104] niks3-server[1051]: 2026/09/20 12:47:26 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 55.568837] niks3-server[1051]: 2026/09/20 12:47:26 INFO Completed upload id=9 worker2 # [ 55.614864] nix-grpc-daemon[900]: time=2026-09-20T12:47:26.127Z level=INFO msg="Upload complete. (556ms)" lb # [ 55.573337] niks3-server[1051]: 2026/09/20 12:47:26 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 55.620373] nix-grpc-daemon[779]: ts=2026-09-20T12:47:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54540 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 55.632176] nix-grpc-daemon[779]: ts=2026-09-20T12:47:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 55.644250] nix-daemon[848]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 55.646626] nix-daemon[848]: reaped child process 898, status = succeeded client # Running as unit: dedup2.service; invocation ID: b163d482d12e472883a18abcb6c8c95f client # [ 55.656987] nix[882]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 55.663272] nix-daemon[848]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # [ 55.854380] nix[897]: don't know how to build these paths: worker1 # [ 55.820743] nix-grpc-daemon[777]: ts=2026-09-20T12:47:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53786 client # [ 55.855474] nix[897]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 55.867670] nix-grpc-daemon[779]: ts=2026-09-20T12:47:26Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 client # [ 55.878402] nix[897]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 55.878321] nix-grpc-daemon[779]: ts=2026-09-20T12:47:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54540 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.06 seconds) ??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 client: waiting for success: ! systemctl is-active dedup1 dedup2 ??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 worker2 # [ 60.289871] nix-daemon[848]: reaped child process 929, status = succeeded worker2 # [ 60.463956] nix-daemon[848]: accepted connection from pid 960, user nix-grpc-daemon (trusted) worker2 # [ 60.484113] nix-daemon[848]: reaped child process 963, status = succeeded lb # [ 60.453498] niks3-server[1051]: 2026/09/20 12:47:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 60.508490] nix-grpc-daemon[900]: time=2026-09-20T12:47:31.021Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 60.510064] nix-grpc-daemon[900]: time=2026-09-20T12:47:31.021Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 60.501100] niks3-server[1051]: 2026/09/20 12:47:31 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 60.516407] niks3-server[1051]: 2026/09/20 12:47:31 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 60.526016] niks3-server[1051]: 2026/09/20 12:47:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign worker2 # [ 60.576253] nix-grpc-daemon[900]: time=2026-09-20T12:47:31.089Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.531587] niks3-server[1051]: 2026/09/20 12:47:31 INFO Signed narinfos id=10 count=1 lb # [ 60.534944] niks3-server[1051]: 2026/09/20 12:47:31 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 60.548396] niks3-server[1051]: 2026/09/20 12:47:31 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 60.557425] niks3-server[1051]: 2026/09/20 12:47:31 INFO Completed upload id=10 worker2 # [ 60.603000] nix-grpc-daemon[900]: time=2026-09-20T12:47:31.116Z level=INFO msg="Upload complete. (326ms)" lb # [ 60.561196] niks3-server[1051]: 2026/09/20 12:47:31 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 60.616319] nix-grpc-daemon[779]: ts=2026-09-20T12:47:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54540 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 60.632516] nix-grpc-daemon[779]: ts=2026-09-20T12:47:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54540 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 60.639032] nix-daemon[848]: reaped child process 927, status = succeeded client # [ 60.662026] systemd[1]: dedup1.service: Deactivated successfully. client # [ 60.674594] systemd[1]: dedup1.service: Consumed 170ms CPU time over 6.293s wall clock time, 37.1M memory peak, 8.3K incoming IP traffic, 8.7K outgoing IP traffic. client # [ 60.712289] systemd[1]: dedup2.service: Deactivated successfully. client # [ 60.714775] systemd[1]: dedup2.service: Consumed 194ms CPU time over 5.212s wall clock time, 33M memory peak, 7.5K incoming IP traffic, 6.4K outgoing IP traffic. lb # [ 61.032732] envoy[913]: conn peer=[2001:db8:1::1]:57342 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1701 ms=2087 lb # [ 61.035265] envoy[913]: conn peer=[2001:db8:1::1]:57348 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1357 ms=5990 lb # [ 61.037653] envoy[913]: conn peer=[2001:db8:1::1]:57362 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1082 ms=4835 client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: two clients wanting the same drv build it once, in 7.49 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 62.027869] systemd[1]: Started Nix Daemon. client # [ 62.231925] nix-daemon[938]: accepted connection from pid 935, user root (trusted) worker1 # [ 62.417350] nix-grpc-daemon[777]: ts=2026-09-20T12:47:32Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 62.424137] nix-grpc-daemon[777]: ts=2026-09-20T12:47:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker2 # [ 62.481642] nix-grpc-daemon[779]: ts=2026-09-20T12:47:32Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 62.487304] nix-grpc-daemon[779]: ts=2026-09-20T12:47:32Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 62.494813] nix-grpc-daemon[777]: ts=2026-09-20T12:47:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 62.513795] nix-grpc-daemon[777]: ts=2026-09-20T12:47:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 62.533683] nix-grpc-daemon[777]: ts=2026-09-20T12:47:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 62.549970] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 62.768203] nix-daemon[835]: accepted connection from pid 1035, user nix-grpc-daemon (trusted) worker1 # [ 62.792332] nix-daemon[835]: reaped child process 1038, status = succeeded worker1 # [ 62.966480] nix-daemon[835]: accepted connection from pid 1040, user nix-grpc-daemon (trusted) worker1 # [ 62.986704] nix-daemon[835]: reaped child process 1043, status = succeeded lb # [ 62.985649] niks3-server[1051]: 2026/09/20 12:47:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 63.007837] nix-grpc-daemon[846]: time=2026-09-20T12:47:33.529Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 63.009737] nix-grpc-daemon[846]: time=2026-09-20T12:47:33.529Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 63.015279] niks3-server[1051]: 2026/09/20 12:47:33 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst worker1 # [ 63.037071] nix-grpc-daemon[846]: time=2026-09-20T12:47:33.558Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.024507] niks3-server[1051]: 2026/09/20 12:47:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 63.032821] niks3-server[1051]: 2026/09/20 12:47:33 INFO Signed narinfos id=11 count=1 lb # [ 63.038162] niks3-server[1051]: 2026/09/20 12:47:33 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 63.046124] niks3-server[1051]: 2026/09/20 12:47:33 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete worker1 # [ 63.065097] nix-grpc-daemon[846]: time=2026-09-20T12:47:33.587Z level=INFO msg="Upload complete. (497ms)" lb # [ 63.053393] niks3-server[1051]: 2026/09/20 12:47:33 INFO Completed upload id=11 lb # [ 63.055832] niks3-server[1051]: 2026/09/20 12:47:33 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker1 # [ 63.072199] nix-grpc-daemon[777]: ts=2026-09-20T12:47:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 63.080800] nix-grpc-daemon[777]: ts=2026-09-20T12:47:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 63.094489] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 63.097568] nix-daemon[835]: reaped child process 1033, status = succeeded worker1 # [ 63.111289] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 63.955612] nix-daemon[835]: reaped child process 1047, status = succeeded worker1 # [ 64.150618] nix-daemon[835]: accepted connection from pid 1062, user nix-grpc-daemon (trusted) worker1 # [ 64.174635] nix-daemon[835]: reaped child process 1065, status = succeeded lb # [ 64.174764] niks3-server[1051]: 2026/09/20 12:47:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 64.195885] nix-grpc-daemon[846]: time=2026-09-20T12:47:34.717Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 64.201696] nix-grpc-daemon[846]: time=2026-09-20T12:47:34.719Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 64.212779] niks3-server[1051]: 2026/09/20 12:47:34 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 64.230168] niks3-server[1051]: 2026/09/20 12:47:34 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 64.240776] niks3-server[1051]: 2026/09/20 12:47:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker1 # [ 64.259033] nix-grpc-daemon[846]: time=2026-09-20T12:47:34.780Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.249818] niks3-server[1051]: 2026/09/20 12:47:34 INFO Signed narinfos id=12 count=1 lb # [ 64.255277] niks3-server[1051]: 2026/09/20 12:47:34 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 64.267460] niks3-server[1051]: 2026/09/20 12:47:34 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete worker1 # [ 64.284944] nix-grpc-daemon[846]: time=2026-09-20T12:47:34.806Z level=INFO msg="Upload complete. (363ms)" lb # [ 64.273163] niks3-server[1051]: 2026/09/20 12:47:34 INFO Completed upload id=12 lb # [ 64.277120] niks3-server[1051]: 2026/09/20 12:47:34 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker1 # [ 64.292693] nix-grpc-daemon[777]: ts=2026-09-20T12:47:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker1 # [ 64.302356] nix-daemon[835]: reaped child process 1045, status = succeeded worker2 # [ 64.334473] nix-grpc-daemon[779]: ts=2026-09-20T12:47:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 64.352702] nix-grpc-daemon[779]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 64.371231] nix-grpc-daemon[777]: ts=2026-09-20T12:47:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 64.380150] nix-grpc-daemon[777]: ts=2026-09-20T12:47:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 64.623749] nix-grpc-daemon[777]: ts=2026-09-20T12:47:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 64.632079] nix-grpc-daemon[777]: ts=2026-09-20T12:47:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 64.639365] nix-grpc-daemon[846]: time=2026-09-20T12:47:35.159Z level=INFO msg="All 1 paths already cached" worker2 # [ 64.685637] nix-grpc-daemon[779]: ts=2026-09-20T12:47:35Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 64.693113] nix-grpc-daemon[779]: ts=2026-09-20T12:47:35Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 64.664452] nix-grpc-daemon[777]: ts=2026-09-20T12:47:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 64.680599] nix-grpc-daemon[777]: ts=2026-09-20T12:47:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 64.696383] nix-grpc-daemon[846]: time=2026-09-20T12:47:35.218Z level=INFO msg="All 1 paths already cached" worker1 # [ 64.706744] nix-grpc-daemon[777]: ts=2026-09-20T12:47:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 64.721936] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 64.943084] nix-daemon[835]: accepted connection from pid 1069, user nix-grpc-daemon (trusted) worker1 # [ 64.965621] nix-daemon[835]: reaped child process 1072, status = succeeded worker1 # [ 65.152644] nix-daemon[835]: accepted connection from pid 1074, user nix-grpc-daemon (trusted) worker1 # [ 65.172980] nix-daemon[835]: reaped child process 1077, status = succeeded lb # [ 65.171277] niks3-server[1051]: 2026/09/20 12:47:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 65.240547] nix-grpc-daemon[846]: time=2026-09-20T12:47:35.761Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 65.242592] nix-grpc-daemon[846]: time=2026-09-20T12:47:35.761Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 65.249212] niks3-server[1051]: 2026/09/20 12:47:35 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst lb # [ 65.260886] niks3-server[1051]: 2026/09/20 12:47:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 65.268121] niks3-server[1051]: 2026/09/20 12:47:35 INFO Signed narinfos id=13 count=1 worker1 # [ 65.279634] nix-grpc-daemon[846]: time=2026-09-20T12:47:35.801Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.275014] niks3-server[1051]: 2026/09/20 12:47:35 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 65.289035] niks3-server[1051]: 2026/09/20 12:47:35 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 65.296191] niks3-server[1051]: 2026/09/20 12:47:35 INFO Completed upload id=13 worker1 # [ 65.308119] nix-grpc-daemon[846]: time=2026-09-20T12:47:35.829Z level=INFO msg="Upload complete. (568ms)" lb # [ 65.299022] niks3-server[1051]: 2026/09/20 12:47:35 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker1 # [ 65.321752] nix-grpc-daemon[777]: ts=2026-09-20T12:47:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 65.336643] nix-grpc-daemon[777]: ts=2026-09-20T12:47:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 65.347632] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 65.355547] nix-daemon[835]: reaped child process 1067, status = succeeded worker1 # [ 65.373501] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 66.628213] nix-daemon[835]: reaped child process 1081, status = succeeded worker1 # [ 66.813307] nix-daemon[835]: accepted connection from pid 1096, user nix-grpc-daemon (trusted) worker1 # [ 66.834615] nix-daemon[835]: reaped child process 1099, status = succeeded lb # [ 66.835022] niks3-server[1051]: 2026/09/20 12:47:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 66.860073] nix-grpc-daemon[846]: time=2026-09-20T12:47:37.378Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 66.861624] nix-grpc-daemon[846]: time=2026-09-20T12:47:37.378Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 66.878837] niks3-server[1051]: 2026/09/20 12:47:37 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst worker1 # [ 66.903170] nix-grpc-daemon[846]: time=2026-09-20T12:47:37.424Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.892459] niks3-server[1051]: 2026/09/20 12:47:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 66.902427] niks3-server[1051]: 2026/09/20 12:47:37 INFO Signed narinfos id=14 count=1 lb # [ 66.909702] niks3-server[1051]: 2026/09/20 12:47:37 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 66.914761] niks3-server[1051]: 2026/09/20 12:47:37 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 66.923165] niks3-server[1051]: 2026/09/20 12:47:37 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete worker1 # [ 66.935487] nix-grpc-daemon[846]: time=2026-09-20T12:47:37.457Z level=INFO msg="Upload complete. (348ms)" lb # [ 66.926385] niks3-server[1051]: 2026/09/20 12:47:37 INFO Completed upload id=14 lb # [ 66.930218] niks3-server[1051]: 2026/09/20 12:47:37 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker1 # [ 66.949239] nix-grpc-daemon[777]: ts=2026-09-20T12:47:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker2 # [ 66.985907] nix-grpc-daemon[779]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:54540 worker1 # [ 66.964581] nix-daemon[835]: reaped child process 1079, status = succeeded worker2 # [ 67.000224] nix-grpc-daemon[779]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker1 # [ 67.011592] nix-grpc-daemon[777]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 67.018780] nix-grpc-daemon[777]: ts=2026-09-20T12:47:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 67.334003] nix-grpc-daemon[779]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:54540 worker1 # [ 67.305208] nix-grpc-daemon[777]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 67.316407] nix-grpc-daemon[846]: time=2026-09-20T12:47:37.838Z level=INFO msg="All 2 paths already cached" worker2 # [ 67.370510] nix-grpc-daemon[779]: ts=2026-09-20T12:47:37Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 67.376936] nix-grpc-daemon[779]: ts=2026-09-20T12:47:37Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 67.348627] nix-grpc-daemon[777]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 67.366343] nix-grpc-daemon[777]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 67.383392] nix-grpc-daemon[846]: time=2026-09-20T12:47:37.905Z level=INFO msg="All 2 paths already cached" worker1 # [ 67.394321] nix-grpc-daemon[777]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 67.409510] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 67.625396] nix-daemon[835]: accepted connection from pid 1103, user nix-grpc-daemon (trusted) worker1 # [ 67.651268] nix-daemon[835]: reaped child process 1106, status = succeeded worker1 # [ 67.840635] nix-daemon[835]: accepted connection from pid 1108, user nix-grpc-daemon (trusted) worker1 # [ 67.861454] nix-daemon[835]: reaped child process 1111, status = succeeded lb # [ 67.860718] niks3-server[1051]: 2026/09/20 12:47:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 68.008534] nix-grpc-daemon[846]: time=2026-09-20T12:47:38.528Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 68.013120] nix-grpc-daemon[846]: time=2026-09-20T12:47:38.528Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 68.020764] niks3-server[1051]: 2026/09/20 12:47:38 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst lb # [ 68.031617] niks3-server[1051]: 2026/09/20 12:47:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker1 # [ 68.051362] nix-grpc-daemon[846]: time=2026-09-20T12:47:38.572Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.042511] niks3-server[1051]: 2026/09/20 12:47:38 INFO Signed narinfos id=15 count=1 lb # [ 68.050744] niks3-server[1051]: 2026/09/20 12:47:38 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 68.062969] niks3-server[1051]: 2026/09/20 12:47:38 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 68.072652] niks3-server[1051]: 2026/09/20 12:47:38 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo lb # [ 68.077997] niks3-server[1051]: 2026/09/20 12:47:38 INFO Completed upload id=15 worker1 # [ 68.090208] nix-grpc-daemon[846]: time=2026-09-20T12:47:38.612Z level=INFO msg="Upload complete. (663ms)" worker1 # [ 68.102698] nix-grpc-daemon[777]: ts=2026-09-20T12:47:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 68.120928] nix-grpc-daemon[777]: ts=2026-09-20T12:47:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 68.131854] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 68.144371] nix-daemon[835]: reaped child process 1101, status = succeeded worker1 # [ 68.158549] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 69.605960] nix-daemon[835]: reaped child process 1115, status = succeeded worker1 # [ 69.782310] nix-daemon[835]: accepted connection from pid 1130, user nix-grpc-daemon (trusted) worker1 # [ 69.802899] nix-daemon[835]: reaped child process 1133, status = succeeded lb # [ 69.807623] niks3-server[1051]: 2026/09/20 12:47:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 69.832521] nix-grpc-daemon[846]: time=2026-09-20T12:47:40.352Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 69.834196] nix-grpc-daemon[846]: time=2026-09-20T12:47:40.352Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 69.855876] niks3-server[1051]: 2026/09/20 12:47:40 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 69.869438] niks3-server[1051]: 2026/09/20 12:47:40 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 69.879370] niks3-server[1051]: 2026/09/20 12:47:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker1 # [ 69.898257] nix-grpc-daemon[846]: time=2026-09-20T12:47:40.419Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.885517] niks3-server[1051]: 2026/09/20 12:47:40 INFO Signed narinfos id=16 count=1 lb # [ 69.892232] niks3-server[1051]: 2026/09/20 12:47:40 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 69.902263] niks3-server[1051]: 2026/09/20 12:47:40 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 69.911878] niks3-server[1051]: 2026/09/20 12:47:40 INFO Completed upload id=16 worker1 # [ 69.924548] nix-grpc-daemon[846]: time=2026-09-20T12:47:40.446Z level=INFO msg="Upload complete. (351ms)" lb # [ 69.915256] niks3-server[1051]: 2026/09/20 12:47:40 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 69.937316] nix-grpc-daemon[777]: ts=2026-09-20T12:47:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker1 # [ 69.958609] nix-grpc-daemon[777]: ts=2026-09-20T12:47:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 69.964684] nix-daemon[835]: reaped child process 1113, status = succeeded worker1 # [ 69.977839] nix-grpc-daemon[777]: ts=2026-09-20T12:47:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 69.984502] nix-grpc-daemon[777]: ts=2026-09-20T12:47:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=0 paths=1 nar_bytes_out=232 client # [ 70.151041] nix-daemon[938]: reaped child process 940, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.38 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.51 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.48 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure lb # [ 71.029680] envoy[913]: conn peer=[2001:db8:1::1]:33120 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3448 tx=1792 ms=1983 lb # [ 71.034934] envoy[913]: conn peer=[2001:db8:1::1]:33128 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=334 ms=33 lb # [ 71.039706] envoy[913]: conn peer=[2001:db8:1::1]:33150 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=28 lb # [ 71.044746] envoy[913]: conn peer=[2001:db8:1::1]:33138 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3901 tx=1965 ms=2414 lb # [ 71.050793] envoy[913]: conn peer=[2001:db8:1::1]:33152 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4352 tx=2110 ms=2743 lb # [ 71.055689] envoy[913]: conn peer=[2001:db8:1::1]:33158 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=71 worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 71.520902] nix-daemon[938]: accepted connection from pid 1018, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker1 # [ 71.699830] nix-grpc-daemon[777]: ts=2026-09-20T12:47:42Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53786 client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 71.708088] nix-grpc-daemon[777]: ts=2026-09-20T12:47:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 71.913383] nix-daemon[835]: accepted connection from pid 1140, user nix-grpc-daemon (trusted) worker1 # [ 71.933144] nix-daemon[835]: reaped child process 1143, status = succeeded lb # [ 71.932940] niks3-server[1051]: 2026/09/20 12:47:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 71.955634] nix-grpc-daemon[846]: time=2026-09-20T12:47:42.476Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 71.957426] nix-grpc-daemon[846]: time=2026-09-20T12:47:42.476Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 71.962503] niks3-server[1051]: 2026/09/20 12:47:42 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 71.977664] niks3-server[1051]: 2026/09/20 12:47:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 71.995526] nix-grpc-daemon[846]: time=2026-09-20T12:47:42.517Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.985766] niks3-server[1051]: 2026/09/20 12:47:42 INFO Signed narinfos id=17 count=1 lb # [ 71.993762] niks3-server[1051]: 2026/09/20 12:47:42 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 72.002689] niks3-server[1051]: 2026/09/20 12:47:42 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete worker1 # [ 72.020179] nix-grpc-daemon[846]: time=2026-09-20T12:47:42.542Z level=INFO msg="Upload complete. (313ms)" lb # [ 72.009797] niks3-server[1051]: 2026/09/20 12:47:42 INFO Completed upload id=17 lb # [ 72.013161] niks3-server[1051]: 2026/09/20 12:47:42 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker2 # [ 72.079590] nix-grpc-daemon[779]: ts=2026-09-20T12:47:42Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 72.085685] nix-grpc-daemon[779]: ts=2026-09-20T12:47:42Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 72.123324] nix-grpc-daemon[779]: ts=2026-09-20T12:47:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 72.139922] nix-grpc-daemon[779]: ts=2026-09-20T12:47:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54540 client # copying 2 paths to 'lb:50051'... worker2 # [ 72.160222] nix-grpc-daemon[779]: ts=2026-09-20T12:47:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54540 client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 72.171167] nix-daemon[848]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 72.358876] nix-daemon[848]: accepted connection from pid 989, user nix-grpc-daemon (trusted) worker2 # [ 72.380666] nix-daemon[848]: reaped child process 992, status = succeeded worker2 # [ 72.558805] nix-daemon[848]: accepted connection from pid 994, user nix-grpc-daemon (trusted) worker2 # [ 72.577788] nix-daemon[848]: reaped child process 997, status = succeeded lb # [ 72.543637] niks3-server[1051]: 2026/09/20 12:47:43 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 72.553928] niks3-server[1051]: 2026/09/20 12:47:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 72.609271] nix-grpc-daemon[900]: time=2026-09-20T12:47:43.122Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 72.610799] nix-grpc-daemon[900]: time=2026-09-20T12:47:43.122Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker2 # [ 72.612586] nix-grpc-daemon[900]: time=2026-09-20T12:47:43.122Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 72.586989] niks3-server[1051]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 72.605994] niks3-server[1051]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 72.617093] niks3-server[1051]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 72.625140] niks3-server[1051]: 2026/09/20 12:47:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 72.629908] niks3-server[1051]: 2026/09/20 12:47:43 INFO Signed narinfos id=18 count=1 lb # [ 72.633288] niks3-server[1051]: 2026/09/20 12:47:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign worker2 # [ 72.680334] nix-grpc-daemon[900]: time=2026-09-20T12:47:43.192Z level=INFO msg="Uploading 3 narinfos" lb # [ 72.637222] niks3-server[1051]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 72.639912] niks3-server[1051]: 2026/09/20 12:47:43 INFO Signed narinfos id=19 count=2 lb # [ 72.665225] niks3-server[1051]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 72.675442] niks3-server[1051]: 2026/09/20 12:47:43 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 72.678599] niks3-server[1051]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 72.683545] niks3-server[1051]: 2026/09/20 12:47:43 INFO Completed upload id=19 lb # [ 72.685782] niks3-server[1051]: 2026/09/20 12:47:43 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete worker2 # [ 72.731040] nix-grpc-daemon[900]: time=2026-09-20T12:47:43.244Z level=INFO msg="Upload complete. (548ms)" lb # [ 72.688476] niks3-server[1051]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 72.691097] niks3-server[1051]: 2026/09/20 12:47:43 INFO Completed upload id=18 worker2 # [ 72.742950] nix-grpc-daemon[779]: ts=2026-09-20T12:47:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54540 duration_s=0 paths=2 nar_bytes_in=984 worker2 # [ 72.760789] nix-grpc-daemon[779]: ts=2026-09-20T12:47:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 72.770280] nix-daemon[848]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 72.778166] nix-daemon[848]: reaped child process 987, status = succeeded worker2 # [ 72.795951] nix-grpc-daemon[779]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 72.818937] nix-daemon[848]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 74.265234] nix-daemon[848]: reaped child process 1002, status = succeeded worker2 # [ 74.455602] nix-daemon[848]: accepted connection from pid 1017, user nix-grpc-daemon (trusted) worker2 # [ 74.473289] nix-daemon[848]: reaped child process 1020, status = succeeded lb # [ 74.446130] niks3-server[1051]: 2026/09/20 12:47:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 74.500197] nix-grpc-daemon[900]: time=2026-09-20T12:47:45.012Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 74.478462] niks3-server[1051]: 2026/09/20 12:47:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker2 # [ 74.534269] nix-grpc-daemon[900]: time=2026-09-20T12:47:45.047Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.495895] niks3-server[1051]: 2026/09/20 12:47:45 INFO Signed narinfos id=20 count=1 lb # [ 74.502647] niks3-server[1051]: 2026/09/20 12:47:45 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 74.508770] niks3-server[1051]: 2026/09/20 12:47:45 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 74.522443] niks3-server[1051]: 2026/09/20 12:47:45 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 74.526144] niks3-server[1051]: 2026/09/20 12:47:45 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo lb # [ 74.530253] niks3-server[1051]: 2026/09/20 12:47:45 INFO Completed upload id=20 worker2 # [ 74.575459] nix-grpc-daemon[900]: time=2026-09-20T12:47:45.089Z level=INFO msg="Upload complete. (338ms)" worker2 # [ 74.589291] nix-grpc-daemon[779]: ts=2026-09-20T12:47:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54540 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker2 # [ 74.605301] nix-daemon[848]: reaped child process 999, status = succeeded client # copying 1 paths... worker1 # [ 74.599244] nix-grpc-daemon[777]: ts=2026-09-20T12:47:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 74.616473] nix-grpc-daemon[777]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 74.701225] nix-grpc-daemon[779]: ts=2026-09-20T12:47:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 74.709394] nix-grpc-daemon[779]: ts=2026-09-20T12:47:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:54540 duration_s=0 paths=1 nar_bytes_out=120 client # [ 74.839654] nix-daemon[938]: reaped child process 1021, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.57 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 75.063593] nix-daemon[938]: accepted connection from pid 1039, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 75.267687] nix-grpc-daemon[779]: ts=2026-09-20T12:47:45Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:54540 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 75.238646] nix-grpc-daemon[777]: ts=2026-09-20T12:47:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 75.250999] nix-grpc-daemon[846]: time=2026-09-20T12:47:45.772Z level=INFO msg="All 1 paths already cached" worker2 # [ 75.304279] nix-grpc-daemon[779]: ts=2026-09-20T12:47:45Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 75.311197] nix-grpc-daemon[779]: ts=2026-09-20T12:47:45Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 75.281700] nix-grpc-daemon[777]: ts=2026-09-20T12:47:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 75.297831] nix-grpc-daemon[777]: ts=2026-09-20T12:47:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53786 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 75.320528] nix-grpc-daemon[777]: ts=2026-09-20T12:47:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 75.335603] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 75.358414] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5) worker1 # [ 75.425342] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 2/5) worker1 # [ 75.501198] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 212 ms (attempt 3/5) worker1 # [ 75.714626] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 4/5) worker1 # [ 75.766425] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 75.776784] nix-grpc-daemon[777]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 76.016831] nix-daemon[835]: accepted connection from pid 1152, user nix-grpc-daemon (trusted) worker1 # [ 76.036488] nix-daemon[835]: reaped child process 1155, status = succeeded worker1 # [ 76.214325] nix-daemon[835]: accepted connection from pid 1157, user nix-grpc-daemon (trusted) worker1 # [ 76.232783] nix-daemon[835]: reaped child process 1160, status = succeeded lb # [ 76.233055] niks3-server[1051]: 2026/09/20 12:47:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.258515] nix-grpc-daemon[846]: time=2026-09-20T12:47:46.779Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 76.260103] nix-grpc-daemon[846]: time=2026-09-20T12:47:46.779Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 76.268767] niks3-server[1051]: 2026/09/20 12:47:46 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst worker1 # [ 76.292569] nix-grpc-daemon[846]: time=2026-09-20T12:47:46.814Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.283396] niks3-server[1051]: 2026/09/20 12:47:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 76.294032] niks3-server[1051]: 2026/09/20 12:47:46 INFO Signed narinfos id=21 count=1 worker1 # [ 76.318653] nix-grpc-daemon[846]: time=2026-09-20T12:47:46.840Z level=INFO msg="Upload complete. (509ms)" lb # [ 76.307012] niks3-server[1051]: 2026/09/20 12:47:46 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 76.312986] niks3-server[1051]: 2026/09/20 12:47:46 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete worker1 # [ 76.328282] nix-grpc-daemon[777]: ts=2026-09-20T12:47:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=1 paths=1 nar_bytes_in=568 lb # [ 76.318591] niks3-server[1051]: 2026/09/20 12:47:46 INFO Completed upload id=21 lb # [ 76.321483] niks3-server[1051]: 2026/09/20 12:47:46 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker1 # [ 76.334687] nix-grpc-daemon[777]: ts=2026-09-20T12:47:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 76.347491] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 76.353806] nix-daemon[835]: reaped child process 1146, status = succeeded client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 76.367184] nix-daemon[835]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 77.792336] nix-daemon[835]: reaped child process 1164, status = succeeded worker1 # [ 77.957892] nix-daemon[835]: accepted connection from pid 1179, user nix-grpc-daemon (trusted) worker1 # [ 77.979766] nix-daemon[835]: reaped child process 1182, status = succeeded lb # [ 77.981260] niks3-server[1051]: 2026/09/20 12:47:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.004471] nix-grpc-daemon[846]: time=2026-09-20T12:47:48.525Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 78.029975] niks3-server[1051]: 2026/09/20 12:47:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker1 # [ 78.054968] nix-grpc-daemon[846]: time=2026-09-20T12:47:48.576Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.046927] niks3-server[1051]: 2026/09/20 12:47:48 INFO Signed narinfos id=22 count=1 lb # [ 78.056389] niks3-server[1051]: 2026/09/20 12:47:48 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 78.062193] niks3-server[1051]: 2026/09/20 12:47:48 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 78.081359] nix-grpc-daemon[846]: time=2026-09-20T12:47:48.603Z level=INFO msg="Upload complete. (304ms)" lb # [ 78.070227] niks3-server[1051]: 2026/09/20 12:47:48 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 78.073199] niks3-server[1051]: 2026/09/20 12:47:48 INFO Completed upload id=22 lb # [ 78.076548] niks3-server[1051]: 2026/09/20 12:47:48 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo client # copying 1 paths... worker1 # [ 78.093202] nix-grpc-daemon[777]: ts=2026-09-20T12:47:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker1 # [ 78.109594] nix-grpc-daemon[777]: ts=2026-09-20T12:47:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53786 client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 78.114260] nix-daemon[835]: reaped child process 1162, status = succeeded worker1 # [ 78.139440] nix-grpc-daemon[777]: ts=2026-09-20T12:47:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 78.145167] nix-grpc-daemon[777]: ts=2026-09-20T12:47:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=0 paths=1 nar_bytes_out=120 client # [ 78.309389] nix-daemon[938]: reaped child process 1042, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.47 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 78.528133] nix-daemon[938]: accepted connection from pid 1060, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 78.734438] nix-grpc-daemon[779]: ts=2026-09-20T12:47:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:54540 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 78.742617] nix-grpc-daemon[779]: ts=2026-09-20T12:47:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 78.754003] nix-grpc-daemon[900]: time=2026-09-20T12:47:49.266Z level=INFO msg="All 1 paths already cached" worker2 # [ 78.769766] nix-grpc-daemon[779]: ts=2026-09-20T12:47:49Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 78.777645] nix-grpc-daemon[779]: ts=2026-09-20T12:47:49Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 78.786873] nix-grpc-daemon[779]: ts=2026-09-20T12:47:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 78.798744] nix-grpc-daemon[779]: ts=2026-09-20T12:47:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 78.813535] nix-grpc-daemon[900]: time=2026-09-20T12:47:49.327Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 78.824113] nix-grpc-daemon[779]: ts=2026-09-20T12:47:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 78.839037] nix-daemon[848]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 79.048655] nix-daemon[848]: accepted connection from pid 1028, user nix-grpc-daemon (trusted) worker2 # [ 79.070025] nix-daemon[848]: reaped child process 1031, status = succeeded worker2 # [ 79.245321] nix-daemon[848]: accepted connection from pid 1033, user nix-grpc-daemon (trusted) worker2 # [ 79.265109] nix-daemon[848]: reaped child process 1036, status = succeeded lb # [ 79.235221] niks3-server[1051]: 2026/09/20 12:47:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 79.290095] nix-grpc-daemon[900]: time=2026-09-20T12:47:49.803Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 79.291655] nix-grpc-daemon[900]: time=2026-09-20T12:47:49.803Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 79.267267] niks3-server[1051]: 2026/09/20 12:47:49 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst worker2 # [ 79.325823] nix-grpc-daemon[900]: time=2026-09-20T12:47:49.839Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.280565] niks3-server[1051]: 2026/09/20 12:47:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 79.293025] niks3-server[1051]: 2026/09/20 12:47:49 INFO Signed narinfos id=23 count=1 lb # [ 79.297140] niks3-server[1051]: 2026/09/20 12:47:49 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 79.306206] niks3-server[1051]: 2026/09/20 12:47:49 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete worker2 # [ 79.356384] nix-grpc-daemon[900]: time=2026-09-20T12:47:49.870Z level=INFO msg="Upload complete. (501ms)" lb # [ 79.311478] niks3-server[1051]: 2026/09/20 12:47:49 INFO Completed upload id=23 lb # [ 79.315485] niks3-server[1051]: 2026/09/20 12:47:49 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker2 # [ 79.364351] nix-grpc-daemon[779]: ts=2026-09-20T12:47:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54540 duration_s=0 paths=1 nar_bytes_in=568 worker2 # [ 79.372991] nix-grpc-daemon[779]: ts=2026-09-20T12:47:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54540 worker2 # [ 79.384210] nix-daemon[848]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 79.387799] nix-daemon[848]: reaped child process 1026, status = succeeded worker2 # [ 79.398829] nix-daemon[848]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 80.846930] nix-daemon[848]: reaped child process 1040, status = succeeded worker2 # [ 81.023501] nix-daemon[848]: accepted connection from pid 1055, user nix-grpc-daemon (trusted) worker2 # [ 81.044897] nix-daemon[848]: reaped child process 1058, status = succeeded lb # [ 81.013924] niks3-server[1051]: 2026/09/20 12:47:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 81.067336] nix-grpc-daemon[900]: time=2026-09-20T12:47:51.580Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 81.031944] envoy[913]: conn peer=[2001:db8:1::1]:54066 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3865 tx=1877 ms=3037 lb # [ 81.042775] envoy[913]: conn peer=[2001:db8:1::1]:54072 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=74 lb # [ 81.055385] envoy[913]: conn peer=[2001:db8:1::1]:54080 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3713 tx=1805 ms=2971 worker2 # [ 81.114062] nix-grpc-daemon[900]: time=2026-09-20T12:47:51.627Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.070591] envoy[913]: conn peer=[2001:db8:1::1]:54082 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=71 lb # [ 81.080561] niks3-server[1051]: 2026/09/20 12:47:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 81.083865] niks3-server[1051]: 2026/09/20 12:47:51 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 81.089814] niks3-server[1051]: 2026/09/20 12:47:51 INFO Signed narinfos id=24 count=1 lb # [ 81.095788] niks3-server[1051]: 2026/09/20 12:47:51 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 81.100390] niks3-server[1051]: 2026/09/20 12:47:51 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete worker2 # [ 81.145473] nix-grpc-daemon[900]: time=2026-09-20T12:47:51.659Z level=INFO msg="Upload complete. (333ms)" lb # [ 81.103730] niks3-server[1051]: 2026/09/20 12:47:51 INFO Completed upload id=24 lb # [ 81.105579] niks3-server[1051]: 2026/09/20 12:47:51 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker2 # [ 81.157387] nix-grpc-daemon[779]: ts=2026-09-20T12:47:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54540 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker2 # [ 81.177801] nix-daemon[848]: reaped child process 1038, status = succeeded client # copying 1 paths... worker1 # [ 81.174931] nix-grpc-daemon[777]: ts=2026-09-20T12:47:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 81.189222] nix-grpc-daemon[777]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 81.239673] nix-grpc-daemon[777]: ts=2026-09-20T12:47:51Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53786 worker1 # [ 81.245732] nix-grpc-daemon[777]: ts=2026-09-20T12:47:51Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53786 duration_s=0 paths=1 nar_bytes_out=120 client # [ 81.401765] nix-daemon[938]: reaped child process 1063, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.09 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 11.11 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.45 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds) worker2 # [ 82.871305] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 83.566270] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=signal_exit worker2 # [ 83.765175] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=scheduler_yield worker2 # [ 83.775717] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 83.731285] niks3-server[1051]: 2026/09/20 12:47:54 INFO lead: released remote=192.168.1.4:38562 worker1 # [ 83.747092] nix-grpc-daemon[777]: ts=2026-09-20T12:47:54Z level=info event=scheduler_take_over worker2 # [ 83.781897] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:54536 worker1 # [ 83.752743] nix-grpc-daemon[777]: ts=2026-09-20T12:47:54Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 83.789039] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 83.793334] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:54536 worker2 # [ 83.797981] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 83.977598] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.983370] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.954181] nix-grpc-daemon[777]: ts=2026-09-20T12:47:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.959857] nix-grpc-daemon[777]: ts=2026-09-20T12:47:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.184720] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.190423] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.160842] nix-grpc-daemon[777]: ts=2026-09-20T12:47:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.166523] nix-grpc-daemon[777]: ts=2026-09-20T12:47:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.391894] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.397589] nix-grpc-daemon[779]: ts=2026-09-20T12:47:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.367260] nix-grpc-daemon[777]: ts=2026-09-20T12:47:54Z level=info event=scheduler_connected addr=lb:50051 lb # [ 83.738163] niks3-server[1051]: 2026/09/20 12:47:54 INFO lead: acquired remote=192.168.1.3:57922 worker1 # [ 84.372929] nix-grpc-daemon[777]: ts=2026-09-20T12:47:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.600989] nix-grpc-daemon[779]: ts=2026-09-20T12:47:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.605448] nix-grpc-daemon[779]: ts=2026-09-20T12:47:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.574108] nix-grpc-daemon[777]: ts=2026-09-20T12:47:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.580544] nix-grpc-daemon[777]: ts=2026-09-20T12:47:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.770361] nix-grpc-daemon[779]: ts=2026-09-20T12:47:55Z level=info event=scheduler_restarting worker1 # [ 84.783418] nix-grpc-daemon[777]: ts=2026-09-20T12:47:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.787838] nix-grpc-daemon[777]: ts=2026-09-20T12:47:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.827757] nix-grpc-daemon[779]: ts=2026-09-20T12:47:55Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 84.833921] nix-daemon[848]: reaped child process 850, status = succeeded worker1 # [ 84.984110] nix-grpc-daemon[777]: ts=2026-09-20T12:47:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.989463] nix-grpc-daemon[777]: ts=2026-09-20T12:47:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.190311] nix-grpc-daemon[777]: ts=2026-09-20T12:47:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.195763] nix-grpc-daemon[777]: ts=2026-09-20T12:47:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.396850] nix-grpc-daemon[777]: ts=2026-09-20T12:47:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.403137] nix-grpc-daemon[777]: ts=2026-09-20T12:47:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.603613] nix-grpc-daemon[777]: ts=2026-09-20T12:47:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.624738] nix-grpc-daemon[777]: ts=2026-09-20T12:47:56Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:40144 worker1 # [ 85.630121] nix-grpc-daemon[777]: ts=2026-09-20T12:47:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 85.714485] nix-grpc-daemon[779]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 85.719311] nix-grpc-daemon[779]: E0000 00:00:1789908476.226544 822 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 85.726227] nix-grpc-daemon[779]: E0000 00:00:1789908476.226871 822 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 85.853112] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 85.860958] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 85.863220] systemd[1]: nix-grpc-daemon.service: Consumed 2.023s CPU time over 1min 4.610s wall clock time, 51.7M memory peak, 56.5K incoming IP traffic, 148.4K outgoing IP traffic. worker2 # [ 85.880684] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 85.883621] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 85.886811] systemd[1]: nix-grpc-daemon.socket: Consumed 644us CPU time over 1min 14.868s wall clock time, 256K memory peak, 76.5K incoming IP traffic, 61.2K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 86.204891] nix-grpc-daemon[777]: ts=2026-09-20T12:47:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53786 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker1 # [ 86.212778] nix-grpc-daemon[777]: ts=2026-09-20T12:47:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53786 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.30 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 86.394875] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 86.447486] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 86.844450] systemd[1]: Starting scheduler-token.service... worker2 # [ 86.958962] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 86.964357] systemd[1]: Finished scheduler-token.service. worker2 # [ 86.966100] systemd[1]: scheduler-token.service: Consumed 57ms CPU time over 118ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 86.976546] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 87.170795] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:57Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 87.173454] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:57Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 87.177843] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:57Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 87.186931] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:57Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 87.198449] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 87.218155] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.188561] nix-grpc-daemon[777]: ts=2026-09-20T12:47:57Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:40144 worker1 # [ 87.194585] nix-grpc-daemon[777]: ts=2026-09-20T12:47:57Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 87.404382] nix-grpc-daemon[777]: ts=2026-09-20T12:47:57Z level=info event=signal_exit worker1 # [ 87.669160] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=scheduler_yield lb # [ 87.663903] niks3-server[1051]: 2026/09/20 12:47:58 INFO lead: released remote=192.168.1.3:57922 worker2 # [ 87.708974] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:58Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 87.677470] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:40144 worker1 # [ 87.686615] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 87.691659] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 87.696164] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:40144 worker1 # [ 87.700737] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 87.910771] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.916778] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.885625] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.891359] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.118275] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.123976] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.092411] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.098118] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.327432] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.298865] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.331977] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.304515] nix-grpc-daemon[777]: ts=2026-09-20T12:47:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.529065] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.534796] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.507387] nix-grpc-daemon[777]: ts=2026-09-20T12:47:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.513328] nix-grpc-daemon[777]: ts=2026-09-20T12:47:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.675101] nix-grpc-daemon[777]: ts=2026-09-20T12:47:59Z level=info event=scheduler_restarting worker2 # [ 88.736258] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.741988] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.734057] nix-daemon[835]: reaped child process 838, status = succeeded worker1 # [ 88.736936] nix-grpc-daemon[777]: ts=2026-09-20T12:47:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 88.943484] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.949406] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.150816] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.156378] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.359568] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.364114] nix-grpc-daemon[1082]: ts=2026-09-20T12:47:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.517124] nix-grpc-daemon[777]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 89.521832] nix-grpc-daemon[777]: E0000 00:00:1789908480.037417 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 89.561106] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.566754] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.585338] nix-grpc-daemon[777]: E0000 00:00:1789908480.107107 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 89.768196] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.773880] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.745212] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 89.755983] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 89.759911] systemd[1]: nix-grpc-daemon.service: Consumed 4.136s CPU time over 1min 8.715s wall clock time, 59.4M memory peak, 88.3K incoming IP traffic, 161.4K outgoing IP traffic. worker1 # [ 89.779369] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 89.781817] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 89.785706] systemd[1]: nix-grpc-daemon.socket: Consumed 656us CPU time over 1min 17.753s wall clock time, 256K memory peak, 87K incoming IP traffic, 72.8K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 89.975364] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.981164] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.180284] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60716 worker2 # [ 90.195290] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.206530] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.221513] nix-daemon[848]: accepted connection from pid 1082, user nix-grpc-daemon (trusted) worker2 # [ 90.239954] nix-grpc-daemon[1082]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 1/5) worker2 # [ 90.302545] nix-grpc-daemon[1082]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 2/5) worker2 # [ 90.394329] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.398899] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.466435] nix-grpc-daemon[1082]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 154 ms (attempt 3/5) worker2 # [ 90.595611] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.602031] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.628527] nix-grpc-daemon[1082]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 533 ms (attempt 4/5) worker2 # [ 90.802825] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.808888] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.010082] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.015586] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 91.028726] envoy[913]: conn peer=[2001:db8:1::1]:54096 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3727 tx=1894 ms=2597 lb # [ 91.029021] envoy[913]: conn peer=[2001:db8:1::1]:33374 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=64 lb # [ 91.029136] envoy[913]: conn peer=[2001:db8:1::4]:57422 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=53533 tx=2754 ms=63250 lb # [ 91.029371] envoy[913]: conn peer=[2001:db8:1::1]:33380 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=25 lb # [ 91.029497] envoy[913]: conn peer=192.168.1.3:53646 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=11693 tx=3242 ms=66154 worker2 # [ 91.170344] nix-grpc-daemon[1082]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 91.202193] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60716 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 91.217234] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.232733] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.247533] nix-daemon[848]: accepted connection from pid 1082, user nix-grpc-daemon (trusted) worker2 # [ 91.268711] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=info event=niks3_push_started pid=1138 worker2 # [ 91.424956] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.444282] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.494774] nix-grpc-daemon[1138]: time=2026-09-20T12:48:02.007Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 91.629934] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.632562] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.681584] nix-daemon[848]: accepted connection from pid 1151, user nix-grpc-daemon (trusted) worker2 # [ 91.703144] nix-daemon[848]: reaped child process 1154, status = succeeded lb # [ 91.672760] niks3-server[1051]: 2026/09/20 12:48:02 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 91.682376] niks3-server[1051]: 2026/09/20 12:48:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 91.739082] nix-grpc-daemon[1138]: time=2026-09-20T12:48:02.250Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 91.741805] nix-grpc-daemon[1138]: time=2026-09-20T12:48:02.250Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 91.743628] nix-grpc-daemon[1138]: time=2026-09-20T12:48:02.250Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 91.750832] niks3-server[1051]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 91.767222] niks3-server[1051]: 2026/09/20 12:48:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 91.780342] niks3-server[1051]: 2026/09/20 12:48:02 INFO Signed narinfos id=26 count=2 worker2 # [ 91.824467] nix-grpc-daemon[1138]: time=2026-09-20T12:48:02.336Z level=INFO msg="Uploading 3 narinfos" lb # [ 91.786687] niks3-server[1051]: 2026/09/20 12:48:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign worker2 # [ 91.835538] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=scheduler_connected addr=lb:50051 lb # [ 91.795942] niks3-server[1051]: 2026/09/20 12:48:02 INFO Signed narinfos id=25 count=1 worker2 # [ 91.841779] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 91.800958] niks3-server[1051]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 91.811507] niks3-server[1051]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 91.819478] niks3-server[1051]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 91.824977] niks3-server[1051]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 91.827847] niks3-server[1051]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 91.836233] niks3-server[1051]: 2026/09/20 12:48:02 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 91.843028] niks3-server[1051]: 2026/09/20 12:48:02 INFO Completed upload id=25 lb # [ 91.845591] niks3-server[1051]: 2026/09/20 12:48:02 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 91.847930] niks3-server[1051]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 91.851283] niks3-server[1051]: 2026/09/20 12:48:02 INFO Completed upload id=26 worker2 # [ 91.896629] nix-grpc-daemon[1138]: time=2026-09-20T12:48:02.410Z level=INFO msg="Upload complete. (397ms)" worker2 # [ 91.908753] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60716 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 91.926634] nix-daemon[848]: reaped child process 1136, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 2.04 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds) worker2 # [ 92.042511] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.048271] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.051446] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 92.062635] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 92.155358] niks3-server[1051]: 2026/09/20 12:48:02 INFO lead: acquired remote=192.168.1.4:50746 worker2 # [ 92.205340] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=scheduler_take_over worker2 # [ 92.249306] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.268162] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 92.273794] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:34944 worker2 # [ 92.279299] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 92.266409] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:02Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 92.269005] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 92.273332] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 92.281739] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 92.283486] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 92.312165] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.348202] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:34944 worker2 # [ 92.353309] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:02Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 12.08 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 93.775091] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 94.193189] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:04Z level=info event=signal_exit worker2 # [ 94.409168] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:04Z level=info event=scheduler_yield lb # [ 94.373463] niks3-server[1051]: 2026/09/20 12:48:04 INFO lead: released remote=192.168.1.4:50746 worker1 # [ 94.389694] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:04Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 94.426762] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34944 worker2 # [ 94.433839] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:04Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 94.438139] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:04Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 94.442449] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34944 worker2 # [ 94.447087] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:04Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 94.589961] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.628399] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.595906] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.634018] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 94.796698] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.802156] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.835681] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.841375] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 95.003433] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.042319] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 95.009262] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.047964] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 95.210223] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 95.216153] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.251407] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.255976] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.415033] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:05Z level=info event=scheduler_restarting worker1 # [ 95.419195] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 95.423871] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 95.449675] nix-daemon[848]: reaped child process 1131, status = succeeded worker2 # [ 95.473735] nix-grpc-daemon[1082]: ts=2026-09-20T12:48:05Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 95.620103] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 95.625836] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 95.826923] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 95.832776] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 96.033731] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 96.039491] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 96.237232] nix-grpc-daemon[1082]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 96.242260] nix-grpc-daemon[1082]: E0000 00:00:1789908486.750671 1125 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 96.251120] nix-grpc-daemon[1082]: E0000 00:00:1789908486.763147 1125 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 96.240618] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 96.246355] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 96.449138] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 96.454183] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 96.655208] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 96.661090] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 96.862526] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 96.868349] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 97.069284] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 97.074910] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 97.236812] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 97.240844] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 97.243403] systemd[1]: nix-grpc-daemon.service: Consumed 531ms CPU time over 10.255s wall clock time, 30.8M memory peak, 23.7K incoming IP traffic, 48.4K outgoing IP traffic. worker2 # [ 97.260504] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 97.262717] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 97.267646] systemd[1]: nix-grpc-daemon.socket: Consumed 964us CPU time over 10.877s wall clock time, 256K memory peak, 20.7K incoming IP traffic, 15.4K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 97.275986] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 97.288242] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 97.283224] niks3-server[1051]: 2026/09/20 12:48:07 INFO lead: acquired remote=192.168.1.3:60210 worker1 # [ 97.296233] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:07Z level=info event=scheduler_take_over worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.12 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker1 # [ 97.486186] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 97.490961] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 97.692041] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 97.697700] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 97.898675] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 97.909285] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:08Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:48430 worker1 # [ 97.915033] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker1 # [ 98.757107] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 98.769270] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 98.790040] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 98.807652] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5) worker1 # [ 98.898557] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 181 ms (attempt 2/5) worker1 # [ 99.080245] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 321 ms (attempt 3/5) worker1 # [ 99.402175] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 440 ms (attempt 4/5) worker1 # [ 99.845343] nix-grpc-daemon[1206]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 99.882186] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:10Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 99.889643] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:10Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 99.929886] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 99.947093] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48442 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 99.963112] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 99.980262] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 100.009546] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:10Z level=info event=niks3_push_started pid=1276 worker1 # [ 100.230209] nix-grpc-daemon[1276]: time=2026-09-20T12:48:10.751Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 100.407862] nix-daemon[835]: accepted connection from pid 1289, user nix-grpc-daemon (trusted) worker1 # [ 100.426253] nix-daemon[835]: reaped child process 1292, status = succeeded worker1 # [ 100.604554] nix-daemon[835]: accepted connection from pid 1294, user nix-grpc-daemon (trusted) worker1 # [ 100.622269] nix-daemon[835]: reaped child process 1297, status = succeeded lb # [ 100.626120] niks3-server[1051]: 2026/09/20 12:48:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 100.653465] nix-grpc-daemon[1276]: time=2026-09-20T12:48:11.173Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 100.655427] nix-grpc-daemon[1276]: time=2026-09-20T12:48:11.174Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 100.680948] niks3-server[1051]: 2026/09/20 12:48:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 100.697191] niks3-server[1051]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst worker1 # [ 100.728149] nix-grpc-daemon[1276]: time=2026-09-20T12:48:11.249Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.715011] niks3-server[1051]: 2026/09/20 12:48:11 INFO Signed narinfos id=27 count=1 lb # [ 100.733878] niks3-server[1051]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 100.743553] niks3-server[1051]: 2026/09/20 12:48:11 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 100.748108] niks3-server[1051]: 2026/09/20 12:48:11 INFO Completed upload id=27 worker1 # [ 100.760508] nix-grpc-daemon[1276]: time=2026-09-20T12:48:11.282Z level=INFO msg="Upload complete. (526ms)" lb # [ 100.757397] niks3-server[1051]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker1 # [ 100.772649] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48442 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 100.792557] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 100.801393] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 100.807459] nix-daemon[835]: reaped child process 1274, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... worker1 # [ 100.820274] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 101.032401] envoy[913]: conn peer=[2001:db8:1::1]:33388 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1010 tx=305 ms=1743 lb # [ 101.037761] envoy[913]: conn peer=[2001:db8:1::4]:36834 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=20956 tx=1101 ms=8249 client # farm-a> LOG-farm-a-on-standby worker1 # [ 101.849174] nix-daemon[835]: reaped child process 1301, status = succeeded worker1 # [ 102.012517] nix-daemon[835]: accepted connection from pid 1316, user nix-grpc-daemon (trusted) worker1 # [ 102.033465] nix-daemon[835]: reaped child process 1319, status = succeeded lb # [ 102.033026] niks3-server[1051]: 2026/09/20 12:48:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 102.060450] nix-grpc-daemon[1276]: time=2026-09-20T12:48:12.580Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 102.061969] nix-grpc-daemon[1276]: time=2026-09-20T12:48:12.580Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 102.085212] niks3-server[1051]: 2026/09/20 12:48:12 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst worker1 # [ 102.113869] nix-grpc-daemon[1276]: time=2026-09-20T12:48:12.634Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.103007] niks3-server[1051]: 2026/09/20 12:48:12 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 102.111065] niks3-server[1051]: 2026/09/20 12:48:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 102.116691] niks3-server[1051]: 2026/09/20 12:48:12 INFO Signed narinfos id=28 count=1 lb # [ 102.124401] niks3-server[1051]: 2026/09/20 12:48:12 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 102.129386] niks3-server[1051]: 2026/09/20 12:48:12 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 102.132842] niks3-server[1051]: 2026/09/20 12:48:12 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker1 # [ 102.144970] nix-grpc-daemon[1276]: time=2026-09-20T12:48:12.666Z level=INFO msg="Upload complete. (310ms)" lb # [ 102.135537] niks3-server[1051]: 2026/09/20 12:48:12 INFO Completed upload id=28 worker1 # [ 102.168823] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 102.180316] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:12Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 102.183549] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:12Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 102.188484] nix-daemon[835]: reaped child process 1299, status = succeeded worker1 # [ 102.209402] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 102.224249] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 102.238960] nix-grpc-daemon[1276]: time=2026-09-20T12:48:12.760Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 102.249578] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 102.263952] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 102.470287] nix-daemon[835]: accepted connection from pid 1325, user nix-grpc-daemon (trusted) worker1 # [ 102.489500] nix-daemon[835]: reaped child process 1328, status = succeeded worker1 # [ 102.666495] nix-daemon[835]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 102.684963] nix-daemon[835]: reaped child process 1333, status = succeeded lb # [ 102.683625] niks3-server[1051]: 2026/09/20 12:48:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 102.708830] nix-grpc-daemon[1276]: time=2026-09-20T12:48:13.230Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 102.710426] nix-grpc-daemon[1276]: time=2026-09-20T12:48:13.230Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" worker1 # [ 102.741101] nix-grpc-daemon[1276]: time=2026-09-20T12:48:13.262Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.718305] niks3-server[1051]: 2026/09/20 12:48:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 102.734301] niks3-server[1051]: 2026/09/20 12:48:13 INFO Signed narinfos id=29 count=1 lb # [ 102.742758] niks3-server[1051]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 102.752298] niks3-server[1051]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls worker1 # [ 102.777050] nix-grpc-daemon[1276]: time=2026-09-20T12:48:13.298Z level=INFO msg="Upload complete. (497ms)" lb # [ 102.765622] niks3-server[1051]: 2026/09/20 12:48:13 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 102.770775] niks3-server[1051]: 2026/09/20 12:48:13 INFO Completed upload id=29 worker1 # [ 102.784134] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48442 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 102.774261] niks3-server[1051]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker1 # [ 102.799730] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 102.806542] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 102.811716] nix-daemon[835]: reaped child process 1323, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... worker1 # [ 102.824586] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv client # farm-b> LOG-farm-b-on-standby worker1 # [ 103.654806] nix-daemon[835]: reaped child process 1337, status = succeeded worker1 # [ 103.819227] nix-daemon[835]: accepted connection from pid 1352, user nix-grpc-daemon (trusted) worker1 # [ 103.840513] nix-daemon[835]: reaped child process 1355, status = succeeded lb # [ 103.842585] niks3-server[1051]: 2026/09/20 12:48:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 103.866343] nix-grpc-daemon[1276]: time=2026-09-20T12:48:14.387Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 103.867992] nix-grpc-daemon[1276]: time=2026-09-20T12:48:14.387Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 103.884321] niks3-server[1051]: 2026/09/20 12:48:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker1 # [ 103.906930] nix-grpc-daemon[1276]: time=2026-09-20T12:48:14.428Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.902512] niks3-server[1051]: 2026/09/20 12:48:14 INFO Signed narinfos id=30 count=1 lb # [ 103.911876] niks3-server[1051]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 103.920379] niks3-server[1051]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 103.929077] niks3-server[1051]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls worker1 # [ 103.946193] nix-grpc-daemon[1276]: time=2026-09-20T12:48:14.468Z level=INFO msg="Upload complete. (307ms)" lb # [ 103.934401] niks3-server[1051]: 2026/09/20 12:48:14 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 103.939717] niks3-server[1051]: 2026/09/20 12:48:14 INFO Completed upload id=30 lb # [ 103.942720] niks3-server[1051]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker1 # [ 103.957772] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 103.973212] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:14Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 103.979772] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:14Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 103.984066] nix-daemon[835]: reaped child process 1335, status = succeeded worker1 # [ 104.021452] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 104.037180] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 104.053016] nix-grpc-daemon[1276]: time=2026-09-20T12:48:14.574Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 104.063932] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 104.079119] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 104.286631] nix-daemon[835]: accepted connection from pid 1361, user nix-grpc-daemon (trusted) worker1 # [ 104.307990] nix-daemon[835]: reaped child process 1364, status = succeeded worker1 # [ 104.481677] nix-daemon[835]: accepted connection from pid 1366, user nix-grpc-daemon (trusted) worker1 # [ 104.501735] nix-daemon[835]: reaped child process 1369, status = succeeded lb # [ 104.500888] niks3-server[1051]: 2026/09/20 12:48:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 104.523755] nix-grpc-daemon[1276]: time=2026-09-20T12:48:15.045Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 104.525443] nix-grpc-daemon[1276]: time=2026-09-20T12:48:15.045Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 104.532465] niks3-server[1051]: 2026/09/20 12:48:15 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst lb # [ 104.546807] niks3-server[1051]: 2026/09/20 12:48:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker1 # [ 104.567030] nix-grpc-daemon[1276]: time=2026-09-20T12:48:15.088Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.560914] niks3-server[1051]: 2026/09/20 12:48:15 INFO Signed narinfos id=31 count=1 lb # [ 104.563460] niks3-server[1051]: 2026/09/20 12:48:15 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 104.577342] niks3-server[1051]: 2026/09/20 12:48:15 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 104.582775] niks3-server[1051]: 2026/09/20 12:48:15 INFO Completed upload id=31 worker1 # [ 104.595104] nix-grpc-daemon[1276]: time=2026-09-20T12:48:15.117Z level=INFO msg="Upload complete. (498ms)" lb # [ 104.585288] niks3-server[1051]: 2026/09/20 12:48:15 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker1 # [ 104.604253] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48442 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 104.615858] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 104.623299] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 104.628621] nix-daemon[835]: reaped child process 1359, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 104.642571] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-on-standby worker1 # [ 106.284934] nix-daemon[835]: reaped child process 1373, status = succeeded worker1 # [ 106.479430] nix-daemon[835]: accepted connection from pid 1388, user nix-grpc-daemon (trusted) worker1 # [ 106.498525] nix-daemon[835]: reaped child process 1391, status = succeeded lb # [ 106.499819] niks3-server[1051]: 2026/09/20 12:48:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 106.528479] nix-grpc-daemon[1276]: time=2026-09-20T12:48:17.048Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 106.530196] nix-grpc-daemon[1276]: time=2026-09-20T12:48:17.048Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 106.544973] niks3-server[1051]: 2026/09/20 12:48:17 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 106.556565] niks3-server[1051]: 2026/09/20 12:48:17 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 106.566837] niks3-server[1051]: 2026/09/20 12:48:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker1 # [ 106.584836] nix-grpc-daemon[1276]: time=2026-09-20T12:48:17.106Z level=INFO msg="Uploading 1 narinfos" lb # [ 106.575487] niks3-server[1051]: 2026/09/20 12:48:17 INFO Signed narinfos id=32 count=1 lb # [ 106.580128] niks3-server[1051]: 2026/09/20 12:48:17 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 106.587307] niks3-server[1051]: 2026/09/20 12:48:17 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 106.594564] niks3-server[1051]: 2026/09/20 12:48:17 INFO Completed upload id=32 worker1 # [ 106.606262] nix-grpc-daemon[1276]: time=2026-09-20T12:48:17.128Z level=INFO msg="Upload complete. (350ms)" lb # [ 106.597295] niks3-server[1051]: 2026/09/20 12:48:17 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker1 # [ 106.621245] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 duration_s=2 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 106.638246] nix-daemon[835]: reaped child process 1371, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.18 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds) worker2 # [ 107.030845] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 107.040812] systemd[1]: Starting scheduler-token.service... worker2 # [ 107.151086] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 107.155630] systemd[1]: Finished scheduler-token.service. worker2 # [ 107.160682] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 113ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 107.166712] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 107.351943] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 107.354574] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 107.358885] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 107.367145] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 107.382620] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 107.400419] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.379481] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:17Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 107.379917] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:48430 worker1 # [ 107.389123] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.28 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 107.850872] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 3515d650c51f41e0920b2953c6f34a10 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds) worker1 # [ 108.069755] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48442 client # [ 108.109367] nix[1162]: don't know how to build these paths: client # [ 108.110407] nix[1162]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 108.091200] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:18Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 108.098716] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:18Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 108.137199] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 108.154371] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48442 client # [ 108.199631] nix[1162]: copying 1 paths to 'lb:50051'... client # [ 108.205996] nix[1162]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 108.173647] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 108.189309] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 108.404197] nix-daemon[835]: accepted connection from pid 1404, user nix-grpc-daemon (trusted) worker1 # [ 108.423842] nix-daemon[835]: reaped child process 1407, status = succeeded worker1 # [ 108.600504] nix-daemon[835]: accepted connection from pid 1409, user nix-grpc-daemon (trusted) worker1 # [ 108.621934] nix-daemon[835]: reaped child process 1412, status = succeeded lb # [ 108.621476] niks3-server[1051]: 2026/09/20 12:48:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 108.644674] nix-grpc-daemon[1276]: time=2026-09-20T12:48:19.166Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 108.646613] nix-grpc-daemon[1276]: time=2026-09-20T12:48:19.168Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 108.655212] niks3-server[1051]: 2026/09/20 12:48:19 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst worker1 # [ 108.682206] nix-grpc-daemon[1276]: time=2026-09-20T12:48:19.203Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.672381] niks3-server[1051]: 2026/09/20 12:48:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 108.683105] niks3-server[1051]: 2026/09/20 12:48:19 INFO Signed narinfos id=33 count=1 lb # [ 108.688829] niks3-server[1051]: 2026/09/20 12:48:19 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 108.697966] niks3-server[1051]: 2026/09/20 12:48:19 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 108.702479] niks3-server[1051]: 2026/09/20 12:48:19 INFO Completed upload id=33 worker1 # [ 108.714719] nix-grpc-daemon[1276]: time=2026-09-20T12:48:19.236Z level=INFO msg="Upload complete. (508ms)" lb # [ 108.705364] niks3-server[1051]: 2026/09/20 12:48:19 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker1 # [ 108.724395] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48442 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 108.733175] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 worker1 # [ 108.747111] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 108.753258] nix-daemon[835]: reaped child process 1402, status = succeeded client # [ 108.796354] nix[1162]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker1 # [ 108.768455] nix-daemon[835]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 110.835154] systemd-journald[267]: Received client request to rotate journal, rotating. worker2 # [ 110.856000] systemd-journald[267]: Vacuuming done, freed 0B of archived journals from /var/log/journal/379daaf79f3c404594fb77369a01d950. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 110.877700] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds) ??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 573 client: must succeed: sleep 5.0 lb # [ 111.030588] envoy[913]: conn peer=[2001:db8:1::1]:47680 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=3884 ms=7886 worker1 # [ 111.294857] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:21Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 116.424162] nix-daemon[835]: reaped child process 1416, status = succeeded worker1 # [ 116.609512] nix-daemon[835]: accepted connection from pid 1456, user nix-grpc-daemon (trusted) worker1 # [ 116.629143] nix-daemon[835]: reaped child process 1459, status = succeeded lb # [ 116.629085] niks3-server[1051]: 2026/09/20 12:48:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 116.652488] nix-grpc-daemon[1276]: time=2026-09-20T12:48:27.173Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 116.654172] nix-grpc-daemon[1276]: time=2026-09-20T12:48:27.173Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 116.662794] niks3-server[1051]: 2026/09/20 12:48:27 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 116.688136] niks3-server[1051]: 2026/09/20 12:48:27 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 116.698192] niks3-server[1051]: 2026/09/20 12:48:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker1 # [ 116.717154] nix-grpc-daemon[1276]: time=2026-09-20T12:48:27.238Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.709003] niks3-server[1051]: 2026/09/20 12:48:27 INFO Signed narinfos id=34 count=1 lb # [ 116.711595] niks3-server[1051]: 2026/09/20 12:48:27 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 116.722335] niks3-server[1051]: 2026/09/20 12:48:27 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 116.728470] niks3-server[1051]: 2026/09/20 12:48:27 INFO Completed upload id=34 worker1 # [ 116.740901] nix-grpc-daemon[1276]: time=2026-09-20T12:48:27.262Z level=INFO msg="Upload complete. (355ms)" lb # [ 116.730758] niks3-server[1051]: 2026/09/20 12:48:27 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 116.757268] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48442 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 116.774139] nix-daemon[835]: reaped child process 1414, status = succeeded client # [ 116.830195] systemd[1]: rs.service: Deactivated successfully. client # [ 116.834592] systemd[1]: rs.service: Consumed 165ms CPU time over 8.983s wall clock time, 38.9M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic. worker1 # [ 117.296120] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:27Z level=info event=signal_exit worker1 # [ 117.517390] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=scheduler_yield lb # [ 117.508259] niks3-server[1051]: 2026/09/20 12:48:28 INFO lead: released remote=192.168.1.3:60210 worker2 # [ 117.557505] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:28Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 117.528788] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48430 worker1 # [ 117.535558] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 117.539985] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 117.543972] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:48430 worker1 # [ 117.548380] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 117.757924] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.763564] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 117.735477] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 117.742877] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 117.964856] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.970196] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 117.946179] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 117.950429] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.171470] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.176888] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.146610] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 118.151980] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 118.378203] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.383475] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.352883] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 118.358193] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.20 seconds) client: waiting for success: ! systemctl is-active rs worker1 # [ 118.523503] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:29Z level=info event=scheduler_restarting client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } worker2 # [ 118.586021] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.591308] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.579227] nix-daemon[835]: reaped child process 1267, status = succeeded worker1 # [ 118.582285] nix-grpc-daemon[1206]: ts=2026-09-20T12:48:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2 # [ 118.792680] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.798018] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 118.799436] nix-grpc-daemon[1206]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 118.804279] nix-grpc-daemon[1206]: E0000 00:00:1789908509.320902 1249 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 118.810710] nix-grpc-daemon[1206]: E0000 00:00:1789908509.321174 1249 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 118.999287] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.004724] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.205860] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.211182] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 119.412549] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.419060] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 119.577027] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 119.583544] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 119.622027] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.589076] systemd[1]: nix-grpc-daemon.service: Consumed 1.855s CPU time over 27.512s wall clock time, 34.6M memory peak, 49.2K incoming IP traffic, 89.2K outgoing IP traffic. worker2 # [ 119.626243] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 119.603637] systemd[1]: Starting Nix worker-protocol over gRPC... lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 119.823064] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.828655] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker1 # [ 119.809650] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 119.812353] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 119.816544] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 119.824955] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 119.826813] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 119.836901] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=scheduler_take_over lb # [ 119.823599] niks3-server[1051]: 2026/09/20 12:48:30 INFO lead: acquired remote=192.168.1.3:59838 worker1 # [ 119.850921] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 119.852904] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 120.030046] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 120.035930] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 120.054181] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 120.059804] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 120.237210] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 120.242652] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 120.260759] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 120.266411] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 120.443853] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 120.449532] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 120.467470] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 120.473128] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 120.652153] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 120.632274] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:31Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 120.637416] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:31Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:32914 worker1 # [ 120.642823] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:31Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 120.673887] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 120.679453] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:31Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:32914 worker1 # [ 120.684517] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.21 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 121.057940] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. lb # [ 121.030685] envoy[913]: conn peer=[2001:db8:1::1]:36582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1349 ms=8699 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds) lb # [ 121.035878] envoy[913]: conn peer=[2001:db8:1::3]:60208 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4160 tx=1321 ms=26261 worker1 # [ 121.278743] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60232 worker1 # [ 121.297092] nix-daemon[835]: accepted connection from pid 1466, user nix-grpc-daemon (trusted) client # Running as unit: mid.service; invocation ID: 9a313e19283545a3b9861c616a61a017 client # [ 121.345414] nix[1197]: don't know how to build these paths: client # [ 121.349672] nix[1197]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 121.326991] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:31Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 121.333977] nix-grpc-daemon[1466]: ts=2026-09-20T12:48:31Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 121.429318] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51570 worker2 # [ 121.444641] nix-daemon[848]: accepted connection from pid 1178, user nix-grpc-daemon (trusted) worker2 # [ 121.470933] nix-grpc-daemon[1178]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 1/5) worker2 # [ 121.537732] nix-grpc-daemon[1178]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 2/5) worker2 # [ 121.550250] nix-grpc-daemon[1178]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 236 ms (attempt 3/5) worker2 # [ 121.795133] nix-grpc-daemon[1178]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 139 ms (attempt 4/5) worker2 # [ 121.942553] nix-grpc-daemon[1178]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 121.965246] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51570 client # [ 121.980204] nix[1197]: copying 1 paths to 'lb:50051'... worker2 # [ 121.982436] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51570 client # [ 121.983344] nix[1197]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 121.999720] nix-daemon[848]: accepted connection from pid 1178, user nix-grpc-daemon (trusted) worker2 # [ 122.032809] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:32Z level=info event=niks3_push_started pid=1288 worker2 # [ 122.251544] nix-grpc-daemon[1288]: time=2026-09-20T12:48:32.764Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 122.445433] nix-daemon[848]: accepted connection from pid 1301, user nix-grpc-daemon (trusted) worker2 # [ 122.464144] nix-daemon[848]: reaped child process 1308, status = succeeded worker2 # [ 122.641467] nix-daemon[848]: accepted connection from pid 1310, user nix-grpc-daemon (trusted) worker2 # [ 122.660573] nix-daemon[848]: reaped child process 1313, status = succeeded lb # [ 122.627373] niks3-server[1051]: 2026/09/20 12:48:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 122.683935] nix-grpc-daemon[1288]: time=2026-09-20T12:48:33.196Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 122.685862] nix-grpc-daemon[1288]: time=2026-09-20T12:48:33.196Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 122.665550] niks3-server[1051]: 2026/09/20 12:48:33 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 122.729379] nix-grpc-daemon[1288]: time=2026-09-20T12:48:33.242Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.683050] niks3-server[1051]: 2026/09/20 12:48:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 122.694364] niks3-server[1051]: 2026/09/20 12:48:33 INFO Signed narinfos id=35 count=1 lb # [ 122.701201] niks3-server[1051]: 2026/09/20 12:48:33 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 122.714956] niks3-server[1051]: 2026/09/20 12:48:33 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 122.720498] niks3-server[1051]: 2026/09/20 12:48:33 INFO Completed upload id=35 worker2 # [ 122.765324] nix-grpc-daemon[1288]: time=2026-09-20T12:48:33.279Z level=INFO msg="Upload complete. (509ms)" lb # [ 122.723457] niks3-server[1051]: 2026/09/20 12:48:33 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo worker2 # [ 122.777909] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51570 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 122.791525] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51570 worker2 # [ 122.797789] nix-daemon[848]: accepted connection from pid 1178, user nix-grpc-daemon (trusted) worker2 # [ 122.803073] nix-daemon[848]: reaped child process 1286, status = succeeded client # [ 122.813314] nix[1197]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 122.814436] nix-daemon[848]: accepted connection from pid 1178, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 125.049986] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1466 (nix-grpc-daemon) on client request. worker1 # [ 125.071329] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 125.061900] niks3-server[1051]: 2026/09/20 12:48:35 INFO lead: released remote=192.168.1.3:59838 worker2 # [ 125.120163] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:35Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))" client # [ 125.120651] nix[1197]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 125.109361] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.13 seconds) client: must succeed: sleep 5.0 worker1 # [ 125.129189] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1 # [ 125.131067] systemd[1]: nix-grpc-daemon.service: Consumed 205ms CPU time over 5.510s wall clock time, 11.6M memory peak, 9.8K incoming IP traffic, 10K outgoing IP traffic. worker1 # [ 125.134639] nix-daemon[835]: reaped child process 1522, status = succeeded worker2 # [ 125.320530] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 125.292166] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker1 # [ 125.306754] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 125.522440] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:36Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 125.525048] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 125.529208] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 125.537710] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:36Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 125.539488] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 125.548939] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:36Z level=info event=scheduler_take_over lb # [ 125.536799] niks3-server[1051]: 2026/09/20 12:48:36 INFO lead: acquired remote=192.168.1.3:34642 worker1 # [ 125.566744] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 125.570793] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:36Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:60236 worker1 # [ 125.572493] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:36Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 125.574187] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:36Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 125.575435] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:36Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:60236 worker1 # [ 125.577351] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:36Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=1 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 130.663005] nix-daemon[848]: reaped child process 1317, status = succeeded worker2 # [ 130.841410] nix-daemon[848]: accepted connection from pid 1353, user nix-grpc-daemon (trusted) worker2 # [ 130.860751] nix-daemon[848]: reaped child process 1356, status = succeeded lb # [ 130.827568] niks3-server[1051]: 2026/09/20 12:48:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 130.887705] nix-grpc-daemon[1288]: time=2026-09-20T12:48:41.398Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 130.889993] nix-grpc-daemon[1288]: time=2026-09-20T12:48:41.398Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 130.869215] niks3-server[1051]: 2026/09/20 12:48:41 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 130.883078] niks3-server[1051]: 2026/09/20 12:48:41 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 130.896585] niks3-server[1051]: 2026/09/20 12:48:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign worker2 # [ 130.947291] nix-grpc-daemon[1288]: time=2026-09-20T12:48:41.459Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.906212] niks3-server[1051]: 2026/09/20 12:48:41 INFO Signed narinfos id=36 count=1 lb # [ 130.911105] niks3-server[1051]: 2026/09/20 12:48:41 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 130.919406] niks3-server[1051]: 2026/09/20 12:48:41 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 130.928086] niks3-server[1051]: 2026/09/20 12:48:41 INFO Completed upload id=36 worker2 # [ 130.971955] nix-grpc-daemon[1288]: time=2026-09-20T12:48:41.485Z level=INFO msg="Upload complete. (337ms)" worker2 # [ 130.985149] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51570 duration_s=8 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker2 # [ 131.000325] nix-grpc-daemon[1288]: time=2026-09-20T12:48:41.506Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 131.007014] nix-daemon[848]: reaped child process 1315, status = succeeded client # [ 131.026427] systemd[1]: mid.service: Deactivated successfully. client # [ 131.030768] systemd[1]: mid.service: Consumed 175ms CPU time over 9.972s wall clock time, 37M memory peak, 8.8K incoming IP traffic, 9.3K outgoing IP traffic. lb # [ 131.031653] envoy[913]: conn peer=[2001:db8:1::3]:39144 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=972 tx=362 ms=5244 lb # [ 131.037600] envoy[913]: conn peer=[2001:db8:1::1]:49302 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3035 tx=1424 ms=9692 client: (finished: waiting for success: ! systemctl is-active mid, in 1.15 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.74 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 131.772509] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 1e0b92555f8f42dab2506ced0763320e client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) client # [ 132.007720] nix[1232]: don't know how to build these paths: client # [ 132.008822] nix[1232]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 132.008286] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:51570 worker1 # [ 131.998396] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:42Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker1 # [ 132.004304] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:42Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 132.046522] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 132.062893] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 132.089220] nix-grpc-daemon[1550]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 74 ms (attempt 1/5) worker1 # [ 132.169765] nix-grpc-daemon[1550]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 105 ms (attempt 2/5) worker1 # [ 132.283023] nix-grpc-daemon[1550]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 3/5) worker1 # [ 132.449303] nix-grpc-daemon[1550]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 599 ms (attempt 4/5) worker1 # [ 133.058041] nix-grpc-daemon[1550]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 133.081763] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 client # [ 133.134163] nix[1232]: copying 1 paths to 'lb:50051'... worker1 # [ 133.105927] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 client # [ 133.139503] nix[1232]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker1 # [ 133.125045] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 133.156148] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:43Z level=info event=niks3_push_started pid=1624 worker1 # [ 133.387694] nix-grpc-daemon[1624]: time=2026-09-20T12:48:43.908Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 133.569401] nix-daemon[835]: accepted connection from pid 1637, user nix-grpc-daemon (trusted) worker1 # [ 133.588835] nix-daemon[835]: reaped child process 1640, status = succeeded worker1 # [ 133.771769] nix-daemon[835]: accepted connection from pid 1642, user nix-grpc-daemon (trusted) worker1 # [ 133.793370] nix-daemon[835]: reaped child process 1645, status = succeeded lb # [ 133.794308] niks3-server[1051]: 2026/09/20 12:48:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.829983] nix-grpc-daemon[1624]: time=2026-09-20T12:48:44.350Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 133.831858] nix-grpc-daemon[1624]: time=2026-09-20T12:48:44.350Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 133.864895] niks3-server[1051]: 2026/09/20 12:48:44 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst worker1 # [ 133.887678] nix-grpc-daemon[1624]: time=2026-09-20T12:48:44.408Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.875936] niks3-server[1051]: 2026/09/20 12:48:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 133.887667] niks3-server[1051]: 2026/09/20 12:48:44 INFO Signed narinfos id=37 count=1 lb # [ 133.893936] niks3-server[1051]: 2026/09/20 12:48:44 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 133.904469] niks3-server[1051]: 2026/09/20 12:48:44 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 133.910223] niks3-server[1051]: 2026/09/20 12:48:44 INFO Completed upload id=37 worker1 # [ 133.922068] nix-grpc-daemon[1624]: time=2026-09-20T12:48:44.443Z level=INFO msg="Upload complete. (530ms)" lb # [ 133.913330] niks3-server[1051]: 2026/09/20 12:48:44 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker1 # [ 133.932429] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 133.952503] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 133.962042] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 133.968583] nix-daemon[835]: reaped child process 1622, status = succeeded client # [ 134.012808] nix[1232]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker1 # [ 133.986077] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 135.545078] systemd[1]: intr.service: Sent signal SIGINT to main process 1232 (nix) on client request. client # [ 135.552635] nix[1232]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) client # [ 135.562599] nix[1232]: error: interrupted by the user client # [ 135.597698] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 135.602835] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 135.605171] systemd[1]: intr.service: Consumed 150ms CPU time over 3.828s wall clock time, 37.2M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic. worker1 # [ 135.620583] nix-daemon[835]: reaped child process 1647, status = succeeded worker1 # [ 135.623866] nix-daemon[1649]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 135.632421] nix-daemon[835]: reaped child process 1649, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 5.19 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 136.990172] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 9bc7108dcdd848ad93ad448eb9f91f84 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds) client # [ 137.251979] nix[1252]: don't know how to build these paths: client # [ 137.253009] nix[1252]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 137.252977] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:51570 worker1 # [ 137.237081] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:47Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 137.314343] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51570 worker2 # [ 137.332684] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51570 client # [ 137.348414] nix[1252]: copying 1 paths to 'lb:50051'... worker2 # [ 137.349985] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51570 client # [ 137.350833] nix[1252]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker2 # [ 137.368944] nix-daemon[848]: accepted connection from pid 1178, user nix-grpc-daemon (trusted) worker2 # [ 137.580867] nix-daemon[848]: accepted connection from pid 1388, user nix-grpc-daemon (trusted) worker2 # [ 137.601269] nix-daemon[848]: reaped child process 1391, status = succeeded worker2 # [ 137.788121] nix-daemon[848]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 137.808153] nix-daemon[848]: reaped child process 1396, status = succeeded lb # [ 137.775506] niks3-server[1051]: 2026/09/20 12:48:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 137.832300] nix-grpc-daemon[1288]: time=2026-09-20T12:48:48.344Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 137.833875] nix-grpc-daemon[1288]: time=2026-09-20T12:48:48.345Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 137.810216] niks3-server[1051]: 2026/09/20 12:48:48 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst lb # [ 137.829132] niks3-server[1051]: 2026/09/20 12:48:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker2 # [ 137.879097] nix-grpc-daemon[1288]: time=2026-09-20T12:48:48.392Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.835059] niks3-server[1051]: 2026/09/20 12:48:48 INFO Signed narinfos id=38 count=1 lb # [ 137.842306] niks3-server[1051]: 2026/09/20 12:48:48 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 137.852937] niks3-server[1051]: 2026/09/20 12:48:48 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 137.858416] niks3-server[1051]: 2026/09/20 12:48:48 INFO Completed upload id=38 worker2 # [ 137.903220] nix-grpc-daemon[1288]: time=2026-09-20T12:48:48.416Z level=INFO msg="Upload complete. (514ms)" worker1 # [ 137.243412] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:47Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=1 lb # [ 137.861023] niks3-server[1051]: 2026/09/20 12:48:48 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker2 # [ 137.913523] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51570 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 137.928684] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51570 worker2 # [ 137.936543] nix-daemon[848]: accepted connection from pid 1178, user nix-grpc-daemon (trusted) worker2 # [ 137.942144] nix-daemon[848]: reaped child process 1386, status = succeeded client # [ 137.952962] nix[1252]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker2 # [ 137.958617] nix-daemon[848]: accepted connection from pid 1178, user nix-grpc-daemon (trusted) worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done worker2 # activating the configuration... worker2 # [ 140.482780] nixos[1431]: switching to system configuration /nix/store/3ydbgxjx8wpxk0hzmy5qz34wrd2xncr6-nixos-system-worker2-test worker2 # [ 140.487421] systemd[1]: Stopped target Remote File Systems. worker2 # [ 140.489043] systemd[1]: Stopped target Local File Systems. worker2 # setting up /etc... lb # [ 141.031489] envoy[913]: conn peer=[2001:db8:1::1]:55468 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=754 ms=3570 worker2 # [ 141.281202] systemd[1]: Reload requested from client PID 1431 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 141.283249] systemd[1]: Reloading... worker2 # [ 142.169623] systemd[1]: Reloading finished in 883 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 142.249879] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 142.400466] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 142.404489] systemd[1]: Reached target Reactivate sysinit units. worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 142.409415] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 142.421401] dbus-broker-launch[494]: Caught SIGHUP, trigger reload. worker2 # [ 142.423329] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 142.455797] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 142.459185] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' worker2 # [ 142.461350] dbus-broker-launch[494]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 142.472731] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 142.505582] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 142.517897] systemd[1]: Reached target Local File Systems. worker2 # [ 142.521576] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 142.527818] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 142.532357] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 142.537038] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 142.547915] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 142.549682] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 142.550886] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 142.556192] systemd[1]: Reached target Remote File Systems. worker2 # [ 142.556996] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 142.558211] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 143.035529] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 143.040846] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 143.042850] systemd[1]: Starting linger-users.service... worker2 # [ 143.088596] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 143.092067] systemd[1]: Finished linger-users.service. worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 143.347344] nixos[1431]: finished switching to system configuration /nix/store/3ydbgxjx8wpxk0hzmy5qz34wrd2xncr6-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.70 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2 # [ 143.384743] nix-grpc-daemon[1178]: ts=2026-09-20T12:48:53Z level=info event=draining worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 143.647870] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 143.656359] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 143.681914] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:54Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker1 # [ 143.689349] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:54Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 143.733564] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 143.754262] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 client # copying 1 paths to 'lb:50051'... worker1 # [ 143.771613] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker1 # [ 143.795631] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 144.010439] nix-daemon[835]: accepted connection from pid 1703, user nix-grpc-daemon (trusted) worker1 # [ 144.030797] nix-daemon[835]: reaped child process 1706, status = succeeded worker1 # [ 144.209552] nix-daemon[835]: accepted connection from pid 1708, user nix-grpc-daemon (trusted) worker1 # [ 144.228597] nix-daemon[835]: reaped child process 1711, status = succeeded lb # [ 144.232594] niks3-server[1051]: 2026/09/20 12:48:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.256484] nix-grpc-daemon[1624]: time=2026-09-20T12:48:54.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 144.258025] nix-grpc-daemon[1624]: time=2026-09-20T12:48:54.777Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 144.263404] niks3-server[1051]: 2026/09/20 12:48:54 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker1 # [ 144.295835] nix-grpc-daemon[1624]: time=2026-09-20T12:48:54.817Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.277563] niks3-server[1051]: 2026/09/20 12:48:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 144.286258] niks3-server[1051]: 2026/09/20 12:48:54 INFO Signed narinfos id=39 count=1 lb # [ 144.294580] niks3-server[1051]: 2026/09/20 12:48:54 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 144.306112] niks3-server[1051]: 2026/09/20 12:48:54 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 144.315672] niks3-server[1051]: 2026/09/20 12:48:54 INFO Completed upload id=39 worker1 # [ 144.328155] nix-grpc-daemon[1624]: time=2026-09-20T12:48:54.850Z level=INFO msg="Upload complete. (514ms)" lb # [ 144.318786] niks3-server[1051]: 2026/09/20 12:48:54 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker1 # [ 144.338925] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=528 worker1 # [ 144.348755] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 144.362025] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 144.365083] nix-daemon[835]: reaped child process 1701, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker1 # [ 144.379106] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-during-drain worker1 # [ 145.612305] nix-daemon[835]: reaped child process 1715, status = succeeded worker1 # [ 145.788293] nix-daemon[835]: accepted connection from pid 1730, user nix-grpc-daemon (trusted) worker1 # [ 145.805837] nix-daemon[835]: reaped child process 1733, status = succeeded lb # [ 145.807338] niks3-server[1051]: 2026/09/20 12:48:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 145.832484] nix-grpc-daemon[1624]: time=2026-09-20T12:48:56.350Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 145.834223] nix-grpc-daemon[1624]: time=2026-09-20T12:48:56.350Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 145.836154] niks3-server[1051]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 145.855048] niks3-server[1051]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 145.870103] niks3-server[1051]: 2026/09/20 12:48:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker1 # [ 145.891649] nix-grpc-daemon[1624]: time=2026-09-20T12:48:56.412Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.879172] niks3-server[1051]: 2026/09/20 12:48:56 INFO Signed narinfos id=40 count=1 lb # [ 145.885924] niks3-server[1051]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 145.898885] niks3-server[1051]: 2026/09/20 12:48:56 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 145.908516] niks3-server[1051]: 2026/09/20 12:48:56 INFO Completed upload id=40 lb # [ 145.911566] niks3-server[1051]: 2026/09/20 12:48:56 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker1 # [ 145.920704] nix-grpc-daemon[1624]: time=2026-09-20T12:48:56.442Z level=INFO msg="Upload complete. (330ms)" worker1 # [ 145.939350] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=1 worker1 # [ 145.956310] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:56Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker1 # [ 145.959960] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:56Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 145.964708] nix-daemon[835]: reaped child process 1713, status = succeeded worker1 # [ 145.991024] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 146.006078] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 146.020335] nix-grpc-daemon[1624]: time=2026-09-20T12:48:56.542Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 146.030930] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker1 # [ 146.054873] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 146.263325] nix-daemon[835]: accepted connection from pid 1739, user nix-grpc-daemon (trusted) worker1 # [ 146.280994] nix-daemon[835]: reaped child process 1742, status = succeeded worker1 # [ 146.453317] nix-daemon[835]: accepted connection from pid 1744, user nix-grpc-daemon (trusted) worker1 # [ 146.471284] nix-daemon[835]: reaped child process 1747, status = succeeded lb # [ 146.471025] niks3-server[1051]: 2026/09/20 12:48:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.492791] nix-grpc-daemon[1624]: time=2026-09-20T12:48:57.014Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 146.494268] nix-grpc-daemon[1624]: time=2026-09-20T12:48:57.014Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 146.500186] niks3-server[1051]: 2026/09/20 12:48:57 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst lb # [ 146.512265] niks3-server[1051]: 2026/09/20 12:48:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker1 # [ 146.531336] nix-grpc-daemon[1624]: time=2026-09-20T12:48:57.053Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.523098] niks3-server[1051]: 2026/09/20 12:48:57 INFO Signed narinfos id=41 count=1 lb # [ 146.530183] niks3-server[1051]: 2026/09/20 12:48:57 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 146.539334] niks3-server[1051]: 2026/09/20 12:48:57 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 146.546476] niks3-server[1051]: 2026/09/20 12:48:57 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo lb # [ 146.552081] niks3-server[1051]: 2026/09/20 12:48:57 INFO Completed upload id=41 worker1 # [ 146.564526] nix-grpc-daemon[1624]: time=2026-09-20T12:48:57.086Z level=INFO msg="Upload complete. (490ms)" worker1 # [ 146.573168] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 146.588496] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 146.594292] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 146.599057] nix-daemon[835]: reaped child process 1737, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker1 # [ 146.614421] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 147.836556] nix-daemon[835]: reaped child process 1751, status = succeeded client # farm-b> LOG-farm-b-during-drain worker1 # [ 147.997041] nix-daemon[835]: accepted connection from pid 1766, user nix-grpc-daemon (trusted) worker1 # [ 148.017807] nix-daemon[835]: reaped child process 1769, status = succeeded lb # [ 148.017354] niks3-server[1051]: 2026/09/20 12:48:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.040408] nix-grpc-daemon[1624]: time=2026-09-20T12:48:58.561Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 148.041918] nix-grpc-daemon[1624]: time=2026-09-20T12:48:58.561Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 148.050977] niks3-server[1051]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 148.064613] niks3-server[1051]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 148.076991] niks3-server[1051]: 2026/09/20 12:48:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker1 # [ 148.094602] nix-grpc-daemon[1624]: time=2026-09-20T12:48:58.616Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.088771] niks3-server[1051]: 2026/09/20 12:48:58 INFO Signed narinfos id=42 count=1 lb # [ 148.098179] niks3-server[1051]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 148.110415] niks3-server[1051]: 2026/09/20 12:48:58 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 148.115809] niks3-server[1051]: 2026/09/20 12:48:58 INFO Completed upload id=42 worker1 # [ 148.128166] nix-grpc-daemon[1624]: time=2026-09-20T12:48:58.650Z level=INFO msg="Upload complete. (302ms)" lb # [ 148.118681] niks3-server[1051]: 2026/09/20 12:48:58 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker1 # [ 148.145904] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=1 worker1 # [ 148.162493] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:58Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker1 # [ 148.166496] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:58Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 148.170731] nix-daemon[835]: reaped child process 1749, status = succeeded worker1 # [ 148.188808] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 148.204906] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 148.220332] nix-grpc-daemon[1624]: time=2026-09-20T12:48:58.742Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker1 # [ 148.230894] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 148.248824] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 148.464230] nix-daemon[835]: accepted connection from pid 1775, user nix-grpc-daemon (trusted) worker1 # [ 148.482332] nix-daemon[835]: reaped child process 1778, status = succeeded worker1 # [ 148.660528] nix-daemon[835]: accepted connection from pid 1780, user nix-grpc-daemon (trusted) worker1 # [ 148.678540] nix-daemon[835]: reaped child process 1783, status = succeeded lb # [ 148.678714] niks3-server[1051]: 2026/09/20 12:48:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.701355] nix-grpc-daemon[1624]: time=2026-09-20T12:48:59.223Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 148.702873] nix-grpc-daemon[1624]: time=2026-09-20T12:48:59.223Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 148.708810] niks3-server[1051]: 2026/09/20 12:48:59 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst lb # [ 148.721344] niks3-server[1051]: 2026/09/20 12:48:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker1 # [ 148.741524] nix-grpc-daemon[1624]: time=2026-09-20T12:48:59.263Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.732917] niks3-server[1051]: 2026/09/20 12:48:59 INFO Signed narinfos id=43 count=1 lb # [ 148.739873] niks3-server[1051]: 2026/09/20 12:48:59 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 148.747655] niks3-server[1051]: 2026/09/20 12:48:59 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 148.755464] niks3-server[1051]: 2026/09/20 12:48:59 INFO Completed upload id=43 worker1 # [ 148.767595] nix-grpc-daemon[1624]: time=2026-09-20T12:48:59.289Z level=INFO msg="Upload complete. (501ms)" lb # [ 148.757650] niks3-server[1051]: 2026/09/20 12:48:59 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker1 # [ 148.777028] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 148.790253] nix-grpc-daemon[1550]: ts=2026-09-20T12:48:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 148.795945] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 148.800847] nix-daemon[835]: reaped child process 1773, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 148.813928] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-during-drain worker1 # [ 149.860421] nix-daemon[835]: reaped child process 1787, status = succeeded worker1 # [ 150.035141] nix-daemon[835]: accepted connection from pid 1802, user nix-grpc-daemon (trusted) worker1 # [ 150.053404] nix-daemon[835]: reaped child process 1805, status = succeeded lb # [ 150.053383] niks3-server[1051]: 2026/09/20 12:49:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.076419] nix-grpc-daemon[1624]: time=2026-09-20T12:49:00.597Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 150.077899] nix-grpc-daemon[1624]: time=2026-09-20T12:49:00.597Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 150.092629] niks3-server[1051]: 2026/09/20 12:49:00 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 150.104424] niks3-server[1051]: 2026/09/20 12:49:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker1 # [ 150.122819] nix-grpc-daemon[1624]: time=2026-09-20T12:49:00.644Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.116767] niks3-server[1051]: 2026/09/20 12:49:00 INFO Signed narinfos id=44 count=1 lb # [ 150.123794] niks3-server[1051]: 2026/09/20 12:49:00 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 150.139004] niks3-server[1051]: 2026/09/20 12:49:00 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 150.142900] niks3-server[1051]: 2026/09/20 12:49:00 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 150.148159] niks3-server[1051]: 2026/09/20 12:49:00 INFO Completed upload id=44 worker1 # [ 150.159714] nix-grpc-daemon[1624]: time=2026-09-20T12:49:00.681Z level=INFO msg="Upload complete. (334ms)" lb # [ 150.150915] niks3-server[1051]: 2026/09/20 12:49:00 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker1 # [ 150.173065] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=1 worker1 # [ 150.189906] nix-daemon[835]: reaped child process 1785, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.83 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 150.593157] nix-daemon[848]: reaped child process 1400, status = succeeded worker2 # [ 150.754528] nix-daemon[848]: accepted connection from pid 1571, user nix-grpc-daemon (trusted) worker2 # [ 150.772736] nix-daemon[848]: reaped child process 1574, status = succeeded lb # [ 150.739040] niks3-server[1051]: 2026/09/20 12:49:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 150.793757] nix-grpc-daemon[1288]: time=2026-09-20T12:49:01.307Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 150.796091] nix-grpc-daemon[1288]: time=2026-09-20T12:49:01.309Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 150.774981] niks3-server[1051]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 150.791181] niks3-server[1051]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 150.799207] niks3-server[1051]: 2026/09/20 12:49:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign worker2 # [ 150.850947] nix-grpc-daemon[1288]: time=2026-09-20T12:49:01.364Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.805457] niks3-server[1051]: 2026/09/20 12:49:01 INFO Signed narinfos id=45 count=1 lb # [ 150.812196] niks3-server[1051]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 150.822693] niks3-server[1051]: 2026/09/20 12:49:01 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 150.832321] niks3-server[1051]: 2026/09/20 12:49:01 INFO Completed upload id=45 worker2 # [ 150.877667] nix-grpc-daemon[1288]: time=2026-09-20T12:49:01.391Z level=INFO msg="Upload complete. (296ms)" lb # [ 150.835739] niks3-server[1051]: 2026/09/20 12:49:01 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker2 # [ 150.889100] nix-grpc-daemon[1178]: ts=2026-09-20T12:49:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51570 duration_s=12 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=1 worker2 # [ 150.905863] nix-daemon[848]: reaped child process 1398, status = succeeded client # [ 150.931552] systemd[1]: sw.service: Deactivated successfully. client # [ 150.936485] systemd[1]: sw.service: Consumed 169ms CPU time over 13.945s wall clock time, 39M memory peak, 8.3K incoming IP traffic, 8.8K outgoing IP traffic. lb # [ 151.037378] envoy[913]: conn peer=[2001:db8:1::1]:33128 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9582 tx=3849 ms=6544 lb # [ 151.042385] envoy[913]: conn peer=[2001:db8:1::1]:55474 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2922 tx=1335 ms=13654 worker2 # [ 151.388587] nix-grpc-daemon[1178]: ts=2026-09-20T12:49:01Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 151.829921] systemd[1]: Starting scheduler-token.service... worker2 # [ 151.910472] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 151.912921] systemd[1]: Finished scheduler-token.service. worker2 # [ 151.913802] systemd[1]: scheduler-token.service: Consumed 30ms CPU time over 82ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 152.622682] nix-grpc-daemon[1178]: ts=2026-09-20T12:49:03Z level=info event=scheduler_restarting worker1 # [ 152.600607] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:03Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60236 worker1 # [ 152.600918] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:03Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 152.650450] nix-grpc-daemon[1178]: ts=2026-09-20T12:49:03Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 152.675654] nix-daemon[848]: reaped child process 1281, status = succeeded worker2 # [ 153.459709] nix-grpc-daemon[1178]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 153.464406] nix-grpc-daemon[1178]: E0000 00:00:1789908543.973204 1221 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker2 # [ 153.468720] nix-grpc-daemon[1178]: E0000 00:00:1789908543.982331 1221 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 153.863846] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 153.871171] systemd[1]: nix-grpc-daemon.service: Consumed 1.155s CPU time over 46.696s wall clock time, 31.2M memory peak, 27.7K incoming IP traffic, 50.8K outgoing IP traffic. worker2 # [ 153.892452] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 154.087239] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:04Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 154.089852] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:04Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 154.094009] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:04Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 154.101979] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:04Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 154.103729] systemd[1]: Started Nix worker-protocol over gRPC. worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.38 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 154.124894] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 154.097846] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:04Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:60236 worker1 # [ 154.104144] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:04Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 18.51 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 155.677680] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 155.691890] nix-daemon[848]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) worker1 # [ 155.681843] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 155.730305] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:06Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker1 # [ 155.737369] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:06Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 155.744293] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:06Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker1 # [ 155.749554] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:06Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 155.776994] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 155.793498] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 155.808612] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 155.824492] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 156.034720] nix-daemon[835]: accepted connection from pid 1814, user nix-grpc-daemon (trusted) worker1 # [ 156.053819] nix-daemon[835]: reaped child process 1817, status = succeeded worker1 # [ 156.225521] nix-daemon[835]: accepted connection from pid 1819, user nix-grpc-daemon (trusted) worker1 # [ 156.245262] nix-daemon[835]: reaped child process 1822, status = succeeded lb # [ 156.247931] niks3-server[1051]: 2026/09/20 12:49:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.269856] nix-grpc-daemon[1624]: time=2026-09-20T12:49:06.791Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 156.271349] nix-grpc-daemon[1624]: time=2026-09-20T12:49:06.791Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 156.275850] niks3-server[1051]: 2026/09/20 12:49:06 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst lb # [ 156.295040] niks3-server[1051]: 2026/09/20 12:49:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign worker1 # [ 156.313466] nix-grpc-daemon[1624]: time=2026-09-20T12:49:06.835Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.308458] niks3-server[1051]: 2026/09/20 12:49:06 INFO Signed narinfos id=46 count=1 lb # [ 156.315572] niks3-server[1051]: 2026/09/20 12:49:06 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 156.327289] niks3-server[1051]: 2026/09/20 12:49:06 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 156.332217] niks3-server[1051]: 2026/09/20 12:49:06 INFO Completed upload id=46 worker1 # [ 156.344267] nix-grpc-daemon[1624]: time=2026-09-20T12:49:06.866Z level=INFO msg="Upload complete. (502ms)" lb # [ 156.335998] niks3-server[1051]: 2026/09/20 12:49:06 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 156.357097] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 156.368356] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 156.380172] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 156.383169] nix-daemon[835]: reaped child process 1812, status = succeeded worker1 # [ 156.398032] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 157.428797] nix-daemon[835]: reaped child process 1826, status = succeeded worker1 # [ 157.601227] nix-daemon[835]: accepted connection from pid 1841, user nix-grpc-daemon (trusted) worker1 # [ 157.619372] nix-daemon[835]: reaped child process 1844, status = succeeded lb # [ 157.619693] niks3-server[1051]: 2026/09/20 12:49:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.641364] nix-grpc-daemon[1624]: time=2026-09-20T12:49:08.163Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 157.645890] nix-grpc-daemon[1624]: time=2026-09-20T12:49:08.165Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 157.655366] niks3-server[1051]: 2026/09/20 12:49:08 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 157.668415] niks3-server[1051]: 2026/09/20 12:49:08 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst worker1 # [ 157.697243] nix-grpc-daemon[1624]: time=2026-09-20T12:49:08.218Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.684499] niks3-server[1051]: 2026/09/20 12:49:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 157.695414] niks3-server[1051]: 2026/09/20 12:49:08 INFO Signed narinfos id=47 count=1 lb # [ 157.701888] niks3-server[1051]: 2026/09/20 12:49:08 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 157.710354] niks3-server[1051]: 2026/09/20 12:49:08 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 157.717003] niks3-server[1051]: 2026/09/20 12:49:08 INFO Completed upload id=47 worker1 # [ 157.729519] nix-grpc-daemon[1624]: time=2026-09-20T12:49:08.251Z level=INFO msg="Upload complete. (320ms)" lb # [ 157.720810] niks3-server[1051]: 2026/09/20 12:49:08 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 157.747927] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=1 worker1 # [ 157.764248] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:08Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 157.775943] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 157.781276] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:08Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 157.789358] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 157.799288] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 157.804124] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 157.808357] nix-daemon[835]: reaped child process 1824, status = succeeded worker1 # [ 157.985473] nix-daemon[835]: accepted connection from pid 1850, user nix-grpc-daemon (trusted) worker1 # [ 158.003425] nix-daemon[835]: reaped child process 1853, status = succeeded worker1 # [ 158.176550] nix-daemon[835]: accepted connection from pid 1855, user nix-grpc-daemon (trusted) worker1 # [ 158.193880] nix-daemon[835]: reaped child process 1858, status = succeeded lb # [ 158.194610] niks3-server[1051]: 2026/09/20 12:49:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.217508] nix-grpc-daemon[1624]: time=2026-09-20T12:49:08.739Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 158.219159] nix-grpc-daemon[1624]: time=2026-09-20T12:49:08.739Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 158.224103] niks3-server[1051]: 2026/09/20 12:49:08 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 158.249965] nix-grpc-daemon[1624]: time=2026-09-20T12:49:08.771Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.241014] niks3-server[1051]: 2026/09/20 12:49:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 158.250892] niks3-server[1051]: 2026/09/20 12:49:08 INFO Signed narinfos id=48 count=1 lb # [ 158.256281] niks3-server[1051]: 2026/09/20 12:49:08 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 158.265103] niks3-server[1051]: 2026/09/20 12:49:08 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 158.270062] niks3-server[1051]: 2026/09/20 12:49:08 INFO Completed upload id=48 worker1 # [ 158.282426] nix-grpc-daemon[1624]: time=2026-09-20T12:49:08.804Z level=INFO msg="Upload complete. (474ms)" lb # [ 158.272925] niks3-server[1051]: 2026/09/20 12:49:08 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 158.292530] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 158.300653] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 158.310911] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 158.315960] nix-daemon[835]: reaped child process 1848, status = succeeded worker1 # [ 158.328268] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 159.558627] nix-daemon[835]: reaped child process 1862, status = succeeded worker1 # [ 159.721118] nix-daemon[835]: accepted connection from pid 1877, user nix-grpc-daemon (trusted) worker1 # [ 159.741045] nix-daemon[835]: reaped child process 1880, status = succeeded lb # [ 159.741664] niks3-server[1051]: 2026/09/20 12:49:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.764402] nix-grpc-daemon[1624]: time=2026-09-20T12:49:10.284Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 159.765881] nix-grpc-daemon[1624]: time=2026-09-20T12:49:10.284Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 159.778796] niks3-server[1051]: 2026/09/20 12:49:10 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 159.791079] niks3-server[1051]: 2026/09/20 12:49:10 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst worker1 # [ 159.823669] nix-grpc-daemon[1624]: time=2026-09-20T12:49:10.345Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.805460] niks3-server[1051]: 2026/09/20 12:49:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 159.815831] niks3-server[1051]: 2026/09/20 12:49:10 INFO Signed narinfos id=49 count=1 lb # [ 159.821772] niks3-server[1051]: 2026/09/20 12:49:10 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 159.829858] niks3-server[1051]: 2026/09/20 12:49:10 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 159.840511] niks3-server[1051]: 2026/09/20 12:49:10 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo lb # [ 159.845856] niks3-server[1051]: 2026/09/20 12:49:10 INFO Completed upload id=49 worker1 # [ 159.858257] nix-grpc-daemon[1624]: time=2026-09-20T12:49:10.380Z level=INFO msg="Upload complete. (318ms)" worker1 # [ 159.875793] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=1 worker1 # [ 159.895031] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:10Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.899539] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 159.904616] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:10Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 159.909965] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 159.914910] nix-daemon[835]: reaped child process 1860, status = succeeded worker1 # [ 159.918680] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 159.928163] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 160.115612] nix-daemon[835]: accepted connection from pid 1886, user nix-grpc-daemon (trusted) worker1 # [ 160.133113] nix-daemon[835]: reaped child process 1889, status = succeeded worker1 # [ 160.310312] nix-daemon[835]: accepted connection from pid 1891, user nix-grpc-daemon (trusted) worker1 # [ 160.328552] nix-daemon[835]: reaped child process 1894, status = succeeded lb # [ 160.327501] niks3-server[1051]: 2026/09/20 12:49:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.348665] nix-grpc-daemon[1624]: time=2026-09-20T12:49:10.870Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 160.350143] nix-grpc-daemon[1624]: time=2026-09-20T12:49:10.870Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 160.357587] niks3-server[1051]: 2026/09/20 12:49:10 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst worker1 # [ 160.378611] nix-grpc-daemon[1624]: time=2026-09-20T12:49:10.900Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.371278] niks3-server[1051]: 2026/09/20 12:49:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 160.381956] niks3-server[1051]: 2026/09/20 12:49:10 INFO Signed narinfos id=50 count=1 lb # [ 160.386160] niks3-server[1051]: 2026/09/20 12:49:10 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls worker1 # [ 160.406771] nix-grpc-daemon[1624]: time=2026-09-20T12:49:10.928Z level=INFO msg="Upload complete. (468ms)" lb # [ 160.395109] niks3-server[1051]: 2026/09/20 12:49:10 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 160.399893] niks3-server[1051]: 2026/09/20 12:49:10 INFO Completed upload id=50 lb # [ 160.402846] niks3-server[1051]: 2026/09/20 12:49:10 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 160.415770] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 160.426182] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 160.431357] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 160.435690] nix-daemon[835]: reaped child process 1884, status = succeeded worker1 # [ 160.447517] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) lb # [ 161.035959] envoy[913]: conn peer=[2001:db8:1::4]:38566 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=13762 tx=958 ms=45248 worker1 # [ 161.685480] nix-daemon[835]: reaped child process 1898, status = succeeded worker1 # [ 161.855154] nix-daemon[835]: accepted connection from pid 1913, user nix-grpc-daemon (trusted) worker1 # [ 161.875204] nix-daemon[835]: reaped child process 1916, status = succeeded lb # [ 161.875208] niks3-server[1051]: 2026/09/20 12:49:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.898964] nix-grpc-daemon[1624]: time=2026-09-20T12:49:12.419Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 161.900597] nix-grpc-daemon[1624]: time=2026-09-20T12:49:12.419Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 161.908402] niks3-server[1051]: 2026/09/20 12:49:12 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 161.929579] niks3-server[1051]: 2026/09/20 12:49:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 161.942977] niks3-server[1051]: 2026/09/20 12:49:12 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 161.951315] niks3-server[1051]: 2026/09/20 12:49:12 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 161.957370] niks3-server[1051]: 2026/09/20 12:49:12 INFO Signed narinfos id=51 count=1 worker1 # [ 161.970042] nix-grpc-daemon[1624]: time=2026-09-20T12:49:12.491Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.964536] niks3-server[1051]: 2026/09/20 12:49:12 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 161.971400] niks3-server[1051]: 2026/09/20 12:49:12 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo lb # [ 161.982520] niks3-server[1051]: 2026/09/20 12:49:12 INFO Completed upload id=51 worker1 # [ 161.995022] nix-grpc-daemon[1624]: time=2026-09-20T12:49:12.516Z level=INFO msg="Upload complete. (337ms)" worker1 # [ 162.009255] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=1 worker1 # [ 162.026839] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:12Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 162.032736] nix-daemon[835]: reaped child process 1896, status = succeeded worker1 # [ 162.049368] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 162.066101] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 162.074134] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:12Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 162.085657] nix-grpc-daemon[1624]: time=2026-09-20T12:49:12.607Z level=INFO msg="All 1 paths already cached" worker1 # [ 162.094999] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 162.108712] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 162.303982] nix-daemon[835]: accepted connection from pid 1922, user nix-grpc-daemon (trusted) worker1 # [ 162.324620] nix-daemon[835]: reaped child process 1925, status = succeeded worker1 # [ 162.500597] nix-daemon[835]: accepted connection from pid 1927, user nix-grpc-daemon (trusted) worker1 # [ 162.520223] nix-daemon[835]: reaped child process 1930, status = succeeded lb # [ 162.519337] niks3-server[1051]: 2026/09/20 12:49:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.545765] nix-grpc-daemon[1624]: time=2026-09-20T12:49:13.067Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 162.547387] nix-grpc-daemon[1624]: time=2026-09-20T12:49:13.067Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 162.555888] niks3-server[1051]: 2026/09/20 12:49:13 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 162.583019] nix-grpc-daemon[1624]: time=2026-09-20T12:49:13.104Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.570657] niks3-server[1051]: 2026/09/20 12:49:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 162.581930] niks3-server[1051]: 2026/09/20 12:49:13 INFO Signed narinfos id=52 count=1 lb # [ 162.588823] niks3-server[1051]: 2026/09/20 12:49:13 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 162.596636] niks3-server[1051]: 2026/09/20 12:49:13 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 162.604254] niks3-server[1051]: 2026/09/20 12:49:13 INFO Completed upload id=52 lb # [ 162.607688] niks3-server[1051]: 2026/09/20 12:49:13 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 162.614041] nix-grpc-daemon[1624]: time=2026-09-20T12:49:13.135Z level=INFO msg="Upload complete. (489ms)" worker1 # [ 162.624601] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 162.635668] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 162.642392] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 162.647068] nix-daemon[835]: reaped child process 1920, status = succeeded worker1 # [ 162.659766] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 163.486198] nix-daemon[835]: reaped child process 1934, status = succeeded worker1 # [ 163.655193] nix-daemon[835]: accepted connection from pid 1949, user nix-grpc-daemon (trusted) worker1 # [ 163.675058] nix-daemon[835]: reaped child process 1952, status = succeeded lb # [ 163.675343] niks3-server[1051]: 2026/09/20 12:49:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.700422] nix-grpc-daemon[1624]: time=2026-09-20T12:49:14.219Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 163.701911] nix-grpc-daemon[1624]: time=2026-09-20T12:49:14.219Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 163.712659] niks3-server[1051]: 2026/09/20 12:49:14 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 163.730128] niks3-server[1051]: 2026/09/20 12:49:14 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 163.741420] niks3-server[1051]: 2026/09/20 12:49:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker1 # [ 163.760767] nix-grpc-daemon[1624]: time=2026-09-20T12:49:14.282Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.750174] niks3-server[1051]: 2026/09/20 12:49:14 INFO Signed narinfos id=53 count=1 lb # [ 163.756073] niks3-server[1051]: 2026/09/20 12:49:14 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 163.767718] niks3-server[1051]: 2026/09/20 12:49:14 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 163.774382] niks3-server[1051]: 2026/09/20 12:49:14 INFO Completed upload id=53 worker1 # [ 163.786790] nix-grpc-daemon[1624]: time=2026-09-20T12:49:14.308Z level=INFO msg="Upload complete. (315ms)" lb # [ 163.777570] niks3-server[1051]: 2026/09/20 12:49:14 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker1 # [ 163.804583] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=1 worker1 # [ 163.821707] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:14Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 163.832994] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 163.839193] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:14Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 163.852244] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 163.858562] nix-daemon[835]: reaped child process 1932, status = succeeded worker1 # [ 163.862886] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 163.866194] nix-grpc-daemon[1624]: time=2026-09-20T12:49:14.354Z level=INFO msg="All 1 paths already cached" worker1 # [ 163.869584] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 164.045708] nix-daemon[835]: accepted connection from pid 1958, user nix-grpc-daemon (trusted) worker1 # [ 164.064750] nix-daemon[835]: reaped child process 1961, status = succeeded worker1 # [ 164.239122] nix-daemon[835]: accepted connection from pid 1963, user nix-grpc-daemon (trusted) worker1 # [ 164.256726] nix-daemon[835]: reaped child process 1966, status = succeeded lb # [ 164.258856] niks3-server[1051]: 2026/09/20 12:49:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.280155] nix-grpc-daemon[1624]: time=2026-09-20T12:49:14.801Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 164.281713] nix-grpc-daemon[1624]: time=2026-09-20T12:49:14.801Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 164.289418] niks3-server[1051]: 2026/09/20 12:49:14 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 164.303750] niks3-server[1051]: 2026/09/20 12:49:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 164.322786] nix-grpc-daemon[1624]: time=2026-09-20T12:49:14.844Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.315758] niks3-server[1051]: 2026/09/20 12:49:14 INFO Signed narinfos id=54 count=1 lb # [ 164.322673] niks3-server[1051]: 2026/09/20 12:49:14 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls worker1 # [ 164.344863] nix-grpc-daemon[1624]: time=2026-09-20T12:49:14.866Z level=INFO msg="Upload complete. (482ms)" lb # [ 164.332749] niks3-server[1051]: 2026/09/20 12:49:14 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 164.338009] niks3-server[1051]: 2026/09/20 12:49:14 INFO Completed upload id=54 worker1 # [ 164.352177] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 164.341379] niks3-server[1051]: 2026/09/20 12:49:14 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 164.366716] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 164.372842] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 164.378110] nix-daemon[835]: reaped child process 1956, status = succeeded worker1 # [ 164.389410] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 165.825586] nix-daemon[835]: reaped child process 1970, status = succeeded worker1 # [ 166.001985] nix-daemon[835]: accepted connection from pid 1985, user nix-grpc-daemon (trusted) worker1 # [ 166.019605] nix-daemon[835]: reaped child process 1988, status = succeeded lb # [ 166.021556] niks3-server[1051]: 2026/09/20 12:49:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.046264] nix-grpc-daemon[1624]: time=2026-09-20T12:49:16.566Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 166.048274] nix-grpc-daemon[1624]: time=2026-09-20T12:49:16.566Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 166.059674] niks3-server[1051]: 2026/09/20 12:49:16 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 166.073659] niks3-server[1051]: 2026/09/20 12:49:16 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 166.084212] niks3-server[1051]: 2026/09/20 12:49:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 166.102255] nix-grpc-daemon[1624]: time=2026-09-20T12:49:16.623Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.092917] niks3-server[1051]: 2026/09/20 12:49:16 INFO Signed narinfos id=55 count=1 lb # [ 166.098442] niks3-server[1051]: 2026/09/20 12:49:16 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 166.107014] niks3-server[1051]: 2026/09/20 12:49:16 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 166.114560] niks3-server[1051]: 2026/09/20 12:49:16 INFO Completed upload id=55 worker1 # [ 166.126352] nix-grpc-daemon[1624]: time=2026-09-20T12:49:16.648Z level=INFO msg="Upload complete. (324ms)" lb # [ 166.117695] niks3-server[1051]: 2026/09/20 12:49:16 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 166.144851] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=1 worker1 # [ 166.166343] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:16Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 166.170674] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 166.176204] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:16Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 166.182303] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 166.187341] nix-daemon[835]: reaped child process 1968, status = succeeded worker1 # [ 166.189584] nix-grpc-daemon[1624]: time=2026-09-20T12:49:16.708Z level=INFO msg="All 1 paths already cached" worker1 # [ 166.194657] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 166.210055] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 166.397392] nix-daemon[835]: accepted connection from pid 1994, user nix-grpc-daemon (trusted) worker1 # [ 166.415538] nix-daemon[835]: reaped child process 1997, status = succeeded worker1 # [ 166.596357] nix-daemon[835]: accepted connection from pid 1999, user nix-grpc-daemon (trusted) worker1 # [ 166.613433] nix-daemon[835]: reaped child process 2002, status = succeeded lb # [ 166.615129] niks3-server[1051]: 2026/09/20 12:49:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.636615] nix-grpc-daemon[1624]: time=2026-09-20T12:49:17.158Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 166.638137] nix-grpc-daemon[1624]: time=2026-09-20T12:49:17.158Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 166.645187] niks3-server[1051]: 2026/09/20 12:49:17 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst worker1 # [ 166.670579] nix-grpc-daemon[1624]: time=2026-09-20T12:49:17.192Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.662669] niks3-server[1051]: 2026/09/20 12:49:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 166.673104] niks3-server[1051]: 2026/09/20 12:49:17 INFO Signed narinfos id=56 count=1 lb # [ 166.678185] niks3-server[1051]: 2026/09/20 12:49:17 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 166.687840] niks3-server[1051]: 2026/09/20 12:49:17 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete worker1 # [ 166.706179] nix-grpc-daemon[1624]: time=2026-09-20T12:49:17.228Z level=INFO msg="Upload complete. (490ms)" lb # [ 166.694485] niks3-server[1051]: 2026/09/20 12:49:17 INFO Completed upload id=56 lb # [ 166.698923] niks3-server[1051]: 2026/09/20 12:49:17 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 166.717002] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 166.726720] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 166.734000] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 166.738594] nix-daemon[835]: reaped child process 1992, status = succeeded worker1 # [ 166.751953] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 167.597943] nix-daemon[835]: reaped child process 2006, status = succeeded worker1 # [ 167.783519] nix-daemon[835]: accepted connection from pid 2021, user nix-grpc-daemon (trusted) worker1 # [ 167.801158] nix-daemon[835]: reaped child process 2024, status = succeeded lb # [ 167.802922] niks3-server[1051]: 2026/09/20 12:49:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.827712] nix-grpc-daemon[1624]: time=2026-09-20T12:49:18.346Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 167.829458] nix-grpc-daemon[1624]: time=2026-09-20T12:49:18.346Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 167.833820] niks3-server[1051]: 2026/09/20 12:49:18 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 167.847375] niks3-server[1051]: 2026/09/20 12:49:18 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 167.866283] niks3-server[1051]: 2026/09/20 12:49:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 167.884131] nix-grpc-daemon[1624]: time=2026-09-20T12:49:18.405Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.878402] niks3-server[1051]: 2026/09/20 12:49:18 INFO Signed narinfos id=57 count=1 lb # [ 167.885223] niks3-server[1051]: 2026/09/20 12:49:18 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 167.894558] niks3-server[1051]: 2026/09/20 12:49:18 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 167.900127] niks3-server[1051]: 2026/09/20 12:49:18 INFO Completed upload id=57 worker1 # [ 167.911890] nix-grpc-daemon[1624]: time=2026-09-20T12:49:18.433Z level=INFO msg="Upload complete. (348ms)" lb # [ 167.903331] niks3-server[1051]: 2026/09/20 12:49:18 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker1 # [ 167.925220] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=1 worker1 # [ 167.942903] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:18Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 167.947624] nix-daemon[835]: reaped child process 2004, status = succeeded worker1 # [ 167.966463] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 167.977372] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:18Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 167.989759] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 168.005796] nix-grpc-daemon[1624]: time=2026-09-20T12:49:18.527Z level=INFO msg="All 2 paths already cached" worker1 # [ 168.015086] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 168.029518] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 168.229691] nix-daemon[835]: accepted connection from pid 2030, user nix-grpc-daemon (trusted) worker1 # [ 168.250637] nix-daemon[835]: reaped child process 2033, status = succeeded worker1 # [ 168.426274] nix-daemon[835]: accepted connection from pid 2035, user nix-grpc-daemon (trusted) worker1 # [ 168.445037] nix-daemon[835]: reaped child process 2038, status = succeeded lb # [ 168.443762] niks3-server[1051]: 2026/09/20 12:49:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.465703] nix-grpc-daemon[1624]: time=2026-09-20T12:49:18.987Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 168.467236] nix-grpc-daemon[1624]: time=2026-09-20T12:49:18.987Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 168.472830] niks3-server[1051]: 2026/09/20 12:49:18 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 168.497295] nix-grpc-daemon[1624]: time=2026-09-20T12:49:19.019Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.489334] niks3-server[1051]: 2026/09/20 12:49:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 168.500587] niks3-server[1051]: 2026/09/20 12:49:19 INFO Signed narinfos id=58 count=1 lb # [ 168.505748] niks3-server[1051]: 2026/09/20 12:49:19 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls worker1 # [ 168.527513] nix-grpc-daemon[1624]: time=2026-09-20T12:49:19.049Z level=INFO msg="Upload complete. (484ms)" lb # [ 168.517019] niks3-server[1051]: 2026/09/20 12:49:19 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 168.523446] niks3-server[1051]: 2026/09/20 12:49:19 INFO Completed upload id=58 worker1 # [ 168.535791] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 168.526544] niks3-server[1051]: 2026/09/20 12:49:19 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 168.545215] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 168.555425] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 168.560569] nix-daemon[835]: reaped child process 2028, status = succeeded worker1 # [ 168.575070] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 169.621108] nix-daemon[835]: reaped child process 2042, status = succeeded worker1 # [ 169.799710] nix-daemon[835]: accepted connection from pid 2057, user nix-grpc-daemon (trusted) worker1 # [ 169.817282] nix-daemon[835]: reaped child process 2060, status = succeeded lb # [ 169.822398] niks3-server[1051]: 2026/09/20 12:49:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 169.843574] nix-grpc-daemon[1624]: time=2026-09-20T12:49:20.364Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 169.845226] nix-grpc-daemon[1624]: time=2026-09-20T12:49:20.364Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 169.864907] niks3-server[1051]: 2026/09/20 12:49:20 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker1 # [ 169.887167] nix-grpc-daemon[1624]: time=2026-09-20T12:49:20.408Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.877405] niks3-server[1051]: 2026/09/20 12:49:20 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 169.887000] niks3-server[1051]: 2026/09/20 12:49:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 169.891907] niks3-server[1051]: 2026/09/20 12:49:20 INFO Signed narinfos id=59 count=1 worker1 # [ 169.911206] nix-grpc-daemon[1624]: time=2026-09-20T12:49:20.433Z level=INFO msg="Upload complete. (325ms)" lb # [ 169.899501] niks3-server[1051]: 2026/09/20 12:49:20 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 169.905081] niks3-server[1051]: 2026/09/20 12:49:20 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 169.909517] niks3-server[1051]: 2026/09/20 12:49:20 INFO Completed upload id=59 worker1 # [ 169.920955] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=1 lb # [ 169.911833] niks3-server[1051]: 2026/09/20 12:49:20 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker1 # [ 169.937071] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:20Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 169.941202] nix-daemon[835]: reaped child process 2040, status = succeeded worker1 # [ 169.964610] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 169.979117] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 169.992634] nix-grpc-daemon[1624]: time=2026-09-20T12:49:20.514Z level=INFO msg="All 2 paths already cached" worker1 # [ 170.001441] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 170.014328] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 170.213345] nix-daemon[835]: accepted connection from pid 2064, user nix-grpc-daemon (trusted) worker1 # [ 170.231360] nix-daemon[835]: reaped child process 2067, status = succeeded worker1 # [ 170.409554] nix-daemon[835]: accepted connection from pid 2069, user nix-grpc-daemon (trusted) worker1 # [ 170.428255] nix-daemon[835]: reaped child process 2072, status = succeeded lb # [ 170.427292] niks3-server[1051]: 2026/09/20 12:49:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.448557] nix-grpc-daemon[1624]: time=2026-09-20T12:49:20.970Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 170.450079] nix-grpc-daemon[1624]: time=2026-09-20T12:49:20.970Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 170.456104] niks3-server[1051]: 2026/09/20 12:49:20 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 170.480989] nix-grpc-daemon[1624]: time=2026-09-20T12:49:21.002Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.471145] niks3-server[1051]: 2026/09/20 12:49:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 170.482244] niks3-server[1051]: 2026/09/20 12:49:20 INFO Signed narinfos id=60 count=1 lb # [ 170.487499] niks3-server[1051]: 2026/09/20 12:49:21 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 170.495840] niks3-server[1051]: 2026/09/20 12:49:21 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 170.512673] nix-grpc-daemon[1624]: time=2026-09-20T12:49:21.034Z level=INFO msg="Upload complete. (483ms)" lb # [ 170.501084] niks3-server[1051]: 2026/09/20 12:49:21 INFO Completed upload id=60 lb # [ 170.504916] niks3-server[1051]: 2026/09/20 12:49:21 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 170.520156] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 170.528800] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 170.540219] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 170.544969] nix-daemon[835]: reaped child process 2062, status = succeeded worker1 # [ 170.558686] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 171.379788] nix-daemon[835]: reaped child process 2076, status = succeeded worker1 # [ 171.538328] nix-daemon[835]: accepted connection from pid 2091, user nix-grpc-daemon (trusted) worker1 # [ 171.560170] nix-daemon[835]: reaped child process 2094, status = succeeded lb # [ 171.561692] niks3-server[1051]: 2026/09/20 12:49:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 171.586872] nix-grpc-daemon[1624]: time=2026-09-20T12:49:22.106Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 171.588533] nix-grpc-daemon[1624]: time=2026-09-20T12:49:22.106Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 171.604240] niks3-server[1051]: 2026/09/20 12:49:22 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 171.616993] niks3-server[1051]: 2026/09/20 12:49:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 171.634763] nix-grpc-daemon[1624]: time=2026-09-20T12:49:22.156Z level=INFO msg="Uploading 1 narinfos" lb # [ 171.625233] niks3-server[1051]: 2026/09/20 12:49:22 INFO Signed narinfos id=61 count=1 lb # [ 171.632521] niks3-server[1051]: 2026/09/20 12:49:22 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 171.642503] niks3-server[1051]: 2026/09/20 12:49:22 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls worker1 # [ 171.662050] nix-grpc-daemon[1624]: time=2026-09-20T12:49:22.183Z level=INFO msg="Upload complete. (294ms)" lb # [ 171.650402] niks3-server[1051]: 2026/09/20 12:49:22 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 171.654345] niks3-server[1051]: 2026/09/20 12:49:22 INFO Completed upload id=61 lb # [ 171.658280] niks3-server[1051]: 2026/09/20 12:49:22 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker1 # [ 171.673052] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=1 worker1 # [ 171.692260] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:22Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 171.696944] nix-daemon[835]: reaped child process 2074, status = succeeded worker1 # [ 171.717287] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 171.733717] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 171.749510] nix-grpc-daemon[1624]: time=2026-09-20T12:49:22.271Z level=INFO msg="All 2 paths already cached" worker1 # [ 171.760131] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 171.774775] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 171.979077] nix-daemon[835]: accepted connection from pid 2098, user nix-grpc-daemon (trusted) worker1 # [ 171.997992] nix-daemon[835]: reaped child process 2101, status = succeeded worker1 # [ 172.183818] nix-daemon[835]: accepted connection from pid 2103, user nix-grpc-daemon (trusted) worker1 # [ 172.202513] nix-daemon[835]: reaped child process 2106, status = succeeded lb # [ 172.204412] niks3-server[1051]: 2026/09/20 12:49:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 172.227165] nix-grpc-daemon[1624]: time=2026-09-20T12:49:22.748Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 172.228842] nix-grpc-daemon[1624]: time=2026-09-20T12:49:22.748Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 172.235221] niks3-server[1051]: 2026/09/20 12:49:22 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 172.272661] nix-grpc-daemon[1624]: time=2026-09-20T12:49:22.794Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.254036] niks3-server[1051]: 2026/09/20 12:49:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 172.267177] niks3-server[1051]: 2026/09/20 12:49:22 INFO Signed narinfos id=62 count=1 lb # [ 172.274394] niks3-server[1051]: 2026/09/20 12:49:22 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 172.285665] niks3-server[1051]: 2026/09/20 12:49:22 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 172.290614] niks3-server[1051]: 2026/09/20 12:49:22 INFO Completed upload id=62 worker1 # [ 172.302618] nix-grpc-daemon[1624]: time=2026-09-20T12:49:22.824Z level=INFO msg="Upload complete. (511ms)" lb # [ 172.293662] niks3-server[1051]: 2026/09/20 12:49:22 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 172.312287] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 172.320396] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 worker1 # [ 172.334310] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 172.339880] nix-daemon[835]: reaped child process 2096, status = succeeded worker1 # [ 172.353664] nix-daemon[835]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker1 # [ 173.201575] nix-daemon[835]: reaped child process 2110, status = succeeded worker1 # [ 173.383369] nix-daemon[835]: accepted connection from pid 2125, user nix-grpc-daemon (trusted) worker1 # [ 173.402529] nix-daemon[835]: reaped child process 2128, status = succeeded lb # [ 173.406825] niks3-server[1051]: 2026/09/20 12:49:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 173.432588] nix-grpc-daemon[1624]: time=2026-09-20T12:49:23.953Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 173.434656] nix-grpc-daemon[1624]: time=2026-09-20T12:49:23.953Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 173.452665] niks3-server[1051]: 2026/09/20 12:49:23 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 173.470914] niks3-server[1051]: 2026/09/20 12:49:23 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 173.485597] niks3-server[1051]: 2026/09/20 12:49:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign worker1 # [ 173.502789] nix-grpc-daemon[1624]: time=2026-09-20T12:49:24.024Z level=INFO msg="Uploading 1 narinfos" lb # [ 173.495130] niks3-server[1051]: 2026/09/20 12:49:24 INFO Signed narinfos id=63 count=1 lb # [ 173.500506] niks3-server[1051]: 2026/09/20 12:49:24 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 173.508340] niks3-server[1051]: 2026/09/20 12:49:24 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 173.516462] niks3-server[1051]: 2026/09/20 12:49:24 INFO Completed upload id=63 worker1 # [ 173.528327] nix-grpc-daemon[1624]: time=2026-09-20T12:49:24.050Z level=INFO msg="Upload complete. (360ms)" lb # [ 173.519757] niks3-server[1051]: 2026/09/20 12:49:24 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 173.541542] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42100 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=1 worker1 # [ 173.563341] nix-daemon[835]: reaped child process 2108, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.27 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1 worker2 # [ 174.035753] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 174.047115] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 174.065981] nix-grpc-daemon[1591]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5) worker2 # [ 174.090829] nix-grpc-daemon[1591]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 2/5) worker2 # [ 174.131675] nix-grpc-daemon[1591]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 292 ms (attempt 3/5) worker2 # [ 174.432109] nix-grpc-daemon[1591]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 652 ms (attempt 4/5) worker2 # [ 175.086398] nix-grpc-daemon[1591]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 175.092752] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:25Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 1.40 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 19.75 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 176.573863] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:27Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.14 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 177.735080] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 177.743578] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42842 worker1 # [ 177.741107] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:28Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker1 # [ 177.741558] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:28Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 177.818602] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 177.837234] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42842 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 177.855898] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 177.873361] nix-daemon[848]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) worker2 # [ 177.905723] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:28Z level=info event=niks3_push_started pid=1647 worker2 # [ 178.126982] nix-grpc-daemon[1647]: time=2026-09-20T12:49:28.639Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 178.317144] nix-daemon[848]: accepted connection from pid 1660, user nix-grpc-daemon (trusted) worker2 # [ 178.336747] nix-daemon[848]: reaped child process 1663, status = succeeded worker2 # [ 178.528771] nix-daemon[848]: accepted connection from pid 1665, user nix-grpc-daemon (trusted) worker2 # [ 178.546481] nix-daemon[848]: reaped child process 1668, status = succeeded lb # [ 178.518978] niks3-server[1051]: 2026/09/20 12:49:29 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 178.575882] nix-grpc-daemon[1647]: time=2026-09-20T12:49:29.088Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 178.577874] nix-grpc-daemon[1647]: time=2026-09-20T12:49:29.088Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 178.564774] niks3-server[1051]: 2026/09/20 12:49:29 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 178.573546] niks3-server[1051]: 2026/09/20 12:49:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker2 # [ 178.625479] nix-grpc-daemon[1647]: time=2026-09-20T12:49:29.138Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.587118] niks3-server[1051]: 2026/09/20 12:49:29 INFO Signed narinfos id=64 count=1 lb # [ 178.597362] niks3-server[1051]: 2026/09/20 12:49:29 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 178.606838] niks3-server[1051]: 2026/09/20 12:49:29 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 178.616512] niks3-server[1051]: 2026/09/20 12:49:29 INFO Completed upload id=64 worker2 # [ 178.658607] nix-grpc-daemon[1647]: time=2026-09-20T12:49:29.172Z level=INFO msg="Upload complete. (527ms)" lb # [ 178.620647] niks3-server[1051]: 2026/09/20 12:49:29 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 178.668621] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42842 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 178.686809] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 178.694266] nix-daemon[848]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) worker2 # [ 178.699407] nix-daemon[848]: reaped child process 1645, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... worker2 # [ 178.711160] nix-daemon[848]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv client # farm-a> LOG-farm-a-drain worker2 # [ 179.963159] nix-daemon[848]: reaped child process 1672, status = succeeded worker2 # [ 180.139196] nix-daemon[848]: accepted connection from pid 1687, user nix-grpc-daemon (trusted) worker2 # [ 180.159645] nix-daemon[848]: reaped child process 1690, status = succeeded lb # [ 180.127946] niks3-server[1051]: 2026/09/20 12:49:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 180.183398] nix-grpc-daemon[1647]: time=2026-09-20T12:49:30.696Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 180.188765] nix-grpc-daemon[1647]: time=2026-09-20T12:49:30.698Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 180.164716] niks3-server[1051]: 2026/09/20 12:49:30 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 180.180795] niks3-server[1051]: 2026/09/20 12:49:30 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 180.191442] niks3-server[1051]: 2026/09/20 12:49:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 180.243508] nix-grpc-daemon[1647]: time=2026-09-20T12:49:30.755Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.197717] niks3-server[1051]: 2026/09/20 12:49:30 INFO Signed narinfos id=65 count=1 lb # [ 180.202848] niks3-server[1051]: 2026/09/20 12:49:30 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 180.215476] niks3-server[1051]: 2026/09/20 12:49:30 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 180.221902] niks3-server[1051]: 2026/09/20 12:49:30 INFO Completed upload id=65 worker2 # [ 180.267072] nix-grpc-daemon[1647]: time=2026-09-20T12:49:30.780Z level=INFO msg="Upload complete. (337ms)" lb # [ 180.224887] niks3-server[1051]: 2026/09/20 12:49:30 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 180.277039] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42842 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=1 worker1 # [ 180.252694] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:30Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker1 # [ 180.253073] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:30Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 180.295587] nix-daemon[848]: reaped child process 1670, status = succeeded worker2 # [ 180.331064] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 180.347667] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 180.362754] nix-grpc-daemon[1647]: time=2026-09-20T12:49:30.876Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 180.373323] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 180.387770] nix-daemon[848]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) worker2 # [ 180.592380] nix-daemon[848]: accepted connection from pid 1694, user nix-grpc-daemon (trusted) worker2 # [ 180.613041] nix-daemon[848]: reaped child process 1697, status = succeeded worker2 # [ 180.789006] nix-daemon[848]: accepted connection from pid 1699, user nix-grpc-daemon (trusted) worker2 # [ 180.807165] nix-daemon[848]: reaped child process 1702, status = succeeded lb # [ 180.772898] niks3-server[1051]: 2026/09/20 12:49:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 180.827969] nix-grpc-daemon[1647]: time=2026-09-20T12:49:31.341Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 180.829608] nix-grpc-daemon[1647]: time=2026-09-20T12:49:31.341Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 180.799003] niks3-server[1051]: 2026/09/20 12:49:31 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 180.858779] nix-grpc-daemon[1647]: time=2026-09-20T12:49:31.372Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.814396] niks3-server[1051]: 2026/09/20 12:49:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 180.828787] niks3-server[1051]: 2026/09/20 12:49:31 INFO Signed narinfos id=66 count=1 lb # [ 180.831614] niks3-server[1051]: 2026/09/20 12:49:31 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 180.841464] niks3-server[1051]: 2026/09/20 12:49:31 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 180.848674] niks3-server[1051]: 2026/09/20 12:49:31 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo lb # [ 180.854655] niks3-server[1051]: 2026/09/20 12:49:31 INFO Completed upload id=66 worker2 # [ 180.900103] nix-grpc-daemon[1647]: time=2026-09-20T12:49:31.413Z level=INFO msg="Upload complete. (495ms)" worker2 # [ 180.908529] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42842 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 180.920539] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 180.930710] nix-daemon[848]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) worker2 # [ 180.940297] nix-daemon[848]: reaped child process 1692, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 180.952877] nix-daemon[848]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) lb # [ 181.033878] envoy[913]: conn peer=[2001:db8:1::1]:53372 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27101 tx=10611 ms=17965 lb # [ 181.039191] envoy[913]: conn peer=[2001:db8:1::1]:40210 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=524 ms=1118 client # farm-b> LOG-farm-b-drain worker2 # [ 181.799248] nix-daemon[848]: reaped child process 1706, status = succeeded worker2 # [ 181.979727] nix-daemon[848]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker2 # [ 181.997935] nix-daemon[848]: reaped child process 1724, status = succeeded lb # [ 181.966176] niks3-server[1051]: 2026/09/20 12:49:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 182.021852] nix-grpc-daemon[1647]: time=2026-09-20T12:49:32.534Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 182.023369] nix-grpc-daemon[1647]: time=2026-09-20T12:49:32.534Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 181.998546] niks3-server[1051]: 2026/09/20 12:49:32 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 182.012523] niks3-server[1051]: 2026/09/20 12:49:32 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 182.024971] niks3-server[1051]: 2026/09/20 12:49:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 182.075188] nix-grpc-daemon[1647]: time=2026-09-20T12:49:32.588Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.032342] niks3-server[1051]: 2026/09/20 12:49:32 INFO Signed narinfos id=67 count=1 lb # [ 182.039495] niks3-server[1051]: 2026/09/20 12:49:32 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 182.048360] niks3-server[1051]: 2026/09/20 12:49:32 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 182.056316] niks3-server[1051]: 2026/09/20 12:49:32 INFO Completed upload id=67 worker2 # [ 182.101753] nix-grpc-daemon[1647]: time=2026-09-20T12:49:32.615Z level=INFO msg="Upload complete. (337ms)" lb # [ 182.059095] niks3-server[1051]: 2026/09/20 12:49:32 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 182.113188] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42842 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=1 worker1 # [ 182.086425] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:32Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker1 # [ 182.092640] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:32Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 182.134087] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 182.143162] nix-daemon[848]: reaped child process 1704, status = succeeded worker2 # [ 182.151031] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 182.163872] nix-grpc-daemon[1647]: time=2026-09-20T12:49:32.677Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 182.173043] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 182.184795] nix-daemon[848]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) worker2 # [ 182.378023] nix-daemon[848]: accepted connection from pid 1728, user nix-grpc-daemon (trusted) worker2 # [ 182.398356] nix-daemon[848]: reaped child process 1731, status = succeeded worker2 # [ 182.571654] nix-daemon[848]: accepted connection from pid 1733, user nix-grpc-daemon (trusted) worker2 # [ 182.589799] nix-daemon[848]: reaped child process 1736, status = succeeded lb # [ 182.557482] niks3-server[1051]: 2026/09/20 12:49:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 182.613202] nix-grpc-daemon[1647]: time=2026-09-20T12:49:33.126Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 182.614750] nix-grpc-daemon[1647]: time=2026-09-20T12:49:33.126Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 182.583569] niks3-server[1051]: 2026/09/20 12:49:33 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst lb # [ 182.597439] niks3-server[1051]: 2026/09/20 12:49:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign worker2 # [ 182.652525] nix-grpc-daemon[1647]: time=2026-09-20T12:49:33.165Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.609917] niks3-server[1051]: 2026/09/20 12:49:33 INFO Signed narinfos id=68 count=1 lb # [ 182.615781] niks3-server[1051]: 2026/09/20 12:49:33 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 182.625125] niks3-server[1051]: 2026/09/20 12:49:33 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 182.631720] niks3-server[1051]: 2026/09/20 12:49:33 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo lb # [ 182.636362] niks3-server[1051]: 2026/09/20 12:49:33 INFO Completed upload id=68 worker2 # [ 182.681450] nix-grpc-daemon[1647]: time=2026-09-20T12:49:33.195Z level=INFO msg="Upload complete. (484ms)" worker2 # [ 182.688211] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42842 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 182.698630] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42842 worker2 # [ 182.709620] nix-daemon[848]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) worker2 # [ 182.719955] nix-daemon[848]: reaped child process 1726, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... worker2 # [ 182.727596] nix-daemon[848]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv client # farm-top> LOG-farm-top-drain worker2 # [ 183.753061] nix-daemon[848]: reaped child process 1740, status = succeeded worker2 # [ 183.928242] nix-daemon[848]: accepted connection from pid 1755, user nix-grpc-daemon (trusted) worker2 # [ 183.948330] nix-daemon[848]: reaped child process 1758, status = succeeded lb # [ 183.918437] niks3-server[1051]: 2026/09/20 12:49:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 183.974721] nix-grpc-daemon[1647]: time=2026-09-20T12:49:34.486Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 183.976357] nix-grpc-daemon[1647]: time=2026-09-20T12:49:34.486Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 183.955672] niks3-server[1051]: 2026/09/20 12:49:34 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 183.969626] niks3-server[1051]: 2026/09/20 12:49:34 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 183.982958] niks3-server[1051]: 2026/09/20 12:49:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker2 # [ 184.032876] nix-grpc-daemon[1647]: time=2026-09-20T12:49:34.546Z level=INFO msg="Uploading 1 narinfos" lb # [ 183.992351] niks3-server[1051]: 2026/09/20 12:49:34 INFO Signed narinfos id=69 count=1 lb # [ 183.998298] niks3-server[1051]: 2026/09/20 12:49:34 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 184.009291] niks3-server[1051]: 2026/09/20 12:49:34 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 184.015071] niks3-server[1051]: 2026/09/20 12:49:34 INFO Completed upload id=69 worker2 # [ 184.059769] nix-grpc-daemon[1647]: time=2026-09-20T12:49:34.573Z level=INFO msg="Upload complete. (323ms)" lb # [ 184.018196] niks3-server[1051]: 2026/09/20 12:49:34 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 184.073174] nix-grpc-daemon[1591]: ts=2026-09-20T12:49:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42842 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=1 worker2 # [ 184.089425] nix-daemon[848]: reaped child process 1738, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.66 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 185.587650] nix-grpc-daemon[1550]: ts=2026-09-20T12:49:36Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.57 seconds) (finished: run the VM test script, in 186.85 seconds) test script finished in 187.15s cleanup kill QemuMachine (pid 51) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 49) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.23 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh