tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.v4kMyfsohP', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) client: QEMU running (pid 49) client # Discarding device blocks: 0/262144 done worker2 # Disk image does not exist, creating the virtualisation disk image... worker1 # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 50) worker1: QEMU running (pid 52) worker2 # Formatting '/build/vm-state-worker2/tmp.ZSdbg2vcgm', fmt=raw size=1073741824 worker1 # Formatting '/build/vm-state-worker1/tmp.73izEfYZoI', fmt=raw size=1073741824 lb # Disk image does not exist, creating the virtualisation disk image... worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # mke2fs 1.47.4 (6-Mar-2025) lb # Formatting '/build/vm-state-lb/tmp.jvhlzNK0NL', fmt=raw size=1073741824 worker2 # Discarding device blocks: 0/262144 done worker1 # Discarding device blocks: 0/262144 done lb # mke2fs 1.47.4 (6-Mar-2025) worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Discarding device blocks: 0/262144 done worker2 # Filesystem UUID: 98a4235e-afaf-4a21-9a87-9e1d3d90e796 worker1 # Filesystem UUID: 994cdaf9-6843-495b-a529-514756fb73ac lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Superblock backups stored on blocks: worker1 # Superblock backups stored on blocks: lb # Filesystem UUID: 56d7eb97-0933-48bd-9d73-ae2c3288cc12 worker2 # 32768, 98304, 163840, 229376 worker1 # 32768, 98304, 163840, 229376 lb # Superblock backups stored on blocks: worker2 # worker1 # lb # 32768, 98304, 163840, 229376 worker2 # Allocating group tables: 0/8 done worker1 # Allocating group tables: 0/8 done lb # worker2 # Writing inode tables: 0/8 done worker1 # Writing inode tables: 0/8 done lb # Allocating group tables: 0/8 done worker2 # Creating journal (8192 blocks): done worker1 # Creating journal (8192 blocks): done lb # Writing inode tables: 0/8 done worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Writing superblocks and filesystem accounting information: 0/8 done lb # Creating journal (8192 blocks): done worker2 # worker1 # lb # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Virtualisation disk image created. worker1 # Virtualisation disk image created. lb # worker2: QEMU running (pid 51) lb # Virtualisation disk image created. client # Creating filesystem with 262144 4k blocks and 65536 inodes client # Filesystem UUID: 37009b6a-fbe0-40d2-a15e-de82b874ec46 (finished: start all VMs, in 0.44 seconds) client # Superblock backups stored on blocks: client: waiting for unit network-addresses-eth1.service client # 32768, 98304, 163840, 229376 client: waiting for the VM to finish booting client # client # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done client # Writing superblocks and filesystem accounting information: 0/8 done client # client # Virtualisation disk image created. client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] KASLR enabled client # [ 0.000000] random: crng init done client # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] efi: UEFI not found. client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] Zone ranges: client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] DMA32 empty client # [ 0.000000] Normal empty client # [ 0.000000] Device empty client # [ 0.000000] Movable zone start for each node client # [ 0.000000] Early memory node ranges client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test/init regInfo=/nix/store/fyblb9a3ys5cssd508s2s53prxsdfvcl-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/fyblb9a3ys5cssd508s2s53prxsdfvcl-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] Zone ranges: client # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] DMA32 empty lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] DMA32 empty client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] Normal empty worker1 # [ 0.000000] Normal empty worker2 # [ 0.000000] Device empty worker1 # [ 0.000000] Device empty worker2 # [ 0.000000] Movable zone start for each node client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] Early memory node ranges lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Early memory node ranges lb # [ 0.000000] KASLR enabled worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] random: crng init done client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Policy zone: DMA lb # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] Zone ranges: worker2 # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] DMA32 empty client # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000000] Normal empty worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] Device empty worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] Movable zone start for each node client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jbmz6j4lv6g7mbr4lfjirkfpl1ip7l3n-nixos-system-worker2-test/init regInfo=/nix/store/f22848wr761m7mhl13dj0mscxryf1720-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/26z9h8v6khkq1di9bb6h1yw8hdp2av88-nixos-system-worker1-test/init regInfo=/nix/store/amyj3rgkzzcd5a9995vqyvs20ykgifx0-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/f22848wr761m7mhl13dj0mscxryf1720-closure-info/registration", will be passed to user space. client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/amyj3rgkzzcd5a9995vqyvs20ykgifx0-closure-info/registration", will be passed to user space. client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 worker2 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1y76sp58sczakc84qnb2p7nq6lq4cpg2-nixos-system-lb-test/init regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Policy zone: DMA lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Policy zone: DMA client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000039] arm-pv: using stolen time PV worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000749] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000924] Console: colour dummy device 80x25 worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000931] printk: legacy console [tty0] enabled worker1 # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.001121] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.001128] pid_max: default: 32768 minimum: 301 lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.001223] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.001398] landlock: Up and running. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.001401] Yama: becoming mindful. lb # [ 0.000000] Policy zone: DMA client # [ 0.002137] LSM support for eBPF active worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.002312] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.002344] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.003484] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.004236] rcu: Hierarchical SRCU implementation. lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.004240] rcu: Max phase no-delay instances is 1000. lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.005420] fsl-mc MSI: its@8080000 domain created lb # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.005511] EFI services will not be available. worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.005617] smp: Bringing up secondary CPUs ... worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.005625] smp: Brought up 1 node, 1 CPU worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.005628] SMP: Total of 1 processors activated. worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.005634] CPU: All CPU(s) started at EL1 lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.005645] CPU features: detected: Branch Target Identification lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.005650] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.005653] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.005657] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.005661] CPU features: detected: Common not Private translations worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.005664] CPU features: detected: CRC32 instructions worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.005667] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.005670] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.005674] CPU features: detected: Data independent timing control (DIT) client # [ 0.005677] CPU features: detected: E0PD lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.005680] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.005682] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000030] arm-pv: using stolen time PV client # [ 0.005686] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000030] arm-pv: using stolen time PV client # [ 0.005689] CPU features: detected: Fine Grained Traps lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000446] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000608] Console: colour dummy device 80x25 client # [ 0.005693] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.000457] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000637] Console: colour dummy device 80x25 client # [ 0.005699] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.000615] printk: legacy console [tty0] enabled lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000645] printk: legacy console [tty0] enabled client # [ 0.005702] CPU features: detected: LSE atomic instructions worker2 # [ 0.000836] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.005705] CPU features: detected: Privileged Access Never worker2 # [ 0.000843] pid_max: default: 32768 minimum: 301 worker1 # [ 0.000845] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.005707] CPU features: detected: PMUv3 lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000852] pid_max: default: 32768 minimum: 301 worker2 # [ 0.000911] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.005710] CPU features: detected: RAS Extension Support worker2 # [ 0.001061] landlock: Up and running. worker1 # [ 0.000937] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.001064] Yama: becoming mindful. lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.001060] landlock: Up and running. worker2 # [ 0.001558] LSM support for eBPF active client # [ 0.005713] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.001063] Yama: becoming mindful. lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.001562] LSM support for eBPF active worker2 # [ 0.001689] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.005715] CPU features: detected: Random Number Generator worker1 # [ 0.001709] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.005718] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.001721] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.005721] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.001741] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.002840] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000027] arm-pv: using stolen time PV client # [ 0.005724] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.003540] rcu: Hierarchical SRCU implementation. worker1 # [ 0.002822] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.003544] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.003518] rcu: Hierarchical SRCU implementation. client # [ 0.005728] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.000401] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.004734] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.003522] rcu: Max phase no-delay instances is 1000. client # [ 0.005770] alternatives: applying system-wide alternatives worker2 # [ 0.004837] EFI services will not be available. lb # [ 0.000555] Console: colour dummy device 80x25 worker1 # [ 0.004706] fsl-mc MSI: its@8080000 domain created lb # [ 0.000562] printk: legacy console [tty0] enabled client # [ 0.008857] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.004797] EFI services will not be available. worker2 # [ 0.004903] smp: Bringing up secondary CPUs ... worker2 # [ 0.004911] smp: Brought up 1 node, 1 CPU worker1 # [ 0.004860] smp: Bringing up secondary CPUs ... worker2 # [ 0.004914] SMP: Total of 1 processors activated. worker1 # [ 0.004868] smp: Brought up 1 node, 1 CPU lb # [ 0.000748] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.004919] CPU: All CPU(s) started at EL1 client # [ 0.009030] Memory: 1406568K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker1 # [ 0.004871] SMP: Total of 1 processors activated. lb # [ 0.000755] pid_max: default: 32768 minimum: 301 worker2 # [ 0.004930] CPU features: detected: Branch Target Identification client # [ 0.009421] devtmpfs: initialized worker1 # [ 0.004876] CPU: All CPU(s) started at EL1 lb # [ 0.000852] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.004898] CPU features: detected: Branch Target Identification worker2 # [ 0.004935] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.011300] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.000997] landlock: Up and running. lb # [ 0.001000] Yama: becoming mindful. worker1 # [ 0.004904] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.004939] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.001470] LSM support for eBPF active client # [ 0.011322] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.004907] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.011505] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.004942] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.001587] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.011509] 0 pages in range for non-PLT usage worker2 # [ 0.004946] CPU features: detected: Common not Private translations lb # [ 0.001619] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.004911] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.011510] 508288 pages in range for PLT usage worker2 # [ 0.004949] CPU features: detected: CRC32 instructions client # [ 0.011624] pinctrl core: initialized pinctrl subsystem lb # [ 0.002738] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.004914] CPU features: detected: Common not Private translations client # [ 0.012387] DMI not present or invalid. lb # [ 0.003517] rcu: Hierarchical SRCU implementation. worker1 # [ 0.004918] CPU features: detected: CRC32 instructions worker2 # [ 0.004952] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.016103] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.003523] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.004920] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.004956] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.004685] fsl-mc MSI: its@8080000 domain created client # [ 0.018561] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.004959] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.004924] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.004783] EFI services will not be available. worker2 # [ 0.004962] CPU features: detected: E0PD lb # [ 0.004852] smp: Bringing up secondary CPUs ... client # [ 0.018762] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.004927] CPU features: detected: Data independent timing control (DIT) lb # [ 0.004860] smp: Brought up 1 node, 1 CPU worker2 # [ 0.004964] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.004930] CPU features: detected: E0PD client # [ 0.018966] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.004864] SMP: Total of 1 processors activated. worker2 # [ 0.004967] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.004869] CPU: All CPU(s) started at EL1 client # [ 0.018989] audit: initializing netlink subsys (disabled) worker1 # [ 0.004933] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.004971] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.004881] CPU features: detected: Branch Target Identification client # [ 0.019609] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.004936] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.004974] CPU features: detected: Fine Grained Traps client # [ 0.019611] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.004886] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.004939] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.004942] CPU features: detected: Fine Grained Traps worker2 # [ 0.004977] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.019615] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.004889] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.004982] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.019620] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.004946] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.004985] CPU features: detected: LSE atomic instructions lb # [ 0.004892] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.019623] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.004951] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.004988] CPU features: detected: Privileged Access Never lb # [ 0.004896] CPU features: detected: Common not Private translations worker1 # [ 0.004954] CPU features: detected: LSE atomic instructions client # [ 0.019656] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.004991] CPU features: detected: PMUv3 lb # [ 0.004899] CPU features: detected: CRC32 instructions worker1 # [ 0.004957] CPU features: detected: Privileged Access Never client # [ 0.019664] cpuidle: using governor ladder worker2 # [ 0.004993] CPU features: detected: RAS Extension Support worker1 # [ 0.004960] CPU features: detected: PMUv3 client # [ 0.019670] cpuidle: using governor menu lb # [ 0.004902] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.004996] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.004962] CPU features: detected: RAS Extension Support client # [ 0.019864] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.004999] CPU features: detected: Random Number Generator lb # [ 0.004906] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.004965] CPU features: detected: RASv1p1 Extension Support client # [ 0.019880] ASID allocator initialised with 65536 entries lb # [ 0.004909] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.004968] CPU features: detected: Random Number Generator client # [ 0.021141] Serial: AMBA PL011 UART driver worker2 # [ 0.005001] CPU features: detected: Speculation barrier (SB) lb # [ 0.004912] CPU features: detected: E0PD worker2 # [ 0.005004] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.004971] CPU features: detected: Speculation barrier (SB) client # [ 0.026396] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.004914] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.005007] CPU features: detected: TLB range maintenance instructions client # [ 0.026552] printk: console [ttyAMA0] enabled worker1 # [ 0.004973] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.004917] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.005011] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.004976] CPU features: detected: TLB range maintenance instructions lb # [ 0.004920] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.005048] alternatives: applying system-wide alternatives worker1 # [ 0.004981] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.004923] CPU features: detected: Fine Grained Traps worker2 # [ 0.007960] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.005018] alternatives: applying system-wide alternatives lb # [ 0.004927] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.007932] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.004932] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.008144] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker2 # [ 0.008532] devtmpfs: initialized lb # [ 0.004935] CPU features: detected: LSE atomic instructions worker1 # [ 0.008171] Memory: 1406536K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) lb # [ 0.004938] CPU features: detected: Privileged Access Never worker2 # [ 0.010375] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.008551] devtmpfs: initialized lb # [ 0.004940] CPU features: detected: PMUv3 worker1 # [ 0.010431] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.010398] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.010578] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.004943] CPU features: detected: RAS Extension Support worker1 # [ 0.010452] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.004946] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.010625] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.004948] CPU features: detected: Random Number Generator lb # [ 0.004951] CPU features: detected: Speculation barrier (SB) client # [ 0.149112] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.004954] CPU features: detected: Stage-2 Force Write-Back client # [ 0.149132] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.004957] CPU features: detected: TLB range maintenance instructions client # [ 0.149137] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.004962] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.149142] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.004999] alternatives: applying system-wide alternatives client # [ 0.149146] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.007931] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.149151] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.149155] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.008128] Memory: 1406568K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) client # [ 0.149160] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.008543] devtmpfs: initialized worker2 # [ 0.010583] 0 pages in range for non-PLT usage worker2 # [ 0.010584] 508288 pages in range for PLT usage lb # [ 0.010553] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.010629] 0 pages in range for non-PLT usage worker2 # [ 0.010697] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.010630] 508288 pages in range for PLT usage worker2 # [ 0.011433] DMI not present or invalid. lb # [ 0.010577] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.156852] fbcon: Taking over console worker1 # [ 0.010721] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.014791] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.156866] ACPI: Interpreter disabled. lb # [ 0.010769] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.011543] DMI not present or invalid. worker2 # [ 0.016955] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.010774] 0 pages in range for non-PLT usage worker1 # [ 0.014952] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.158733] iommu: Default domain type: Translated lb # [ 0.010775] 508288 pages in range for PLT usage worker2 # [ 0.017140] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.017173] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.158742] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.010880] pinctrl core: initialized pinctrl subsystem lb # [ 0.011771] DMI not present or invalid. worker2 # [ 0.017337] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.160393] SCSI subsystem initialized worker1 # [ 0.017366] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.014880] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.017359] audit: initializing netlink subsys (disabled) worker1 # [ 0.017566] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.017889] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.017222] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.017587] audit: initializing netlink subsys (disabled) worker2 # [ 0.017891] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.017403] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.018168] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.017894] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.018170] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.017601] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.017899] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.018174] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.017624] audit: initializing netlink subsys (disabled) worker2 # [ 0.017902] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.018178] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.018267] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.017926] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.018181] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.018269] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.017934] cpuidle: using governor ladder worker2 # [ 0.017940] cpuidle: using governor menu lb # [ 0.018273] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.165696] usbcore: registered new interface driver usbfs worker1 # [ 0.018207] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.165733] usbcore: registered new interface driver hub worker1 # [ 0.018215] cpuidle: using governor ladder worker2 # [ 0.018125] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.018278] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.018221] cpuidle: using governor menu client # [ 0.165753] usbcore: registered new device driver usb worker2 # [ 0.018141] ASID allocator initialised with 65536 entries lb # [ 0.018281] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.019385] Serial: AMBA PL011 UART driver worker1 # [ 0.018421] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.166046] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.018305] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.018436] ASID allocator initialised with 65536 entries worker2 # [ 0.024551] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.166052] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.018315] cpuidle: using governor ladder worker1 # [ 0.019643] Serial: AMBA PL011 UART driver worker2 # [ 0.024669] printk: console [ttyAMA0] enabled lb # [ 0.018321] cpuidle: using governor menu client # [ 0.166063] PTP clock support registered client # [ 0.166110] EDAC MC: Ver: 3.0.0 worker1 # [ 0.024894] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.018517] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.025045] printk: console [ttyAMA0] enabled client # [ 0.170615] scmi_core: SCMI protocol bus registered worker2 # [ 0.144051] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.018532] ASID allocator initialised with 65536 entries lb # [ 0.019809] Serial: AMBA PL011 UART driver worker2 # [ 0.144069] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.171587] FPGA manager framework worker1 # [ 0.145361] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.172516] vgaarb: loaded worker2 # [ 0.144075] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.025651] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.145379] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.144079] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.025836] printk: console [ttyAMA0] enabled client # [ 0.173146] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.145385] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.144084] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.145389] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.144088] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.145394] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.144092] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.145398] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.144097] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.145402] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.176924] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.145406] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.176961] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.151434] fbcon: Taking over console worker2 # [ 0.151447] ACPI: Interpreter disabled. worker2 # [ 0.153299] iommu: Default domain type: Translated worker1 # [ 0.152967] fbcon: Taking over console worker2 # [ 0.153309] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.152982] ACPI: Interpreter disabled. client # [ 0.180756] netfs: FS-Cache loaded client # [ 0.180860] pnp: PnP ACPI: disabled worker1 # [ 0.154837] iommu: Default domain type: Translated worker2 # [ 0.155012] SCSI subsystem initialized worker1 # [ 0.154847] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.149353] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.149378] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.156600] SCSI subsystem initialized lb # [ 0.149384] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.149388] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.184831] NET: Registered PF_INET protocol family lb # [ 0.149392] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.149397] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.185095] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.149401] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.149406] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.162438] usbcore: registered new interface driver usbfs lb # [ 0.156888] fbcon: Taking over console worker2 # [ 0.162471] usbcore: registered new interface driver hub lb # [ 0.156905] ACPI: Interpreter disabled. worker2 # [ 0.162489] usbcore: registered new device driver usb worker1 # [ 0.164024] usbcore: registered new interface driver usbfs lb # [ 0.158890] iommu: Default domain type: Translated worker2 # [ 0.162789] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.164056] usbcore: registered new interface driver hub lb # [ 0.158906] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.164075] usbcore: registered new device driver usb worker2 # [ 0.162795] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.160570] SCSI subsystem initialized worker1 # [ 0.164355] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.162805] PTP clock support registered worker2 # [ 0.162854] EDAC MC: Ver: 3.0.0 worker1 # [ 0.164361] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.167463] scmi_core: SCMI protocol bus registered worker1 # [ 0.164371] PTP clock support registered worker1 # [ 0.164418] EDAC MC: Ver: 3.0.0 worker2 # [ 0.168421] FPGA manager framework worker2 # [ 0.169450] vgaarb: loaded worker1 # [ 0.169177] scmi_core: SCMI protocol bus registered worker1 # [ 0.170162] FPGA manager framework worker1 # [ 0.171114] vgaarb: loaded worker2 # [ 0.170103] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.170702] VFS: Disk quotas dquot_6.6.0 lb # [ 0.165737] usbcore: registered new interface driver usbfs worker2 # [ 0.170731] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.171771] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.165778] usbcore: registered new interface driver hub worker1 # [ 0.172359] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.173103] netfs: FS-Cache loaded lb # [ 0.165798] usbcore: registered new device driver usb worker2 # [ 0.173215] pnp: PnP ACPI: disabled worker1 # [ 0.172385] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.166076] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.174728] netfs: FS-Cache loaded worker1 # [ 0.174842] pnp: PnP ACPI: disabled lb # [ 0.166082] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.166093] PTP clock support registered lb # [ 0.166144] EDAC MC: Ver: 3.0.0 lb # [ 0.170771] scmi_core: SCMI protocol bus registered lb # [ 0.171773] FPGA manager framework lb # [ 0.172728] vgaarb: loaded lb # [ 0.173360] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.179066] NET: Registered PF_INET protocol family worker2 # [ 0.179337] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.180756] NET: Registered PF_INET protocol family lb # [ 0.178201] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.181035] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.178239] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.181977] netfs: FS-Cache loaded lb # [ 0.182111] pnp: PnP ACPI: disabled client # [ 0.214875] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.186070] NET: Registered PF_INET protocol family lb # [ 0.186329] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.214923] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.214954] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.215034] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.215177] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.215274] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.215311] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.215346] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.215439] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.215463] NET: Registered PF_XDP protocol family client # [ 0.215482] PCI: CLS 0 bytes, default 64 client # [ 0.215720] Trying to unpack rootfs image as initramfs... client # [ 0.231019] kvm [1]: HYP mode not available worker2 # [ 0.208702] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.208746] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.210343] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.208785] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.210392] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.208860] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.210424] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.209004] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.210495] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.209086] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.210641] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.209122] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.209158] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.210722] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.209252] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.210759] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.209296] NET: Registered PF_XDP protocol family worker1 # [ 0.210794] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.209314] PCI: CLS 0 bytes, default 64 worker1 # [ 0.210909] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.209556] Trying to unpack rootfs image as initramfs... lb # [ 0.215477] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.210936] NET: Registered PF_XDP protocol family worker1 # [ 0.210956] PCI: CLS 0 bytes, default 64 lb # [ 0.215533] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.211212] Trying to unpack rootfs image as initramfs... lb # [ 0.215573] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.215648] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.215792] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.215898] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.215939] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.215978] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.228013] kvm [1]: HYP mode not available lb # [ 0.216099] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.216128] NET: Registered PF_XDP protocol family worker1 # [ 0.229855] kvm [1]: HYP mode not available lb # [ 0.216153] PCI: CLS 0 bytes, default 64 lb # [ 0.216432] Trying to unpack rootfs image as initramfs... lb # [ 0.231451] kvm [1]: HYP mode not available client # [ 0.325703] Initialise system trusted keyrings client # [ 0.326468] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.327782] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.328558] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.315363] Initialise system trusted keyrings worker2 # [ 0.322157] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.323592] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.324349] Initialise system trusted keyrings worker1 # [ 0.325127] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.324376] 9p: Installing v9fs 9p2000 file system support client # [ 0.352523] Key type asymmetric registered worker1 # [ 0.326423] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.352551] Asymmetric key parser 'x509' registered client # [ 0.352628] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.327175] 9p: Installing v9fs 9p2000 file system support lb # [ 0.327149] Initialise system trusted keyrings lb # [ 0.327932] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.329223] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.361214] io scheduler mq-deadline registered client # [ 0.361238] io scheduler kyber registered client # [ 0.366439] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.367753] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.330084] 9p: Installing v9fs 9p2000 file system support client # [ 0.368170] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.368187] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.344963] Key type asymmetric registered worker2 # [ 0.344986] Asymmetric key parser 'x509' registered client # [ 0.368199] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.345060] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.368207] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.368228] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.368249] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.368322] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.368332] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.368338] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.368343] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.368348] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.368440] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.354159] io scheduler mq-deadline registered worker2 # [ 0.354178] io scheduler kyber registered client # [ 0.368867] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.355876] Key type asymmetric registered client # [ 0.369050] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.349979] Key type asymmetric registered worker1 # [ 0.355904] Asymmetric key parser 'x509' registered client # [ 0.369067] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.350006] Asymmetric key parser 'x509' registered worker1 # [ 0.355974] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.369097] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.350084] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.358107] io scheduler mq-deadline registered client # [ 0.369114] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.358118] io scheduler kyber registered worker2 # [ 0.359289] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.360586] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.360975] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.357425] io scheduler mq-deadline registered lb # [ 0.357447] io scheduler kyber registered worker2 # [ 0.360992] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.361006] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.361014] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.361034] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.367902] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.361058] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.361135] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.361144] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.361150] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.389671] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.361156] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.389877] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.369294] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.389895] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.361161] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.369696] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.389925] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.361220] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.369715] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.390400] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.361653] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.369727] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.390586] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.361838] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.390602] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.361854] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.369735] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.369536] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.390632] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.361883] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.369757] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.361900] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.391085] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.369780] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.391279] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.391296] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.369860] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.370996] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.369870] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.391328] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.369876] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.371423] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.391786] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.369881] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.391970] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.371442] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.369886] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.391987] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.371461] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.392016] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.369944] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.371471] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.392467] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.370385] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.392649] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.370573] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.371500] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.392664] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.370590] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.371529] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.370620] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.392694] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.371610] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.382431] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.370636] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.393164] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.371621] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.382635] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.371096] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.393348] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.371627] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.382652] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.371281] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.393364] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.371632] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.382682] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.371298] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.393393] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.371637] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.383160] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.371327] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.393410] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.383347] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.371697] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.383362] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.393899] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.372158] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.394086] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.383392] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.390505] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.372351] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.394116] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.383847] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.390695] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.372369] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.384030] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.390710] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.394578] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.372402] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.384046] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.394765] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.390740] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.372420] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.384078] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.394795] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.391207] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.372913] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.384548] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.391392] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.395185] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.373105] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.384733] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.391407] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.395374] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.373122] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.384749] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.391439] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.373153] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.395620] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.384786] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.395907] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.385268] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.395924] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.385452] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.392363] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.395953] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.385468] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.392554] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.396420] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.385498] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.392572] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.396602] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.385946] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.392603] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.396619] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.393067] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.396650] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.393253] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.393271] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.393306] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.406164] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.406187] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.406216] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.403962] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.406233] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.404156] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.406704] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.404173] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.406895] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.404203] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.437282] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.406925] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.404662] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.437304] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.407375] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.404845] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.407559] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.437310] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.404861] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.407590] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.404897] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.437360] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.407988] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.405383] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.437410] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.408169] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.405568] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.405897] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.437458] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.405584] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.406123] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.408411] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.437505] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.405613] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.406143] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.408675] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.405628] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.408692] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.437553] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.406177] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.408721] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.406073] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.406690] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.437603] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.406258] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.409183] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.406879] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.437650] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.406288] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.409365] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.406895] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.409381] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.437698] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.406940] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.406738] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.409410] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.437747] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.406927] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.407406] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.410000] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.406956] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.407596] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.437849] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.410011] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.407613] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.437897] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.407344] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.407644] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.410017] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.407525] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.437919] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.407661] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.410062] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.437941] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.407785] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.408145] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.408049] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.437963] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.408067] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.408338] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.437988] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.408370] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.408097] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.438010] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.408569] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.408834] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.438032] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.408752] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.409027] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.438054] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.408768] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.409059] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.438076] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.408804] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.409484] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.438099] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.409369] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.409673] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.438122] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.409381] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.438145] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.409930] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.409387] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.410212] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.438167] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.438188] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.410232] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.409431] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.434118] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.438210] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.410263] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.409478] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.438232] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.434178] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.410745] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.409524] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.438254] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.410941] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.434227] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.438275] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.409569] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.410959] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.434275] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.438297] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.409616] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.410990] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.434325] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.438320] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.411600] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.409661] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.438348] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.434373] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.411614] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.438377] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.409708] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.434421] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.438387] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.411620] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.409754] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.434477] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.438392] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.411666] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.409801] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.434573] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.439576] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.411715] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.409875] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.434621] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.411764] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.409920] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.434648] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.409941] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.411813] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.434670] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.409962] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.411862] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.434693] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.409984] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.434718] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.411911] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.410009] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.434739] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.411959] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.410030] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.434761] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.410053] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.412008] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.434784] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.410075] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.412056] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.434806] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.410097] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.412134] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.434828] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.410118] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.412182] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.434851] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.410141] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.434874] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.412205] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.410163] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.434895] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.412229] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.410185] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.434916] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.412252] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.410206] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.434937] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.412279] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.410227] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.434958] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.412303] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.410247] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.434980] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.412328] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.410269] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.435002] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.412352] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.435024] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.410291] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.412376] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.435046] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.410313] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.435068] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.412400] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.410335] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker2 # [ 0.435096] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.410357] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.412423] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.435105] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.410383] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.412447] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.435110] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.410392] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.412471] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.436287] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.410397] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.412494] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.411563] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.412517] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.412540] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.412563] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.412586] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.412609] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.412633] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.412657] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.412686] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.495955] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.412697] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.412702] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.471902] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58929 usecs client # [ 0.502200] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.504222] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.473983] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.483611] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.485734] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.514553] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.516764] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.492177] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.494401] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.496847] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.527875] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.495681] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.530873] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.504391] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.532925] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.506505] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.505591] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.509228] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.510704] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.512576] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.542996] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.514713] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.544862] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.516822] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.516313] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.519147] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.521215] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.523351] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.518699] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.527165] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.556154] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.529341] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.533527] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.535323] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.540443] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.529950] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.532022] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.570141] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.534173] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.543608] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.572912] msm_serial: driver initialized lb # [ 0.536559] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.573070] SuperH (H)SCI(F) driver initialized client # [ 0.573126] STM32 USART driver initialized worker1 # [ 0.546860] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) lb # [ 0.547374] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.549331] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.556611] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.561058] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.559055] msm_serial: driver initialized worker2 # [ 0.559199] SuperH (H)SCI(F) driver initialized worker2 # [ 0.559253] STM32 USART driver initialized worker1 # [ 0.563658] msm_serial: driver initialized lb # [ 0.559429] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.564372] SuperH (H)SCI(F) driver initialized worker1 # [ 0.564429] STM32 USART driver initialized client # [ 0.604225] loop: module loaded client # [ 0.604434] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.606399] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.574801] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.577787] msm_serial: driver initialized lb # [ 0.577952] SuperH (H)SCI(F) driver initialized lb # [ 0.578012] STM32 USART driver initialized worker2 # [ 0.590710] loop: module loaded worker2 # [ 0.590875] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.591594] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.617780] megasas: 07.734.00.00-rc1 worker1 # [ 0.598400] loop: module loaded client # [ 0.618544] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.598583] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.620715] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.599359] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.620743] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.622365] Using buffer write method client # [ 0.622438] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.624190] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.624223] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.604371] megasas: 07.734.00.00-rc1 worker1 # [ 0.605128] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.607316] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.602798] megasas: 07.734.00.00-rc1 worker1 # [ 0.607336] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.603498] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.605751] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.605807] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.607318] Using buffer write method worker2 # [ 0.607380] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.609048] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.642804] Using buffer write method client # [ 0.642838] Concatenating MTD devices: worker2 # [ 0.609076] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.642842] (0): "0.flash" client # [ 0.642846] (1): "0.flash" client # [ 0.642850] into device "0.flash" lb # [ 0.612236] loop: module loaded worker1 # [ 0.616853] Using buffer write method lb # [ 0.612431] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.616928] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.613159] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.619671] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.619695] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.617989] megasas: 07.734.00.00-rc1 worker2 # [ 0.626655] Using buffer write method worker2 # [ 0.626689] Concatenating MTD devices: worker2 # [ 0.626694] (0): "0.flash" lb # [ 0.618758] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.626697] (1): "0.flash" worker2 # [ 0.626701] into device "0.flash" lb # [ 0.621175] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.621197] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.632958] Using buffer write method worker1 # [ 0.632994] Concatenating MTD devices: worker1 # [ 0.632999] (0): "0.flash" worker1 # [ 0.633003] (1): "0.flash" worker1 # [ 0.633007] into device "0.flash" lb # [ 0.630346] Using buffer write method lb # [ 0.630429] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.632815] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.632847] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.642293] Using buffer write method lb # [ 0.642321] Concatenating MTD devices: lb # [ 0.642325] (0): "0.flash" lb # [ 0.642330] (1): "0.flash" lb # [ 0.642333] into device "0.flash" client # [ 0.876973] Freeing initrd memory: 26160K client # [ 0.883127] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.886951] thunder_xcv, ver 1.0 client # [ 0.886998] thunder_bgx, ver 1.0 client # [ 0.887022] nicpf, ver 1.0 worker2 # [ 0.862965] Freeing initrd memory: 26148K client # [ 0.887613] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.887621] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.865950] Freeing initrd memory: 26148K client # [ 0.887646] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.887655] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.887685] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.887691] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.887714] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.869183] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.887720] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.887864] sky2: driver version 1.30 client # [ 0.889841] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.889895] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.872074] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.890115] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.872895] thunder_xcv, ver 1.0 worker2 # [ 0.872939] thunder_bgx, ver 1.0 worker2 # [ 0.872961] nicpf, ver 1.0 client # [ 0.900173] usbcore: registered new interface driver usb-storage worker2 # [ 0.873521] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.875760] thunder_xcv, ver 1.0 client # [ 0.900230] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.873528] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.900245] usbserial: USB Serial support registered for generic worker2 # [ 0.873551] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.900864] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.873560] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.904112] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.873587] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.905194] hub 1-0:1.0: USB hub found worker2 # [ 0.873593] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.905699] hub 1-0:1.0: 6 ports detected worker2 # [ 0.873616] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.873622] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.876264] thunder_bgx, ver 1.0 worker2 # [ 0.873761] sky2: driver version 1.30 worker1 # [ 0.876297] nicpf, ver 1.0 worker1 # [ 0.876858] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.907164] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.876865] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.876899] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.907192] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:40 UTC (1789896760) client # [ 0.907536] i2c_dev: i2c /dev entries driver worker1 # [ 0.876908] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.876941] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.876947] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.882732] usbcore: registered new interface driver usb-storage worker1 # [ 0.876970] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.882813] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.876976] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.882828] usbserial: USB Serial support registered for generic client # [ 0.912711] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.877111] sky2: driver version 1.30 client # [ 0.912724] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.883441] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.878693] usbcore: registered new interface driver usb-storage client # [ 0.913004] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.884743] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 0.878795] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.884777] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.878811] usbserial: USB Serial support registered for generic worker2 # [ 0.885070] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.879398] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.880537] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.915416] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.880563] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.890571] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.880766] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.917986] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.890600] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:40 UTC (1789896760) worker2 # [ 0.890947] i2c_dev: i2c /dev entries driver worker1 # [ 0.892324] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.918245] usbcore: registered new interface driver usbhid worker1 # [ 0.892648] hub 1-0:1.0: USB hub found client # [ 0.918255] usbhid: USB HID core driver worker1 # [ 0.892663] hub 1-0:1.0: 6 ports detected worker1 # [ 0.895760] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.921209] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.896454] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:40 UTC (1789896760) client # [ 0.922795] drop_monitor: Initializing network drop monitor service worker2 # [ 0.895965] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.896816] i2c_dev: i2c /dev entries driver client # [ 0.922943] NET: Registered PF_INET6 protocol family worker2 # [ 0.895975] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.896244] Synopsys Designware Multimedia Card Interface Driver client # [ 0.925982] Segment Routing with IPv6 client # [ 0.925999] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.896621] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 0.926043] NET: Registered PF_PACKET protocol family worker2 # [ 0.900811] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.901875] hub 1-0:1.0: USB hub found worker2 # [ 0.901907] hub 1-0:1.0: 6 ports detected client # [ 0.927712] 9pnet: Installing 9P2000 support worker1 # [ 0.901071] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.901080] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.903504] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.901343] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.903752] usbcore: registered new interface driver usbhid worker1 # [ 0.901717] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.903759] usbhid: USB HID core driver worker1 # [ 0.903419] hid: raw HID events driver (C) Jiri Kosina client # [ 0.930595] Key type dns_resolver registered worker1 # [ 0.903677] usbcore: registered new interface driver usbhid worker1 # [ 0.903683] usbhid: USB HID core driver worker2 # [ 0.906695] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.908261] drop_monitor: Initializing network drop monitor service lb # [ 0.903986] Freeing initrd memory: 26140K worker2 # [ 0.908449] NET: Registered PF_INET6 protocol family client # [ 0.937122] registered taskstats version 1 worker2 # [ 0.911484] Segment Routing with IPv6 worker1 # [ 0.909328] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.911502] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.910823] drop_monitor: Initializing network drop monitor service worker2 # [ 0.911532] NET: Registered PF_PACKET protocol family worker1 # [ 0.911010] NET: Registered PF_INET6 protocol family worker1 # [ 0.914097] Segment Routing with IPv6 worker2 # [ 0.913210] 9pnet: Installing 9P2000 support worker1 # [ 0.914127] In-situ OAM (IOAM) with IPv6 client # [ 0.937816] Loading compiled-in X.509 certificates worker1 # [ 0.914156] NET: Registered PF_PACKET protocol family lb # [ 0.910284] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.915939] Key type dns_resolver registered worker1 # [ 0.916031] 9pnet: Installing 9P2000 support client # [ 0.946017] Demotion targets for Node 0: null worker1 # [ 0.918200] Key type dns_resolver registered client # [ 0.946121] Key type .fscrypt registered client # [ 0.946128] Key type fscrypt-provisioning registered client # [ 0.946224] ima: No TPM chip found, activating TPM-bypass! client # [ 0.946243] ima: Allocated hash algorithm: sha1 client # [ 0.946266] ima: No architecture policies found lb # [ 0.914107] thunder_xcv, ver 1.0 client # [ 0.950322] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.914152] thunder_bgx, ver 1.0 lb # [ 0.914177] nicpf, ver 1.0 lb # [ 0.914774] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.914781] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.922123] registered taskstats version 1 lb # [ 0.914807] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.922269] Loading compiled-in X.509 certificates lb # [ 0.914814] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.925072] registered taskstats version 1 lb # [ 0.914844] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.925231] Loading compiled-in X.509 certificates lb # [ 0.914850] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.914874] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.914880] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.915041] sky2: driver version 1.30 worker2 # [ 0.930976] Demotion targets for Node 0: null lb # [ 0.916818] usbcore: registered new interface driver usb-storage worker2 # [ 0.931086] Key type .fscrypt registered lb # [ 0.916969] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.931093] Key type fscrypt-provisioning registered lb # [ 0.916985] usbserial: USB Serial support registered for generic worker2 # [ 0.931185] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.931204] ima: Allocated hash algorithm: sha1 lb # [ 0.918130] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 0.933637] Demotion targets for Node 0: null worker2 # [ 0.931225] ima: No architecture policies found worker1 # [ 0.933745] Key type .fscrypt registered lb # [ 0.918157] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.933751] Key type fscrypt-provisioning registered lb # [ 0.918379] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.933845] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.935528] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.933864] ima: Allocated hash algorithm: sha1 lb # [ 0.930093] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.933887] ima: No architecture policies found lb # [ 0.930435] hub 1-0:1.0: USB hub found lb # [ 0.930455] hub 1-0:1.0: 6 ports detected worker1 # [ 0.937997] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.932841] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.934473] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.934503] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:41 UTC (1789896761) lb # [ 0.934831] i2c_dev: i2c /dev entries driver client # [ 0.969222] clk: Disabling unused clocks client # [ 0.969247] PM: genpd: Disabling unused power domains lb # [ 0.940155] sdhci: Secure Digital Host Controller Interface driver client # [ 0.973528] Freeing unused kernel memory: 4736K lb # [ 0.940168] sdhci: Copyright(c) Pierre Ossman client # [ 0.973730] Run /init as init process lb # [ 0.940472] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.940884] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.945572] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.945838] usbcore: registered new interface driver usbhid lb # [ 0.945844] usbhid: USB HID core driver worker2 # [ 0.953905] clk: Disabling unused clocks worker2 # [ 0.953938] PM: genpd: Disabling unused power domains lb # [ 0.948898] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.951645] drop_monitor: Initializing network drop monitor service worker1 # [ 0.956354] clk: Disabling unused clocks worker2 # [ 0.958211] Freeing unused kernel memory: 4736K lb # [ 0.951846] NET: Registered PF_INET6 protocol family worker1 # [ 0.956378] PM: genpd: Disabling unused power domains worker2 # [ 0.958405] Run /init as init process lb # [ 0.954013] Segment Routing with IPv6 lb # [ 0.954044] In-situ OAM (IOAM) with IPv6 lb # [ 0.954085] NET: Registered PF_PACKET protocol family worker1 # [ 0.960626] Freeing unused kernel memory: 4736K worker1 # [ 0.960836] Run /init as init process lb # [ 0.955754] 9pnet: Installing 9P2000 support client # [ 0.991505] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.958517] Key type dns_resolver registered lb # [ 0.965144] registered taskstats version 1 lb # [ 0.965298] Loading compiled-in X.509 certificates worker2 # [ 0.976387] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 0.978142] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.974137] Demotion targets for Node 0: null lb # [ 0.974248] Key type .fscrypt registered lb # [ 0.974255] Key type fscrypt-provisioning registered lb # [ 0.974351] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.974371] ima: Allocated hash algorithm: sha1 lb # [ 0.974395] ima: No architecture policies found lb # [ 0.978490] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.996443] clk: Disabling unused clocks lb # [ 0.996473] PM: genpd: Disabling unused power domains lb # [ 1.000814] Freeing unused kernel memory: 4736K lb # [ 1.001021] Run /init as init process lb # [ 1.015666] systemd[1]: Successfully made /usr/ read-only. client # [ 1.153227] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.139856] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.150187] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.177447] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.307465] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.292263] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.302412] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.326343] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.339045] systemd[1]: Detected virtualization qemu. client # [ 1.341243] systemd[1]: Detected architecture arm64. client # [ 1.343248] systemd[1]: Running in initrd. client # [ 1.346001] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.311231] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.348963] systemd[1]: Hostname set to . worker1 # [ 1.313029] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.323912] systemd[1]: Detected virtualization qemu. worker1 # [ 1.325421] systemd[1]: Detected virtualization qemu. worker2 # [ 1.326050] systemd[1]: Detected architecture arm64. worker1 # [ 1.327525] systemd[1]: Detected architecture arm64. worker2 # [ 1.328125] systemd[1]: Running in initrd. worker1 # [ 1.329588] systemd[1]: Running in initrd. worker2 # [ 1.330877] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.332344] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.333999] systemd[1]: Hostname set to . worker1 # [ 1.335288] systemd[1]: Hostname set to . lb # [ 1.329922] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.350467] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.393469] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.362803] systemd[1]: Detected virtualization qemu. lb # [ 1.362895] systemd[1]: Detected architecture arm64. lb # [ 1.362936] systemd[1]: Running in initrd. lb # [ 1.363923] systemd[1]: Initializing machine ID from random generator. lb # [ 1.364211] systemd[1]: Hostname set to . worker1 # [ 1.380158] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.390347] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.417705] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.517245] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.507861] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.510192] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.541463] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.664034] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.639246] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.650329] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.680749] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.686303] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.670637] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.675407] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker1 # [ 1.675148] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.680557] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.693579] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.699616] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.772995] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.754817] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.783526] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.784655] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.785966] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.787046] systemd[1]: Reached target Path Units. client # [ 1.787824] systemd[1]: Reached target Slice Units. client # [ 1.788608] systemd[1]: Reached target Swaps. client # [ 1.789348] systemd[1]: Reached target Timer Units. client # [ 1.790305] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.763881] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.764677] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.791481] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.792551] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.765916] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.767345] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.768408] systemd[1]: Reached target Path Units. client # [ 1.793535] systemd[1]: Listening on udev Control Socket. client # [ 1.793654] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.769257] systemd[1]: Reached target Slice Units. client # [ 1.793678] systemd[1]: Reached target Socket Units. worker2 # [ 1.770133] systemd[1]: Reached target Swaps. worker2 # [ 1.770896] systemd[1]: Reached target Timer Units. worker2 # [ 1.771921] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.797694] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.773170] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.773884] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.774333] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.774914] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.775340] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.776466] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.777374] systemd[1]: Reached target Socket Units. worker1 # [ 1.776100] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.776132] systemd[1]: Reached target Path Units. client # [ 1.805333] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.776149] systemd[1]: Reached target Slice Units. worker1 # [ 1.776166] systemd[1]: Reached target Swaps. worker1 # [ 1.776183] systemd[1]: Reached target Timer Units. client # [ 1.806459] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.779906] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.776354] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.776500] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.776622] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.776735] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.776842] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.776861] systemd[1]: Reached target Socket Units. worker1 # [ 1.786312] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.812657] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.790296] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.792805] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.785928] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.790389] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.793812] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.794882] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.803702] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.832212] systemd[1]: Starting Journal Service... worker2 # [ 1.806769] systemd[1]: Starting Journal Service... client # [ 1.845427] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.818508] systemd[1]: Starting Journal Service... client # [ 1.846317] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.826507] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.826635] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.857522] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.836201] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.836325] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.866555] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.867535] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.867842] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.868076] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.845418] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.854313] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.857163] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.857708] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 1.859157] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.866404] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.866268] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.862936] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.867204] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.867513] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.895309] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.898295] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.872479] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.872826] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.871626] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.872747] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.874045] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.875030] systemd[1]: Reached target Path Units. worker2 # [ 1.879516] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.875791] systemd[1]: Reached target Slice Units. lb # [ 1.876565] systemd[1]: Reached target Swaps. lb # [ 1.877264] systemd[1]: Reached target Timer Units. worker1 # [ 1.880164] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.878282] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.879432] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.880485] systemd[1]: Listening on Journal Sockets. lb # [ 1.881439] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.884912] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.882397] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.883262] systemd[1]: Reached target Socket Units. lb # [ 1.885463] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.899410] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.893569] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.894667] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.929835] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.900876] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.906070] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.906313] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.906322] [drm] features: -context_init worker1 # [ 1.907036] [drm] number of scanouts: 1 worker1 # [ 1.907052] [drm] number of cap sets: 0 client # [ 1.935677] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.937847] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.918815] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.921345] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.949247] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.917798] systemd[1]: Starting Journal Service... worker1 # [ 1.920809] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.920833] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 1.957138] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.930366] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.932774] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.942744] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.940361] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.969878] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.969902] [drm] features: -context_init client # [ 1.970687] [drm] number of scanouts: 1 client # [ 1.970706] [drm] number of cap sets: 0 worker1 # [ 1.948819] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.945589] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.949540] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.957114] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.952896] Console: switching to colour frame buffer device 160x50 client # [ 1.981356] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.981373] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.963291] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker2 # [ 1.963533] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.963543] [drm] features: -context_init worker2 # [ 1.964265] [drm] number of scanouts: 1 worker2 # [ 1.964283] [drm] number of cap sets: 0 lb # [ 1.965083] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.967131] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.972642] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 2.005810] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 2.006202] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.979797] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 2.006229] systemd[1]: Reached target Local File Systems. worker2 # [ 1.979820] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 1.984381] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.986865] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.987873] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.988768] systemd[1]: Reached target Local File Systems. lb # [ 1.982004] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.989519] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.989729] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.989766] systemd[1]: Reached target Local File Systems. client # [ 2.013438] Console: switching to colour frame buffer device 160x50 client # [ 2.020151] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 1.995602] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.023580] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.989535] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.998356] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.994351] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 1.994583] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 1.994590] [drm] features: -context_init lb # [ 1.995329] [drm] number of scanouts: 1 lb # [ 1.995347] [drm] number of cap sets: 0 worker1 # [ 2.008352] systemd[1]: Finished Load Kernel Modules. lb # [ 2.005521] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 2.006088] systemd[1]: Mounted Kernel Configuration File System. lb # [ 2.011486] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 2.013750] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 2.013768] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 2.018380] Console: switching to colour frame buffer device 160x50 worker2 # [ 2.024995] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.061562] systemd[1]: Finished Load Kernel Modules. client # [ 2.065136] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.044011] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.050508] systemd[1]: Started Journal Service. lb # [ 2.046117] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 2.049708] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 2.044523] systemd-modules-load[74]: Inserted module 'dm_mod' worker2 # [ 2.046806] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker2 # [ 2.047892] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.068558] systemd[1]: Finished Apply Kernel Variables. lb # [ 2.057755] Console: switching to colour frame buffer device 160x50 client # [ 2.080443] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.064221] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 2.060393] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.098723] systemd[1]: Started Journal Service. worker2 # [ 2.061430] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.084920] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker2 # [ 2.062467] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.068108] systemd[1]: Finished Load Kernel Modules. client # [ 2.096367] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.098466] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.104413] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.089644] systemd[1]: Finished Load Kernel Modules. lb # [ 2.093020] systemd[1]: Starting Apply Kernel Variables... client # [ 2.112361] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.091024] systemd-udevd[80]: Using default interface naming scheme 'v261'. client # [ 2.122608] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 2.105808] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.119036] systemd[1]: Started Journal Service. worker1 # [ 2.109128] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.110236] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.111342] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.137660] systemd[1]: Finished Apply Kernel Variables. lb # [ 2.125708] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 2.118780] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.125936] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.125971] systemd[1]: Reached target Local File Systems. worker2 # [ 2.121916] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.121397] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.131218] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 2.124395] systemd-udevd[80]: Using default interface naming scheme 'v261'. client # [ 2.155039] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.133647] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.145986] systemd[1]: Finished Apply Kernel Variables. client # [ 2.169966] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.147416] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.157964] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.157300] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.162945] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.173841] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.193629] systemd[1]: Started Journal Service. lb # [ 2.188399] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.189562] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.190611] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.224110] systemd[1]: Starting Virtual Console Setup... lb # [ 2.191586] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.208501] systemd[1]: Starting Virtual Console Setup... lb # [ 2.208466] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.223867] systemd[1]: Starting Virtual Console Setup... lb # [ 2.220490] systemd-udevd[81]: Using default interface naming scheme 'v261'. lb # [ 2.232429] systemd[1]: Finished Create System Files and Directories. client # [ 2.276456] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.280060] systemd[1]: Finished Virtual Console Setup. lb # [ 2.254710] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.268510] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.271975] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.280491] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.283885] systemd[1]: Finished Virtual Console Setup. lb # [ 2.320193] systemd[1]: Starting Virtual Console Setup... lb # [ 2.364453] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.368082] systemd[1]: Finished Virtual Console Setup. client # [ 2.897519] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.898461] systemd[1]: Reached target System Initialization. worker2 # [ 2.875477] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.899262] systemd[1]: Reached target Basic System. worker2 # [ 2.876462] systemd[1]: Reached target System Initialization. worker2 # [ 2.877255] systemd[1]: Reached target Basic System. worker1 # [ 2.885319] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.888137] systemd[1]: Reached target System Initialization. worker1 # [ 2.888965] systemd[1]: Reached target Basic System. lb # [ 2.974526] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.980780] systemd[1]: Reached target System Initialization. lb # [ 2.981697] systemd[1]: Reached target Basic System. client # [ 3.035942] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.016426] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.021075] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.032079] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.047622] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.072678] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.077999] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.074336] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.080223] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.132495] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.139414] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.120709] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.144107] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.123666] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.127301] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.123961] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.137187] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.140931] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.143996] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.145236] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.192067] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.163433] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.199207] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.202561] systemd[1]: Mounting /sysroot... worker2 # [ 3.179298] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.187051] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.196321] systemd[1]: Mounting /sysroot... worker1 # [ 3.201719] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.209349] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.211399] systemd[1]: Mounting /sysroot... client # [ 3.251754] EXT4-fs (vda): mounted filesystem 37009b6a-fbe0-40d2-a15e-de82b874ec46 r/w with ordered data mode. Quota mode: none. client # [ 3.241405] systemd[1]: Mounted /sysroot. client # [ 3.244406] systemd[1]: Reached target Initrd Root File System. client # [ 3.252112] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.244108] EXT4-fs (vda): mounted filesystem 98a4235e-afaf-4a21-9a87-9e1d3d90e796 r/w with ordered data mode. Quota mode: none. lb # [ 3.225232] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.235423] systemd[1]: Mounted /sysroot. lb # [ 3.228635] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.240137] systemd[1]: Reached target Initrd Root File System. lb # [ 3.232170] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.245379] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.260489] EXT4-fs (vda): mounted filesystem 994cdaf9-6843-495b-a529-514756fb73ac r/w with ordered data mode. Quota mode: none. client # [ 3.275816] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.252869] systemd[1]: Mounted /sysroot. worker1 # [ 3.253938] systemd[1]: Reached target Initrd Root File System. client # [ 3.283290] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.260233] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.285847] systemd[1]: Reloading... worker2 # [ 3.266923] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.273165] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.276126] systemd[1]: Reloading... worker1 # [ 3.285199] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.279032] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.292095] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.288115] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.296665] systemd[1]: Reloading... lb # [ 3.292455] systemd[1]: Mounting /sysroot... lb # [ 3.343326] EXT4-fs (vda): mounted filesystem 56d7eb97-0933-48bd-9d73-ae2c3288cc12 r/w with ordered data mode. Quota mode: none. lb # [ 3.330683] systemd[1]: Mounted /sysroot. lb # [ 3.332564] systemd[1]: Reached target Initrd Root File System. lb # [ 3.340119] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.363552] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.369191] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.372725] systemd[1]: Reloading... client # [ 3.491654] systemd[1]: Reloading finished in 208 ms. worker2 # [ 3.485584] systemd[1]: Reloading finished in 210 ms. worker1 # [ 3.498736] systemd[1]: Reloading finished in 207 ms. client # [ 3.524593] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... client # [ 3.527905] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.535127] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.515096] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... client # [ 3.540811] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.519649] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.544276] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.545382] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.525671] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.535723] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.535631] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.539552] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker2 # [ 3.542575] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.544801] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.545362] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.570546] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.572145] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.552606] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.556084] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 3.557691] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.561064] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.562200] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.570065] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.573494] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.584116] systemd[1]: Reloading finished in 210 ms. lb # [ 3.611292] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... lb # [ 3.614859] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.628286] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.630988] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.638893] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.643779] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.647994] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.650761] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.844079] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.854888] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.836143] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.866499] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.846024] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.849359] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.859875] systemd[1]: Mounting /sysroot/run... client # [ 3.885103] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.867395] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.905531] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.883960] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.895778] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.899844] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.903346] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.913619] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.937223] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.935384] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.960542] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.938879] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.964497] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.941219] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.937504] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.970163] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.974847] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.950138] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.960690] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.984265] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.955176] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.966807] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.959636] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.972919] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.971556] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.983100] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.979008] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 4.011793] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.013605] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.997195] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.000788] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.002186] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.003564] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.999789] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 4.012601] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.026280] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 4.038760] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.040072] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.043225] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.043788] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 4.066674] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.070263] systemd[1]: Mounted /sysroot/run. worker2 # [ 4.086468] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.079165] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 4.088766] systemd[1]: Reached target Initrd File Systems. lb # [ 4.082430] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 4.092970] systemd[1]: Starting Find NixOS closure... lb # [ 4.101738] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.111203] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.102853] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.137040] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.156717] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.158754] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.163606] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.197859] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.203700] systemd[1]: Stopped target Basic System. worker2 # [ 4.205676] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.207645] systemd[1]: Stopped target Path Units. worker2 # [ 4.208449] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.211834] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.215360] systemd[1]: Stopped target Slice Units. worker2 # [ 4.221382] systemd[1]: Stopped target Socket Units. worker2 # [ 4.222134] systemd[1]: Stopped target System Initialization. worker2 # [ 4.222960] systemd[1]: Stopped target Swaps. worker2 # [ 4.223591] systemd[1]: Stopped target Timer Units. worker2 # [ 4.227819] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.233817] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.234679] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.235700] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.240261] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 4.242678] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.246284] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.249229] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.252838] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.265639] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.266573] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.273476] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.277660] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.280357] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.283993] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.285997] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.287393] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 4.296298] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.297207] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 4.298234] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.300521] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.301685] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.302719] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.303639] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.304777] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.305601] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 4.306594] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 4.307438] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.312233] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.316253] systemd[1]: systemd-udevd.service: Consumed 1.105s CPU time over 2.306s wall clock time, 20.5M memory peak. worker2 # [ 4.317837] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.320173] systemd[1]: Closed udev Control Socket. worker2 # [ 4.320932] systemd[1]: Starting Cleanup udev Database... worker2 # [ 4.324160] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.325223] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.328152] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.329277] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.332297] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 4.333292] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 4.350431] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.353335] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.354720] systemd[1]: Reached target Switch Root. worker2 # [ 4.356548] systemd[1]: Starting NixOS Activation... client # [ 4.381176] (udev-worker)[101]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.387368] (udev-worker)[101]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.419366] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.420916] systemd[1]: Stopped Virtual Console Setup. client # [ 4.424170] systemd[1]: Stopping Virtual Console Setup... client # [ 4.425012] systemd[1]: Starting Virtual Console Setup... client # [ 4.448383] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.451615] systemd[1]: Finished Virtual Console Setup. worker1 # [ 4.431681] (udev-worker)[102]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.437802] (udev-worker)[102]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.467589] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.469913] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.472161] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.472987] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.500581] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.503940] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.520367] initrd-nixos-activation-start[172]: booting system configuration /nix/store/jbmz6j4lv6g7mbr4lfjirkfpl1ip7l3n-nixos-system-worker2-test lb # [ 4.519994] (udev-worker)[93]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.526123] (udev-worker)[93]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory lb # [ 4.548952] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.553384] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.555272] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.560551] systemd[1]: Starting Virtual Console Setup... lb # [ 4.566177] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.567583] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.573048] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.584135] initrd-nixos-activation-start[172]: running activation script... lb # [ 4.600660] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.603726] systemd[1]: Finished Virtual Console Setup. client # [ 4.847747] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.836857] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.914341] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.920270] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.899232] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.904397] systemd[1]: Reached target Initrd File Systems. client # [ 4.930452] systemd[1]: Starting Find NixOS closure... client # [ 4.933349] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.910164] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.920977] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.940562] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.985222] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.989556] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.968106] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.970516] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 5.003983] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.981334] systemd[1]: Finished Find NixOS closure. client # [ 5.007354] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.983137] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.986662] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.012476] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 5.001240] initrd-nixos-activation-start[195]: setting up /etc... worker1 # [ 5.011953] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.013706] systemd[1]: Stopped target Basic System. worker1 # [ 5.014958] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.007313] systemd[1]: Mounted /sysroot/nix/store. client # [ 5.043558] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.020196] systemd[1]: Stopped target Path Units. lb # [ 5.012426] systemd[1]: Reached target Initrd File Systems. worker1 # [ 5.021226] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.022589] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.048599] systemd[1]: Stopped target Basic System. client # [ 5.049730] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.016828] systemd[1]: Starting Find NixOS closure... worker1 # [ 5.025967] systemd[1]: Stopped target Slice Units. client # [ 5.050915] systemd[1]: Stopped target Path Units. worker1 # [ 5.027202] systemd[1]: Stopped target Socket Units. client # [ 5.051920] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.031358] systemd[1]: Stopped target System Initialization. client # [ 5.057384] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.060151] systemd[1]: Stopped target Slice Units. lb # [ 5.026014] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 5.036262] systemd[1]: Stopped target Swaps. worker1 # [ 5.037930] systemd[1]: Stopped target Timer Units. client # [ 5.064176] systemd[1]: Stopped target Socket Units. worker1 # [ 5.039530] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.065184] systemd[1]: Stopped target System Initialization. client # [ 5.068190] systemd[1]: Stopped target Swaps. client # [ 5.069055] systemd[1]: Stopped target Timer Units. worker1 # [ 5.044282] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.070174] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.072359] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.048189] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.049352] systemd[1]: Stopped Find NixOS closure. client # [ 5.075654] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.053382] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 5.054325] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.055957] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.081279] systemd[1]: Stopped Find NixOS closure. client # [ 5.082118] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.083051] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.083940] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.060460] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.062180] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.063930] systemd[1]: Stopped Load Kernel Modules. client # [ 5.093965] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.095499] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.097184] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.072421] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.097945] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.073600] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.099053] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.074797] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.084227] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.077833] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.086719] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.087568] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.115012] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 5.082556] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 5.117316] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.092297] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.093330] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.119155] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.094093] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.095843] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.121142] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.098448] systemd[1]: Stopped Virtual Console Setup. client # [ 5.123454] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.100255] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.101253] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.126738] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.102227] systemd[1]: systemd-udevd.service: Consumed 1.427s CPU time over 3.083s wall clock time, 22.3M memory peak. client # [ 5.127533] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.103612] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.104591] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.105478] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.106439] systemd[1]: Closed udev Control Socket. worker1 # [ 5.107133] systemd[1]: Starting Cleanup udev Database... lb # [ 5.099104] systemd[1]: Finished Find NixOS closure. client # [ 5.132250] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.107891] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.133330] systemd[1]: Stopped Virtual Console Setup. client # [ 5.134076] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.102074] systemd[1]: Reached target Initrd Default Target. client # [ 5.135747] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.136925] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.137827] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.138804] systemd[1]: systemd-udevd.service: Consumed 1.371s CPU time over 3.106s wall clock time, 22.3M memory peak. client # [ 5.140283] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.141252] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.116395] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.108487] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.142063] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 5.117329] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.143076] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.118725] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.143937] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.148220] systemd[1]: Closed udev Control Socket. client # [ 5.148977] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.124194] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.125204] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.150705] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.126065] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 5.127057] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.127898] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.156121] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.157047] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.132495] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.158156] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.160202] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.164201] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.135281] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.137368] systemd[1]: Stopped target Basic System. lb # [ 5.140374] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.141589] systemd[1]: Stopped target Path Units. lb # [ 5.144357] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.153516] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.146852] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.156917] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.157732] systemd[1]: Reached target Switch Root. lb # [ 5.150125] systemd[1]: Stopped target Slice Units. worker1 # [ 5.159567] systemd[1]: Starting NixOS Activation... lb # [ 5.152175] systemd[1]: Stopped target Socket Units. client # [ 5.187962] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.156186] systemd[1]: Stopped target System Initialization. client # [ 5.189860] systemd[1]: Finished Cleanup udev Database. lb # [ 5.157340] systemd[1]: Stopped target Swaps. lb # [ 5.158162] systemd[1]: Stopped target Timer Units. client # [ 5.192484] systemd[1]: Reached target Switch Root. lb # [ 5.160138] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.194345] systemd[1]: Starting NixOS Activation... lb # [ 5.163951] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.165325] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.167412] systemd[1]: Stopped Find NixOS closure. lb # [ 5.169438] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.176958] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.180863] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 5.187111] systemd[1]: Stopped Apply Kernel Variables. lb # [ 5.191414] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 5.198238] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.198969] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 5.204172] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 5.207830] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 5.210238] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.211907] systemd[1]: Stopped target Local File Systems. lb # [ 5.216340] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 5.218009] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.219860] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.224500] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 5.225560] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 5.226549] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.227257] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.228486] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 5.229402] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.230396] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 5.231227] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.232302] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.233111] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.234031] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 5.235003] systemd[1]: systemd-udevd.service: Consumed 1.433s CPU time over 3.101s wall clock time, 25.5M memory peak. lb # [ 5.240247] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.241289] systemd[1]: Closed udev Control Socket. lb # [ 5.244303] systemd[1]: Starting Cleanup udev Database... lb # [ 5.245254] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.248211] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 5.258094] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.249123] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 5.260892] systemd[1]: Finished NixOS Activation. lb # [ 5.252167] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.253156] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 5.264183] systemd[1]: Starting Switch Root... lb # [ 5.256176] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.283514] systemd[1]: Switching root. lb # [ 5.280868] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.283585] systemd[1]: Finished Cleanup udev Database. lb # [ 5.284815] systemd[1]: Reached target Switch Root. lb # [ 5.288504] systemd[1]: Starting NixOS Activation... worker1 # [ 5.321427] initrd-nixos-activation-start[179]: booting system configuration /nix/store/26z9h8v6khkq1di9bb6h1yw8hdp2av88-nixos-system-worker1-test client # [ 5.352420] initrd-nixos-activation-start[179]: booting system configuration /nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test worker1 # [ 5.384128] initrd-nixos-activation-start[179]: running activation script... client # [ 5.414044] initrd-nixos-activation-start[179]: running activation script... worker2 # [ 5.473614] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 5.454327] initrd-nixos-activation-start[180]: booting system configuration /nix/store/1y76sp58sczakc84qnb2p7nq6lq4cpg2-nixos-system-lb-test lb # [ 5.520782] initrd-nixos-activation-start[180]: running activation script... worker1 # [ 5.790273] initrd-nixos-activation-start[202]: setting up /etc... client # [ 5.817276] initrd-nixos-activation-start[202]: setting up /etc... lb # [ 5.943576] initrd-nixos-activation-start[203]: setting up /etc... client # [ 6.076056] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.052194] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.055395] systemd[1]: Finished NixOS Activation. worker1 # [ 6.056776] systemd[1]: Starting Switch Root... client # [ 6.078930] systemd[1]: Finished NixOS Activation. client # [ 6.084326] systemd[1]: Starting Switch Root... worker2 # [ 6.067228] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.079371] systemd[1]: Detected virtualization qemu. worker2 # [ 6.082450] systemd[1]: Detected architecture arm64. worker2 # [ 6.085454] systemd[1]: Detected first boot. client # [ 6.104184] systemd[1]: Switching root. worker1 # [ 6.079647] systemd[1]: Switching root. worker2 # [ 6.093362] systemd[1]: Initializing machine ID from random generator. lb # [ 6.211537] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 6.214554] systemd[1]: Finished NixOS Activation. lb # [ 6.216108] systemd[1]: Starting Switch Root... lb # [ 6.239952] systemd[1]: Switching root. client # [ 6.291968] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.274792] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.419840] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 6.436491] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.605583] systemd[1]: Applying preset policy. client # [ 6.889936] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.902108] systemd[1]: Detected virtualization qemu. client # [ 6.904967] systemd[1]: Detected architecture arm64. worker1 # [ 6.871479] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.908603] systemd[1]: Detected first boot. worker1 # [ 6.883963] systemd[1]: Detected virtualization qemu. worker1 # [ 6.887577] systemd[1]: Detected architecture arm64. worker1 # [ 6.889935] systemd[1]: Detected first boot. client # [ 6.916106] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.897044] systemd[1]: Initializing machine ID from random generator. lb # [ 7.053733] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 7.066302] systemd[1]: Detected virtualization qemu. lb # [ 7.069288] systemd[1]: Detected architecture arm64. lb # [ 7.073132] systemd[1]: Detected first boot. lb # [ 7.080473] systemd[1]: Initializing machine ID from random generator. worker2 # [ 7.092823] systemd[1]: Populated /etc with preset unit settings. client # [ 7.230477] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 7.220243] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.408235] systemd[1]: Applying preset policy. worker1 # [ 7.403546] systemd[1]: Applying preset policy. lb # [ 7.414575] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 7.590922] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.592218] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 7.595439] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 7.599352] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.601006] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.603015] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.603124] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.603157] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 7.603173] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.603198] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.603228] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.603601] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.603854] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.604108] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.604365] systemd[1]: Reached target Path Units. lb # [ 7.605306] systemd[1]: Applying preset policy. worker2 # [ 7.604605] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.604859] systemd[1]: Reached target Slice Units. worker2 # [ 7.605091] systemd[1]: Reached target Swaps. worker2 # [ 7.617509] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.622449] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.626413] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.630285] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.631515] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.637142] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 7.639204] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.643372] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.645671] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.647921] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.650521] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.661583] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.663816] systemd[1]: Listening on udev Control Socket. worker2 # [ 7.665774] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.670458] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.675600] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 7.683712] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.696047] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 7.708608] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 7.722539] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 7.722905] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 7.731969] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.734018] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.742522] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.751710] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 7.754467] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.824311] systemd[1]: Starting Journal Service... worker2 # [ 7.837943] systemd[1]: Starting Load Kernel Modules... worker2 # [ 7.855123] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 7.887358] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.862934] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.866261] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.873821] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 7.881384] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 7.881860] systemd[1]: Mounted Huge Pages File System. worker2 # [ 7.886348] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 7.886841] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 7.889873] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.887219] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 7.887587] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 7.944948] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 7.952123] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 8.014983] EXT4-fs (vda): re-mounted 98a4235e-afaf-4a21-9a87-9e1d3d90e796. worker2 # [ 8.030812] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.033279] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.033640] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.044551] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 8.044903] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.045586] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 8.051631] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 8.059204] systemd-journald[267]: Collecting audit messages is enabled. worker2 # [ 8.086396] systemd[1]: Finished Load Kernel Modules. worker2 # [ 8.076247] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.079434] systemd[1]: systemd-journald.service: Deactivated successfully.[ 8.097161] systemd[1]: Starting Firewall... worker2 # [ 8.103246] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.105125] systemd[1]: Started Journal Service. worker2 # lb # [ 8.112899] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 8.108537] systemd-modules-load[268]: Module 'atkbd' is built in worker2 # [ 8.120529] systemd-modules-load[268]: Module 'loop' is built in worker2 # [ 8.141136] fuse: init (API version 7.45) worker2 # [ 8.130725] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 8.161059] systemd-oomd[269]: No swap; memory pressure usage will be degraded worker2 # [ 8.173637] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.188977] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 8.191461] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 8.194212] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 8.196588] systemd[1]: Reached target First Boot Complete. worker2 # [ 8.229013] systemd-journald[267]: Received client request to flush runtime journal. worker2 # [ 8.294020] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 8.298544] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 8.303031] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 8.305980] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 8.383835] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.385106] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.389594] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.392958] systemd[1]: Created slice Slice /system/getty. client # [ 8.394781] systemd[1]: Created slice User and Session Slice. client # [ 8.395720] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.398274] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.399260] systemd[1]: Expecting device /dev/hvc0... client # [ 8.400218] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.401282] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.401608] systemd[1]: Stopped target initrd-fs.target. client # [ 8.401865] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.402116] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.402365] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.402618] systemd[1]: Reached target Path Units. client # [ 8.402854] systemd[1]: Reached target Remote File Systems. client # [ 8.403086] systemd[1]: Reached target Slice Units. client # [ 8.403337] systemd[1]: Reached target Swaps. client # [ 8.412526] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.387054] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 8.388626] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.417346] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.390168] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 8.394789] systemd[1]: Created slice Slice /system/getty. client # [ 8.421132] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 8.396993] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.398232] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.425072] systemd[1]: Listening on Factory Reset Management. client # [ 8.426321] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.400025] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.402336] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.388435] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 8.403337] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.431731] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.404861] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 8.391572] systemd[1]: Reached target Preparation for Local File Systems. client # [ 8.433806] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.406986] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 8.408802] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.409872] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.437846] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 8.412291] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.439425] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.413480] systemd[1]: Reached target Path Units. worker1 # [ 8.414789] systemd[1]: Reached target Remote File Systems. client # [ 8.440769] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.416283] systemd[1]: Reached target Slice Units. worker2 # [ 8.395141] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 8.442813] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 8.418314] systemd[1]: Reached target Swaps. worker1 # [ 8.421961] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.426573] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.454381] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.455763] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.430554] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.458016] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.434343] systemd[1]: Listening on Factory Reset Management. worker1 # [ 8.435537] systemd[1]: Listening on Hostname Service Socket. client # [ 8.461954] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.441025] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.443076] systemd[1]: Listening on Journal Audit Socket. client # [ 8.469788] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 8.447251] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 8.448869] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.450866] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.452706] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.481354] systemd[1]: Mounting Kernel Debug File System... client # [ 8.486633] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.464820] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.465284] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.465638] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.471959] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.476250] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.502673] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.508041] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.509483] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.488021] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 8.493496] systemd[1]: Mounting Kernel Trace File System... client # [ 8.525648] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.527791] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.535300] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.510464] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.555752] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.532063] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.557937] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.535767] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.546954] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 8.550325] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.557863] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.584243] systemd[1]: Mounting /run/wrappers... client # [ 8.626689] systemd[1]: Starting Journal Service... worker1 # [ 8.613210] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 8.587781] systemd[1]: Mounting FUSE Control File System... worker1 # [ 8.617030] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.641327] systemd[1]: Starting Journal Service... client # [ 8.667508] systemd[1]: Starting Load Kernel Modules... lb # [ 8.640492] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 8.642113] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.650651] systemd[1]: Starting Load Kernel Modules... lb # [ 8.643724] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.637085] systemd[1]: Mounted FUSE Control File System. lb # [ 8.648426] systemd[1]: Created slice Slice /system/getty. lb # [ 8.650723] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.656872] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.652040] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 8.653946] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 8.655658] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.657083] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 8.658588] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.660870] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.662798] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 8.657546] systemd[1]: Mounted /run/wrappers. lb # [ 8.664673] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.658651] systemd[1]: Reached target Local File Systems. worker1 # [ 8.672080] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 8.666729] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.668749] systemd[1]: Reached target Path Units. worker1 # [ 8.675234] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.670574] systemd[1]: Reached target Remote File Systems. client # [ 8.702704] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.672456] systemd[1]: Reached target Slice Units. worker2 # [ 8.663777] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 8.674312] systemd[1]: Reached target Swaps. lb # [ 8.678449] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.688386] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.683630] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.687516] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.680160] systemd[1]: Starting register-nix-paths.service... worker1 # [ 8.694256] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 8.681997] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 8.691496] systemd[1]: Listening on Factory Reset Management. lb # [ 8.692763] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.698069] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.683402] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.698567] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 8.698948] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 8.699314] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 8.699686] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.698679] systemd[1]: Starting Journal Log Access Socket... client # [ 8.731790] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 8.700841] systemd[1]: Listening on Journal Audit Socket. client # [ 8.734907] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.709903] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.704863] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.706530] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 8.708299] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.710200] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.742522] fuse: init (API version 7.45) worker1 # [ 8.717155] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 8.703050] systemd-udevd[305]: Using default interface naming scheme 'v261'. lb # [ 8.721847] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 8.713572] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 8.723318] systemd[1]: Listening on udev Control Socket. lb # [ 8.724783] systemd[1]: Listening on udev Varlink Socket. client # [ 8.757672] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.729306] systemd[1]: Mounting Huge Pages File System... worker2 # [ 8.722977] systemd[1]: Starting Create System Files and Directories... lb # [ 8.734607] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 8.742436] systemd[1]: Mounting Kernel Debug File System... client # [ 8.778419] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.754282] systemd[1]: Mounting Kernel Trace File System... client # [ 8.789226] systemd[1]: Mounted Huge Pages File System. client # [ 8.797380] systemd[1]: Mounted POSIX Message Queue File System. client # [ 8.797903] systemd[1]: Mounted Kernel Debug File System. client # [ 8.798281] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.769136] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.776340] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.807835] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.778486] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.812404] systemd-journald[273]: Collecting audit messages is enabled. client # [ 8.815812] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.792361] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.822655] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.823282] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.823833] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 8.795144] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.824345] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.824997] systemd[1]: Finished Load Kernel Modules. worker1 # [ 8.803452] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.798275] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.806358] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 8.795007] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 8.822673] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.841317] EXT4-fs (vda): re-mounted 37009b6a-fbe0-40d2-a15e-de82b874ec46. lb # [ 8.810606] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.826189] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.799097] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.833148] systemd-modules-load[274]: Module 'atkbd' is built in lb # [ 8.816891] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.851597] systemd[1]: Mounting FUSE Control File System... worker1 # [ 8.828115] EXT4-fs (vda): re-mounted 994cdaf9-6843-495b-a529-514756fb73ac. client # [ 8.840747] systemd-modules-load[274]: Module 'loop' is built in worker1 # [ 8.833999] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 8.836698] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 8.863561] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 8.838927] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 8.836125] systemd[1]: Starting Journal Service... worker1 # [ 8.845153] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 8.847318] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.877946] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 8.853246] systemd[1]: Finished Load Kernel Modules. worker1 # [ 8.858294] systemd[1]: Starting Firewall... worker1 # [ 8.873872] systemd[1]: Starting Apply Kernel Variables... client # [ 8.910026] systemd[1]: Started Journal Service. client # [ 8.897418] systemd-oomd[275]: No swap; memory pressure usage will be degraded lb # [ 8.886618] systemd[1]: Starting Load Kernel Modules... worker1 # [ 8.895077] systemd-journald[273]: Collecting audit messages is enabled. client # [ 8.911368] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 8.918442] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 8.917665] fuse: init (API version 7.45) lb # [ 8.932684] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.925170] systemd[1]: Finished Create System Files and Directories. worker2 # [ 8.937212] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 8.945528] fuse: init (API version 7.45) worker2 # [ 8.941485] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.969568] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 8.960540] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 8.963264] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.978432] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 8.970219] systemd[1]: Started Journal Service. client # [ 8.985640] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 8.962210] systemd[1]: Queued start job for default target Multi-User System. lb # [ 8.971368] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.965550] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.976473] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.993616] systemd[1]: Starting Load/Save OS Random Seed... client # [ 8.996312] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.973110] systemd-modules-load[274]: Module 'atkbd' is built in client # [ 9.007312] systemd[1]: Mounted FUSE Control File System. worker1 # [ 8.985251] systemd-modules-load[274]: Module 'loop' is built in worker1 # [ 8.990138] systemd-oomd[275]: No swap; memory pressure usage will be degraded worker1 # [ 8.997528] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 9.029894] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.004917] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.034063] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 9.013821] systemd[1]: Reached target First Boot Complete. lb # [ 9.027208] systemd-journald[274]: Collecting audit messages is enabled. client # [ 9.044984] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.024134] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 9.039505] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 9.033567] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.026082] systemd[1]: Queued start job for default target Multi-User System. lb # [ 9.036243] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 9.045469] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.037992] systemd-modules-load[275]: Module 'atkbd' is built in lb # [ 9.038988] systemd-modules-load[275]: Module 'loop' is built in worker1 # [ 9.043285] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.052085] systemd[1]: Finished Apply Kernel Variables. client # [ 9.094601] systemd-journald[273]: Received client request to flush runtime journal. worker2 # [ 9.057735] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.067770] systemd[1]: Started Journal Service. lb # [ 9.056135] systemd[1]: Listening on Journal Log Access Socket. lb # [ 9.061437] systemd[1]: Mounted Huge Pages File System. lb # [ 9.063068] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 9.071413] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 9.094925] systemd-journald[273]: Received client request to flush runtime journal. lb # [ 9.074482] systemd[1]: Mounted Kernel Trace File System. lb # [ 9.080310] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 9.084568] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 9.089182] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 9.126582] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 9.095271] systemd[1]: Mounted Kernel Configuration File System. client # [ 9.131911] systemd[1]: Reached target First Boot Complete. lb # [ 9.098337] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 9.134794] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 9.106347] systemd[1]: Finished Load Kernel Module fuse. lb # [ 9.108298] systemd[1]: Finished Load Kernel Modules. lb # [ 9.113998] systemd-oomd[276]: No swap; memory pressure usage will be degraded lb # [ 9.137603] EXT4-fs (vda): re-mounted 56d7eb97-0933-48bd-9d73-ae2c3288cc12. lb # [ 9.125521] systemd[1]: Mounting FUSE Control File System... client # [ 9.158271] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.159249] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.161529] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.129359] systemd[1]: Starting Firewall... worker2 # [ 9.141589] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 9.145451] systemd[1]: Starting Update is Completed... lb # [ 9.140130] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 9.153695] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 9.162149] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 9.178706] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.181840] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 9.184594] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.177807] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 9.189853] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 9.208383] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 9.228484] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 9.266528] systemd-udevd[305]: Using default interface naming scheme 'v261'. lb # [ 9.236410] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 9.246283] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 9.259138] systemd[1]: Finished Update is Completed. lb # [ 9.253563] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.304223] systemd-udevd[310]: Using default interface naming scheme 'v261'. lb # [ 9.313389] systemd[1]: Mounted FUSE Control File System. lb # [ 9.319505] systemd[1]: Finished Apply Kernel Variables. client # [ 9.370120] systemd[1]: Mounting /run/wrappers... lb # [ 9.382408] systemd-journald[274]: Received client request to flush runtime journal. worker1 # [ 9.380957] systemd[1]: Mounting /run/wrappers... client # [ 9.411686] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 9.383904] systemd[1]: Mounting FUSE Control File System... client # [ 9.430288] systemd[1]: Mounted /run/wrappers. client # [ 9.431870] systemd[1]: Reached target Local File Systems. client # [ 9.439091] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.443578] systemd[1]: Starting register-nix-paths.service... client # [ 9.452099] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 9.430990] systemd[1]: Mounted FUSE Control File System. client # [ 9.456160] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 9.437028] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 9.447685] systemd[1]: Mounted /run/wrappers. client # [ 9.472576] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 9.445433] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.454259] systemd[1]: Reached target Local File Systems. lb # [ 9.448811] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 9.455862] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.486433] systemd[1]: Starting Create System Files and Directories... lb # [ 9.454335] systemd[1]: Reached target First Boot Complete. worker1 # [ 9.462349] systemd[1]: Starting register-nix-paths.service... lb # [ 9.457750] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 9.465377] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 9.468592] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.481065] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.487225] systemd[1]: Starting Create System Files and Directories... lb # [ 9.506473] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 9.508295] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 9.518342] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.561411] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.572401] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.593612] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 9.604611] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.650707] systemd[1]: Finished Create System Files and Directories. client # [ 9.654872] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 9.632715] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.658400] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.629065] systemd[1]: Mounting /run/wrappers... lb # [ 9.637162] systemd-udevd[317]: Using default interface naming scheme 'v261'. lb # [ 9.693863] systemd[1]: Mounted /run/wrappers. lb # [ 9.695155] systemd[1]: Reached target Local File Systems. lb # [ 9.700293] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.707086] systemd[1]: Starting register-nix-paths.service... client # [ 9.740406] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.711846] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.717957] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 9.723196] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.736410] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.740904] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 9.751586] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.757118] systemd[1]: Starting Create System Files and Directories... client # [ 9.792566] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.799313] systemd[1]: Starting Update is Completed... client # [ 9.864915] systemd[1]: Finished Update is Completed. worker2 # [ 9.839042] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 9.844878] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 9.858895] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.884565] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 9.900306] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.943851] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 9.934975] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 9.947778] systemd[1]: Starting Update is Completed... lb # [ 9.980383] systemd[1]: Finished Create System Files and Directories. lb # [ 9.990973] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 10.004321] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 10.030591] systemd[1]: Finished Update is Completed. lb # [ 10.134594] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 10.203896] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 10.220377] systemd[1]: Starting Update is Completed... worker2 # [ 10.281037] systemd[1]: Finished Firewall. client # [ 10.311521] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.316115] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 10.329099] systemd[1]: Finished Update is Completed. worker1 # [ 10.433826] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 10.437011] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.463118] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.489783] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.546668] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 10.605853] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 10.730687] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 10.789093] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 10.796820] systemd[1]: Finished register-nix-paths.service. worker2 # [ 10.797827] systemd[1]: Reached target System Initialization. worker2 # [ 10.798687] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 10.802645] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 10.803625] systemd[1]: Reached target Timer Units. worker2 # [ 10.804670] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 10.809457] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 10.811034] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 10.814493] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 10.818458] systemd[1]: Reached target Socket Units. worker2 # [ 10.825796] systemd[1]: Reached target Basic System. worker2 # [ 10.826877] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 10.842950] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 10.848502] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.849640] systemd[1]: Started Reset console on configuration changes. worker2 # [ 10.856542] systemd[1]: Starting resolvconf update... lb # [ 10.851909] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 10.864091] systemd[1]: Finished Firewall. worker2 # [ 10.866744] systemd[1]: Starting D-Bus System Message Bus... lb # [ 10.857938] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.948431] systemd[1]: Finished Post-Boot Actions. worker2 # [ 10.991282] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.997738] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.008452] nsncd[491]: Sep 20 09:32:50.615 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.011465] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.021211] systemd[1]: Starting User Login Management... worker1 # [ 11.020427] systemd[1]: Finished Coldplug All udev Devices. client # [ 11.043486] (udev-worker)[315]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 11.049595] (udev-worker)[315]: Network interface NamePolicy= disabled on kernel command line. client # [ 11.053411] (udev-worker)[310]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.034750] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.064384] systemd[1]: Finished register-nix-paths.service. client # [ 11.065481] systemd[1]: Reached target System Initialization. client # [ 11.068568] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.070627] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.073150] systemd[1]: Reached target Timer Units. client # [ 11.075985] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.079215] systemd[1]: Listening on Nix Daemon Socket. client # [ 11.085183] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.087414] systemd[1]: Reached target Socket Units. client # [ 11.089299] systemd[1]: Reached target Basic System. client # [ 11.090674] systemd[1]: Started backdoor.service. client # [ 11.093793] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.099525] systemd[1]: Starting nftables firewall... worker1 # [ 11.080510] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 11.100183] dbus-broker-launch[496]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.126232] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.111786] dbus-broker-launch[496]: NSS returned no entry for 'systemd-timesync' client # [ 11.141715] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.118676] dbus-broker-launch[496]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.175378] systemd[1]: Started Reset console on configuration changes. worker2 # [ 11.155877] systemd[1]: Started D-Bus System Message Bus. client # [ 11.190802] systemd[1]: Starting resolvconf update... worker2 # [ 11.187492] systemd-logind[503]: New seat seat0. client # connecting to host... worker2 # [ 11.196220] systemd[1]: Started User Login Management. worker2 # [ 11.203750] systemd[1]: Starting linger-users.service... lb # [ 11.197274] systemd[1]: Finished register-nix-paths.service. worker2 # [ 11.211370] dbus-broker-launch[496]: Ready worker2 # [ 11.220183] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 11.225948] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 11.232593] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 11.234655] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.236579] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 11.237969] systemd[1]: nscd.service: Deactivated successfully. client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 11.245708] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 11.253706] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.294405] systemd[1]: Finished Post-Boot Actions. client # [ 11.301063] nsncd[398]: Sep 20 09:32:50.910 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 11.267188] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.269049] systemd[1]: Reached target System Initialization. lb # [ 11.271572] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 11.280422] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 11.311481] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.278469] systemd[1]: Started niks3 garbage collection timer. client # [ 11.323883] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.315961] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 11.315059] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 11.279301] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 11.320473] systemd[1]: Finished linger-users.service. client # [ 11.329553] systemd[1]: Reached target User and Group Name Lookups. client: connected to guest root shell lb # [ 11.282230] systemd[1]: Reached target Timer Units. worker2 # [ 11.336285] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.343690] systemd[1]: Starting D-Bus System Message Bus... client: (connecting took 11.83 seconds) lb # [ 11.284823] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 11.340350] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.355414] systemd[1]: Starting User Login Management... client: (finished: waiting for the VM to finish booting, in 11.83 seconds) lb # [ 11.291549] systemd[1]: Listening on niks3 server socket. worker2 # [ 11.343801] nsncd[561]: Sep 20 09:32:50.961 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 11.292625] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.351237] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.294365] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.377513] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 11.300171] systemd[1]: Reached target Socket Units. lb # [ 11.304857] systemd[1]: Reached target Basic System. lb # [ 11.307306] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.314294] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.323127] systemd[1]: Starting Post-Boot Actions... lb # [ 11.358835] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.374240] systemd[1]: Finished register-nix-paths.service. worker1 # [ 11.376571] systemd[1]: Reached target System Initialization. worker1 # [ 11.378430] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 11.380239] systemd[1]: Finished resolvconf update. worker1 # [ 11.381785] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 11.384482] systemd[1]: Reached target Preparation for Network. worker1 # [ 11.385612] systemd[1]: Reached target Timer Units. lb # [ 11.381630] systemd[1]: Starting resolvconf update... worker2 # [ 11.387578] systemd[1]: Starting DHCP Client... worker2 # [ 11.392614] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.387245] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 11.392708] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 11.401318] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 11.403709] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.415745] systemd[1]: Reached target Socket Units. worker1 # [ 11.419976] systemd[1]: Reached target Basic System. lb # [ 11.415665] systemd[1]: Started rustfs.service. worker1 # [ 11.424837] systemd[1]: Started backdoor.service. lb # [ 11.434064] systemd[1]: Starting rustfs-bucket.service... worker1 # [ 11.431238] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 11.445636] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.454727] systemd[1]: Starting Virtual Console Setup... worker1 # [ 11.456619] systemd[1]: Starting Post-Boot Actions... worker1 # [ 11.464617] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.476806] systemd[1]: Starting resolvconf update... worker1 # [ 11.486207] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.493018] systemd[1]: Finished Post-Boot Actions. lb # [ 11.502733] nsncd[488]: Sep 20 09:32:52.084 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.527140] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 11.522505] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.535097] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 11.540248] systemd[1]: Starting Virtual Console Setup... worker1 # [ 11.545143] systemd[1]: Finished Post-Boot Actions. client # [ 11.593687] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 11.563057] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.573126] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 11.569472] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.603276] systemd-logind[429]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 11.613648] systemd-logind[429]: New seat seat0. lb # [ 11.584728] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 11.593302] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.618577] systemd[1]: Started User Login Management. client # [ 11.624782] systemd[1]: Starting linger-users.service... lb # [ 11.592122] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # connecting to host... worker1 # [ 11.604690] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.606005] nsncd[495]: Sep 20 09:32:51.216 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.607946] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.641231] dbus-broker-launch[428]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.612993] systemd[1]: Starting User Login Management... lb # [ 11.618718] systemd[1]: Finished Firewall. worker1 # [ 11.626646] systemd[1]: Starting User Login Management... worker1 # [ 11.636327] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.663697] dbus-broker-launch[428]: NSS returned no entry for 'systemd-timesync' client # [ 11.672103] dbus-broker-launch[428]: Invalid user-name in /nix/store/i87y3v12qnxz4jgnndbs0w0ih92vmmjw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.642227] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.695949] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 11.683204] dhcpcd[596]: dhcpcd-10.3.2 starting client # [ 11.703535] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.709642] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.714994] systemd[1]: Stopping User and Group Name Lookups... client # [ 11.719301] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 11.701285] dhcpcd[631]: dev: loaded udev client # [ 11.725736] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.707002] dhcpcd[631]: no valid interfaces found client # [ 11.732962] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 11.709730] dhcpcd[631]: no valid interfaces found client # [ 11.733849] systemd[1]: Started D-Bus System Message Bus. client # [ 11.744621] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 11.722690] dbus-broker-launch[500]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.747760] systemd[1]: Finished linger-users.service. worker1 # [ 11.740650] dbus-broker-launch[500]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.754863] systemd[1]: Finished Extra networking commands.. client # [ 11.779911] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.758966] systemd[1]: Reached target Network. worker2 # [ 11.761320] systemd[1]: Starting Permit User Sessions... worker1 # [ 11.746919] dbus-broker-launch[500]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.791257] dbus-broker-launch[428]: Ready worker1 # [ 11.792116] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 11.810317] systemd-logind[519]: New seat seat0. worker2 # [ 11.814255] systemd[1]: Finished Permit User Sessions. worker1 # [ 11.816915] systemd[1]: Started User Login Management. worker2 # [ 11.820311] systemd[1]: Started Getty on tty1. worker2 # [ 11.821364] systemd[1]: Reached target Login Prompts. worker1 # [ 11.820718] systemd[1]: Starting linger-users.service... client # [ 11.865370] mousedev: PS/2 mouse device common for all mice worker1 # [ 11.846299] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 11.847327] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.877684] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.853538] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.881568] nsncd[495]: Sep 20 09:32:51.489 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.883597] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.858415] dbus-broker-launch[526]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.893304] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.869186] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 11.870177] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 11.871057] systemd[1]: nscd.service: Deactivated successfully. client # [ 11.896624] systemd[1]: Finished resolvconf update. worker1 # [ 11.871851] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 11.900728] systemd[1]: Starting DHCP Client... worker1 # [ 11.878964] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.888257] dbus-broker-launch[500]: Ready lb # [ 11.884376] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.890799] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.900631] dbus-broker-launch[526]: NSS returned no entry for 'systemd-timesync' lb # [ 11.909886] dbus-broker-launch[526]: Invalid user-name in /nix/store/r3k08synkldj3yxnxmc97ljig0y68d44-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.933605] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 11.941332] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 11.942354] systemd[1]: Finished linger-users.service. lb # [ 11.941790] systemd[1]: Stopping User and Group Name Lookups... lb # [ 11.949631] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 11.958626] (udev-worker)[360]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 11.956956] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 11.967069] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.971872] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 11.964592] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 11.970736] nsncd[568]: Sep 20 09:32:51.582 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.977619] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.978483] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.979332] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.971946] systemd-logind[529]: New seat seat0. worker1 # [ 11.985745] (udev-worker)[353]: Network interface NamePolicy= disabled on kernel command line. lb # [ 11.979854] systemd[1]: Started User Login Management. lb # [ 11.986463] systemd[1]: Starting linger-users.service... lb # [ 11.995629] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 12.029372] systemd-logind[429]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 11.999916] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 12.013962] systemd[1]: Finished resolvconf update. worker1 # [ 12.014781] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.019427] systemd[1]: Starting DHCP Client... worker2 # [ 12.022083] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 12.028478] systemd[1]: Started backdoor.service. worker1 # [ 12.023606] systemd[1]: Starting Extra networking commands.... lb # [ 12.035957] dbus-broker-launch[526]: Ready worker2 # [ 12.093300] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.113749] dhcpcd[530]: dhcpcd-10.3.2 starting client # [ 12.128913] dhcpcd[540]: dev: loaded udev lb # [ 12.098459] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 12.103199] systemd[1]: Finished linger-users.service. lb # [ 12.117715] systemd[1]: Finished resolvconf update. worker1 # [ 12.131303] systemd-logind[519]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 12.124377] systemd[1]: Reached target Preparation for Network. lb # [ 12.135939] systemd[1]: Starting DHCP Client... client # [ 12.190473] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.178729] systemd[1]: Finished nftables firewall. client # [ 12.179538] systemd[1]: Reached target Preparation for Network. lb # [ 12.143623] systemd[1]: Starting Extra networking commands.... client # [ 12.186625] systemd[1]: Starting Address configuration of eth1... worker2 # connecting to host... lb # [ 12.155990] nsncd[588]: Sep 20 09:32:52.738 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 12.193101] systemd[1]: Starting Extra networking commands.... worker2 # [ 12.184420] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 12.165154] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 12.217907] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.221193] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.225420] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.225753] cfg80211: failed to load regulatory.db lb # [ 12.208352] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 12.212259] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 12.221125] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 12.238469] (udev-worker)[662]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.242006] (udev-worker)[661]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 12.247095] (udev-worker)[661]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.253564] dhcpcd[603]: dhcpcd-10.3.2 starting worker2 # [ 12.264992] systemd-vconsole-setup[600]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 12.272575] systemd[1]: Finished Virtual Console Setup. worker1 # [ 12.271226] dhcpcd[642]: dev: loaded udev client # [ 12.315681] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.303589] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 12.304896] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 12.311393] systemd[1]: Starting Address configuration of eth1...[ 12.329791] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.357454] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # lb # [ 12.317195] systemd[1]: Started backdoor.service. client # [ 12.366319] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.366785] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 12.371512] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.371832] cfg80211: failed to load regulatory.db worker1 # [ 12.348859] systemd[1]: Finished Extra networking commands.. client # [ 12.379264] network-addresses-eth1-start[545]: adding address 192.168.1.1/24... done worker1 # [ 12.351595] systemd[1]: Reached target Network. worker1 # [ 12.358812] systemd[1]: Starting Permit User Sessions... client # [ 12.397284] network-addresses-eth1-start[545]: adding address 2001:db8:1::1/64... done worker2 # [ 12.400453] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 12.425308] systemd[1]: Finished Address configuration of eth1. worker2 # [ 12.404343] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.421495] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.451796] dhcpcd[576]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (548) - Operation not permitted client # [ 12.455237] dhcpcd[576]: .resolvconf-wrapped: clearing stale lock pid 548 worker1 # [ 12.457450] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.457961] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.463409] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 12.463748] cfg80211: failed to load regulatory.db worker2 # [ 12.454860] systemd-logind[503]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 12.459309] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.469387] systemd[1]: Started Getty on tty1. worker1 # [ 12.470122] systemd[1]: Reached target Login Prompts. client # [ 12.524449] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.510693] dhcpcd[540]: eth0: waiting for carrier client # [ 12.513263] dhcpcd[540]: libudev: received NULL device client # [ 12.514133] dhcpcd[540]: libudev: received NULL device client # [ 12.515566] dhcpcd[540]: eth0: carrier acquired worker1 # [ 12.510334] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 12.520227] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.530647] dhcpcd[540]: DUID 00:01:00:01:32:42:64:c4:52:54:00:12:34:56 client # [ 12.532538] dhcpcd[540]: eth0: IAID 00:12:34:56 worker2 # [ 12.509301] dhcpcd[631]: eth0: waiting for carrier client # [ 12.533205] dhcpcd[540]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.511898] dhcpcd[631]: eth0: carrier acquired client # [ 12.540504] systemd[1]: Finished Extra networking commands.. worker2 # [ 12.533585] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 12.544308] systemd[1]: Reached target Network. lb # connecting to host... worker1 # [ 12.521541] network-addresses-eth1-start[654]: adding address 192.168.1.3/24... done client # [ 12.548939] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.530061] dhcpcd[631]: DUID 00:01:00:01:32:42:64:c4:52:54:00:12:34:56 worker2 # [ 12.532542] dhcpcd[631]: eth0: IAID 00:12:34:56 worker2 # [ 12.534441] dhcpcd[631]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 12.538929] network-addresses-eth1-start[654]: adding address 2001:db8:1::3/64... done worker2 # [ 12.546408] network-addresses-eth1-start[680]: adding address 192.168.1.4/24... done worker2 # [ 12.562451] network-addresses-eth1-start[680]: adding address 2001:db8:1::4/64... done worker1 # [ 12.576934] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 12.562897] dhcpcd[642]: eth0: waiting for carrier worker1 # [ 12.568197] dhcpcd[642]: eth0: waiting for carrier worker1 # [ 12.568978] dhcpcd[642]: eth0: carrier acquired client # [ 12.596183] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.572758] systemd[1]: Finished Address configuration of eth1. worker2 # [ 12.581842] systemd[1]: Finished Address configuration of eth1. client # [ 12.604784] systemd[1]: Started Getty on tty1. client # [ 12.609298] systemd[1]: Reached target Login Prompts. lb # [ 12.580516] dhcpcd[620]: dhcpcd-10.3.2 starting worker1 # [ 12.589812] dhcpcd[642]: DUID 00:01:00:01:32:42:64:c4:52:54:00:12:34:56 worker1 # [ 12.590753] dhcpcd[642]: eth0: IAID 00:12:34:56 worker1 # [ 12.591378] dhcpcd[642]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.614241] mousedev: PS/2 mouse device common for all mice lb # [ 12.597362] dhcpcd[673]: dev: loaded udev worker1 # [ 12.637618] mousedev: PS/2 mouse device common for all mice worker1 # [ 12.650615] systemd-logind[519]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 12.664089] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.652920] systemd[1]: Finished Extra networking commands.. lb # [ 12.662608] systemd[1]: Reached target Network. lb # [ 12.675068] systemd[1]: Starting PostgreSQL Server... lb # [ 12.691063] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.716128] systemd-logind[503]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 12.810857] systemd[1]: Finished Permit User Sessions. client: (finished: waiting for unit network-addresses-eth1.service, in 13.30 seconds) lb # [ 12.840683] cfg80211: Loading compiled-in X.509 certificates for regulatory database client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 12.827851] systemd[1]: Started Getty on tty1. lb # [ 12.829987] systemd[1]: Reached target Login Prompts. client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 12.902071] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 12.902564] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 12.907351] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 12.907677] cfg80211: failed to load regulatory.db worker2 # [ 12.915550] dhcpcd[631]: eth0: soliciting a DHCP lease lb # [ 12.907473] dhcpcd[673]: no valid interfaces found lb # [ 12.908636] dhcpcd[673]: no valid interfaces found worker2 # [ 12.920642] dhcpcd[631]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 12.928218] dhcpcd[631]: eth0: probing address 10.0.2.15/24 lb # [ 12.992722] (udev-worker)[696]: Network interface NamePolicy= disabled on kernel command line. lb # [ 13.058170] (udev-worker)[697]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 13.069950] (udev-worker)[697]: Network interface NamePolicy= disabled on kernel command line. client # [ 13.160786] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.164220] postgresql-pre-start[708]: The files belonging to this database system will be owned by user "postgres". worker1 # [ 13.174599] dhcpcd[642]: eth0: soliciting a DHCP lease lb # [ 13.167383] postgresql-pre-start[708]: This user must also own the server process. worker1 # [ 13.181147] dhcpcd[642]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 13.178425] postgresql-pre-start[708]: The database cluster will be initialized with locale "en_US.UTF-8". worker1 # [ 13.188236] dhcpcd[642]: eth0: probing address 10.0.2.15/24 lb # [ 13.180393] postgresql-pre-start[708]: The default database encoding has accordingly been set to "UTF8". lb # [ 13.185689] postgresql-pre-start[708]: The default text search configuration will be set to "english". lb # [ 13.189382] postgresql-pre-start[708]: Data page checksums are enabled. lb # [ 13.193203] postgresql-pre-start[708]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 13.196475] postgresql-pre-start[708]: creating subdirectories ... ok lb # [ 13.202550] postgresql-pre-start[708]: selecting dynamic shared memory implementation ... posix worker1 # [ 13.350253] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.386192] postgresql-pre-start[708]: selecting default "max_connections" ... 100 client # [ 13.456762] systemd[1]: Starting Virtual Console Setup... lb # [ 13.452263] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 13.465089] systemd-logind[529]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 13.504262] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 13.471969] systemd[1]: Starting Address configuration of eth1... client # [ 13.517146] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 13.518266] systemd[1]: Stopped Virtual Console Setup. client # [ 13.524670] systemd[1]: Starting Virtual Console Setup... client # [ 13.551090] systemd-logind[429]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 13.578805] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 13.566032] dhcpcd[673]: eth0: waiting for carrier lb # [ 13.566828] dhcpcd[673]: eth0: carrier acquired lb # [ 13.598388] dhcpcd[673]: DUID 00:01:00:01:32:42:64:c6:52:54:00:12:34:56 lb # [ 13.599375] dhcpcd[673]: eth0: IAID 00:12:34:56 lb # [ 13.600003] dhcpcd[673]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 13.613543] postgresql-pre-start[708]: selecting default "shared_buffers" ... 128MB lb # [ 13.647146] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 13.645286] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 13.645732] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 13.655354] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.656804] systemd[1]: Stopped Virtual Console Setup. lb # [ 13.650664] network-addresses-eth1-start[735]: adding address 192.168.1.2/24... done worker2 # [ 13.660173] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 13.662886] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.665611] systemd[1]: Starting Virtual Console Setup... lb # [ 13.665088] network-addresses-eth1-start[735]: adding address 2001:db8:1::2/64... done worker2 # [ 13.686960] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.690458] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.691223] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.690617] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.694277] systemd[1]: Stopped Virtual Console Setup. lb # [ 13.688268] systemd[1]: Finished Address configuration of eth1. worker1 # [ 13.696625] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.702157] systemd-logind[503]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 13.761907] dhcpcd[540]: eth0: soliciting a DHCP lease worker1 # [ 13.739812] systemd-logind[519]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 13.768579] dhcpcd[540]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 13.776199] dhcpcd[540]: eth0: probing address 10.0.2.15/24 lb # [ 13.775508] mousedev: PS/2 mouse device common for all mice lb # [ 13.879799] systemd-logind[529]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 13.946214] systemd-vconsole-setup[648]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 13.950196] systemd[1]: Finished Virtual Console Setup. worker2 # [ 14.005712] systemd-vconsole-setup[704]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.010655] systemd[1]: Finished Virtual Console Setup. client # [ 14.114226] dhcpcd[540]: eth0: soliciting an IPv6 router client # [ 14.117847] dhcpcd[540]: eth0: Router Advertisement from fe80::2 client # [ 14.120421] dhcpcd[540]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 14.123093] dhcpcd[540]: eth0: adding route to fec0::/64 client # [ 14.125382] dhcpcd[540]: eth0: adding default route via fe80::2 worker1 # [ 14.124430] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.128476] systemd[1]: Finished Virtual Console Setup. lb: (finished: waiting for unit network-addresses-eth1.service, in 1.30 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit niks3.service worker2 # [ 14.586642] dhcpcd[631]: eth0: soliciting an IPv6 router worker2 # [ 14.590164] dhcpcd[631]: eth0: Router Advertisement from fe80::2 worker2 # [ 14.592772] dhcpcd[631]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 14.595565] dhcpcd[631]: eth0: adding route to fec0::/64 worker2 # [ 14.598012] dhcpcd[631]: eth0: adding default route via fe80::2 lb # [ 14.828447] dhcpcd[673]: eth0: soliciting a DHCP lease lb # [ 14.832477] dhcpcd[673]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 14.840271] dhcpcd[673]: eth0: probing address 10.0.2.15/24 worker1 # [ 14.849267] dhcpcd[642]: eth0: soliciting an IPv6 router worker1 # [ 14.849614] dhcpcd[642]: eth0: Router Advertisement from fe80::2 lb # [ 14.863298] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker1 # [ 14.849747] dhcpcd[642]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 14.849909] dhcpcd[642]: eth0: adding route to fec0::/64 worker1 # [ 14.850032] dhcpcd[642]: eth0: adding default route via fe80::2 lb # [ 15.299295] systemd[1]: Starting Virtual Console Setup... lb # [ 15.345899] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 15.365260] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.370178] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.382421] systemd[1]: Starting Virtual Console Setup... lb # [ 15.447906] systemd-logind[529]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 15.512774] dhcpcd[673]: eth0: soliciting an IPv6 router lb # [ 15.514364] dhcpcd[673]: eth0: Router Advertisement from fe80::2 lb # [ 15.516284] dhcpcd[673]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 15.518465] dhcpcd[673]: eth0: adding route to fec0::/64 lb # [ 15.520129] dhcpcd[673]: eth0: adding default route via fe80::2 lb # [ 15.884455] systemd-vconsole-setup[775]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 15.889300] systemd[1]: Finished Virtual Console Setup. lb # [ 16.209409] postgresql-pre-start[708]: selecting default time zone ... UTC lb # [ 16.213455] postgresql-pre-start[708]: creating configuration files ... ok lb # [ 16.475118] postgresql-pre-start[708]: running bootstrap script ... ok lb # [ 17.145679] postgresql-pre-start[708]: performing post-bootstrap initialization ... ok lb # [ 17.293894] postgresql-pre-start[708]: syncing data to disk ... ok lb # [ 17.296060] postgresql-pre-start[708]: initdb: warning: enabling "trust" authentication for local connections lb # [ 17.297512] postgresql-pre-start[708]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 17.299650] postgresql-pre-start[708]: Success. You can now start the database server using: lb # [ 17.300957] postgresql-pre-start[708]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 17.428899] postgres[809]: [809] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.433201] postgres[809]: [809] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.434406] postgres[809]: [809] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.437098] postgres[809]: [809] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.450563] postgres[818]: [818] LOG: database system was shut down at 2026-09-20 09:32:57 GMT lb # [ 17.455843] postgres[809]: [809] LOG: database system is ready to accept connections lb # [ 17.460496] systemd[1]: Started PostgreSQL Server. lb # [ 17.466937] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 17.694011] postgresql-setup-start[829]: CREATE DATABASE lb # [ 17.744681] postgresql-setup-start[834]: CREATE ROLE lb # [ 17.770155] postgresql-setup-start[836]: ALTER DATABASE lb # [ 17.776603] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 17.778569] systemd[1]: Reached target PostgreSQL. worker1 # [ 17.831494] dhcpcd[642]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 17.835338] dhcpcd[642]: eth0: adding route to 10.0.2.0/24 worker1 # [ 17.838642] dhcpcd[642]: eth0: adding default route via 10.0.2.2 worker1 # [ 17.998133] systemd[1]: Started DHCP Client. worker1 # [ 18.000462] systemd[1]: Reached target Multi-User System. worker1 # [ 18.001369] systemd[1]: Startup finished in 949ms (kernel) + 5.434s (initrd) + 11.615s (userspace) = 17.999s. client # [ 18.326619] dhcpcd[540]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 18.313055] dhcpcd[631]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 18.316885] dhcpcd[631]: eth0: adding route to 10.0.2.0/24 worker2 # [ 18.319970] dhcpcd[631]: eth0: adding default route via 10.0.2.2 client # [ 18.330058] dhcpcd[540]: eth0: adding route to 10.0.2.0/24 client # [ 18.330230] dhcpcd[540]: eth0: adding default route via 10.0.2.2 client # [ 18.487635] systemd[1]: Started DHCP Client. client # [ 18.491627] systemd[1]: Reached target Multi-User System. client # [ 18.492815] systemd[1]: Startup finished in 961ms (kernel) + 5.440s (initrd) + 12.089s (userspace) = 18.491s. worker2 # [ 18.481850] systemd[1]: Started DHCP Client. worker2 # [ 18.484272] systemd[1]: Reached target Multi-User System. worker2 # [ 18.485312] systemd[1]: Startup finished in 948ms (kernel) + 4.637s (initrd) + 12.897s (userspace) = 18.483s. lb # [ 19.603758] dhcpcd[673]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 19.606895] dhcpcd[673]: eth0: adding route to 10.0.2.0/24 lb # [ 19.609958] dhcpcd[673]: eth0: adding default route via 10.0.2.2 lb # [ 19.760589] systemd[1]: Started DHCP Client. lb # [ 19.763314] systemd[1]: Reached target Network is Online. lb # [ 19.768809] systemd[1]: Started Envoy reverse proxy. lb # [ 19.777833] systemd[1]: Started mock-oidc.service. lb # [ 19.884698] mock-oidc-server[914]: Mock OIDC Server running lb # [ 19.885601] mock-oidc-server[914]: OIDC Address: 192.168.1.2:8080 lb # [ 19.886442] mock-oidc-server[914]: Issue Address: 0.0.0.0:8081 lb # [ 19.887249] mock-oidc-server[914]: Issuer: http://192.168.1.2:8080/oidc lb # [ 19.888553] mock-oidc-server[914]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 19.890676] mock-oidc-server[914]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 19.892849] mock-oidc-server[914]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 20.447634] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 20.449871] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 20.451753] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 20.454064] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 20.456704] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 20.459470] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 20.462318] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 20.466673] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 20.487544] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 20.489886] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 20.498166] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 20.500565] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 20.503244] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 20.508742] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 20.511596] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 20.516423] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 20.519008] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 20.522256] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 20.526839] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 20.529207] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 20.531934] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 20.534092] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 20.542679] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 20.556622] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 20.558582] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 20.562607] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 20.565928] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 20.568913] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 20.571057] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 20.573343] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 20.575141] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 20.580201] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 20.582123] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 20.583865] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 20.588846] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 20.590820] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 20.593552] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 20.595503] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 20.598242] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 20.600116] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.602832] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 20.606487] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.608697] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 20.611775] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 20.614915] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 20.624458] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 20.626735] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 20.629080] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 20.631036] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.633940] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 20.637144] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 20.639911] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 20.643415] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 20.646162] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 20.651267] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 20.653571] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.655843] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 20.657969] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 20.660306] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 20.662819] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 20.665793] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 20.669335] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 20.671864] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 20.675589] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 20.679015] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 20.681398] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 20.688832] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 20.690500] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 20.695880] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 20.698070] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 20.702948] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 20.708679] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 20.740033] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 20.741895] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 20.743726] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 20.745980] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 20.750225] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 20.752282] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 20.755003] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 20.757395] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 20.759386] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 20.762254] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 20.770617] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 20.778026] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 20.781699] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 20.783993] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 20.786708] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 20.789282] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 20.792818] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 20.795293] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 20.797491] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 20.799306] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 20.801565] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 20.803525] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 20.806845] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 20.813808] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 20.815735] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 20.822280] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 20.824624] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 20.827297] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 20.829515] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 20.832385] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 20.835622] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 20.842625] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 20.844856] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 20.847062] envoy[913]: [2026-09-20 09:33:01.029][913][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 20.850961] envoy[913]: [2026-09-20 09:33:01.067][913][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 20.852885] envoy[913]: [2026-09-20 09:33:01.069][913][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 20.868787] envoy[913]: [2026-09-20 09:33:01.069][913][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 20.870586] envoy[913]: [2026-09-20 09:33:01.069][913][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 20.879863] envoy[913]: [2026-09-20 09:33:01.069][913][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 20.881938] envoy[913]: [2026-09-20 09:33:01.332][913][info][main] [source/server/server.cc:968] runtime: {} lb # [ 20.883395] envoy[913]: [2026-09-20 09:33:01.360][913][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 20.885702] envoy[913]: [2026-09-20 09:33:01.361][913][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 20.887425] envoy[913]: [2026-09-20 09:33:01.361][913][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 20.889243] envoy[913]: [2026-09-20 09:33:01.369][913][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 20.890977] envoy[913]: [2026-09-20 09:33:01.369][913][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 20.892947] envoy[913]: [2026-09-20 09:33:01.369][913][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 20.917340] envoy[913]: [2026-09-20 09:33:01.500][913][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 20.927834] envoy[913]: [2026-09-20 09:33:01.510][913][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker1 # [ 20.937052] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 20.930685] envoy[913]: [2026-09-20 09:33:01.513][913][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 20.934144] envoy[913]: [2026-09-20 09:33:01.513][913][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 20.948383] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 21.192620] nix-grpc-daemon[778]: ts=2026-09-20T09:33:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 21.191982] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 21.204217] nix-grpc-daemon[778]: ts=2026-09-20T09:33:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 21.203728] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 21.247193] nix-grpc-daemon[778]: ts=2026-09-20T09:33:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 21.248815] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 21.251559] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 21.253620] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 21.288987] envoy[913]: [2026-09-20 09:33:01.871][913][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 21.300277] envoy[913]: [2026-09-20 09:33:01.871][913][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 21.306208] envoy[913]: [2026-09-20 09:33:01.871][913][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker2 # [ 21.322740] nix-grpc-daemon[778]: ts=2026-09-20T09:33:00Z level=info event=scheduler_connected addr=lb:50051 lb # [ 21.312843] envoy[913]: [2026-09-20 09:33:01.871][913][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 21.331531] nix-grpc-daemon[778]: ts=2026-09-20T09:33:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.331463] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.333900] nix-grpc-daemon[774]: ts=2026-09-20T09:33:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.532970] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.535386] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.538358] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.540480] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.737503] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.739196] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.744430] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.742878] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.945391] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.943993] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.950769] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.949400] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.151673] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.150350] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.157198] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.155638] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.358405] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.361142] nix-grpc-daemon[778]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.358535] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.362787] nix-grpc-daemon[774]: ts=2026-09-20T09:33:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.559127] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.562271] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.567641] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.569975] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.766357] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.768565] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.773956] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.772460] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.973128] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.974835] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.978353] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.980278] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.179280] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.181311] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.184588] nix-grpc-daemon[774]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.186598] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.386591] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.388704] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.391414] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.393487] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.588314] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.594601] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.593425] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.599639] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.794243] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.796600] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.799491] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.801916] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.000699] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.002842] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.006239] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.008354] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.206908] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.208984] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.212413] nix-grpc-daemon[774]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.214344] nix-grpc-daemon[778]: ts=2026-09-20T09:33:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.415157] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.417193] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.419450] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.421412] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.616277] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.617948] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.621648] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.623428] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.822539] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.824254] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.827838] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.829568] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.028756] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.030438] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.034087] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.035838] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.235065] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.236699] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.240545] nix-grpc-daemon[774]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.242116] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.444740] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.443441] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.448949] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.447713] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.646272] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.644609] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.651151] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.650052] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.852195] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.852286] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.857646] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.860316] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.053631] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.058567] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.059107] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.064001] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.260083] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.264929] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.265461] nix-grpc-daemon[774]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.270287] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.468461] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.473182] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.472863] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.477391] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.669116] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.673646] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.674718] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.679186] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.875643] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.880585] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.881321] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.885918] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.081988] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.086835] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.087393] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.092300] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.288628] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.293131] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.294267] nix-grpc-daemon[774]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.298672] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.496754] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.501353] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.501953] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.505827] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.702896] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.706803] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.708493] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.712287] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.909405] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.913187] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.914881] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.918676] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.115886] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.119726] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.121262] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.124874] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.321486] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.322091] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.326965] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.327359] nix-grpc-daemon[774]: ts=2026-09-20T09:33:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.529900] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.530526] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.534182] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.534780] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.730819] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.730792] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.736333] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.736688] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.937034] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.937949] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.943472] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.945868] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.142619] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.144414] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.147992] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.149968] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.348880] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.351166] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.354693] nix-grpc-daemon[778]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.357239] nix-grpc-daemon[774]: ts=2026-09-20T09:33:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.557135] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.560000] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.562762] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.564425] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.760489] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.763389] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.766051] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.768746] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.967145] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.969543] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.972911] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.974676] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.175413] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.174025] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.180937] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.179649] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.381798] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.380656] nix-grpc-daemon[774]: ts=2026-09-20T09:33:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.387262] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.386214] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.473968] rustfs-bucket-start[1022]: mb s3://farm lb # [ 30.483022] systemd[1]: Finished rustfs-bucket.service. lb # [ 30.491573] systemd[1]: Starting niks3 server... worker2 # [ 30.590235] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.589276] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.594557] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.593522] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.712938] postgres[1037]: [1037] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 30.714272] postgres[1037]: [1037] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 30.749196] niks3-server[1032]: 2026/09/20 09:33:11 OK 20241026095416_initial_model.sql (21.21ms) lb # [ 30.752758] niks3-server[1032]: 2026/09/20 09:33:11 OK 20251210153512_drop_unused_gin_index.sql (3.95ms) lb # [ 30.758552] niks3-server[1032]: 2026/09/20 09:33:11 OK 20251218171726_add_pins.sql (5.73ms) lb # [ 30.763410] niks3-server[1032]: 2026/09/20 09:33:11 OK 20260628120000_add_object_size_and_stats.sql (4.81ms) lb # [ 30.768935] niks3-server[1032]: 2026/09/20 09:33:11 OK 20260905000000_add_claims.sql (5.49ms) lb # [ 30.773935] niks3-server[1032]: 2026/09/20 09:33:11 OK 20260920000000_drop_claims.sql (4.84ms) lb # [ 30.775214] niks3-server[1032]: 2026/09/20 09:33:11 goose: successfully migrated database to version: 20260920000000 lb # [ 30.780574] niks3-server[1032]: 2026/09/20 09:33:11 OK 1_commit_pending_closure.sql (6.61ms) worker2 # [ 30.790648] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.789346] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:50051 lb # [ 30.784942] niks3-server[1032]: 2026/09/20 09:33:11 OK 2_object_stats_trigger.sql (4.18ms) lb # [ 30.786480] niks3-server[1032]: 2026/09/20 09:33:11 goose: up to current file version: 2 worker2 # [ 30.796208] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.794880] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.790884] niks3-server[1032]: 2026/09/20 09:33:11 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 30.840114] niks3-server[1032]: 2026/09/20 09:33:11 INFO Read proxy enabled — serving cache objects from S3 lb # [ 30.843201] niks3-server[1032]: 2026/09/20 09:33:11 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 30.846434] systemd[1]: Started niks3 server. lb # [ 30.847142] niks3-server[1032]: 2026/09/20 09:33:11 INFO systemd watchdog enabled interval=15s lb # [ 30.852302] niks3-server[1032]: 2026/09/20 09:33:11 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 30.855708] systemd[1]: Reached target Multi-User System. lb # [ 30.857988] niks3-server[1032]: 2026/09/20 09:33:11 INFO lead: acquired remote=192.168.1.3:35130 lb # [ 30.861394] systemd[1]: Startup finished in 988ms (kernel) + 5.562s (initrd) + 24.299s (userspace) = 30.850s. worker1 # [ 30.868972] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_take_over worker2 # [ 30.997133] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.995996] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.002711] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.001574] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.202669] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.203606] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.209363] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.208475] nix-grpc-daemon[774]: ts=2026-09-20T09:33:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.410106] nix-grpc-daemon[778]: ts=2026-09-20T09:33:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.409325] nix-grpc-daemon[774]: ts=2026-09-20T09:33:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.421302] nix-grpc-daemon[774]: ts=2026-09-20T09:33:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 31.427488] nix-grpc-daemon[774]: ts=2026-09-20T09:33:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: waiting for unit niks3.service, in 17.03 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.07 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 31.762467] envoy[913]: conn peer=[::1]:58144 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=4 lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy ??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 128 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.15 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 32.585911] nix-grpc-daemon[774]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 32.596335] systemd[1]: Started Nix Daemon. worker1 # [ 32.862365] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 32.896903] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 1/5) worker1 # [ 32.968196] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 2/5) worker1 # [ 32.983439] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 117 ms (attempt 3/5) worker1 # [ 33.107978] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 118 ms (attempt 4/5) worker1 # [ 33.235808] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 33.279248] nix-grpc-daemon[778]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 33.295097] systemd[1]: Started Nix Daemon. worker2 # [ 33.588997] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 33.616330] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5) worker2 # [ 33.656174] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 2/5) worker2 # [ 33.715572] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 3/5) worker2 # [ 33.812914] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 792 ms (attempt 4/5) worker2 # [ 34.615858] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 34.632104] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 34.645360] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 34.657550] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds) client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds) worker2 # [ 35.108228] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 35.114574] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:50050 worker1 # [ 35.138908] nix-grpc-daemon[774]: ts=2026-09-20T09:33:14Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 35.144708] nix-grpc-daemon[774]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:49238 worker2 # [ 35.164966] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:50050 worker1 # [ 35.158161] nix-grpc-daemon[774]: ts=2026-09-20T09:33:14Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 35.177325] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=path_info_miss path=w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test error="error: path '/nix/store/w9lhiinp5ib6z9s3bral0qif32yxxqxs-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.06 seconds) worker1 # [ 37.546099] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 37.827668] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.62 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 38.094144] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49238 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 38.111884] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker1 # [ 38.163697] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker1 # [ 38.170283] nix-grpc-daemon[774]: ts=2026-09-20T09:33:17Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 38.220158] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 38.248551] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 client # copying 1 paths to 'lb:50051'... worker2 # [ 38.268139] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker2 # [ 38.309082] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 38.353531] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=info event=niks3_push_started pid=846 worker2 # [ 38.849915] nix-daemon[836]: accepted connection from pid 859, user nix-grpc-daemon (trusted) worker2 # [ 38.871035] nix-daemon[836]: reaped child process 862, status = succeeded worker2 # [ 39.090608] nix-daemon[836]: accepted connection from pid 864, user nix-grpc-daemon (trusted) worker2 # [ 39.109261] nix-daemon[836]: reaped child process 868, status = succeeded lb # [ 39.114241] niks3-server[1032]: 2026/09/20 09:33:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 39.173824] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.794Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 39.175918] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.794Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 39.227690] niks3-server[1032]: 2026/09/20 09:33:19 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 39.243157] niks3-server[1032]: 2026/09/20 09:33:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign worker2 # [ 39.265371] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.887Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.254628] niks3-server[1032]: 2026/09/20 09:33:19 INFO Signed narinfos id=1 count=1 lb # [ 39.279197] niks3-server[1032]: 2026/09/20 09:33:19 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 39.292367] niks3-server[1032]: 2026/09/20 09:33:19 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 39.320607] niks3-server[1032]: 2026/09/20 09:33:19 INFO Completed upload id=1 lb # [ 39.329347] niks3-server[1032]: 2026/09/20 09:33:19 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo worker2 # [ 39.330401] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.953Z level=INFO msg="Upload complete. (680ms)" worker2 # [ 39.348741] nix-grpc-daemon[778]: ts=2026-09-20T09:33:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 paths=1 nar_bytes_in=504 worker2 # [ 39.361155] nix-grpc-daemon[778]: ts=2026-09-20T09:33:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 39.380077] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 39.385287] nix-daemon[836]: reaped child process 844, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... worker2 # [ 39.401366] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv client # farm-a> LOG-farm-a-t1 lb # [ 40.921407] envoy[913]: conn peer=[2001:db8:1::1]:55908 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2121 lb # [ 40.927557] envoy[913]: conn peer=[2001:db8:1::1]:55920 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=98 lb # [ 40.933557] envoy[913]: conn peer=[2001:db8:1::1]:55930 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=199 ms=25 lb # [ 40.940275] envoy[913]: conn peer=[2001:db8:1::1]:55936 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=18 worker2 # [ 41.074002] nix-daemon[836]: reaped child process 872, status = succeeded worker2 # [ 41.268166] nix-daemon[836]: accepted connection from pid 887, user nix-grpc-daemon (trusted) worker2 # [ 41.291544] nix-daemon[836]: reaped child process 890, status = succeeded lb # [ 41.299294] niks3-server[1032]: 2026/09/20 09:33:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 41.332862] nix-grpc-daemon[846]: time=2026-09-20T09:33:20.955Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 41.335788] nix-grpc-daemon[846]: time=2026-09-20T09:33:20.958Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 41.369459] niks3-server[1032]: 2026/09/20 09:33:21 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 41.382440] niks3-server[1032]: 2026/09/20 09:33:21 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 41.399369] niks3-server[1032]: 2026/09/20 09:33:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 41.410211] niks3-server[1032]: 2026/09/20 09:33:21 INFO Signed narinfos id=2 count=1 worker2 # [ 41.417911] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.039Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.413819] niks3-server[1032]: 2026/09/20 09:33:21 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 41.428569] niks3-server[1032]: 2026/09/20 09:33:22 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 41.438850] niks3-server[1032]: 2026/09/20 09:33:22 INFO Completed upload id=2 worker2 # [ 41.448419] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.071Z level=INFO msg="Upload complete. (426ms)" lb # [ 41.442949] niks3-server[1032]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker2 # [ 41.466322] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker1 # [ 41.475339] nix-grpc-daemon[774]: ts=2026-09-20T09:33:21Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker1 # [ 41.482246] nix-grpc-daemon[774]: ts=2026-09-20T09:33:21Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 41.496998] nix-daemon[836]: reaped child process 870, status = succeeded worker2 # [ 41.528810] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 41.549423] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 41.570010] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.193Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 41.582002] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker2 # [ 41.608346] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 41.851333] nix-daemon[836]: accepted connection from pid 894, user nix-grpc-daemon (trusted) worker2 # [ 41.874525] nix-daemon[836]: reaped child process 897, status = succeeded worker2 # [ 42.058093] nix-daemon[836]: accepted connection from pid 899, user nix-grpc-daemon (trusted) worker2 # [ 42.077991] nix-daemon[836]: reaped child process 902, status = succeeded lb # [ 42.080150] niks3-server[1032]: 2026/09/20 09:33:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 42.104927] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.727Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 42.106517] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.727Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 42.118977] niks3-server[1032]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst worker2 # [ 42.145116] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.768Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.136249] niks3-server[1032]: 2026/09/20 09:33:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 42.145036] niks3-server[1032]: 2026/09/20 09:33:22 INFO Signed narinfos id=3 count=1 lb # [ 42.154298] niks3-server[1032]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 42.165487] niks3-server[1032]: 2026/09/20 09:33:22 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 42.170392] niks3-server[1032]: 2026/09/20 09:33:22 INFO Completed upload id=3 worker2 # [ 42.179864] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.803Z level=INFO msg="Upload complete. (551ms)" lb # [ 42.173273] niks3-server[1032]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker2 # [ 42.191056] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 42.209851] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 42.219968] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 42.226187] nix-daemon[836]: reaped child process 892, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker2 # [ 42.248450] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-t1 worker2 # [ 43.287082] nix-daemon[836]: reaped child process 906, status = succeeded worker2 # [ 43.458737] nix-daemon[836]: accepted connection from pid 922, user nix-grpc-daemon (trusted) worker2 # [ 43.479702] nix-daemon[836]: reaped child process 925, status = succeeded lb # [ 43.487553] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 43.512454] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.134Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 43.514112] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.134Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 43.533512] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 43.546647] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker2 # [ 43.562967] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.185Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.556604] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 43.559849] niks3-server[1032]: 2026/09/20 09:33:24 INFO Signed narinfos id=4 count=1 lb # [ 43.570841] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 43.577767] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls worker2 # [ 43.586335] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.209Z level=INFO msg="Upload complete. (315ms)" lb # [ 43.580637] niks3-server[1032]: 2026/09/20 09:33:24 INFO Completed upload id=4 lb # [ 43.584040] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker2 # [ 43.597121] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker1 # [ 43.605802] nix-grpc-daemon[774]: ts=2026-09-20T09:33:23Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 43.615321] nix-daemon[836]: reaped child process 904, status = succeeded worker1 # [ 43.612373] nix-grpc-daemon[774]: ts=2026-09-20T09:33:23Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 43.663167] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 43.685361] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 43.704852] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.328Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker2 # [ 43.717642] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 43.738196] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 43.955598] nix-daemon[836]: accepted connection from pid 929, user nix-grpc-daemon (trusted) worker2 # [ 43.975704] nix-daemon[836]: reaped child process 932, status = succeeded worker2 # [ 44.160192] nix-daemon[836]: accepted connection from pid 934, user nix-grpc-daemon (trusted) worker2 # [ 44.179983] nix-daemon[836]: reaped child process 937, status = succeeded lb # [ 44.183534] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 44.203724] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.827Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 44.205985] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.828Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 44.223659] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst worker2 # [ 44.247636] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.870Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.242044] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 44.251273] niks3-server[1032]: 2026/09/20 09:33:24 INFO Signed narinfos id=5 count=1 lb # [ 44.257290] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 44.267665] niks3-server[1032]: 2026/09/20 09:33:24 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 44.274102] niks3-server[1032]: 2026/09/20 09:33:24 INFO Completed upload id=5 lb # [ 44.278032] niks3-server[1032]: 2026/09/20 09:33:24 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker2 # [ 44.281870] nix-grpc-daemon[846]: time=2026-09-20T09:33:23.905Z level=INFO msg="Upload complete. (523ms)" worker2 # [ 44.292373] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 44.308206] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 44.315993] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 44.321780] nix-daemon[836]: reaped child process 927, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 44.337698] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1 worker2 # [ 45.586125] nix-daemon[836]: reaped child process 941, status = succeeded worker2 # [ 45.770554] nix-daemon[836]: accepted connection from pid 956, user nix-grpc-daemon (trusted) worker2 # [ 45.792235] nix-daemon[836]: reaped child process 960, status = succeeded lb # [ 45.802433] niks3-server[1032]: 2026/09/20 09:33:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.826748] nix-grpc-daemon[846]: time=2026-09-20T09:33:25.447Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 45.828541] nix-grpc-daemon[846]: time=2026-09-20T09:33:25.448Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 45.862957] niks3-server[1032]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 45.877841] niks3-server[1032]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst worker2 # [ 45.892907] nix-grpc-daemon[846]: time=2026-09-20T09:33:25.515Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.886479] niks3-server[1032]: 2026/09/20 09:33:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 45.892624] niks3-server[1032]: 2026/09/20 09:33:26 INFO Signed narinfos id=6 count=1 lb # [ 45.894382] niks3-server[1032]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 45.899697] niks3-server[1032]: 2026/09/20 09:33:26 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 45.911731] niks3-server[1032]: 2026/09/20 09:33:26 INFO Completed upload id=6 lb # [ 45.913890] niks3-server[1032]: 2026/09/20 09:33:26 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker2 # [ 45.921250] nix-grpc-daemon[846]: time=2026-09-20T09:33:25.544Z level=INFO msg="Upload complete. (371ms)" worker2 # [ 45.933678] nix-grpc-daemon[778]: ts=2026-09-20T09:33:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker2 # [ 45.963019] nix-daemon[836]: reaped child process 939, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 8.15 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.29 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.33 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.94 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.33 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 47.705731] nix-grpc-daemon[774]: ts=2026-09-20T09:33:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49238 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 47.725246] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 47.742032] nix-grpc-daemon[846]: time=2026-09-20T09:33:27.362Z level=INFO msg="All 2 paths already cached" worker1 # [ 47.757415] nix-grpc-daemon[774]: ts=2026-09-20T09:33:27Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.38 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.09 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.62 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 48.866562] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50050 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 48.878028] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 48.891046] nix-grpc-daemon[846]: time=2026-09-20T09:33:28.513Z level=INFO msg="All 2 paths already cached" worker1 # [ 48.907670] nix-grpc-daemon[774]: ts=2026-09-20T09:33:28Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker1 # [ 48.913838] nix-grpc-daemon[774]: ts=2026-09-20T09:33:28Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 48.954118] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 48.971199] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 48.987556] nix-grpc-daemon[846]: time=2026-09-20T09:33:28.610Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker2 # [ 49.000938] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 49.019761] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 49.233268] nix-daemon[836]: accepted connection from pid 977, user nix-grpc-daemon (trusted) worker2 # [ 49.255426] nix-daemon[836]: reaped child process 980, status = succeeded worker2 # [ 49.430384] nix-daemon[836]: accepted connection from pid 982, user nix-grpc-daemon (trusted) worker2 # [ 49.448426] nix-daemon[836]: reaped child process 985, status = succeeded lb # [ 49.451534] niks3-server[1032]: 2026/09/20 09:33:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 49.470773] nix-grpc-daemon[846]: time=2026-09-20T09:33:29.093Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 49.472378] nix-grpc-daemon[846]: time=2026-09-20T09:33:29.093Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 49.480928] niks3-server[1032]: 2026/09/20 09:33:30 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst worker2 # [ 49.504449] nix-grpc-daemon[846]: time=2026-09-20T09:33:29.127Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.498368] niks3-server[1032]: 2026/09/20 09:33:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 49.508818] niks3-server[1032]: 2026/09/20 09:33:30 INFO Signed narinfos id=7 count=1 lb # [ 49.513605] niks3-server[1032]: 2026/09/20 09:33:30 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 49.521586] niks3-server[1032]: 2026/09/20 09:33:30 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete worker2 # [ 49.535862] nix-grpc-daemon[846]: time=2026-09-20T09:33:29.159Z level=INFO msg="Upload complete. (497ms)" lb # [ 49.526530] niks3-server[1032]: 2026/09/20 09:33:30 INFO Completed upload id=7 lb # [ 49.529516] niks3-server[1032]: 2026/09/20 09:33:30 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker2 # [ 49.544283] nix-grpc-daemon[778]: ts=2026-09-20T09:33:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 49.556309] nix-grpc-daemon[778]: ts=2026-09-20T09:33:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 49.564374] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 49.567799] nix-daemon[836]: reaped child process 975, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 49.581435] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1b worker2 # [ 50.618096] nix-daemon[836]: reaped child process 989, status = succeeded worker2 # [ 50.783004] nix-daemon[836]: accepted connection from pid 1004, user nix-grpc-daemon (trusted) worker2 # [ 50.804242] nix-daemon[836]: reaped child process 1007, status = succeeded lb # [ 50.807775] niks3-server[1032]: 2026/09/20 09:33:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 50.828437] nix-grpc-daemon[846]: time=2026-09-20T09:33:30.449Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 50.829939] nix-grpc-daemon[846]: time=2026-09-20T09:33:30.449Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 50.851232] niks3-server[1032]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst worker2 # [ 50.875897] nix-grpc-daemon[846]: time=2026-09-20T09:33:30.498Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.863023] niks3-server[1032]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 50.877600] niks3-server[1032]: 2026/09/20 09:33:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 50.886869] niks3-server[1032]: 2026/09/20 09:33:31 INFO Signed narinfos id=8 count=1 lb # [ 50.892142] niks3-server[1032]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 50.895969] niks3-server[1032]: 2026/09/20 09:33:31 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete worker2 # [ 50.910035] nix-grpc-daemon[846]: time=2026-09-20T09:33:30.533Z level=INFO msg="Upload complete. (319ms)" lb # [ 50.900828] niks3-server[1032]: 2026/09/20 09:33:31 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo lb # [ 50.904929] niks3-server[1032]: 2026/09/20 09:33:31 INFO Completed upload id=8 worker2 # [ 50.919717] nix-grpc-daemon[778]: ts=2026-09-20T09:33:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 lb # [ 50.919669] envoy[913]: conn peer=[2001:db8:1::1]:55942 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9549 tx=3821 ms=7867 lb # [ 50.924408] envoy[913]: conn peer=[2001:db8:1::1]:45642 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=481 ms=76 worker2 # [ 50.936973] nix-daemon[836]: reaped child process 987, status = succeeded lb # [ 50.928736] envoy[913]: conn peer=[2001:db8:1::1]:45646 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1731 ms=2070 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.35 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.98 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 51.497317] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # Running as unit: dedup1.service; invocation ID: abeb70959be545eb82df2d7b13dd8289 client # [ 51.747408] nix[885]: don't know how to build these paths: client # [ 51.749458] nix[885]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 51.722244] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 51.736267] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker1 # [ 51.742454] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 51.787564] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 51.809516] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49238 client # [ 51.848194] nix[885]: copying 1 paths to 'lb:50051'... worker1 # [ 51.825165] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 client # [ 51.852295] nix[885]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker1 # [ 51.845398] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 51.876510] nix-grpc-daemon[774]: ts=2026-09-20T09:33:31Z level=info event=niks3_push_started pid=890 worker1 # [ 52.329934] nix-daemon[836]: accepted connection from pid 903, user nix-grpc-daemon (trusted) worker1 # [ 52.353758] nix-daemon[836]: reaped child process 906, status = succeeded worker1 # [ 52.529397] nix-daemon[836]: accepted connection from pid 908, user nix-grpc-daemon (trusted) worker1 # [ 52.548130] nix-daemon[836]: reaped child process 911, status = succeeded lb # [ 52.552972] niks3-server[1032]: 2026/09/20 09:33:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.573562] nix-grpc-daemon[890]: time=2026-09-20T09:33:32.190Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.575119] nix-grpc-daemon[890]: time=2026-09-20T09:33:32.191Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 52.589989] niks3-server[1032]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst client # [ 52.617555] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: c6697a977cd44777823cbfb2f750c706 lb # [ 52.603788] niks3-server[1032]: 2026/09/20 09:33:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker1 # [ 52.618252] nix-grpc-daemon[890]: time=2026-09-20T09:33:32.237Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.613458] niks3-server[1032]: 2026/09/20 09:33:33 INFO Signed narinfos id=9 count=1 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds) lb # [ 52.622915] niks3-server[1032]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 52.635270] niks3-server[1032]: 2026/09/20 09:33:33 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete worker1 # [ 52.653512] nix-grpc-daemon[890]: time=2026-09-20T09:33:32.272Z level=INFO msg="Upload complete. (511ms)" lb # [ 52.646129] niks3-server[1032]: 2026/09/20 09:33:33 INFO Completed upload id=9 worker1 # [ 52.659453] nix-grpc-daemon[774]: ts=2026-09-20T09:33:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 52.650470] niks3-server[1032]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker1 # [ 52.671271] nix-grpc-daemon[774]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 52.676788] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 52.680191] nix-daemon[836]: reaped child process 888, status = succeeded client # [ 52.713938] nix[885]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker1 # [ 52.691748] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker2 # [ 52.911223] nix-grpc-daemon[778]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50050 client # [ 52.942391] nix[901]: don't know how to build these paths: client # [ 52.944052] nix[901]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 52.931268] nix-grpc-daemon[774]: ts=2026-09-20T09:33:32Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker1 # [ 52.944152] nix-grpc-daemon[774]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 client # [ 52.975916] nix[901]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.07 seconds) ??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 client: waiting for success: ! systemctl is-active dedup1 dedup2 ??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 worker1 # [ 56.343817] nix-daemon[836]: reaped child process 919, status = succeeded worker1 # [ 56.525572] nix-daemon[836]: accepted connection from pid 946, user nix-grpc-daemon (trusted) worker1 # [ 56.545259] nix-daemon[836]: reaped child process 949, status = succeeded lb # [ 56.550319] niks3-server[1032]: 2026/09/20 09:33:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 56.568595] nix-grpc-daemon[890]: time=2026-09-20T09:33:36.186Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 56.570488] nix-grpc-daemon[890]: time=2026-09-20T09:33:36.186Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 56.595328] niks3-server[1032]: 2026/09/20 09:33:37 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 56.608765] niks3-server[1032]: 2026/09/20 09:33:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign worker1 # [ 56.617813] nix-grpc-daemon[890]: time=2026-09-20T09:33:36.235Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.619105] niks3-server[1032]: 2026/09/20 09:33:37 INFO Signed narinfos id=10 count=1 lb # [ 56.625194] niks3-server[1032]: 2026/09/20 09:33:37 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 56.643520] nix-grpc-daemon[890]: time=2026-09-20T09:33:36.262Z level=INFO msg="Upload complete. (336ms)" lb # [ 56.636700] niks3-server[1032]: 2026/09/20 09:33:37 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 56.641688] niks3-server[1032]: 2026/09/20 09:33:37 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 56.647248] niks3-server[1032]: 2026/09/20 09:33:37 INFO Completed upload id=10 lb # [ 56.649940] niks3-server[1032]: 2026/09/20 09:33:37 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker1 # [ 56.663963] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 56.669233] nix-grpc-daemon[774]: ts=2026-09-20T09:33:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 56.674128] nix-daemon[836]: reaped child process 917, status = succeeded client # [ 56.738065] systemd[1]: dedup2.service: Deactivated successfully. client # [ 56.742787] systemd[1]: dedup2.service: Consumed 183ms CPU time over 4.125s wall clock time, 31M memory peak, 7.6K incoming IP traffic, 6.5K outgoing IP traffic. client # [ 56.753752] systemd[1]: dedup1.service: Deactivated successfully. client # [ 56.755642] systemd[1]: dedup1.service: Consumed 163ms CPU time over 5.254s wall clock time, 39.2M memory peak, 8.6K incoming IP traffic, 8.9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.33 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 57.975924] systemd[1]: Started Nix Daemon. client # [ 58.166182] nix-daemon[943]: accepted connection from pid 940, user root (trusted) worker2 # [ 58.346864] nix-grpc-daemon[778]: ts=2026-09-20T09:33:37Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 58.358115] nix-grpc-daemon[778]: ts=2026-09-20T09:33:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker1 # [ 58.377130] nix-grpc-daemon[774]: ts=2026-09-20T09:33:37Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker1 # [ 58.383217] nix-grpc-daemon[774]: ts=2026-09-20T09:33:37Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 58.425998] nix-grpc-daemon[778]: ts=2026-09-20T09:33:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 58.442127] nix-grpc-daemon[778]: ts=2026-09-20T09:33:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 58.457774] nix-grpc-daemon[778]: ts=2026-09-20T09:33:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 58.476395] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 58.700346] nix-daemon[836]: accepted connection from pid 1034, user nix-grpc-daemon (trusted) worker2 # [ 58.723694] nix-daemon[836]: reaped child process 1037, status = succeeded worker2 # [ 58.902712] nix-daemon[836]: accepted connection from pid 1039, user nix-grpc-daemon (trusted) worker2 # [ 58.921187] nix-daemon[836]: reaped child process 1042, status = succeeded lb # [ 58.925965] niks3-server[1032]: 2026/09/20 09:33:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 58.943794] nix-grpc-daemon[846]: time=2026-09-20T09:33:38.566Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 58.945474] nix-grpc-daemon[846]: time=2026-09-20T09:33:38.566Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 58.951343] niks3-server[1032]: 2026/09/20 09:33:39 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 58.966873] niks3-server[1032]: 2026/09/20 09:33:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker2 # [ 58.981545] nix-grpc-daemon[846]: time=2026-09-20T09:33:38.604Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.978159] niks3-server[1032]: 2026/09/20 09:33:39 INFO Signed narinfos id=11 count=1 lb # [ 58.984300] niks3-server[1032]: 2026/09/20 09:33:39 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls worker2 # [ 59.000881] nix-grpc-daemon[846]: time=2026-09-20T09:33:38.624Z level=INFO msg="Upload complete. (507ms)" lb # [ 58.993192] niks3-server[1032]: 2026/09/20 09:33:39 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 58.998209] niks3-server[1032]: 2026/09/20 09:33:39 INFO Completed upload id=11 worker2 # [ 59.006773] nix-grpc-daemon[778]: ts=2026-09-20T09:33:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 59.001493] niks3-server[1032]: 2026/09/20 09:33:39 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker2 # [ 59.016864] nix-grpc-daemon[778]: ts=2026-09-20T09:33:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 59.028166] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 59.031309] nix-daemon[836]: reaped child process 1032, status = succeeded worker2 # [ 59.045022] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 60.287874] nix-daemon[836]: reaped child process 1046, status = succeeded worker2 # [ 60.468305] nix-daemon[836]: accepted connection from pid 1061, user nix-grpc-daemon (trusted) worker2 # [ 60.487757] nix-daemon[836]: reaped child process 1064, status = succeeded lb # [ 60.491170] niks3-server[1032]: 2026/09/20 09:33:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 60.509866] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.132Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 60.514734] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.134Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 60.532834] niks3-server[1032]: 2026/09/20 09:33:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker2 # [ 60.554844] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.177Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.550054] niks3-server[1032]: 2026/09/20 09:33:41 INFO Signed narinfos id=12 count=1 lb # [ 60.562377] niks3-server[1032]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 60.571319] niks3-server[1032]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 60.580357] niks3-server[1032]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 60.585526] niks3-server[1032]: 2026/09/20 09:33:41 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete worker2 # [ 60.594842] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.218Z level=INFO msg="Upload complete. (340ms)" lb # [ 60.589179] niks3-server[1032]: 2026/09/20 09:33:41 INFO Completed upload id=12 lb # [ 60.592180] niks3-server[1032]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker2 # [ 60.605141] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker2 # [ 60.624648] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 60.629558] nix-daemon[836]: reaped child process 1044, status = succeeded worker1 # [ 60.641847] nix-grpc-daemon[774]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 60.664621] nix-grpc-daemon[774]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 60.687788] nix-grpc-daemon[774]: ts=2026-09-20T09:33:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=128 lb # [ 60.917484] envoy[913]: conn peer=[2001:db8:1::1]:45888 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=3766 lb # [ 60.922573] envoy[913]: conn peer=[2001:db8:1::1]:45878 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1372 ms=4953 lb # [ 60.927654] envoy[913]: conn peer=[2001:db8:1::1]:45906 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=108 lb # [ 60.932469] envoy[913]: conn peer=[2001:db8:1::1]:45890 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3401 tx=1664 ms=2400 worker2 # [ 60.989757] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 60.997117] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 61.003779] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.626Z level=INFO msg="All 1 paths already cached" worker1 # [ 61.016446] nix-grpc-daemon[774]: ts=2026-09-20T09:33:40Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker1 # [ 61.022986] nix-grpc-daemon[774]: ts=2026-09-20T09:33:40Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 61.027218] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 61.042046] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 61.056225] nix-grpc-daemon[846]: time=2026-09-20T09:33:40.679Z level=INFO msg="All 1 paths already cached" worker2 # [ 61.065149] nix-grpc-daemon[778]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 61.079087] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 61.288610] nix-daemon[836]: accepted connection from pid 1068, user nix-grpc-daemon (trusted) worker2 # [ 61.306846] nix-daemon[836]: reaped child process 1071, status = succeeded worker2 # [ 61.478957] nix-daemon[836]: accepted connection from pid 1073, user nix-grpc-daemon (trusted) worker2 # [ 61.495694] nix-daemon[836]: reaped child process 1076, status = succeeded lb # [ 61.498654] niks3-server[1032]: 2026/09/20 09:33:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 61.517208] nix-grpc-daemon[846]: time=2026-09-20T09:33:41.140Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 61.518685] nix-grpc-daemon[846]: time=2026-09-20T09:33:41.140Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 61.524352] niks3-server[1032]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker2 # [ 61.547154] nix-grpc-daemon[846]: time=2026-09-20T09:33:41.170Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.541192] niks3-server[1032]: 2026/09/20 09:33:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 61.552316] niks3-server[1032]: 2026/09/20 09:33:42 INFO Signed narinfos id=13 count=1 lb # [ 61.563994] niks3-server[1032]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls worker2 # [ 61.578070] nix-grpc-daemon[846]: time=2026-09-20T09:33:41.201Z level=INFO msg="Upload complete. (481ms)" lb # [ 61.569693] niks3-server[1032]: 2026/09/20 09:33:42 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete worker2 # [ 61.584275] nix-grpc-daemon[778]: ts=2026-09-20T09:33:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 61.575301] niks3-server[1032]: 2026/09/20 09:33:42 INFO Completed upload id=13 lb # [ 61.579931] niks3-server[1032]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker2 # [ 61.597161] nix-grpc-daemon[778]: ts=2026-09-20T09:33:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 61.602588] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 61.607382] nix-daemon[836]: reaped child process 1066, status = succeeded worker2 # [ 61.619864] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 62.668812] nix-daemon[836]: reaped child process 1080, status = succeeded worker2 # [ 62.849752] nix-daemon[836]: accepted connection from pid 1095, user nix-grpc-daemon (trusted) worker2 # [ 62.868533] nix-daemon[836]: reaped child process 1098, status = succeeded lb # [ 62.874064] niks3-server[1032]: 2026/09/20 09:33:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 62.894091] nix-grpc-daemon[846]: time=2026-09-20T09:33:42.516Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 62.895617] nix-grpc-daemon[846]: time=2026-09-20T09:33:42.516Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 62.915321] niks3-server[1032]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst worker2 # [ 62.936714] nix-grpc-daemon[846]: time=2026-09-20T09:33:42.559Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.929376] niks3-server[1032]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 62.938325] niks3-server[1032]: 2026/09/20 09:33:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 62.946842] niks3-server[1032]: 2026/09/20 09:33:43 INFO Signed narinfos id=14 count=1 worker2 # [ 62.959778] nix-grpc-daemon[846]: time=2026-09-20T09:33:42.583Z level=INFO msg="Upload complete. (328ms)" lb # [ 62.952738] niks3-server[1032]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 62.955702] niks3-server[1032]: 2026/09/20 09:33:43 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 62.959828] niks3-server[1032]: 2026/09/20 09:33:43 INFO Completed upload id=14 lb # [ 62.962399] niks3-server[1032]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker2 # [ 62.973101] nix-grpc-daemon[778]: ts=2026-09-20T09:33:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker2 # [ 62.986737] nix-daemon[836]: reaped child process 1078, status = succeeded worker2 # [ 63.017355] nix-grpc-daemon[778]: ts=2026-09-20T09:33:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:50050 worker1 # [ 63.050360] nix-grpc-daemon[774]: ts=2026-09-20T09:33:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 63.065035] nix-grpc-daemon[774]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker1 # [ 63.082255] nix-grpc-daemon[774]: ts=2026-09-20T09:33:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 63.387439] nix-grpc-daemon[774]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:49238 worker2 # [ 63.394161] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 63.405292] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.028Z level=INFO msg="All 2 paths already cached" worker1 # [ 63.422140] nix-grpc-daemon[774]: ts=2026-09-20T09:33:43Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker1 # [ 63.428392] nix-grpc-daemon[774]: ts=2026-09-20T09:33:43Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 63.469853] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 63.486328] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 63.500896] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.124Z level=INFO msg="All 2 paths already cached" worker2 # [ 63.510410] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 63.524601] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 63.732888] nix-daemon[836]: accepted connection from pid 1102, user nix-grpc-daemon (trusted) worker2 # [ 63.752637] nix-daemon[836]: reaped child process 1105, status = succeeded worker2 # [ 63.929284] nix-daemon[836]: accepted connection from pid 1107, user nix-grpc-daemon (trusted) worker2 # [ 63.946764] nix-daemon[836]: reaped child process 1110, status = succeeded lb # [ 63.952146] niks3-server[1032]: 2026/09/20 09:33:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 63.968538] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.591Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 63.970487] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.593Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 63.984134] niks3-server[1032]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker2 # [ 64.007049] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.630Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.001336] niks3-server[1032]: 2026/09/20 09:33:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 64.010317] niks3-server[1032]: 2026/09/20 09:33:44 INFO Signed narinfos id=15 count=1 lb # [ 64.014118] niks3-server[1032]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 64.022248] niks3-server[1032]: 2026/09/20 09:33:44 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete worker2 # [ 64.035556] nix-grpc-daemon[846]: time=2026-09-20T09:33:43.658Z level=INFO msg="Upload complete. (493ms)" lb # [ 64.026997] niks3-server[1032]: 2026/09/20 09:33:44 INFO Completed upload id=15 lb # [ 64.029942] niks3-server[1032]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker2 # [ 64.044747] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 64.055181] nix-grpc-daemon[778]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 64.064449] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 64.067175] nix-daemon[836]: reaped child process 1100, status = succeeded worker2 # [ 64.079889] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 64.925166] nix-daemon[836]: reaped child process 1114, status = succeeded worker2 # [ 65.106855] nix-daemon[836]: accepted connection from pid 1129, user nix-grpc-daemon (trusted) worker2 # [ 65.125346] nix-daemon[836]: reaped child process 1132, status = succeeded lb # [ 65.129709] niks3-server[1032]: 2026/09/20 09:33:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 65.148470] nix-grpc-daemon[846]: time=2026-09-20T09:33:44.771Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 65.149963] nix-grpc-daemon[846]: time=2026-09-20T09:33:44.771Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 65.171947] niks3-server[1032]: 2026/09/20 09:33:45 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 65.185700] niks3-server[1032]: 2026/09/20 09:33:45 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 65.195656] niks3-server[1032]: 2026/09/20 09:33:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker2 # [ 65.211704] nix-grpc-daemon[846]: time=2026-09-20T09:33:44.834Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.202046] niks3-server[1032]: 2026/09/20 09:33:45 INFO Signed narinfos id=16 count=1 lb # [ 65.208483] niks3-server[1032]: 2026/09/20 09:33:45 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 65.217951] niks3-server[1032]: 2026/09/20 09:33:45 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 65.226065] niks3-server[1032]: 2026/09/20 09:33:45 INFO Completed upload id=16 worker2 # [ 65.234801] nix-grpc-daemon[846]: time=2026-09-20T09:33:44.858Z level=INFO msg="Upload complete. (345ms)" lb # [ 65.229108] niks3-server[1032]: 2026/09/20 09:33:45 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 65.249771] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:49238 worker2 # [ 65.249125] nix-grpc-daemon[778]: ts=2026-09-20T09:33:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker2 # [ 65.264804] nix-daemon[836]: reaped child process 1112, status = succeeded worker1 # [ 65.263651] nix-grpc-daemon[774]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker1 # [ 65.306055] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 65.311454] nix-grpc-daemon[774]: ts=2026-09-20T09:33:44Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=232 client # [ 65.461887] nix-daemon[943]: reaped child process 945, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.73 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.86 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 66.764765] nix-daemon[943]: accepted connection from pid 1026, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 66.944564] nix-grpc-daemon[778]: ts=2026-09-20T09:33:46Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:50050 client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 66.952339] nix-grpc-daemon[778]: ts=2026-09-20T09:33:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker1 # [ 66.963402] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 66.980376] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 67.188402] nix-daemon[836]: accepted connection from pid 978, user nix-grpc-daemon (trusted) worker1 # [ 67.205869] nix-daemon[836]: reaped child process 981, status = succeeded lb # [ 67.211815] niks3-server[1032]: 2026/09/20 09:33:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 67.229256] nix-grpc-daemon[890]: time=2026-09-20T09:33:46.847Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 67.231055] nix-grpc-daemon[890]: time=2026-09-20T09:33:46.847Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 67.238854] niks3-server[1032]: 2026/09/20 09:33:47 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 67.254067] niks3-server[1032]: 2026/09/20 09:33:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 67.268136] nix-grpc-daemon[890]: time=2026-09-20T09:33:46.886Z level=INFO msg="Uploading 1 narinfos" lb # [ 67.267005] niks3-server[1032]: 2026/09/20 09:33:47 INFO Signed narinfos id=17 count=1 lb # [ 67.272472] niks3-server[1032]: 2026/09/20 09:33:47 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 67.281019] niks3-server[1032]: 2026/09/20 09:33:47 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete worker1 # [ 67.288319] nix-grpc-daemon[890]: time=2026-09-20T09:33:46.907Z level=INFO msg="Upload complete. (293ms)" lb # [ 67.285534] niks3-server[1032]: 2026/09/20 09:33:47 INFO Completed upload id=17 lb # [ 67.288520] niks3-server[1032]: 2026/09/20 09:33:47 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker1 # [ 67.300606] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_in=120 worker1 # [ 67.320304] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker1 # [ 67.327213] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 67.332357] nix-daemon[836]: reaped child process 976, status = succeeded worker1 # [ 67.364311] nix-grpc-daemon[774]: ts=2026-09-20T09:33:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 67.381072] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49238 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 67.401182] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 67.412288] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 67.620394] nix-daemon[836]: accepted connection from pid 987, user nix-grpc-daemon (trusted) worker1 # [ 67.639175] nix-daemon[836]: reaped child process 990, status = succeeded worker1 # [ 67.810410] nix-daemon[836]: accepted connection from pid 992, user nix-grpc-daemon (trusted) worker1 # [ 67.827455] nix-daemon[836]: reaped child process 995, status = succeeded lb # [ 67.832514] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 67.842548] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 67.859555] nix-grpc-daemon[890]: time=2026-09-20T09:33:47.478Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 67.861247] nix-grpc-daemon[890]: time=2026-09-20T09:33:47.478Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" worker1 # [ 67.862991] nix-grpc-daemon[890]: time=2026-09-20T09:33:47.478Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" lb # [ 67.879516] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 67.892236] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 67.904338] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign worker1 # [ 67.919054] nix-grpc-daemon[890]: time=2026-09-20T09:33:47.537Z level=INFO msg="Uploading 3 narinfos" lb # [ 67.913820] niks3-server[1032]: 2026/09/20 09:33:48 INFO Signed narinfos id=19 count=2 lb # [ 67.915934] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 67.926213] niks3-server[1032]: 2026/09/20 09:33:48 INFO Signed narinfos id=18 count=1 lb # [ 67.931430] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 67.938735] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 67.946418] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 67.954604] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 67.961702] niks3-server[1032]: 2026/09/20 09:33:48 INFO Completed upload id=19 lb # [ 67.964090] niks3-server[1032]: 2026/09/20 09:33:48 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 67.966559] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 67.969328] niks3-server[1032]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 67.971532] niks3-server[1032]: 2026/09/20 09:33:48 INFO Completed upload id=18 worker1 # [ 67.977135] nix-grpc-daemon[890]: time=2026-09-20T09:33:47.596Z level=INFO msg="Upload complete. (543ms)" worker1 # [ 67.989325] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=2 nar_bytes_in=984 worker1 # [ 68.004603] nix-grpc-daemon[774]: ts=2026-09-20T09:33:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 68.018834] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 68.027796] nix-daemon[836]: reaped child process 985, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker1 # [ 68.036348] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 69.286984] nix-daemon[836]: reaped child process 999, status = succeeded worker1 # [ 69.470089] nix-daemon[836]: accepted connection from pid 1014, user nix-grpc-daemon (trusted) worker1 # [ 69.488108] nix-daemon[836]: reaped child process 1017, status = succeeded lb # [ 69.493445] niks3-server[1032]: 2026/09/20 09:33:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 69.511381] nix-grpc-daemon[890]: time=2026-09-20T09:33:49.129Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 69.523691] niks3-server[1032]: 2026/09/20 09:33:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker1 # [ 69.541313] nix-grpc-daemon[890]: time=2026-09-20T09:33:49.160Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.536845] niks3-server[1032]: 2026/09/20 09:33:50 INFO Signed narinfos id=20 count=1 lb # [ 69.547669] niks3-server[1032]: 2026/09/20 09:33:50 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 69.556516] niks3-server[1032]: 2026/09/20 09:33:50 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 69.567486] niks3-server[1032]: 2026/09/20 09:33:50 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 69.576457] niks3-server[1032]: 2026/09/20 09:33:50 INFO Completed upload id=20 worker1 # [ 69.583343] nix-grpc-daemon[890]: time=2026-09-20T09:33:49.202Z level=INFO msg="Upload complete. (333ms)" lb # [ 69.579607] niks3-server[1032]: 2026/09/20 09:33:50 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker1 # [ 69.597169] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker1 # [ 69.612112] nix-daemon[836]: reaped child process 997, status = succeeded client # copying 1 paths... worker1 # [ 69.641290] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:49238 client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 69.671612] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 69.676945] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=120 client # [ 69.825260] nix-daemon[943]: reaped child process 1029, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.30 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 70.043847] nix-daemon[943]: accepted connection from pid 1048, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 70.223327] nix-grpc-daemon[778]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:50050 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 70.224907] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 70.235226] nix-grpc-daemon[890]: time=2026-09-20T09:33:49.854Z level=INFO msg="All 1 paths already cached" worker1 # [ 70.254267] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker1 # [ 70.261218] nix-grpc-daemon[774]: ts=2026-09-20T09:33:49Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 70.266183] nix-grpc-daemon[778]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 70.282429] nix-grpc-daemon[778]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50050 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 70.309881] nix-grpc-daemon[778]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 worker2 # [ 70.325418] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 70.349273] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5) worker2 # [ 70.411991] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 2/5) worker2 # [ 70.511712] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 127 ms (attempt 3/5) worker2 # [ 70.646500] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 513 ms (attempt 4/5) lb # [ 70.917840] envoy[913]: conn peer=[2001:db8:1::1]:34122 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3874 tx=1878 ms=2152 lb # [ 70.922851] envoy[913]: conn peer=[2001:db8:1::1]:34126 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=98 lb # [ 70.927986] envoy[913]: conn peer=[2001:db8:1::1]:34144 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=63 lb # [ 70.932659] envoy[913]: conn peer=[2001:db8:1::1]:34142 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4330 tx=2242 ms=1978 lb # [ 70.937384] envoy[913]: conn peer=[2001:db8:1::1]:34148 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4267 tx=1769 ms=2787 lb # [ 70.942157] envoy[913]: conn peer=[2001:db8:1::1]:34162 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=63 worker2 # [ 71.167704] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 71.177558] nix-grpc-daemon[778]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 71.417703] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) worker2 # [ 71.437203] nix-daemon[836]: reaped child process 1146, status = succeeded worker2 # [ 71.613171] nix-daemon[836]: accepted connection from pid 1148, user nix-grpc-daemon (trusted) worker2 # [ 71.630505] nix-daemon[836]: reaped child process 1151, status = succeeded lb # [ 71.634213] niks3-server[1032]: 2026/09/20 09:33:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.654008] nix-grpc-daemon[846]: time=2026-09-20T09:33:51.276Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 71.655867] nix-grpc-daemon[846]: time=2026-09-20T09:33:51.276Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 71.671830] niks3-server[1032]: 2026/09/20 09:33:52 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst worker2 # [ 71.691798] nix-grpc-daemon[846]: time=2026-09-20T09:33:51.314Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.687799] niks3-server[1032]: 2026/09/20 09:33:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker2 # [ 71.709788] nix-grpc-daemon[846]: time=2026-09-20T09:33:51.333Z level=INFO msg="Upload complete. (502ms)" lb # [ 71.697033] niks3-server[1032]: 2026/09/20 09:33:52 INFO Signed narinfos id=21 count=1 lb # [ 71.706799] niks3-server[1032]: 2026/09/20 09:33:52 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls worker2 # [ 71.716593] nix-grpc-daemon[778]: ts=2026-09-20T09:33:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 paths=1 nar_bytes_in=568 lb # [ 71.712549] niks3-server[1032]: 2026/09/20 09:33:52 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 71.716907] niks3-server[1032]: 2026/09/20 09:33:52 INFO Completed upload id=21 worker2 # [ 71.725995] nix-grpc-daemon[778]: ts=2026-09-20T09:33:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 lb # [ 71.719387] niks3-server[1032]: 2026/09/20 09:33:52 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker2 # [ 71.735809] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 71.740553] nix-daemon[836]: reaped child process 1137, status = succeeded worker2 # [ 71.755941] nix-grpc-daemon[778]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... worker2 # [ 71.770389] nix-daemon[836]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 72.994764] nix-daemon[836]: reaped child process 1156, status = succeeded worker2 # [ 73.153507] nix-daemon[836]: accepted connection from pid 1171, user nix-grpc-daemon (trusted) worker2 # [ 73.172964] nix-daemon[836]: reaped child process 1174, status = succeeded lb # [ 73.178791] niks3-server[1032]: 2026/09/20 09:33:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 73.198006] nix-grpc-daemon[846]: time=2026-09-20T09:33:52.820Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 73.206034] niks3-server[1032]: 2026/09/20 09:33:53 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 73.216802] niks3-server[1032]: 2026/09/20 09:33:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker2 # [ 73.232275] nix-grpc-daemon[846]: time=2026-09-20T09:33:52.855Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.225657] niks3-server[1032]: 2026/09/20 09:33:53 INFO Signed narinfos id=22 count=1 lb # [ 73.234948] niks3-server[1032]: 2026/09/20 09:33:53 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 73.250539] niks3-server[1032]: 2026/09/20 09:33:53 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete worker2 # [ 73.264728] nix-grpc-daemon[846]: time=2026-09-20T09:33:52.888Z level=INFO msg="Upload complete. (282ms)" lb # [ 73.256067] niks3-server[1032]: 2026/09/20 09:33:53 INFO Completed upload id=22 lb # [ 73.258855] niks3-server[1032]: 2026/09/20 09:33:53 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker2 # [ 73.272813] nix-grpc-daemon[778]: ts=2026-09-20T09:33:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50050 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker2 # [ 73.288298] nix-daemon[836]: reaped child process 1153, status = succeeded client # copying 1 paths... worker1 # [ 73.323104] nix-grpc-daemon[774]: ts=2026-09-20T09:33:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 73.331998] nix-grpc-daemon[774]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 73.379541] nix-grpc-daemon[774]: ts=2026-09-20T09:33:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 73.385221] nix-grpc-daemon[774]: ts=2026-09-20T09:33:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=120 client # [ 73.529448] nix-daemon[943]: reaped child process 1051, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.71 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 73.758925] nix-daemon[943]: accepted connection from pid 1070, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 73.934771] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:49238 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 73.942972] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 73.951250] nix-grpc-daemon[890]: time=2026-09-20T09:33:53.568Z level=INFO msg="All 1 paths already cached" worker1 # [ 73.964170] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker1 # [ 73.972146] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 73.981329] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 73.992713] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:49238 client # copying 1 paths to 'lb:50051'... worker1 # [ 74.008129] nix-grpc-daemon[890]: time=2026-09-20T09:33:53.626Z level=INFO msg="All 1 paths already cached" client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 74.014124] nix-grpc-daemon[774]: ts=2026-09-20T09:33:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 74.029367] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 74.225377] nix-daemon[836]: accepted connection from pid 1026, user nix-grpc-daemon (trusted) worker1 # [ 74.245473] nix-daemon[836]: reaped child process 1029, status = succeeded worker1 # [ 74.431005] nix-daemon[836]: accepted connection from pid 1031, user nix-grpc-daemon (trusted) worker1 # [ 74.449623] nix-daemon[836]: reaped child process 1034, status = succeeded lb # [ 74.456808] niks3-server[1032]: 2026/09/20 09:33:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 74.475409] nix-grpc-daemon[890]: time=2026-09-20T09:33:54.094Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 74.477177] nix-grpc-daemon[890]: time=2026-09-20T09:33:54.094Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 74.491886] niks3-server[1032]: 2026/09/20 09:33:55 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 74.506243] niks3-server[1032]: 2026/09/20 09:33:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker1 # [ 74.520589] nix-grpc-daemon[890]: time=2026-09-20T09:33:54.139Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.518682] niks3-server[1032]: 2026/09/20 09:33:55 INFO Signed narinfos id=23 count=1 lb # [ 74.524393] niks3-server[1032]: 2026/09/20 09:33:55 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 74.531300] niks3-server[1032]: 2026/09/20 09:33:55 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 74.537216] niks3-server[1032]: 2026/09/20 09:33:55 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo lb # [ 74.542062] niks3-server[1032]: 2026/09/20 09:33:55 INFO Completed upload id=23 worker1 # [ 74.550052] nix-grpc-daemon[890]: time=2026-09-20T09:33:54.169Z level=INFO msg="Upload complete. (505ms)" worker1 # [ 74.560261] nix-grpc-daemon[774]: ts=2026-09-20T09:33:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_in=568 worker1 # [ 74.575434] nix-grpc-daemon[774]: ts=2026-09-20T09:33:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 74.581865] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 74.587027] nix-daemon[836]: reaped child process 1024, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker1 # [ 74.598417] nix-daemon[836]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 75.622411] nix-daemon[836]: reaped child process 1038, status = succeeded worker1 # [ 75.780955] nix-daemon[836]: accepted connection from pid 1053, user nix-grpc-daemon (trusted) worker1 # [ 75.800276] nix-daemon[836]: reaped child process 1056, status = succeeded lb # [ 75.805879] niks3-server[1032]: 2026/09/20 09:33:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 75.823436] nix-grpc-daemon[890]: time=2026-09-20T09:33:55.442Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 75.838379] niks3-server[1032]: 2026/09/20 09:33:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker1 # [ 75.854721] nix-grpc-daemon[890]: time=2026-09-20T09:33:55.473Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.853126] niks3-server[1032]: 2026/09/20 09:33:56 INFO Signed narinfos id=24 count=1 lb # [ 75.861608] niks3-server[1032]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 75.872920] niks3-server[1032]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 75.882970] niks3-server[1032]: 2026/09/20 09:33:56 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 75.889324] niks3-server[1032]: 2026/09/20 09:33:56 INFO Completed upload id=24 worker1 # [ 75.896773] nix-grpc-daemon[890]: time=2026-09-20T09:33:55.515Z level=INFO msg="Upload complete. (286ms)" lb # [ 75.890970] niks3-server[1032]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker1 # [ 75.904996] nix-grpc-daemon[774]: ts=2026-09-20T09:33:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker1 # [ 75.920395] nix-daemon[836]: reaped child process 1036, status = succeeded client # copying 1 paths... worker1 # [ 75.955605] nix-grpc-daemon[774]: ts=2026-09-20T09:33:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:49238 client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 75.990939] nix-grpc-daemon[774]: ts=2026-09-20T09:33:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 75.997710] nix-grpc-daemon[774]: ts=2026-09-20T09:33:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:49238 duration_s=0 paths=1 nar_bytes_out=120 client # [ 76.146095] nix-daemon[943]: reaped child process 1073, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.61 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 10.55 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds) worker2 # [ 77.538944] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 78.291482] nix-grpc-daemon[778]: ts=2026-09-20T09:33:57Z level=info event=signal_exit worker1 # [ 79.552807] nix-grpc-daemon[774]: ts=2026-09-20T09:33:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:49236 worker2 # [ 79.555569] nix-grpc-daemon[778]: ts=2026-09-20T09:33:59Z level=info event=scheduler_restarting worker1 # [ 79.557698] nix-grpc-daemon[774]: ts=2026-09-20T09:33:59Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 79.591602] nix-grpc-daemon[778]: ts=2026-09-20T09:33:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 79.614291] nix-daemon[836]: reaped child process 838, status = succeeded worker2 # [ 79.787278] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 79.797055] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 79.799560] systemd[1]: nix-grpc-daemon.service: Consumed 3.642s CPU time over 58.847s wall clock time, 62.1M memory peak, 84.2K incoming IP traffic, 152.2K outgoing IP traffic. worker2 # [ 79.817598] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 79.821262] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 79.822993] systemd[1]: nix-grpc-daemon.socket: Consumed 562us CPU time over 1min 9.015s wall clock time, 256K memory peak, 73.6K incoming IP traffic, 60.1K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 80.148666] nix-grpc-daemon[774]: ts=2026-09-20T09:33:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:49238 worker1 # [ 80.157609] nix-grpc-daemon[774]: ts=2026-09-20T09:33:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:49238 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.28 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.03 seconds) worker2 # [ 80.307117] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 80.390068] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 80.446410] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 80.677827] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 80.680664] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 80.689473] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 80.691300] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 80.734990] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.737396] nix-grpc-daemon[774]: ts=2026-09-20T09:34:00Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 80.920652] envoy[913]: conn peer=[2001:db8:1::1]:34164 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3723 tx=1919 ms=3217 lb # [ 80.925839] envoy[913]: conn peer=[2001:db8:1::1]:54468 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=62 lb # [ 80.931273] envoy[913]: conn peer=[2001:db8:1::1]:54482 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1803 ms=2116 lb # [ 80.936456] envoy[913]: conn peer=[2001:db8:1::1]:54494 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=63 lb # [ 80.941235] envoy[913]: conn peer=[2001:db8:1::4]:56084 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8374 tx=2478 ms=58250 lb # [ 80.946311] envoy[913]: conn peer=[2001:db8:1::1]:54498 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=29 worker1 # [ 81.288324] nix-grpc-daemon[774]: ts=2026-09-20T09:34:00Z level=info event=signal_exit worker1 # [ 81.547665] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_yield worker2 # [ 81.553914] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 81.545833] niks3-server[1032]: 2026/09/20 09:34:02 INFO lead: released remote=192.168.1.3:35130 worker1 # [ 81.555362] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:49236 worker1 # [ 81.560473] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 81.566610] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 81.573746] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:49236 worker1 # [ 81.578635] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 81.756857] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.762404] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.770190] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.774612] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.964170] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.970151] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.970700] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.976485] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.171132] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.176892] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.177320] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.182697] nix-grpc-daemon[774]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.377897] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.383428] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.383767] nix-grpc-daemon[774]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.389744] nix-grpc-daemon[774]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.554244] nix-grpc-daemon[774]: ts=2026-09-20T09:34:02Z level=info event=scheduler_restarting worker2 # [ 82.584745] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.590223] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.615871] nix-daemon[836]: reaped child process 839, status = succeeded worker1 # [ 82.618448] nix-grpc-daemon[774]: ts=2026-09-20T09:34:02Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 82.793117] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.797578] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.993861] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.999439] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.200401] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.205894] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.407233] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.410511] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 83.413120] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.415451] nix-grpc-daemon[774]: E0000 00:00:1789896843.027871 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 83.423224] nix-grpc-daemon[774]: E0000 00:00:1789896843.041732 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 83.614277] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.619952] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.705154] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 83.714105] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 83.718687] systemd[1]: nix-grpc-daemon.service: Consumed 2.033s CPU time over 1min 2.764s wall clock time, 54.7M memory peak, 58.3K incoming IP traffic, 103.4K outgoing IP traffic. worker1 # [ 83.737822] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 83.741828] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 83.745561] systemd[1]: nix-grpc-daemon.socket: Consumed 560us CPU time over 1min 12.354s wall clock time, 256K memory peak, 78.2K incoming IP traffic, 67.5K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 83.823064] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.827537] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.10 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 84.023939] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.029471] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.107329] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 84.123083] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 84.152993] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5) worker2 # [ 84.230396] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.235586] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.243590] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 120 ms (attempt 2/5) worker2 # [ 84.371383] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 3/5) worker2 # [ 84.434971] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 4/5) worker2 # [ 84.443698] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.449166] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.480933] nix-grpc-daemon[1195]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 84.507793] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 84.530765] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 84.561903] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=niks3_push_started pid=1251 worker2 # [ 84.649869] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.655066] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.854921] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.857534] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.962978] nix-daemon[836]: accepted connection from pid 1264, user nix-grpc-daemon (trusted) worker2 # [ 84.983515] nix-daemon[836]: reaped child process 1267, status = succeeded lb # [ 84.990145] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 84.998179] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 85.018538] nix-grpc-daemon[1251]: time=2026-09-20T09:34:04.639Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 85.020992] nix-grpc-daemon[1251]: time=2026-09-20T09:34:04.639Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 85.022881] nix-grpc-daemon[1251]: time=2026-09-20T09:34:04.639Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" worker2 # [ 85.058090] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_connected addr=lb:50051 lb # [ 85.045787] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst worker2 # [ 85.063962] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 85.069694] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 85.081715] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 85.090282] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 85.097102] niks3-server[1032]: 2026/09/20 09:34:05 INFO Signed narinfos id=25 count=1 worker2 # [ 85.108167] nix-grpc-daemon[1251]: time=2026-09-20T09:34:04.729Z level=INFO msg="Uploading 3 narinfos" lb # [ 85.103071] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 85.111778] niks3-server[1032]: 2026/09/20 09:34:05 INFO Signed narinfos id=26 count=2 lb # [ 85.116443] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 85.134980] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 85.142927] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 85.146692] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 85.151837] niks3-server[1032]: 2026/09/20 09:34:05 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 85.165300] niks3-server[1032]: 2026/09/20 09:34:05 INFO Completed upload id=25 lb # [ 85.168212] niks3-server[1032]: 2026/09/20 09:34:05 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 85.171323] niks3-server[1032]: 2026/09/20 09:34:05 INFO Completed upload id=26 worker2 # [ 85.181116] nix-grpc-daemon[1251]: time=2026-09-20T09:34:04.804Z level=INFO msg="Upload complete. (392ms)" worker2 # [ 85.192349] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 85.210128] nix-daemon[836]: reaped child process 1249, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.38 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2 # [ 85.265482] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.274093] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.05 seconds) worker1 # [ 85.372956] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 85.379592] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 85.472492] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.477816] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.577506] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 85.580956] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 85.590777] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 85.595180] niks3-server[1032]: 2026/09/20 09:34:06 INFO lead: acquired remote=192.168.1.3:33320 worker1 # [ 85.607632] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 85.617934] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=scheduler_take_over lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 85.640483] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.642325] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.678534] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.684066] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.11 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.60 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 85.843510] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.853322] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 85.886167] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.884935] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 85.999522] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 86.595843] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=signal_exit worker1 # [ 86.801084] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_yield worker2 # [ 86.807168] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:06Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 86.807462] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39720 lb # [ 86.805480] niks3-server[1032]: 2026/09/20 09:34:07 INFO lead: released remote=192.168.1.3:33320 worker1 # [ 86.813884] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 86.818780] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 86.822998] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39720 worker1 # [ 86.827562] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 87.008657] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.015056] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.013873] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.019365] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.215483] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.214771] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.221234] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.220201] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.422066] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.420951] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.427587] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.426254] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.628687] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.628914] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.634209] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.634581] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.806425] nix-grpc-daemon[1079]: ts=2026-09-20T09:34:07Z level=info event=scheduler_restarting worker2 # [ 87.834887] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.840631] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.042688] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.048121] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.248988] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.254384] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.455176] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.460820] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.661805] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.667487] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.707251] nix-grpc-daemon[1079]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 88.712227] nix-grpc-daemon[1079]: E0000 00:00:1789896848.325084 1122 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 88.719381] nix-grpc-daemon[1079]: E0000 00:00:1789896848.338110 1122 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 88.868704] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.874142] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.077047] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.081336] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.277697] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.283243] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.484079] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.489399] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.629597] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 89.635736] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 89.640585] systemd[1]: nix-grpc-daemon.service: Consumed 196ms CPU time over 4.246s wall clock time, 12.8M memory peak, 7.5K incoming IP traffic, 7.5K outgoing IP traffic. worker1 # [ 89.655313] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 89.658570] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 89.661944] systemd[1]: nix-grpc-daemon.socket: Consumed 933us CPU time over 4.292s wall clock time, 256K memory peak, 13.1K incoming IP traffic, 10.4K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 89.690375] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.703859] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.898830] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.904373] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.107068] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.111297] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.307648] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.313018] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.513466] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.516272] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 90.694729] niks3-server[1032]: 2026/09/20 09:34:11 INFO lead: acquired remote=192.168.1.4:45664 worker2 # [ 90.704886] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_take_over worker2 # [ 90.717240] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.722422] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.18 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds) worker2 # [ 90.923219] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=scheduler_connected addr=lb:50051 lb # [ 90.925269] envoy[913]: conn peer=[2001:db8:1::3]:42682 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8314 tx=2265 ms=61284 lb # [ 90.933447] envoy[913]: conn peer=[2001:db8:1::1]:56690 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=304 ms=1101 worker2 # [ 90.950158] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:10Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 90.941023] envoy[913]: conn peer=[2001:db8:1::3]:58582 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1163 tx=400 ms=2210 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker2 # [ 92.237197] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:41082 client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 92.249160] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 92.276797] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker2 # [ 92.283841] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 92.321616] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 92.337962] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41082 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker2 # [ 92.354868] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 92.371363] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 92.584419] nix-daemon[836]: accepted connection from pid 1298, user nix-grpc-daemon (trusted) worker2 # [ 92.603873] nix-daemon[836]: reaped child process 1301, status = succeeded worker2 # [ 92.782126] nix-daemon[836]: accepted connection from pid 1303, user nix-grpc-daemon (trusted) worker2 # [ 92.801023] nix-daemon[836]: reaped child process 1306, status = succeeded lb # [ 92.804871] niks3-server[1032]: 2026/09/20 09:34:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 92.824826] nix-grpc-daemon[1251]: time=2026-09-20T09:34:12.447Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 92.826468] nix-grpc-daemon[1251]: time=2026-09-20T09:34:12.447Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 92.840892] niks3-server[1032]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst worker2 # [ 92.863722] nix-grpc-daemon[1251]: time=2026-09-20T09:34:12.486Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.856428] niks3-server[1032]: 2026/09/20 09:34:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 92.865572] niks3-server[1032]: 2026/09/20 09:34:13 INFO Signed narinfos id=27 count=1 worker2 # [ 92.882652] nix-grpc-daemon[1251]: time=2026-09-20T09:34:12.506Z level=INFO msg="Upload complete. (493ms)" lb # [ 92.873626] niks3-server[1032]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 92.879008] niks3-server[1032]: 2026/09/20 09:34:13 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 92.883925] niks3-server[1032]: 2026/09/20 09:34:13 INFO Completed upload id=27 worker2 # [ 92.892223] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 paths=1 nar_bytes_in=520 lb # [ 92.885875] niks3-server[1032]: 2026/09/20 09:34:13 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker2 # [ 92.903038] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 92.910941] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 92.913130] nix-daemon[836]: reaped child process 1296, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... worker2 # [ 92.924902] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv client # farm-a> LOG-farm-a-on-standby worker2 # [ 94.371819] nix-daemon[836]: reaped child process 1310, status = succeeded worker2 # [ 94.555357] nix-daemon[836]: accepted connection from pid 1325, user nix-grpc-daemon (trusted) worker2 # [ 94.571961] nix-daemon[836]: reaped child process 1328, status = succeeded lb # [ 94.578588] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 94.599315] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.220Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 94.600988] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.220Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 94.611978] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 94.626027] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 94.638223] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 94.645082] niks3-server[1032]: 2026/09/20 09:34:15 INFO Signed narinfos id=28 count=1 worker2 # [ 94.654455] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.276Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.650187] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 94.661144] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 94.670281] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo lb # [ 94.674807] niks3-server[1032]: 2026/09/20 09:34:15 INFO Completed upload id=28 worker2 # [ 94.684276] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.307Z level=INFO msg="Upload complete. (348ms)" worker2 # [ 94.707983] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker2 # [ 94.724327] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker2 # [ 94.727736] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 94.731839] nix-daemon[836]: reaped child process 1308, status = succeeded worker2 # [ 94.753582] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 94.770850] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 94.785440] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.408Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 94.796118] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker2 # [ 94.814425] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 95.020086] nix-daemon[836]: accepted connection from pid 1334, user nix-grpc-daemon (trusted) worker2 # [ 95.039778] nix-daemon[836]: reaped child process 1337, status = succeeded worker2 # [ 95.211709] nix-daemon[836]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker2 # [ 95.231120] nix-daemon[836]: reaped child process 1342, status = succeeded lb # [ 95.232825] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.252079] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.875Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 95.253589] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.875Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 95.263337] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst worker2 # [ 95.286262] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.909Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.280363] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 95.291373] niks3-server[1032]: 2026/09/20 09:34:15 INFO Signed narinfos id=29 count=1 lb # [ 95.296316] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls worker2 # [ 95.315781] nix-grpc-daemon[1251]: time=2026-09-20T09:34:14.939Z level=INFO msg="Upload complete. (484ms)" lb # [ 95.306968] niks3-server[1032]: 2026/09/20 09:34:15 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 95.312964] niks3-server[1032]: 2026/09/20 09:34:15 INFO Completed upload id=29 worker2 # [ 95.322787] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 95.317439] niks3-server[1032]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker2 # [ 95.332621] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 95.342663] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 95.347493] nix-daemon[836]: reaped child process 1332, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... worker2 # [ 95.358527] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker2 # [ 95.984262] nix-daemon[836]: reaped child process 1346, status = succeeded client # farm-b> LOG-farm-b-on-standby worker2 # [ 96.142082] nix-daemon[836]: accepted connection from pid 1361, user nix-grpc-daemon (trusted) worker2 # [ 96.160538] nix-daemon[836]: reaped child process 1364, status = succeeded lb # [ 96.165879] niks3-server[1032]: 2026/09/20 09:34:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 96.185887] nix-grpc-daemon[1251]: time=2026-09-20T09:34:15.808Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 96.187388] nix-grpc-daemon[1251]: time=2026-09-20T09:34:15.808Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 96.197083] niks3-server[1032]: 2026/09/20 09:34:16 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 96.213640] niks3-server[1032]: 2026/09/20 09:34:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker2 # [ 96.227947] nix-grpc-daemon[1251]: time=2026-09-20T09:34:15.851Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.225421] niks3-server[1032]: 2026/09/20 09:34:16 INFO Signed narinfos id=30 count=1 lb # [ 96.227809] niks3-server[1032]: 2026/09/20 09:34:16 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 96.236515] niks3-server[1032]: 2026/09/20 09:34:16 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 96.244299] niks3-server[1032]: 2026/09/20 09:34:16 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 96.247504] niks3-server[1032]: 2026/09/20 09:34:16 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo lb # [ 96.251291] niks3-server[1032]: 2026/09/20 09:34:16 INFO Completed upload id=30 worker2 # [ 96.260794] nix-grpc-daemon[1251]: time=2026-09-20T09:34:15.884Z level=INFO msg="Upload complete. (290ms)" worker2 # [ 96.274752] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker2 # [ 96.289414] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker2 # [ 96.292842] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 96.296409] nix-daemon[836]: reaped child process 1344, status = succeeded worker2 # [ 96.317118] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 96.329345] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 96.340947] nix-grpc-daemon[1251]: time=2026-09-20T09:34:15.964Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker2 # [ 96.351031] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 96.365426] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 96.558205] nix-daemon[836]: accepted connection from pid 1370, user nix-grpc-daemon (trusted) worker2 # [ 96.577623] nix-daemon[836]: reaped child process 1373, status = succeeded worker2 # [ 96.750262] nix-daemon[836]: accepted connection from pid 1375, user nix-grpc-daemon (trusted) worker2 # [ 96.769187] nix-daemon[836]: reaped child process 1378, status = succeeded lb # [ 96.773141] niks3-server[1032]: 2026/09/20 09:34:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 96.791576] nix-grpc-daemon[1251]: time=2026-09-20T09:34:16.414Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 96.793216] nix-grpc-daemon[1251]: time=2026-09-20T09:34:16.414Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 96.800667] niks3-server[1032]: 2026/09/20 09:34:17 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker2 # [ 96.826348] nix-grpc-daemon[1251]: time=2026-09-20T09:34:16.449Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.811367] niks3-server[1032]: 2026/09/20 09:34:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 96.821867] niks3-server[1032]: 2026/09/20 09:34:17 INFO Signed narinfos id=31 count=1 lb # [ 96.828871] niks3-server[1032]: 2026/09/20 09:34:17 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 96.838582] niks3-server[1032]: 2026/09/20 09:34:17 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete worker2 # [ 96.853042] nix-grpc-daemon[1251]: time=2026-09-20T09:34:16.476Z level=INFO msg="Upload complete. (472ms)" lb # [ 96.843736] niks3-server[1032]: 2026/09/20 09:34:17 INFO Completed upload id=31 lb # [ 96.846724] niks3-server[1032]: 2026/09/20 09:34:17 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker2 # [ 96.859511] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 96.871225] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 96.877092] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 96.881789] nix-daemon[836]: reaped child process 1368, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 96.893914] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 97.914396] nix-daemon[836]: reaped child process 1382, status = succeeded client # farm-top> LOG-farm-top-on-standby worker2 # [ 98.077114] nix-daemon[836]: accepted connection from pid 1397, user nix-grpc-daemon (trusted) worker2 # [ 98.096655] nix-daemon[836]: reaped child process 1400, status = succeeded lb # [ 98.099353] niks3-server[1032]: 2026/09/20 09:34:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.123175] nix-grpc-daemon[1251]: time=2026-09-20T09:34:17.744Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 98.124791] nix-grpc-daemon[1251]: time=2026-09-20T09:34:17.745Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 98.147182] niks3-server[1032]: 2026/09/20 09:34:18 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst worker2 # [ 98.168996] nix-grpc-daemon[1251]: time=2026-09-20T09:34:17.792Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.160845] niks3-server[1032]: 2026/09/20 09:34:18 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 98.169091] niks3-server[1032]: 2026/09/20 09:34:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 98.174530] niks3-server[1032]: 2026/09/20 09:34:18 INFO Signed narinfos id=32 count=1 lb # [ 98.179949] niks3-server[1032]: 2026/09/20 09:34:18 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls worker2 # [ 98.193582] nix-grpc-daemon[1251]: time=2026-09-20T09:34:17.816Z level=INFO msg="Upload complete. (290ms)" lb # [ 98.184644] niks3-server[1032]: 2026/09/20 09:34:18 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 98.188087] niks3-server[1032]: 2026/09/20 09:34:18 INFO Completed upload id=32 lb # [ 98.190908] niks3-server[1032]: 2026/09/20 09:34:18 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker2 # [ 98.205017] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker2 # [ 98.219249] nix-daemon[836]: reaped child process 1380, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.27 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds) worker1 # [ 98.582443] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 98.591739] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 98.790243] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 98.792627] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:18Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 98.800079] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 98.824128] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 98.854050] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 98.859138] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.50 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 99.327524] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds) worker2 # [ 99.545644] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:41082 client # Running as unit: rs.service; invocation ID: 9e1595d889e747209dd5741bdd3fb453 client # [ 99.577038] nix[1174]: don't know how to build these paths: client # [ 99.578867] nix[1174]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 99.566480] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker2 # [ 99.573341] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 99.615446] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 99.631521] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41082 client # [ 99.667155] nix[1174]: copying 1 paths to 'lb:50051'... client # [ 99.672433] nix[1174]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker2 # [ 99.649155] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 99.663974] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 99.872582] nix-daemon[836]: accepted connection from pid 1415, user nix-grpc-daemon (trusted) worker2 # [ 99.891191] nix-daemon[836]: reaped child process 1418, status = succeeded worker2 # [ 100.062905] nix-daemon[836]: accepted connection from pid 1420, user nix-grpc-daemon (trusted) worker2 # [ 100.080431] nix-daemon[836]: reaped child process 1423, status = succeeded lb # [ 100.083393] niks3-server[1032]: 2026/09/20 09:34:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 100.102723] nix-grpc-daemon[1251]: time=2026-09-20T09:34:19.725Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 100.104268] nix-grpc-daemon[1251]: time=2026-09-20T09:34:19.725Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 100.114468] niks3-server[1032]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst worker2 # [ 100.137039] nix-grpc-daemon[1251]: time=2026-09-20T09:34:19.760Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.129978] niks3-server[1032]: 2026/09/20 09:34:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 100.140851] niks3-server[1032]: 2026/09/20 09:34:20 INFO Signed narinfos id=33 count=1 lb # [ 100.146370] niks3-server[1032]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 100.154928] niks3-server[1032]: 2026/09/20 09:34:20 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 100.160719] niks3-server[1032]: 2026/09/20 09:34:20 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo lb # [ 100.164826] niks3-server[1032]: 2026/09/20 09:34:20 INFO Completed upload id=33 worker2 # [ 100.174063] nix-grpc-daemon[1251]: time=2026-09-20T09:34:19.797Z level=INFO msg="Upload complete. (493ms)" worker2 # [ 100.182334] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 100.196105] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 worker2 # [ 100.203355] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker2 # [ 100.208718] nix-daemon[836]: reaped child process 1413, status = succeeded client # [ 100.241711] nix[1174]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker2 # [ 100.221721] nix-daemon[836]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) lb # [ 100.923909] envoy[913]: conn peer=[2001:db8:1::1]:51538 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9606 tx=3852 ms=5983 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 102.278831] systemd-journald[273]: Received client request to rotate journal, rotating. worker1 # [ 102.305211] systemd-journald[273]: Vacuuming done, freed 0B of archived journals from /var/log/journal/8ce22dac6e05441b95b2412a25a6cd0e. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 102.362258] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds) ??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 573 client: must succeed: sleep 5.0 worker2 # [ 102.706247] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:22Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 107.862647] nix-daemon[836]: reaped child process 1427, status = succeeded worker2 # [ 108.031938] nix-daemon[836]: accepted connection from pid 1467, user nix-grpc-daemon (trusted) worker2 # [ 108.051631] nix-daemon[836]: reaped child process 1470, status = succeeded lb # [ 108.054635] niks3-server[1032]: 2026/09/20 09:34:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 108.076422] nix-grpc-daemon[1251]: time=2026-09-20T09:34:27.698Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 108.078093] nix-grpc-daemon[1251]: time=2026-09-20T09:34:27.698Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 108.100819] niks3-server[1032]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 108.113392] niks3-server[1032]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 108.132357] nix-grpc-daemon[1251]: time=2026-09-20T09:34:27.755Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.125441] niks3-server[1032]: 2026/09/20 09:34:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 108.132928] niks3-server[1032]: 2026/09/20 09:34:28 INFO Signed narinfos id=34 count=1 lb # [ 108.134913] niks3-server[1032]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 108.141927] niks3-server[1032]: 2026/09/20 09:34:28 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 108.148139] niks3-server[1032]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo lb # [ 108.151646] niks3-server[1032]: 2026/09/20 09:34:28 INFO Completed upload id=34 worker2 # [ 108.160984] nix-grpc-daemon[1251]: time=2026-09-20T09:34:27.784Z level=INFO msg="Upload complete. (323ms)" worker2 # [ 108.177183] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41082 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 108.191510] nix-daemon[836]: reaped child process 1425, status = succeeded client # [ 108.237451] systemd[1]: rs.service: Deactivated successfully. client # [ 108.241764] systemd[1]: rs.service: Consumed 162ms CPU time over 8.913s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic. worker2 # [ 108.707287] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=signal_exit worker2 # [ 108.929082] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_yield lb # [ 108.927941] niks3-server[1032]: 2026/09/20 09:34:29 INFO lead: released remote=192.168.1.4:45664 worker2 # [ 108.939473] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 108.939440] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:28Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 108.945932] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42220 worker2 # [ 108.950531] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 108.954643] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42220 worker2 # [ 108.959135] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 109.139452] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.140917] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.145246] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.147183] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.345936] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.349440] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.351415] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.353665] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.550195] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.552390] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.555511] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.557516] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.756088] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.758595] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 109.761302] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 109.763923] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 109.934719] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=scheduler_restarting worker1 # [ 109.965852] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 109.971040] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.23 seconds) client: waiting for success: ! systemctl is-active rs worker2 # [ 109.990003] nix-grpc-daemon[1195]: ts=2026-09-20T09:34:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 109.995420] nix-daemon[836]: reaped child process 1244, status = succeeded client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 110.170148] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.175492] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker1 # [ 110.376467] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.381631] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 110.582724] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.588519] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 110.769559] nix-grpc-daemon[1195]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 110.769883] nix-grpc-daemon[1195]: E0000 00:00:1789896870.391374 1238 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 110.770087] nix-grpc-daemon[1195]: E0000 00:00:1789896870.391739 1238 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 110.789294] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.794633] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 110.922062] envoy[913]: conn peer=[2001:db8:1::1]:51548 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1351 ms=8639 lb # [ 110.922429] envoy[913]: conn peer=[2001:db8:1::4]:42312 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7226 tx=2123 ms=29239 worker1 # [ 110.997587] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.001824] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.063460] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 111.070997] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 111.077879] systemd[1]: nix-grpc-daemon.service: Consumed 1.994s CPU time over 30.614s wall clock time, 36.4M memory peak, 60.9K incoming IP traffic, 121.6K outgoing IP traffic. worker2 # [ 111.090432] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 111.198218] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.203498] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 111.286814] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 111.289380] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 111.296854] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 111.298632] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 111.306791] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=scheduler_take_over lb # [ 111.298468] niks3-server[1032]: 2026/09/20 09:34:31 INFO lead: acquired remote=192.168.1.4:48350 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2 # [ 111.333213] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.335027] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.404470] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.409816] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.536194] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.541432] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.610750] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.616325] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.742141] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.747560] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.817163] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.822499] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.948417] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.953634] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.025454] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.029924] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.154583] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.163160] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 112.226209] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.228963] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:31Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.26 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 112.585102] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 1c5f89cca7624954809060788261632b client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds) worker1 # [ 112.806884] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50610 worker1 # [ 112.822488] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) client # [ 112.866700] nix[1210]: don't know how to build these paths: client # [ 112.871145] nix[1210]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 112.860120] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:32Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 112.860417] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:32Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 112.921640] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60080 worker2 # [ 112.935474] nix-daemon[836]: accepted connection from pid 1477, user nix-grpc-daemon (trusted) worker2 # [ 112.959000] nix-grpc-daemon[1477]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5) worker2 # [ 113.025805] nix-grpc-daemon[1477]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 2/5) worker2 # [ 113.101222] nix-grpc-daemon[1477]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 282 ms (attempt 3/5) worker2 # [ 113.384066] nix-grpc-daemon[1477]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 119 ms (attempt 4/5) worker2 # [ 113.504113] nix-grpc-daemon[1477]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 113.525401] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60080 client # [ 113.564209] nix[1210]: copying 1 paths to 'lb:50051'... worker2 # [ 113.541832] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60080 client # [ 113.568187] nix[1210]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 113.559089] nix-daemon[836]: accepted connection from pid 1477, user nix-grpc-daemon (trusted) worker2 # [ 113.588088] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:33Z level=info event=niks3_push_started pid=1544 worker2 # [ 113.992571] nix-daemon[836]: accepted connection from pid 1557, user nix-grpc-daemon (trusted) worker2 # [ 114.008933] nix-daemon[836]: reaped child process 1564, status = succeeded worker2 # [ 114.187025] nix-daemon[836]: accepted connection from pid 1566, user nix-grpc-daemon (trusted) worker2 # [ 114.203879] nix-daemon[836]: reaped child process 1569, status = succeeded lb # [ 114.206863] niks3-server[1032]: 2026/09/20 09:34:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 114.230493] nix-grpc-daemon[1544]: time=2026-09-20T09:34:33.852Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 114.231970] nix-grpc-daemon[1544]: time=2026-09-20T09:34:33.852Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 114.244272] niks3-server[1032]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst lb # [ 114.258591] niks3-server[1032]: 2026/09/20 09:34:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign worker2 # [ 114.275147] nix-grpc-daemon[1544]: time=2026-09-20T09:34:33.898Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.269878] niks3-server[1032]: 2026/09/20 09:34:34 INFO Signed narinfos id=35 count=1 lb # [ 114.278840] niks3-server[1032]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 114.291109] niks3-server[1032]: 2026/09/20 09:34:34 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 114.304720] niks3-server[1032]: 2026/09/20 09:34:34 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo lb # [ 114.327955] niks3-server[1032]: 2026/09/20 09:34:34 INFO Completed upload id=35 worker2 # [ 114.337612] nix-grpc-daemon[1544]: time=2026-09-20T09:34:33.960Z level=INFO msg="Upload complete. (530ms)" worker2 # [ 114.350028] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60080 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 114.368579] nix-grpc-daemon[1477]: ts=2026-09-20T09:34:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60080 worker2 # [ 114.388405] nix-daemon[836]: accepted connection from pid 1477, user nix-grpc-daemon (trusted) worker2 # [ 114.391477] nix-daemon[836]: reaped child process 1542, status = succeeded client # [ 114.421427] nix[1210]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 114.402371] nix-daemon[836]: accepted connection from pid 1477, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 116.581580] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1477 (nix-grpc-daemon) on client request. worker2 # [ 116.583184] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 116.590124] niks3-server[1032]: 2026/09/20 09:34:37 INFO lead: released remote=192.168.1.4:48350 client # [ 116.635909] nix[1210]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds) client: must succeed: sleep 5.0 worker1 # [ 116.610713] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:36Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 116.643033] nix[1210]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 116.628650] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 116.630287] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 116.631530] systemd[1]: nix-grpc-daemon.service: Consumed 535ms CPU time over 5.538s wall clock time, 33.9M memory peak, 12.4K incoming IP traffic, 16.1K outgoing IP traffic. worker2 # [ 116.647280] nix-daemon[836]: reaped child process 1537, status = succeeded worker2 # [ 116.648624] nix-daemon[836]: reaped child process 1571, status = succeeded worker2 # [ 116.654537] nix-daemon[1573]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 116.662534] nix-daemon[836]: reaped child process 1573, status = failed with exit code 1 worker1 # [ 116.810627] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.816408] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker2 # [ 116.830064] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 117.042303] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 117.044633] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 117.052308] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 117.054056] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 117.066086] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=scheduler_take_over lb # [ 117.057058] niks3-server[1032]: 2026/09/20 09:34:37 INFO lead: acquired remote=192.168.1.4:48418 worker2 # [ 117.082444] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 117.099055] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.100956] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 117.126513] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 117.129352] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:36Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 117.172200] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50610 worker1 # [ 117.195088] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5) worker1 # [ 117.288189] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 2/5) worker1 # [ 117.391542] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 335 ms (attempt 3/5) worker1 # [ 117.735569] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 323 ms (attempt 4/5) worker1 # [ 118.058349] nix-grpc-daemon[1143]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 118.081968] nix-grpc-daemon[1143]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'... worker1 # [ 118.120754] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) worker1 # [ 118.139125] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) client # [ 118.163966] nix[1210]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... lb # [ 120.921538] envoy[913]: conn peer=[2001:db8:1::4]:54964 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=990 tx=434 ms=5283 client: (finished: must succeed: sleep 5.0, in 5.07 seconds) worker1 # [ 121.962496] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:41Z level=info event=niks3_push_started pid=1296 worker1 # [ 121.981880] nix-daemon[836]: reaped child process 1272, status = succeeded client: waiting for success: ! systemctl is-active mid worker1 # [ 122.336571] nix-daemon[836]: accepted connection from pid 1309, user nix-grpc-daemon (trusted) worker1 # [ 122.356224] nix-daemon[836]: reaped child process 1312, status = succeeded lb # [ 122.362063] niks3-server[1032]: 2026/09/20 09:34:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 122.380452] nix-grpc-daemon[1296]: time=2026-09-20T09:34:41.998Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 122.381932] nix-grpc-daemon[1296]: time=2026-09-20T09:34:41.998Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 122.399961] niks3-server[1032]: 2026/09/20 09:34:42 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 122.419151] niks3-server[1032]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 122.431710] niks3-server[1032]: 2026/09/20 09:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign worker1 # [ 122.446926] nix-grpc-daemon[1296]: time=2026-09-20T09:34:42.064Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.442031] niks3-server[1032]: 2026/09/20 09:34:43 INFO Signed narinfos id=36 count=1 lb # [ 122.451098] niks3-server[1032]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 122.461336] niks3-server[1032]: 2026/09/20 09:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 122.472313] niks3-server[1032]: 2026/09/20 09:34:43 INFO Completed upload id=36 worker1 # [ 122.478219] nix-grpc-daemon[1296]: time=2026-09-20T09:34:42.097Z level=INFO msg="Upload complete. (311ms)" worker1 # [ 122.488535] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50610 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 lb # [ 122.493440] niks3-server[1032]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo worker1 # [ 122.506464] nix-daemon[836]: reaped child process 1270, status = succeeded client # [ 122.557268] systemd[1]: mid.service: Deactivated successfully. client # [ 122.561573] systemd[1]: mid.service: Consumed 164ms CPU time over 9.975s wall clock time, 37.2M memory peak, 9.8K incoming IP traffic, 10.6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.70 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 123.259717] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: ada56286b4424e68b78ee719a57a9bb4 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) worker1 # [ 123.455845] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50610 client # [ 123.488239] nix[1246]: don't know how to build these paths: client # [ 123.489353] nix[1246]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 123.482890] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:43Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker2 # [ 123.483220] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:43Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 123.530443] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 123.545304] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 123.568129] nix-grpc-daemon[1609]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5) worker2 # [ 123.649149] nix-grpc-daemon[1609]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 2/5) worker2 # [ 123.739781] nix-grpc-daemon[1609]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 291 ms (attempt 3/5) worker2 # [ 124.038774] nix-grpc-daemon[1609]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 782 ms (attempt 4/5) worker2 # [ 124.822987] nix-grpc-daemon[1609]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 124.845122] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40696 client # [ 124.885228] nix[1246]: copying 1 paths to 'lb:50051'... worker2 # [ 124.861641] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 client # [ 124.885504] nix[1246]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker2 # [ 124.880695] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 124.909038] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:44Z level=info event=niks3_push_started pid=1685 worker2 # [ 125.293233] nix-daemon[836]: accepted connection from pid 1698, user nix-grpc-daemon (trusted) worker2 # [ 125.310730] nix-daemon[836]: reaped child process 1701, status = succeeded worker2 # [ 125.484570] nix-daemon[836]: accepted connection from pid 1703, user nix-grpc-daemon (trusted) worker2 # [ 125.502782] nix-daemon[836]: reaped child process 1706, status = succeeded lb # [ 125.505712] niks3-server[1032]: 2026/09/20 09:34:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 125.530054] nix-grpc-daemon[1685]: time=2026-09-20T09:34:45.151Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 125.531927] nix-grpc-daemon[1685]: time=2026-09-20T09:34:45.151Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 125.548879] niks3-server[1032]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 125.562928] niks3-server[1032]: 2026/09/20 09:34:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign worker2 # [ 125.579708] nix-grpc-daemon[1685]: time=2026-09-20T09:34:45.202Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.573690] niks3-server[1032]: 2026/09/20 09:34:46 INFO Signed narinfos id=37 count=1 lb # [ 125.581909] niks3-server[1032]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 125.594101] niks3-server[1032]: 2026/09/20 09:34:46 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 125.601007] niks3-server[1032]: 2026/09/20 09:34:46 INFO Completed upload id=37 worker2 # [ 125.609145] nix-grpc-daemon[1685]: time=2026-09-20T09:34:45.232Z level=INFO msg="Upload complete. (484ms)" lb # [ 125.603023] niks3-server[1032]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker2 # [ 125.620701] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 125.632209] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 125.639431] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 125.644803] nix-daemon[836]: reaped child process 1683, status = succeeded client # [ 125.678210] nix[1246]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker2 # [ 125.658654] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 126.957659] systemd[1]: intr.service: Sent signal SIGINT to main process 1246 (nix) on client request. client # [ 126.966363] nix[1246]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 126.973828] nix[1246]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) client # [ 127.006654] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 127.011072] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 127.013356] systemd[1]: intr.service: Consumed 140ms CPU time over 3.749s wall clock time, 39.2M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic. worker2 # [ 127.104589] nix-daemon[1710]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 127.108424] nix-daemon[836]: reaped child process 1708, status = succeeded worker2 # [ 127.115815] nix-daemon[836]: reaped child process 1710, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.93 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 127.210515] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 2a3f8155914f4338838b3743a68348ec client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds) worker1 # [ 127.422171] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50610 client # [ 127.455477] nix[1266]: don't know how to build these paths: client # [ 127.456753] nix[1266]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 127.442386] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:47Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 127.448513] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:47Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 127.488233] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50610 worker1 # [ 127.504119] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50610 client # [ 127.543793] nix[1266]: copying 1 paths to 'lb:50051'... worker1 # [ 127.520066] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50610 client # [ 127.546408] nix[1266]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 127.533959] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) worker1 # [ 127.744699] nix-daemon[836]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker1 # [ 127.764785] nix-daemon[836]: reaped child process 1343, status = succeeded worker1 # [ 127.936635] nix-daemon[836]: accepted connection from pid 1345, user nix-grpc-daemon (trusted) worker1 # [ 127.955893] nix-daemon[836]: reaped child process 1348, status = succeeded lb # [ 127.962223] niks3-server[1032]: 2026/09/20 09:34:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 127.978943] nix-grpc-daemon[1296]: time=2026-09-20T09:34:47.597Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 127.980550] nix-grpc-daemon[1296]: time=2026-09-20T09:34:47.597Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 127.989405] niks3-server[1032]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker1 # [ 128.011358] nix-grpc-daemon[1296]: time=2026-09-20T09:34:47.630Z level=INFO msg="Uploading 1 narinfos" lb # [ 128.006559] niks3-server[1032]: 2026/09/20 09:34:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 128.017684] niks3-server[1032]: 2026/09/20 09:34:48 INFO Signed narinfos id=38 count=1 worker1 # [ 128.036830] nix-grpc-daemon[1296]: time=2026-09-20T09:34:47.656Z level=INFO msg="Upload complete. (485ms)" lb # [ 128.023560] niks3-server[1032]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls worker1 # [ 128.042574] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50610 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 128.035595] niks3-server[1032]: 2026/09/20 09:34:48 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 128.041191] niks3-server[1032]: 2026/09/20 09:34:48 INFO Completed upload id=38 lb # [ 128.043865] niks3-server[1032]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker1 # [ 128.058145] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50610 worker1 # [ 128.063645] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) worker1 # [ 128.068284] nix-daemon[836]: reaped child process 1338, status = succeeded client # [ 128.102855] nix[1266]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker1 # [ 128.081297] nix-daemon[836]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 129.905322] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 129.955924] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 worker1 # [ 130.274869] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50610 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 130.284692] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 130.311241] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:49Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 130.318334] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:49Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 130.362812] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 130.378005] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40696 client # copying 1 paths to 'lb:50051'... worker2 # [ 130.394194] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker2 # [ 130.418714] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 130.623274] nix-daemon[836]: accepted connection from pid 1760, user nix-grpc-daemon (trusted) worker2 # [ 130.643825] nix-daemon[836]: reaped child process 1763, status = succeeded worker2 # [ 130.818921] nix-daemon[836]: accepted connection from pid 1765, user nix-grpc-daemon (trusted) worker1 # [ 130.825378] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:50Z level=info event=draining worker2 # [ 130.836376] nix-daemon[836]: reaped child process 1768, status = succeeded lb # [ 130.842375] niks3-server[1032]: 2026/09/20 09:34:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 130.861019] nix-grpc-daemon[1685]: time=2026-09-20T09:34:50.483Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 130.862508] nix-grpc-daemon[1685]: time=2026-09-20T09:34:50.483Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 130.870105] niks3-server[1032]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker2 # [ 130.893602] nix-grpc-daemon[1685]: time=2026-09-20T09:34:50.516Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.886867] niks3-server[1032]: 2026/09/20 09:34:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 130.897458] niks3-server[1032]: 2026/09/20 09:34:51 INFO Signed narinfos id=39 count=1 lb # [ 130.902654] niks3-server[1032]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 130.912869] niks3-server[1032]: 2026/09/20 09:34:51 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 130.917789] niks3-server[1032]: 2026/09/20 09:34:51 INFO Completed upload id=39 worker2 # [ 130.927237] nix-grpc-daemon[1685]: time=2026-09-20T09:34:50.550Z level=INFO msg="Upload complete. (491ms)" lb # [ 130.921049] niks3-server[1032]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo lb # [ 130.926241] envoy[913]: conn peer=[2001:db8:1::1]:58690 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3841 tx=1661 ms=9710 lb # [ 130.931084] envoy[913]: conn peer=[2001:db8:1::1]:54886 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=756 ms=3506 worker2 # [ 130.936272] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 130.946944] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 130.953306] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 130.958184] nix-daemon[836]: reaped child process 1758, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker2 # [ 130.971503] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-during-drain worker2 # [ 132.217304] nix-daemon[836]: reaped child process 1772, status = succeeded worker2 # [ 132.394361] nix-daemon[836]: accepted connection from pid 1787, user nix-grpc-daemon (trusted) worker2 # [ 132.411647] nix-daemon[836]: reaped child process 1790, status = succeeded lb # [ 132.415721] niks3-server[1032]: 2026/09/20 09:34:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 132.436506] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.057Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 132.438443] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.057Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 132.462261] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 132.473513] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 132.485217] niks3-server[1032]: 2026/09/20 09:34:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 132.492763] niks3-server[1032]: 2026/09/20 09:34:53 INFO Signed narinfos id=40 count=1 worker2 # [ 132.502980] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.124Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.497860] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 132.508307] niks3-server[1032]: 2026/09/20 09:34:53 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 132.519161] niks3-server[1032]: 2026/09/20 09:34:53 INFO Completed upload id=40 worker2 # [ 132.528647] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.151Z level=INFO msg="Upload complete. (346ms)" lb # [ 132.522727] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker2 # [ 132.546611] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker2 # [ 132.563713] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker2 # [ 132.567751] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 132.571861] nix-daemon[836]: reaped child process 1770, status = succeeded worker2 # [ 132.597198] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 132.608194] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 132.622521] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.245Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 132.633607] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker2 # [ 132.656760] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 132.863844] nix-daemon[836]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker2 # [ 132.883234] nix-daemon[836]: reaped child process 1799, status = succeeded worker2 # [ 133.054894] nix-daemon[836]: accepted connection from pid 1801, user nix-grpc-daemon (trusted) worker2 # [ 133.072404] nix-daemon[836]: reaped child process 1804, status = succeeded lb # [ 133.074185] niks3-server[1032]: 2026/09/20 09:34:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 133.094251] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.717Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 133.095839] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.717Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 133.107460] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst worker2 # [ 133.126024] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.749Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.120211] niks3-server[1032]: 2026/09/20 09:34:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 133.130071] niks3-server[1032]: 2026/09/20 09:34:53 INFO Signed narinfos id=41 count=1 lb # [ 133.137445] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls worker2 # [ 133.151100] nix-grpc-daemon[1685]: time=2026-09-20T09:34:52.774Z level=INFO msg="Upload complete. (476ms)" lb # [ 133.142255] niks3-server[1032]: 2026/09/20 09:34:53 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 133.146833] niks3-server[1032]: 2026/09/20 09:34:53 INFO Completed upload id=41 lb # [ 133.150128] niks3-server[1032]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker2 # [ 133.159956] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 133.164410] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 133.173646] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 133.178126] nix-daemon[836]: reaped child process 1794, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... worker2 # [ 133.189697] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv client # farm-b> LOG-farm-b-during-drain worker2 # [ 134.032556] nix-daemon[836]: reaped child process 1808, status = succeeded worker2 # [ 134.211362] nix-daemon[836]: accepted connection from pid 1823, user nix-grpc-daemon (trusted) worker2 # [ 134.228633] nix-daemon[836]: reaped child process 1826, status = succeeded lb # [ 134.234699] niks3-server[1032]: 2026/09/20 09:34:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 134.255899] nix-grpc-daemon[1685]: time=2026-09-20T09:34:53.878Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 134.258336] nix-grpc-daemon[1685]: time=2026-09-20T09:34:53.878Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 134.293480] niks3-server[1032]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker2 # [ 134.310514] nix-grpc-daemon[1685]: time=2026-09-20T09:34:53.933Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.302585] niks3-server[1032]: 2026/09/20 09:34:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 134.311794] niks3-server[1032]: 2026/09/20 09:34:54 INFO Signed narinfos id=42 count=1 lb # [ 134.317743] niks3-server[1032]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 134.327540] niks3-server[1032]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 134.332328] niks3-server[1032]: 2026/09/20 09:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 134.336588] niks3-server[1032]: 2026/09/20 09:34:54 INFO Completed upload id=42 worker2 # [ 134.341219] nix-grpc-daemon[1685]: time=2026-09-20T09:34:53.964Z level=INFO msg="Upload complete. (340ms)" lb # [ 134.339819] niks3-server[1032]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 134.357461] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker2 # [ 134.376356] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:53Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker2 # [ 134.382222] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:53Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 134.387171] nix-daemon[836]: reaped child process 1806, status = succeeded worker2 # [ 134.417841] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 134.433092] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 134.447241] nix-grpc-daemon[1685]: time=2026-09-20T09:34:54.070Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 134.457535] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker2 # [ 134.480477] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 134.682538] nix-daemon[836]: accepted connection from pid 1832, user nix-grpc-daemon (trusted) worker2 # [ 134.700252] nix-daemon[836]: reaped child process 1835, status = succeeded worker2 # [ 134.874996] nix-daemon[836]: accepted connection from pid 1837, user nix-grpc-daemon (trusted) worker2 # [ 134.892599] nix-daemon[836]: reaped child process 1840, status = succeeded lb # [ 134.894579] niks3-server[1032]: 2026/09/20 09:34:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 134.912766] nix-grpc-daemon[1685]: time=2026-09-20T09:34:54.535Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 134.914316] nix-grpc-daemon[1685]: time=2026-09-20T09:34:54.535Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 134.919790] niks3-server[1032]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst lb # [ 134.935225] niks3-server[1032]: 2026/09/20 09:34:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker2 # [ 134.951147] nix-grpc-daemon[1685]: time=2026-09-20T09:34:54.574Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.947955] niks3-server[1032]: 2026/09/20 09:34:55 INFO Signed narinfos id=43 count=1 lb # [ 134.953812] niks3-server[1032]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls worker2 # [ 134.970741] nix-grpc-daemon[1685]: time=2026-09-20T09:34:54.594Z level=INFO msg="Upload complete. (472ms)" lb # [ 134.963006] niks3-server[1032]: 2026/09/20 09:34:55 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 134.968477] niks3-server[1032]: 2026/09/20 09:34:55 INFO Completed upload id=43 lb # [ 134.971711] niks3-server[1032]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker2 # [ 134.977860] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 134.990911] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 134.996615] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 135.001682] nix-daemon[836]: reaped child process 1830, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 135.014598] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 136.234470] nix-daemon[836]: reaped child process 1844, status = succeeded client # farm-top> LOG-farm-top-during-drain worker2 # [ 136.391410] nix-daemon[836]: accepted connection from pid 1859, user nix-grpc-daemon (trusted) worker2 # [ 136.411194] nix-daemon[836]: reaped child process 1862, status = succeeded lb # [ 136.414802] niks3-server[1032]: 2026/09/20 09:34:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 136.435089] nix-grpc-daemon[1685]: time=2026-09-20T09:34:56.056Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 136.436725] nix-grpc-daemon[1685]: time=2026-09-20T09:34:56.056Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 136.445238] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 136.461239] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst worker2 # [ 136.489102] nix-grpc-daemon[1685]: time=2026-09-20T09:34:56.112Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.472980] niks3-server[1032]: 2026/09/20 09:34:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 136.482929] niks3-server[1032]: 2026/09/20 09:34:57 INFO Signed narinfos id=44 count=1 lb # [ 136.490291] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 136.499070] niks3-server[1032]: 2026/09/20 09:34:57 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete worker2 # [ 136.513904] nix-grpc-daemon[1685]: time=2026-09-20T09:34:56.137Z level=INFO msg="Upload complete. (290ms)" lb # [ 136.506680] niks3-server[1032]: 2026/09/20 09:34:57 INFO Completed upload id=44 lb # [ 136.510851] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker2 # [ 136.525934] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker2 # [ 136.541248] nix-daemon[836]: reaped child process 1842, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.56 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 136.910642] nix-daemon[836]: reaped child process 1352, status = succeeded worker1 # [ 137.072122] nix-daemon[836]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker1 # [ 137.090440] nix-daemon[836]: reaped child process 1396, status = succeeded lb # [ 137.094072] niks3-server[1032]: 2026/09/20 09:34:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 137.112408] nix-grpc-daemon[1296]: time=2026-09-20T09:34:56.731Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 137.114013] nix-grpc-daemon[1296]: time=2026-09-20T09:34:56.731Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 137.131632] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 137.147150] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 137.155491] niks3-server[1032]: 2026/09/20 09:34:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 137.161461] niks3-server[1032]: 2026/09/20 09:34:57 INFO Signed narinfos id=45 count=1 worker1 # [ 137.170023] nix-grpc-daemon[1296]: time=2026-09-20T09:34:56.788Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.166303] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 137.176113] niks3-server[1032]: 2026/09/20 09:34:57 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete worker1 # [ 137.191516] nix-grpc-daemon[1296]: time=2026-09-20T09:34:56.810Z level=INFO msg="Upload complete. (294ms)" lb # [ 137.185184] niks3-server[1032]: 2026/09/20 09:34:57 INFO Completed upload id=45 lb # [ 137.189515] niks3-server[1032]: 2026/09/20 09:34:57 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker1 # [ 137.204983] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50610 duration_s=9 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 137.217106] nix-daemon[836]: reaped child process 1350, status = succeeded client # [ 137.271970] systemd[1]: sw.service: Deactivated successfully. client # [ 137.277321] systemd[1]: sw.service: Consumed 153ms CPU time over 10.065s wall clock time, 37M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic. worker1 # [ 137.827702] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:57Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 139.074312] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60088 worker2 # [ 139.074660] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:58Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 139.080931] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:58Z level=info event=scheduler_restarting worker1 # [ 139.097679] nix-grpc-daemon[1143]: ts=2026-09-20T09:34:58Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 139.124702] nix-daemon[836]: reaped child process 1248, status = succeeded worker1 # [ 139.311938] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 139.315063] systemd[1]: nix-grpc-daemon.service: Consumed 907ms CPU time over 40.718s wall clock time, 33.4M memory peak, 24.2K incoming IP traffic, 35.1K outgoing IP traffic. worker1 # [ 139.336477] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 139.535965] nix-grpc-daemon[1410]: ts=2026-09-20T09:34:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 139.538413] nix-grpc-daemon[1410]: ts=2026-09-20T09:34:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 139.545959] nix-grpc-daemon[1410]: ts=2026-09-20T09:34:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 139.547754] systemd[1]: Started Nix worker-protocol over gRPC. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.52 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 139.589245] nix-grpc-daemon[1410]: ts=2026-09-20T09:34:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 139.594098] nix-grpc-daemon[1609]: ts=2026-09-20T09:34:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.78 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 lb # [ 140.925101] envoy[913]: conn peer=[2001:db8:1::1]:54904 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9599 tx=3874 ms=6268 lb # [ 140.930311] envoy[913]: conn peer=[2001:db8:1::1]:54902 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2935 tx=1332 ms=9795 lb # [ 140.935750] envoy[913]: conn peer=[2001:db8:1::3]:46348 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3202 tx=1002 ms=40236 worker1 # [ 141.150463] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 141.166320] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 141.187348] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 141.202949] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 1/5) worker1 # [ 141.223913] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5) worker1 # [ 141.316692] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 3/5) worker1 # [ 141.450338] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 776 ms (attempt 4/5) worker1 # [ 142.237180] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 142.290865] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:01Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker2 # [ 142.296924] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:01Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 142.302942] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:01Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker2 # [ 142.308247] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:01Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 142.336603] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 142.353861] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 142.368830] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 142.384361] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 142.413772] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:02Z level=info event=niks3_push_started pid=1466 worker1 # [ 142.801935] nix-daemon[836]: accepted connection from pid 1479, user nix-grpc-daemon (trusted) worker1 # [ 142.819734] nix-daemon[836]: reaped child process 1482, status = succeeded worker1 # [ 142.996625] nix-daemon[836]: accepted connection from pid 1484, user nix-grpc-daemon (trusted) worker1 # [ 143.016551] nix-daemon[836]: reaped child process 1487, status = succeeded lb # [ 143.021552] niks3-server[1032]: 2026/09/20 09:35:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 143.039650] nix-grpc-daemon[1466]: time=2026-09-20T09:35:02.657Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 143.041553] nix-grpc-daemon[1466]: time=2026-09-20T09:35:02.657Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 143.058732] niks3-server[1032]: 2026/09/20 09:35:03 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 143.086393] nix-grpc-daemon[1466]: time=2026-09-20T09:35:02.704Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.072568] niks3-server[1032]: 2026/09/20 09:35:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 143.083063] niks3-server[1032]: 2026/09/20 09:35:03 INFO Signed narinfos id=46 count=1 lb # [ 143.091018] niks3-server[1032]: 2026/09/20 09:35:03 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 143.099993] niks3-server[1032]: 2026/09/20 09:35:03 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete worker1 # [ 143.113534] nix-grpc-daemon[1466]: time=2026-09-20T09:35:02.732Z level=INFO msg="Upload complete. (483ms)" lb # [ 143.107655] niks3-server[1032]: 2026/09/20 09:35:03 INFO Completed upload id=46 lb # [ 143.111591] niks3-server[1032]: 2026/09/20 09:35:03 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 143.120278] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 143.136485] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 143.142850] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 143.147897] nix-daemon[836]: reaped child process 1464, status = succeeded worker1 # [ 143.161831] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 144.196879] nix-daemon[836]: reaped child process 1491, status = succeeded worker1 # [ 144.368058] nix-daemon[836]: accepted connection from pid 1506, user nix-grpc-daemon (trusted) worker1 # [ 144.385091] nix-daemon[836]: reaped child process 1509, status = succeeded lb # [ 144.391768] niks3-server[1032]: 2026/09/20 09:35:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.412183] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.028Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 144.413646] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.028Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 144.426454] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker1 # [ 144.453833] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.073Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.445910] niks3-server[1032]: 2026/09/20 09:35:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 144.461003] niks3-server[1032]: 2026/09/20 09:35:05 INFO Signed narinfos id=47 count=1 lb # [ 144.469138] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst worker1 # [ 144.490076] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.109Z level=INFO msg="Upload complete. (318ms)" lb # [ 144.482171] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 144.486328] niks3-server[1032]: 2026/09/20 09:35:05 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 144.491105] niks3-server[1032]: 2026/09/20 09:35:05 INFO Completed upload id=47 lb # [ 144.494317] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker2 # [ 144.502487] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:04Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 144.499987] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=1 worker2 # [ 144.515990] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:04Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 144.518225] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 144.524823] nix-daemon[836]: reaped child process 1489, status = succeeded worker1 # [ 144.532424] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 144.544271] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 144.554908] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 144.741308] nix-daemon[836]: accepted connection from pid 1513, user nix-grpc-daemon (trusted) worker1 # [ 144.759355] nix-daemon[836]: reaped child process 1516, status = succeeded worker1 # [ 144.937251] nix-daemon[836]: accepted connection from pid 1518, user nix-grpc-daemon (trusted) worker1 # [ 144.955228] nix-daemon[836]: reaped child process 1521, status = succeeded lb # [ 144.960760] niks3-server[1032]: 2026/09/20 09:35:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.977284] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.596Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 144.978827] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.596Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 144.990250] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 145.009701] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.628Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.003582] niks3-server[1032]: 2026/09/20 09:35:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 145.015467] niks3-server[1032]: 2026/09/20 09:35:05 INFO Signed narinfos id=48 count=1 lb # [ 145.025672] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 145.030866] niks3-server[1032]: 2026/09/20 09:35:05 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete worker1 # [ 145.044218] nix-grpc-daemon[1466]: time=2026-09-20T09:35:04.663Z level=INFO msg="Upload complete. (477ms)" lb # [ 145.037078] niks3-server[1032]: 2026/09/20 09:35:05 INFO Completed upload id=48 lb # [ 145.041705] niks3-server[1032]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 145.052131] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 145.064253] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 145.070583] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 145.075567] nix-daemon[836]: reaped child process 1511, status = succeeded worker1 # [ 145.088651] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 146.327651] nix-daemon[836]: reaped child process 1525, status = succeeded worker1 # [ 146.498908] nix-daemon[836]: accepted connection from pid 1540, user nix-grpc-daemon (trusted) worker1 # [ 146.517144] nix-daemon[836]: reaped child process 1543, status = succeeded lb # [ 146.521666] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.540371] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.158Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 146.541901] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.158Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 146.563308] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 146.579571] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 146.591434] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 146.598821] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls worker1 # [ 146.607121] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.225Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.604144] niks3-server[1032]: 2026/09/20 09:35:07 INFO Signed narinfos id=49 count=1 lb # [ 146.614656] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 146.624313] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo lb # [ 146.633922] niks3-server[1032]: 2026/09/20 09:35:07 INFO Completed upload id=49 worker1 # [ 146.641946] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.261Z level=INFO msg="Upload complete. (343ms)" worker2 # [ 146.651737] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:06Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 146.653321] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=1 worker2 # [ 146.666424] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:06Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 146.675982] nix-daemon[836]: reaped child process 1523, status = succeeded worker1 # [ 146.704494] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 146.721672] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 146.736674] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 146.750638] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 146.961140] nix-daemon[836]: accepted connection from pid 1547, user nix-grpc-daemon (trusted) worker1 # [ 146.981552] nix-daemon[836]: reaped child process 1550, status = succeeded worker1 # [ 147.155827] nix-daemon[836]: accepted connection from pid 1552, user nix-grpc-daemon (trusted) worker1 # [ 147.173048] nix-daemon[836]: reaped child process 1555, status = succeeded lb # [ 147.178634] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.198462] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.817Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 147.199978] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.817Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 147.212339] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 147.224747] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker1 # [ 147.238823] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.857Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.235040] niks3-server[1032]: 2026/09/20 09:35:07 INFO Signed narinfos id=50 count=1 lb # [ 147.241281] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 147.248420] niks3-server[1032]: 2026/09/20 09:35:07 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 147.254185] niks3-server[1032]: 2026/09/20 09:35:07 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo lb # [ 147.258926] niks3-server[1032]: 2026/09/20 09:35:07 INFO Completed upload id=50 worker1 # [ 147.266833] nix-grpc-daemon[1466]: time=2026-09-20T09:35:06.885Z level=INFO msg="Upload complete. (500ms)" worker1 # [ 147.274472] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 147.287651] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 147.294264] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 147.298954] nix-daemon[836]: reaped child process 1545, status = succeeded worker1 # [ 147.312596] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 148.155380] nix-daemon[836]: reaped child process 1559, status = succeeded worker1 # [ 148.334703] nix-daemon[836]: accepted connection from pid 1574, user nix-grpc-daemon (trusted) worker1 # [ 148.352386] nix-daemon[836]: reaped child process 1577, status = succeeded lb # [ 148.356992] niks3-server[1032]: 2026/09/20 09:35:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.373902] nix-grpc-daemon[1466]: time=2026-09-20T09:35:07.992Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 148.377048] nix-grpc-daemon[1466]: time=2026-09-20T09:35:07.992Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 148.397135] niks3-server[1032]: 2026/09/20 09:35:08 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker1 # [ 148.415424] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.034Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.409214] niks3-server[1032]: 2026/09/20 09:35:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 148.422031] niks3-server[1032]: 2026/09/20 09:35:08 INFO Signed narinfos id=51 count=1 lb # [ 148.426495] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls worker1 # [ 148.440866] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.060Z level=INFO msg="Upload complete. (317ms)" lb # [ 148.433576] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 148.439824] niks3-server[1032]: 2026/09/20 09:35:09 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 148.443983] niks3-server[1032]: 2026/09/20 09:35:09 INFO Completed upload id=51 worker2 # [ 148.449882] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:08Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 148.446050] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker1 # [ 148.452938] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=1 worker2 # [ 148.462778] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:08Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 148.468263] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 148.474626] nix-daemon[836]: reaped child process 1557, status = succeeded worker1 # [ 148.478587] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 148.486779] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.105Z level=INFO msg="All 1 paths already cached" worker1 # [ 148.493974] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 148.503981] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 148.694591] nix-daemon[836]: accepted connection from pid 1581, user nix-grpc-daemon (trusted) worker1 # [ 148.713783] nix-daemon[836]: reaped child process 1584, status = succeeded worker1 # [ 148.890310] nix-daemon[836]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker1 # [ 148.909232] nix-daemon[836]: reaped child process 1589, status = succeeded lb # [ 148.912629] niks3-server[1032]: 2026/09/20 09:35:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.929193] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.548Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 148.930731] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.548Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 148.939876] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst lb # [ 148.953727] niks3-server[1032]: 2026/09/20 09:35:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker1 # [ 148.971186] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.590Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.965666] niks3-server[1032]: 2026/09/20 09:35:09 INFO Signed narinfos id=52 count=1 lb # [ 148.971774] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 148.980179] niks3-server[1032]: 2026/09/20 09:35:09 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete worker1 # [ 148.994503] nix-grpc-daemon[1466]: time=2026-09-20T09:35:08.613Z level=INFO msg="Upload complete. (479ms)" lb # [ 148.987217] niks3-server[1032]: 2026/09/20 09:35:09 INFO Completed upload id=52 lb # [ 148.990798] niks3-server[1032]: 2026/09/20 09:35:09 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 149.000238] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 149.014145] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 149.019904] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 149.024919] nix-daemon[836]: reaped child process 1579, status = succeeded worker1 # [ 149.038678] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 150.064456] nix-daemon[836]: reaped child process 1593, status = succeeded worker1 # [ 150.229870] nix-daemon[836]: accepted connection from pid 1608, user nix-grpc-daemon (trusted) worker1 # [ 150.249016] nix-daemon[836]: reaped child process 1611, status = succeeded lb # [ 150.255246] niks3-server[1032]: 2026/09/20 09:35:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.276431] nix-grpc-daemon[1466]: time=2026-09-20T09:35:09.892Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 150.278015] nix-grpc-daemon[1466]: time=2026-09-20T09:35:09.893Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 150.294555] niks3-server[1032]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 150.308806] niks3-server[1032]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 150.322918] niks3-server[1032]: 2026/09/20 09:35:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker1 # [ 150.335972] nix-grpc-daemon[1466]: time=2026-09-20T09:35:09.954Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.331424] niks3-server[1032]: 2026/09/20 09:35:10 INFO Signed narinfos id=53 count=1 lb # [ 150.336864] niks3-server[1032]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 150.343366] niks3-server[1032]: 2026/09/20 09:35:10 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 150.349530] niks3-server[1032]: 2026/09/20 09:35:10 INFO Completed upload id=53 worker1 # [ 150.357019] nix-grpc-daemon[1466]: time=2026-09-20T09:35:09.976Z level=INFO msg="Upload complete. (308ms)" lb # [ 150.351860] niks3-server[1032]: 2026/09/20 09:35:10 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker2 # [ 150.366621] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:09Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 150.371407] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=1 worker2 # [ 150.380571] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:10Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 150.395644] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 150.399889] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 150.405002] nix-daemon[836]: reaped child process 1591, status = succeeded worker1 # [ 150.410926] nix-grpc-daemon[1466]: time=2026-09-20T09:35:10.030Z level=INFO msg="All 1 paths already cached" worker1 # [ 150.418134] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 150.429141] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 150.629088] nix-daemon[836]: accepted connection from pid 1615, user nix-grpc-daemon (trusted) worker1 # [ 150.646588] nix-daemon[836]: reaped child process 1618, status = succeeded worker1 # [ 150.819611] nix-daemon[836]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker1 # [ 150.835898] nix-daemon[836]: reaped child process 1623, status = succeeded lb # [ 150.842832] niks3-server[1032]: 2026/09/20 09:35:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.859999] nix-grpc-daemon[1466]: time=2026-09-20T09:35:10.478Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 150.861725] nix-grpc-daemon[1466]: time=2026-09-20T09:35:10.478Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 150.870901] niks3-server[1032]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst worker1 # [ 150.892281] nix-grpc-daemon[1466]: time=2026-09-20T09:35:10.511Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.885292] niks3-server[1032]: 2026/09/20 09:35:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 150.895989] niks3-server[1032]: 2026/09/20 09:35:11 INFO Signed narinfos id=54 count=1 lb # [ 150.902499] niks3-server[1032]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 150.910066] niks3-server[1032]: 2026/09/20 09:35:11 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 150.916295] niks3-server[1032]: 2026/09/20 09:35:11 INFO Completed upload id=54 worker1 # [ 150.924092] nix-grpc-daemon[1466]: time=2026-09-20T09:35:10.543Z level=INFO msg="Upload complete. (481ms)" lb # [ 150.919400] niks3-server[1032]: 2026/09/20 09:35:11 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 150.932172] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 150.943943] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 150.949715] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 150.954663] nix-daemon[836]: reaped child process 1613, status = succeeded worker1 # [ 150.967640] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 152.215929] nix-daemon[836]: reaped child process 1627, status = succeeded worker1 # [ 152.399590] nix-daemon[836]: accepted connection from pid 1642, user nix-grpc-daemon (trusted) worker1 # [ 152.420395] nix-daemon[836]: reaped child process 1645, status = succeeded lb # [ 152.424758] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.442756] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.061Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 152.447807] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.063Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 152.466070] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 152.478216] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst worker1 # [ 152.498255] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.117Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.492345] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 152.495757] niks3-server[1032]: 2026/09/20 09:35:13 INFO Signed narinfos id=55 count=1 lb # [ 152.506215] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 152.511947] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 152.515785] niks3-server[1032]: 2026/09/20 09:35:13 INFO Completed upload id=55 worker1 # [ 152.523738] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.142Z level=INFO msg="Upload complete. (345ms)" lb # [ 152.518258] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker2 # [ 152.533549] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:12Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 152.538092] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=1 worker2 # [ 152.546990] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:12Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 152.561022] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 152.565383] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 152.571601] nix-daemon[836]: reaped child process 1625, status = succeeded worker1 # [ 152.579910] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.199Z level=INFO msg="All 1 paths already cached" worker1 # [ 152.587885] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 152.599524] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 152.790590] nix-daemon[836]: accepted connection from pid 1649, user nix-grpc-daemon (trusted) worker1 # [ 152.812301] nix-daemon[836]: reaped child process 1652, status = succeeded worker1 # [ 152.995473] nix-daemon[836]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker1 # [ 153.014079] nix-daemon[836]: reaped child process 1657, status = succeeded lb # [ 153.017284] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.039798] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.658Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 153.041537] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.658Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 153.054418] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst worker1 # [ 153.076038] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.695Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.071091] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 153.081223] niks3-server[1032]: 2026/09/20 09:35:13 INFO Signed narinfos id=56 count=1 lb # [ 153.083767] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 153.094553] niks3-server[1032]: 2026/09/20 09:35:13 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 153.099793] niks3-server[1032]: 2026/09/20 09:35:13 INFO Completed upload id=56 worker1 # [ 153.101088] nix-grpc-daemon[1466]: time=2026-09-20T09:35:12.720Z level=INFO msg="Upload complete. (489ms)" lb # [ 153.103069] niks3-server[1032]: 2026/09/20 09:35:13 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 153.111605] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 153.123909] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 153.130901] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 153.137387] nix-daemon[836]: reaped child process 1647, status = succeeded worker1 # [ 153.152199] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 154.590605] nix-daemon[836]: reaped child process 1661, status = succeeded worker1 # [ 154.768875] nix-daemon[836]: accepted connection from pid 1676, user nix-grpc-daemon (trusted) worker1 # [ 154.790658] nix-daemon[836]: reaped child process 1679, status = succeeded lb # [ 154.797514] niks3-server[1032]: 2026/09/20 09:35:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.816456] nix-grpc-daemon[1466]: time=2026-09-20T09:35:14.434Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 154.819948] nix-grpc-daemon[1466]: time=2026-09-20T09:35:14.434Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 154.847951] niks3-server[1032]: 2026/09/20 09:35:15 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 154.862588] niks3-server[1032]: 2026/09/20 09:35:15 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 154.874015] niks3-server[1032]: 2026/09/20 09:35:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 154.886867] nix-grpc-daemon[1466]: time=2026-09-20T09:35:14.505Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.883257] niks3-server[1032]: 2026/09/20 09:35:15 INFO Signed narinfos id=57 count=1 lb # [ 154.887295] niks3-server[1032]: 2026/09/20 09:35:15 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 154.892336] niks3-server[1032]: 2026/09/20 09:35:15 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 154.899598] niks3-server[1032]: 2026/09/20 09:35:15 INFO Completed upload id=57 worker1 # [ 154.908254] nix-grpc-daemon[1466]: time=2026-09-20T09:35:14.526Z level=INFO msg="Upload complete. (343ms)" lb # [ 154.902338] niks3-server[1032]: 2026/09/20 09:35:15 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker2 # [ 154.918066] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:14Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 154.932785] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:14Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 154.921394] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=1 worker1 # [ 154.940382] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 154.952151] nix-daemon[836]: reaped child process 1659, status = succeeded worker1 # [ 154.958493] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 154.973238] nix-grpc-daemon[1466]: time=2026-09-20T09:35:14.592Z level=INFO msg="All 2 paths already cached" worker1 # [ 154.982968] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 154.996243] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 155.200176] nix-daemon[836]: accepted connection from pid 1683, user nix-grpc-daemon (trusted) worker1 # [ 155.220356] nix-daemon[836]: reaped child process 1686, status = succeeded worker1 # [ 155.417965] nix-daemon[836]: accepted connection from pid 1688, user nix-grpc-daemon (trusted) worker1 # [ 155.437832] nix-daemon[836]: reaped child process 1691, status = succeeded lb # [ 155.441702] niks3-server[1032]: 2026/09/20 09:35:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.459899] nix-grpc-daemon[1466]: time=2026-09-20T09:35:15.078Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 155.461635] nix-grpc-daemon[1466]: time=2026-09-20T09:35:15.078Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 155.477790] niks3-server[1032]: 2026/09/20 09:35:16 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 155.497918] nix-grpc-daemon[1466]: time=2026-09-20T09:35:15.116Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.494604] niks3-server[1032]: 2026/09/20 09:35:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 155.505016] niks3-server[1032]: 2026/09/20 09:35:16 INFO Signed narinfos id=58 count=1 lb # [ 155.507491] niks3-server[1032]: 2026/09/20 09:35:16 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 155.515553] niks3-server[1032]: 2026/09/20 09:35:16 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 155.521781] niks3-server[1032]: 2026/09/20 09:35:16 INFO Completed upload id=58 worker1 # [ 155.529655] nix-grpc-daemon[1466]: time=2026-09-20T09:35:15.148Z level=INFO msg="Upload complete. (519ms)" lb # [ 155.524453] niks3-server[1032]: 2026/09/20 09:35:16 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 155.540581] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 155.547409] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 155.561217] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 155.571518] nix-daemon[836]: reaped child process 1681, status = succeeded worker1 # [ 155.579002] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 156.608293] nix-daemon[836]: reaped child process 1695, status = succeeded worker1 # [ 156.791360] nix-daemon[836]: accepted connection from pid 1710, user nix-grpc-daemon (trusted) worker1 # [ 156.818085] nix-daemon[836]: reaped child process 1713, status = succeeded lb # [ 156.825303] niks3-server[1032]: 2026/09/20 09:35:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.848620] nix-grpc-daemon[1466]: time=2026-09-20T09:35:16.464Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 156.851487] nix-grpc-daemon[1466]: time=2026-09-20T09:35:16.465Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 156.879296] niks3-server[1032]: 2026/09/20 09:35:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker1 # [ 156.897653] nix-grpc-daemon[1466]: time=2026-09-20T09:35:16.516Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.896753] niks3-server[1032]: 2026/09/20 09:35:17 INFO Signed narinfos id=59 count=1 lb # [ 156.907380] niks3-server[1032]: 2026/09/20 09:35:17 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 156.920404] niks3-server[1032]: 2026/09/20 09:35:17 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 156.926668] niks3-server[1032]: 2026/09/20 09:35:17 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls worker1 # [ 156.938737] nix-grpc-daemon[1466]: time=2026-09-20T09:35:16.557Z level=INFO msg="Upload complete. (347ms)" lb # [ 156.931553] niks3-server[1032]: 2026/09/20 09:35:17 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 156.935670] niks3-server[1032]: 2026/09/20 09:35:17 INFO Completed upload id=59 lb # [ 156.939619] niks3-server[1032]: 2026/09/20 09:35:17 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker2 # [ 156.951001] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:16Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 156.954228] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=1 worker1 # [ 156.973311] nix-daemon[836]: reaped child process 1693, status = succeeded worker1 # [ 156.997376] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 157.020980] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 157.038131] nix-grpc-daemon[1466]: time=2026-09-20T09:35:16.657Z level=INFO msg="All 2 paths already cached" worker1 # [ 157.048692] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 157.064262] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 157.277311] nix-daemon[836]: accepted connection from pid 1717, user nix-grpc-daemon (trusted) worker1 # [ 157.295566] nix-daemon[836]: reaped child process 1720, status = succeeded worker1 # [ 157.468643] nix-daemon[836]: accepted connection from pid 1722, user nix-grpc-daemon (trusted) worker1 # [ 157.486263] nix-daemon[836]: reaped child process 1725, status = succeeded lb # [ 157.489871] niks3-server[1032]: 2026/09/20 09:35:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.507222] nix-grpc-daemon[1466]: time=2026-09-20T09:35:17.126Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 157.509370] nix-grpc-daemon[1466]: time=2026-09-20T09:35:17.128Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 157.520996] niks3-server[1032]: 2026/09/20 09:35:18 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 157.542998] nix-grpc-daemon[1466]: time=2026-09-20T09:35:17.162Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.535054] niks3-server[1032]: 2026/09/20 09:35:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 157.546742] niks3-server[1032]: 2026/09/20 09:35:18 INFO Signed narinfos id=60 count=1 lb # [ 157.553028] niks3-server[1032]: 2026/09/20 09:35:18 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 157.563334] niks3-server[1032]: 2026/09/20 09:35:18 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 157.572113] niks3-server[1032]: 2026/09/20 09:35:18 INFO Completed upload id=60 worker1 # [ 157.579345] nix-grpc-daemon[1466]: time=2026-09-20T09:35:17.198Z level=INFO msg="Upload complete. (495ms)" lb # [ 157.574057] niks3-server[1032]: 2026/09/20 09:35:18 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 157.589051] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 157.603495] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 157.612682] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 157.617886] nix-daemon[836]: reaped child process 1715, status = succeeded worker1 # [ 157.632242] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 159.074825] nix-daemon[836]: reaped child process 1729, status = succeeded worker1 # [ 159.263015] nix-daemon[836]: accepted connection from pid 1744, user nix-grpc-daemon (trusted) worker1 # [ 159.281251] nix-daemon[836]: reaped child process 1747, status = succeeded lb # [ 159.285378] niks3-server[1032]: 2026/09/20 09:35:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.306146] nix-grpc-daemon[1466]: time=2026-09-20T09:35:18.923Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 159.307785] nix-grpc-daemon[1466]: time=2026-09-20T09:35:18.923Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 159.327732] niks3-server[1032]: 2026/09/20 09:35:19 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 159.338968] niks3-server[1032]: 2026/09/20 09:35:19 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker1 # [ 159.357899] nix-grpc-daemon[1466]: time=2026-09-20T09:35:18.976Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.349588] niks3-server[1032]: 2026/09/20 09:35:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 159.357207] niks3-server[1032]: 2026/09/20 09:35:19 INFO Signed narinfos id=61 count=1 lb # [ 159.359732] niks3-server[1032]: 2026/09/20 09:35:19 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 159.371802] niks3-server[1032]: 2026/09/20 09:35:19 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 159.377622] niks3-server[1032]: 2026/09/20 09:35:19 INFO Completed upload id=61 worker1 # [ 159.385495] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.004Z level=INFO msg="Upload complete. (340ms)" lb # [ 159.380669] niks3-server[1032]: 2026/09/20 09:35:19 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker2 # [ 159.397164] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:19Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.401165] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=1 worker1 # [ 159.416461] nix-daemon[836]: reaped child process 1727, status = succeeded worker1 # [ 159.440761] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 159.457194] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 159.472615] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.091Z level=INFO msg="All 2 paths already cached" worker1 # [ 159.484500] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 159.499193] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 159.699966] nix-daemon[836]: accepted connection from pid 1751, user nix-grpc-daemon (trusted) worker1 # [ 159.719569] nix-daemon[836]: reaped child process 1754, status = succeeded worker1 # [ 159.890837] nix-daemon[836]: accepted connection from pid 1756, user nix-grpc-daemon (trusted) worker1 # [ 159.909653] nix-daemon[836]: reaped child process 1759, status = succeeded lb # [ 159.915012] niks3-server[1032]: 2026/09/20 09:35:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.933792] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.552Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 159.935341] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.552Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 159.948567] niks3-server[1032]: 2026/09/20 09:35:20 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 159.965498] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.584Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.962445] niks3-server[1032]: 2026/09/20 09:35:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 159.972974] niks3-server[1032]: 2026/09/20 09:35:20 INFO Signed narinfos id=62 count=1 lb # [ 159.976873] niks3-server[1032]: 2026/09/20 09:35:20 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 159.984325] niks3-server[1032]: 2026/09/20 09:35:20 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 159.988883] niks3-server[1032]: 2026/09/20 09:35:20 INFO Completed upload id=62 worker1 # [ 159.995930] nix-grpc-daemon[1466]: time=2026-09-20T09:35:19.615Z level=INFO msg="Upload complete. (478ms)" lb # [ 159.991456] niks3-server[1032]: 2026/09/20 09:35:20 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 160.007148] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 160.019483] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 worker1 # [ 160.026177] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 160.030715] nix-daemon[836]: reaped child process 1749, status = succeeded worker1 # [ 160.044139] nix-daemon[836]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 161.693772] nix-daemon[836]: reaped child process 1763, status = succeeded worker1 # [ 161.868108] nix-daemon[836]: accepted connection from pid 1778, user nix-grpc-daemon (trusted) worker1 # [ 161.885007] nix-daemon[836]: reaped child process 1781, status = succeeded lb # [ 161.893307] niks3-server[1032]: 2026/09/20 09:35:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.912487] nix-grpc-daemon[1466]: time=2026-09-20T09:35:21.530Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.914406] nix-grpc-daemon[1466]: time=2026-09-20T09:35:21.530Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 161.939480] niks3-server[1032]: 2026/09/20 09:35:22 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst worker1 # [ 161.959107] nix-grpc-daemon[1466]: time=2026-09-20T09:35:21.577Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.953824] niks3-server[1032]: 2026/09/20 09:35:22 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 161.963196] niks3-server[1032]: 2026/09/20 09:35:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 161.968918] niks3-server[1032]: 2026/09/20 09:35:22 INFO Signed narinfos id=63 count=1 lb # [ 161.974762] niks3-server[1032]: 2026/09/20 09:35:22 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 161.978804] niks3-server[1032]: 2026/09/20 09:35:22 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 161.983052] niks3-server[1032]: 2026/09/20 09:35:22 INFO Completed upload id=63 worker1 # [ 161.990482] nix-grpc-daemon[1466]: time=2026-09-20T09:35:21.609Z level=INFO msg="Upload complete. (333ms)" lb # [ 161.985733] niks3-server[1032]: 2026/09/20 09:35:22 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 162.002616] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36584 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=1 worker1 # [ 162.023164] nix-daemon[836]: reaped child process 1761, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.19 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1' worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.09 seconds) client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1 worker1 # [ 162.424409] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36584 worker2 # [ 162.431180] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 162.458231] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:22Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 lb # [ 170.928535] envoy[913]: conn peer=[2001:db8:1::1]:45972 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27161 tx=10811 ms=20874 client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 30.34 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.62 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1 # [ 193.577757] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:53Z level=info event=unhealthy reason=min_free worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.23 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 worker1 # [ 194.081877] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36584 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 194.094883] nix-grpc-daemon[1410]: ts=2026-09-20T09:35:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36584 worker2 # [ 194.136982] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:53Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 194.146132] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:53Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 194.156384] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 194.174601] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40696 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 194.195746] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 194.219466] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 194.462687] nix-daemon[836]: accepted connection from pid 1889, user nix-grpc-daemon (trusted) worker2 # [ 194.483859] nix-daemon[836]: reaped child process 1892, status = succeeded worker2 # [ 194.670049] nix-daemon[836]: accepted connection from pid 1894, user nix-grpc-daemon (trusted) worker2 # [ 194.690399] nix-daemon[836]: reaped child process 1897, status = succeeded lb # [ 194.697324] niks3-server[1032]: 2026/09/20 09:35:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 194.721557] nix-grpc-daemon[1685]: time=2026-09-20T09:35:54.343Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 194.723067] nix-grpc-daemon[1685]: time=2026-09-20T09:35:54.343Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 194.745699] niks3-server[1032]: 2026/09/20 09:35:55 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 194.765182] niks3-server[1032]: 2026/09/20 09:35:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker2 # [ 194.783500] nix-grpc-daemon[1685]: time=2026-09-20T09:35:54.406Z level=INFO msg="Uploading 1 narinfos" lb # [ 194.778693] niks3-server[1032]: 2026/09/20 09:35:55 INFO Signed narinfos id=64 count=1 lb # [ 194.783113] niks3-server[1032]: 2026/09/20 09:35:55 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 194.799935] niks3-server[1032]: 2026/09/20 09:35:55 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 194.812112] niks3-server[1032]: 2026/09/20 09:35:55 INFO Completed upload id=64 worker2 # [ 194.821450] nix-grpc-daemon[1685]: time=2026-09-20T09:35:54.444Z level=INFO msg="Upload complete. (581ms)" lb # [ 194.818938] niks3-server[1032]: 2026/09/20 09:35:55 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 194.832461] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 194.849618] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 194.863744] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 194.871213] nix-daemon[836]: reaped child process 1887, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 194.887840] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-drain worker2 # [ 196.130789] nix-daemon[836]: reaped child process 1901, status = succeeded worker2 # [ 196.297982] nix-daemon[836]: accepted connection from pid 1916, user nix-grpc-daemon (trusted) worker2 # [ 196.317434] nix-daemon[836]: reaped child process 1919, status = succeeded lb # [ 196.322204] niks3-server[1032]: 2026/09/20 09:35:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 196.354526] nix-grpc-daemon[1685]: time=2026-09-20T09:35:55.976Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 196.358907] nix-grpc-daemon[1685]: time=2026-09-20T09:35:55.977Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 196.375432] niks3-server[1032]: 2026/09/20 09:35:56 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 196.401681] niks3-server[1032]: 2026/09/20 09:35:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 196.411305] niks3-server[1032]: 2026/09/20 09:35:56 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 196.415173] niks3-server[1032]: 2026/09/20 09:35:56 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls worker2 # [ 196.424229] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.046Z level=INFO msg="Uploading 1 narinfos" lb # [ 196.419341] niks3-server[1032]: 2026/09/20 09:35:56 INFO Signed narinfos id=65 count=1 lb # [ 196.426958] niks3-server[1032]: 2026/09/20 09:35:57 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 196.433694] niks3-server[1032]: 2026/09/20 09:35:57 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo lb # [ 196.436835] niks3-server[1032]: 2026/09/20 09:35:57 INFO Completed upload id=65 worker2 # [ 196.446349] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.069Z level=INFO msg="Upload complete. (345ms)" worker2 # [ 196.465218] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=1 worker2 # [ 196.484416] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker2 # [ 196.489306] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 196.494455] nix-daemon[836]: reaped child process 1899, status = succeeded worker2 # [ 196.515079] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 196.535754] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 196.552965] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.176Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 196.564624] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 196.585125] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 196.828963] nix-daemon[836]: accepted connection from pid 1925, user nix-grpc-daemon (trusted) worker2 # [ 196.853903] nix-daemon[836]: reaped child process 1928, status = succeeded worker2 # [ 197.044114] nix-daemon[836]: accepted connection from pid 1930, user nix-grpc-daemon (trusted) worker2 # [ 197.061519] nix-daemon[836]: reaped child process 1933, status = succeeded lb # [ 197.065441] niks3-server[1032]: 2026/09/20 09:35:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 197.090602] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.713Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 197.092287] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.713Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 197.109607] niks3-server[1032]: 2026/09/20 09:35:57 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 197.135783] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.758Z level=INFO msg="Uploading 1 narinfos" lb # [ 197.126509] niks3-server[1032]: 2026/09/20 09:35:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 197.139357] niks3-server[1032]: 2026/09/20 09:35:57 INFO Signed narinfos id=66 count=1 lb # [ 197.147330] niks3-server[1032]: 2026/09/20 09:35:57 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 197.158345] niks3-server[1032]: 2026/09/20 09:35:57 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 197.166635] niks3-server[1032]: 2026/09/20 09:35:57 INFO Completed upload id=66 worker2 # [ 197.175305] nix-grpc-daemon[1685]: time=2026-09-20T09:35:56.798Z level=INFO msg="Upload complete. (565ms)" lb # [ 197.169852] niks3-server[1032]: 2026/09/20 09:35:57 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 197.189725] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 197.203965] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 197.222107] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 197.229205] nix-daemon[836]: reaped child process 1923, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... worker2 # [ 197.243809] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv client # farm-b> LOG-farm-b-drain worker2 # [ 198.093382] nix-daemon[836]: reaped child process 1937, status = succeeded worker2 # [ 198.346631] nix-daemon[836]: accepted connection from pid 1952, user nix-grpc-daemon (trusted) worker2 # [ 198.375170] nix-daemon[836]: reaped child process 1955, status = succeeded lb # [ 198.382999] niks3-server[1032]: 2026/09/20 09:35:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 198.408446] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.027Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 198.410100] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.028Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 198.445088] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 198.458316] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 198.468194] niks3-server[1032]: 2026/09/20 09:35:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 198.482647] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.105Z level=INFO msg="Uploading 1 narinfos" lb # [ 198.477102] niks3-server[1032]: 2026/09/20 09:35:59 INFO Signed narinfos id=67 count=1 lb # [ 198.479220] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 198.486955] niks3-server[1032]: 2026/09/20 09:35:59 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 198.493667] niks3-server[1032]: 2026/09/20 09:35:59 INFO Completed upload id=67 worker2 # [ 198.502395] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.125Z level=INFO msg="Upload complete. (443ms)" lb # [ 198.495942] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 198.524260] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=1 worker2 # [ 198.536470] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 198.543379] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 198.547773] nix-daemon[836]: reaped child process 1935, status = succeeded worker2 # [ 198.566087] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 198.581327] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 198.595253] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.218Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 198.604443] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 198.620763] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 198.819301] nix-daemon[836]: accepted connection from pid 1961, user nix-grpc-daemon (trusted) worker2 # [ 198.836153] nix-daemon[836]: reaped child process 1964, status = succeeded worker2 # [ 199.005633] nix-daemon[836]: accepted connection from pid 1966, user nix-grpc-daemon (trusted) worker2 # [ 199.021338] nix-daemon[836]: reaped child process 1969, status = succeeded lb # [ 199.023310] niks3-server[1032]: 2026/09/20 09:35:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 199.041457] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.664Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 199.042947] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.664Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 199.048250] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 199.071903] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.695Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.062678] niks3-server[1032]: 2026/09/20 09:35:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 199.074847] niks3-server[1032]: 2026/09/20 09:35:59 INFO Signed narinfos id=68 count=1 lb # [ 199.082657] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 199.091243] niks3-server[1032]: 2026/09/20 09:35:59 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 199.097892] niks3-server[1032]: 2026/09/20 09:35:59 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo lb # [ 199.103781] niks3-server[1032]: 2026/09/20 09:35:59 INFO Completed upload id=68 worker2 # [ 199.113182] nix-grpc-daemon[1685]: time=2026-09-20T09:35:58.736Z level=INFO msg="Upload complete. (476ms)" worker2 # [ 199.120869] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 199.135019] nix-grpc-daemon[1609]: ts=2026-09-20T09:35:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 worker2 # [ 199.141288] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 199.146130] nix-daemon[836]: reaped child process 1959, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 199.160791] nix-daemon[836]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 200.582732] nix-daemon[836]: reaped child process 1973, status = succeeded client # farm-top> LOG-farm-top-drain worker2 # [ 200.736916] nix-daemon[836]: accepted connection from pid 1988, user nix-grpc-daemon (trusted) worker2 # [ 200.754410] nix-daemon[836]: reaped child process 1991, status = succeeded lb # [ 200.763350] niks3-server[1032]: 2026/09/20 09:36:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.783862] nix-grpc-daemon[1685]: time=2026-09-20T09:36:00.405Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 200.785552] nix-grpc-daemon[1685]: time=2026-09-20T09:36:00.405Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 200.792915] niks3-server[1032]: 2026/09/20 09:36:01 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 200.812400] niks3-server[1032]: 2026/09/20 09:36:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker2 # [ 200.842341] nix-grpc-daemon[1685]: time=2026-09-20T09:36:00.465Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.826670] niks3-server[1032]: 2026/09/20 09:36:01 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 200.836646] niks3-server[1032]: 2026/09/20 09:36:01 INFO Signed narinfos id=69 count=1 lb # [ 200.841226] niks3-server[1032]: 2026/09/20 09:36:01 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 200.847919] niks3-server[1032]: 2026/09/20 09:36:01 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 200.852657] niks3-server[1032]: 2026/09/20 09:36:01 INFO Completed upload id=69 worker2 # [ 200.862103] nix-grpc-daemon[1685]: time=2026-09-20T09:36:00.485Z level=INFO msg="Upload complete. (290ms)" lb # [ 200.854851] niks3-server[1032]: 2026/09/20 09:36:01 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 200.877112] nix-grpc-daemon[1609]: ts=2026-09-20T09:36:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40696 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=1 worker2 # [ 200.890620] nix-daemon[836]: reaped child process 1971, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.14 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath lb # [ 200.931584] envoy[913]: conn peer=[2001:db8:1::1]:52364 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=30064 lb # [ 200.936745] envoy[913]: conn peer=[2001:db8:1::1]:39344 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9480 tx=3864 ms=6805 client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 201.583660] nix-grpc-daemon[1410]: ts=2026-09-20T09:36:01Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.04 seconds) (finished: run the VM test script, in 203.46 seconds) test script finished in 203.76s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.07 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh