tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker2 # Disk image does not exist, creating the virtualisation disk image... worker2 # Formatting '/build/vm-state-worker2/tmp.EfND4EEfE6', fmt=raw size=1073741824 worker2 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2: QEMU running (pid 52) worker2 # Filesystem UUID: 7c01e191-bd07-4db9-a5f4-b693d5ad70b2 client # Disk image does not exist, creating the virtualisation disk image... lb # Disk image does not exist, creating the virtualisation disk image... worker2 # Superblock backups stored on blocks: client # Formatting '/build/vm-state-client/tmp.Mp67SHhjzm', fmt=raw size=1073741824 worker1 # Disk image does not exist, creating the virtualisation disk image... lb # Formatting '/build/vm-state-lb/tmp.FLvC1C81UC', fmt=raw size=1073741824 worker2 # 32768, 98304, 163840, 229376 client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Formatting '/build/vm-state-worker1/tmp.NZY4EVktna', fmt=raw size=1073741824 lb # mke2fs 1.47.4 (6-Mar-2025) worker2 # client # Discarding device blocks: 0/262144 done worker1 # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done worker2 # Allocating group tables: 0/8 done client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Discarding device blocks: 0/262144 done lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Writing inode tables: 0/8 done client # Filesystem UUID: d9d6b65f-b122-4009-b3a5-9eb885862862 worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Filesystem UUID: 905076c0-e181-4080-837f-daf948d134a9 worker2 # Creating journal (8192 blocks): done client # Superblock backups stored on blocks: worker1 # Filesystem UUID: 080bd0e5-fce3-4c48-8ebe-ab778c805ed6 lb # Superblock backups stored on blocks: worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # 32768, 98304, 163840, 229376 worker1 # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 worker2 # client # worker1 # 32768, 98304, 163840, 229376 lb # worker2 # Virtualisation disk image created. client # Allocating group tables: 0/8 done worker1 # lb # Allocating group tables: 0/8 done client: QEMU running (pid 49) lb: QEMU running (pid 50) worker1: QEMU running (pid 51) client # Writing inode tables: 0/8 done lb # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done lb # Creating journal (8192 blocks): done (finished: start all VMs, in 0.55 seconds) worker1 # Allocating group tables: 0/8 done client # Writing superblocks and filesystem accounting information: 0/8 done lb # Writing superblocks and filesystem accounting information: 0/8 done client: waiting for unit network-addresses-eth1.service worker1 # Writing inode tables: 0/8 done client # lb # client: waiting for the VM to finish booting worker1 # Creating journal (8192 blocks): done client # Virtualisation disk image created. worker1 # Writing superblocks and filesystem accounting information: 0/8 done lb # Virtualisation disk image created. worker1 # worker1 # Virtualisation disk image created. worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] Zone ranges: client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] KASLR enabled lb # [ 0.000000] KASLR enabled worker2 # [ 0.000000] DMA32 empty client # [ 0.000000] random: crng init done lb # [ 0.000000] random: crng init done worker2 # [ 0.000000] Normal empty worker2 # [ 0.000000] Device empty lb # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] efi: UEFI not found. client # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] Early memory node ranges client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] Zone ranges: lb # [ 0.000000] Zone ranges: worker2 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] DMA32 empty lb # [ 0.000000] DMA32 empty worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] Normal empty lb # [ 0.000000] Normal empty worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] Device empty lb # [ 0.000000] Device empty client # [ 0.000000] Movable zone start for each node lb # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] Early memory node ranges lb # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ni25qis79is9vbds50baywbk2s5jd3jl-nixos-system-worker2-test/init regInfo=/nix/store/i01kk4b75nksh47g8rmm15ik1l7gvsa6-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/i01kk4b75nksh47g8rmm15ik1l7gvsa6-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/48jbsm9kd5qiv7f4kb30g64m8mnnbmi9-nixos-system-client-test/init regInfo=/nix/store/j5plr3b199wmis6j3s7n10hnnns4lqbj-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] random: crng init done client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/j5plr3b199wmis6j3s7n10hnnns4lqbj-closure-info/registration", will be passed to user space. lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] DMA32 empty client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] Normal empty worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] Device empty client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] Movable zone start for each node lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] Policy zone: DMA lb # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xrykcgrr46dyc1l2vn0lvwkl791ca1wb-nixos-system-worker1-test/init regInfo=/nix/store/kihanf6pbjhl91m5bjpnv9kgynavm3yr-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/kihanf6pbjhl91m5bjpnv9kgynavm3yr-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.000031] arm-pv: using stolen time PV worker1 # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000457] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000621] Console: colour dummy device 80x25 worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000629] printk: legacy console [tty0] enabled client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Policy zone: DMA worker2 # [ 0.000828] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000835] pid_max: default: 32768 minimum: 301 worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000932] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000033] arm-pv: using stolen time PV worker2 # [ 0.001100] landlock: Up and running. lb # [ 0.000031] arm-pv: using stolen time PV worker1 # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.001103] Yama: becoming mindful. worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.001636] LSM support for eBPF active client # [ 0.000522] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000524] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000707] Console: colour dummy device 80x25 worker2 # [ 0.001782] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000695] Console: colour dummy device 80x25 worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000715] printk: legacy console [tty0] enabled lb # [ 0.000704] printk: legacy console [tty0] enabled worker1 # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.001821] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000908] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000898] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.003038] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.003784] rcu: Hierarchical SRCU implementation. client # [ 0.000915] pid_max: default: 32768 minimum: 301 worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000906] pid_max: default: 32768 minimum: 301 worker2 # [ 0.003788] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.001001] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000988] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.001186] landlock: Up and running. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.005010] fsl-mc MSI: its@8080000 domain created lb # [ 0.001152] landlock: Up and running. client # [ 0.001189] Yama: becoming mindful. worker2 # [ 0.005103] EFI services will not be available. lb # [ 0.001155] Yama: becoming mindful. client # [ 0.001857] LSM support for eBPF active worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.005192] smp: Bringing up secondary CPUs ... lb # [ 0.001797] LSM support for eBPF active worker2 # [ 0.005201] smp: Brought up 1 node, 1 CPU client # [ 0.002013] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.001961] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.005204] SMP: Total of 1 processors activated. worker2 # [ 0.005210] CPU: All CPU(s) started at EL1 client # [ 0.002047] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.001994] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.005221] CPU features: detected: Branch Target Identification client # [ 0.003226] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.003188] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.004044] rcu: Hierarchical SRCU implementation. worker2 # [ 0.005226] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.003943] rcu: Hierarchical SRCU implementation. client # [ 0.004048] rcu: Max phase no-delay instances is 1000. lb # [ 0.003947] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.005229] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.005243] fsl-mc MSI: its@8080000 domain created lb # [ 0.005188] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.005333] EFI services will not be available. lb # [ 0.005288] EFI services will not be available. worker1 # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.005233] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.005425] smp: Bringing up secondary CPUs ... lb # [ 0.005359] smp: Bringing up secondary CPUs ... worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.005438] smp: Brought up 1 node, 1 CPU worker2 # [ 0.005236] CPU features: detected: Common not Private translations lb # [ 0.005369] smp: Brought up 1 node, 1 CPU worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.005442] SMP: Total of 1 processors activated. worker2 # [ 0.005240] CPU features: detected: CRC32 instructions lb # [ 0.005372] SMP: Total of 1 processors activated. worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.005448] CPU: All CPU(s) started at EL1 lb # [ 0.005378] CPU: All CPU(s) started at EL1 worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.005243] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.005469] CPU features: detected: Branch Target Identification lb # [ 0.005391] CPU features: detected: Branch Target Identification worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.005246] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.005474] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.005397] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.005250] CPU features: detected: Data independent timing control (DIT) client # [ 0.005477] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.005253] CPU features: detected: E0PD lb # [ 0.005400] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.005255] CPU features: detected: Enhanced Counter Virtualization client # [ 0.005481] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.005404] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.005258] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.005485] CPU features: detected: Common not Private translations lb # [ 0.005408] CPU features: detected: Common not Private translations worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.005489] CPU features: detected: CRC32 instructions worker2 # [ 0.005261] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.005411] CPU features: detected: CRC32 instructions worker2 # [ 0.005264] CPU features: detected: Fine Grained Traps worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.005492] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.005414] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.005269] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.005497] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.005418] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.005274] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.005500] CPU features: detected: Data independent timing control (DIT) lb # [ 0.005422] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.005277] CPU features: detected: LSE atomic instructions client # [ 0.005504] CPU features: detected: E0PD lb # [ 0.005425] CPU features: detected: E0PD worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.005280] CPU features: detected: Privileged Access Never client # [ 0.005507] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.005428] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.005283] CPU features: detected: PMUv3 client # [ 0.005514] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.005286] CPU features: detected: RAS Extension Support worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.005431] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.005518] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.005289] CPU features: detected: RASv1p1 Extension Support lb # [ 0.005434] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.005521] CPU features: detected: Fine Grained Traps worker2 # [ 0.005291] CPU features: detected: Random Number Generator lb # [ 0.005438] CPU features: detected: Fine Grained Traps worker1 # [ 0.000032] arm-pv: using stolen time PV worker2 # [ 0.005294] CPU features: detected: Speculation barrier (SB) client # [ 0.005526] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.005442] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.000509] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.005297] CPU features: detected: Stage-2 Force Write-Back client # [ 0.005532] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.005448] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.000695] Console: colour dummy device 80x25 client # [ 0.005535] CPU features: detected: LSE atomic instructions worker2 # [ 0.005300] CPU features: detected: TLB range maintenance instructions lb # [ 0.005451] CPU features: detected: LSE atomic instructions worker1 # [ 0.000703] printk: legacy console [tty0] enabled client # [ 0.005539] CPU features: detected: Privileged Access Never worker2 # [ 0.005305] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.005454] CPU features: detected: Privileged Access Never client # [ 0.005542] CPU features: detected: PMUv3 lb # [ 0.005457] CPU features: detected: PMUv3 worker1 # [ 0.000906] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.005344] alternatives: applying system-wide alternatives client # [ 0.005545] CPU features: detected: RAS Extension Support lb # [ 0.005460] CPU features: detected: RAS Extension Support worker1 # [ 0.000914] pid_max: default: 32768 minimum: 301 worker2 # [ 0.008454] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.005463] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.000986] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.001208] landlock: Up and running. client # [ 0.005547] CPU features: detected: RASv1p1 Extension Support lb # [ 0.005466] CPU features: detected: Random Number Generator worker1 # [ 0.001210] Yama: becoming mindful. worker2 # [ 0.008734] Memory: 1406592K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) client # [ 0.005550] CPU features: detected: Random Number Generator worker1 # [ 0.001791] LSM support for eBPF active lb # [ 0.005469] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.009151] devtmpfs: initialized client # [ 0.005552] CPU features: detected: Speculation barrier (SB) lb # [ 0.005472] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.001970] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.011060] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.005556] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.005475] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.002003] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.005559] CPU features: detected: TLB range maintenance instructions lb # [ 0.005482] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.003581] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.005563] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.011083] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.005523] alternatives: applying system-wide alternatives worker1 # [ 0.004332] rcu: Hierarchical SRCU implementation. client # [ 0.005603] alternatives: applying system-wide alternatives lb # [ 0.008588] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.004338] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.011274] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.011278] 0 pages in range for non-PLT usage worker1 # [ 0.005556] fsl-mc MSI: its@8080000 domain created client # [ 0.008607] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.011279] 508288 pages in range for PLT usage worker1 # [ 0.005649] EFI services will not be available. worker1 # [ 0.005724] smp: Bringing up secondary CPUs ... worker2 # [ 0.011394] pinctrl core: initialized pinctrl subsystem lb # [ 0.008771] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) lb # [ 0.009161] devtmpfs: initialized worker1 # [ 0.005733] smp: Brought up 1 node, 1 CPU client # [ 0.008776] Memory: 1406516K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker2 # [ 0.012184] DMI not present or invalid. client # [ 0.009201] devtmpfs: initialized worker1 # [ 0.005736] SMP: Total of 1 processors activated. worker2 # [ 0.015790] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.011147] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.005742] CPU: All CPU(s) started at EL1 client # [ 0.011172] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.018081] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.005754] CPU features: detected: Branch Target Identification client # [ 0.011196] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.018283] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.005759] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.011171] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.011402] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.018492] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.011373] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.005762] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.011407] 0 pages in range for non-PLT usage lb # [ 0.011378] 0 pages in range for non-PLT usage worker2 # [ 0.018518] audit: initializing netlink subsys (disabled) client # [ 0.011408] 508288 pages in range for PLT usage lb # [ 0.011379] 508288 pages in range for PLT usage worker1 # [ 0.005766] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.011507] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.019148] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.011497] pinctrl core: initialized pinctrl subsystem client # [ 0.012315] DMI not present or invalid. worker1 # [ 0.005770] CPU features: detected: Common not Private translations worker2 # [ 0.019150] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.012274] DMI not present or invalid. worker1 # [ 0.005773] CPU features: detected: CRC32 instructions client # [ 0.015955] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.019154] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.015935] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.018256] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.005775] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.019159] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.018189] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.019161] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.005779] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.018454] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.018388] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.005782] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.019186] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.018657] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.018594] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.005785] CPU features: detected: E0PD worker2 # [ 0.019195] cpuidle: using governor ladder client # [ 0.018684] audit: initializing netlink subsys (disabled) worker2 # [ 0.019201] cpuidle: using governor menu lb # [ 0.018619] audit: initializing netlink subsys (disabled) worker1 # [ 0.005787] CPU features: detected: Enhanced Counter Virtualization client # [ 0.019311] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.019403] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.019263] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.005790] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.019313] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.019419] ASID allocator initialised with 65536 entries lb # [ 0.019265] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.005793] CPU features: detected: Enhanced Virtualization Traps client # [ 0.019317] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.020672] Serial: AMBA PL011 UART driver lb # [ 0.019269] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.005796] CPU features: detected: Fine Grained Traps client # [ 0.019323] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.025945] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.019275] thermal_sys: Registered thermal governor 'user_space' client # [ 0.019326] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.005800] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.026111] printk: console [ttyAMA0] enabled lb # [ 0.019277] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.005806] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.019353] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.005808] CPU features: detected: LSE atomic instructions lb # [ 0.019305] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.019361] cpuidle: using governor ladder lb # [ 0.019313] cpuidle: using governor ladder client # [ 0.019368] cpuidle: using governor menu worker1 # [ 0.005812] CPU features: detected: Privileged Access Never lb # [ 0.019319] cpuidle: using governor menu worker1 # [ 0.005814] CPU features: detected: PMUv3 client # [ 0.019574] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.019517] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.019591] ASID allocator initialised with 65536 entries lb # [ 0.019532] ASID allocator initialised with 65536 entries client # [ 0.020868] Serial: AMBA PL011 UART driver worker1 # [ 0.005817] CPU features: detected: RAS Extension Support lb # [ 0.020753] Serial: AMBA PL011 UART driver worker1 # [ 0.005820] CPU features: detected: RASv1p1 Extension Support client # [ 0.026262] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.005822] CPU features: detected: Random Number Generator lb # [ 0.026318] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.026406] printk: console [ttyAMA0] enabled lb # [ 0.026495] printk: console [ttyAMA0] enabled worker1 # [ 0.005825] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.005828] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.005831] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.005836] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.005876] alternatives: applying system-wide alternatives worker1 # [ 0.008963] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.146648] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.146674] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.146679] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.009158] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.009583] devtmpfs: initialized worker2 # [ 0.146684] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.011509] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.146689] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.011535] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.146693] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.011723] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.146697] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.146947] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.011728] 0 pages in range for non-PLT usage lb # [ 0.147375] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.146967] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.146702] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.011729] 508288 pages in range for PLT usage lb # [ 0.147394] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.011832] pinctrl core: initialized pinctrl subsystem client # [ 0.146973] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.147399] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.012620] DMI not present or invalid. client # [ 0.146986] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.147404] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.016158] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.146994] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.154590] fbcon: Taking over console lb # [ 0.147408] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.018398] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.154608] ACPI: Interpreter disabled. client # [ 0.146998] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.147413] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.018616] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.147003] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.147417] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.147007] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.018826] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.147421] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.018856] audit: initializing netlink subsys (disabled) worker1 # [ 0.019453] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.019455] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.154395] fbcon: Taking over console lb # [ 0.154818] fbcon: Taking over console client # [ 0.154413] ACPI: Interpreter disabled. worker1 # [ 0.019459] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.154836] ACPI: Interpreter disabled. worker1 # [ 0.019464] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.156758] iommu: Default domain type: Translated worker1 # [ 0.019467] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.156768] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.162336] iommu: Default domain type: Translated worker1 # [ 0.019515] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.158515] SCSI subsystem initialized worker1 # [ 0.019524] cpuidle: using governor ladder worker2 # [ 0.162348] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.019530] cpuidle: using governor menu worker2 # [ 0.162753] SCSI subsystem initialized worker1 # [ 0.019728] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.019746] ASID allocator initialised with 65536 entries worker2 # [ 0.164864] usbcore: registered new interface driver usbfs worker1 # [ 0.020901] Serial: AMBA PL011 UART driver worker2 # [ 0.164898] usbcore: registered new interface driver hub worker2 # [ 0.164917] usbcore: registered new device driver usb worker1 # [ 0.026262] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.165216] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.026437] printk: console [ttyAMA0] enabled client # [ 0.163137] iommu: Default domain type: Translated worker2 # [ 0.165224] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.165244] PTP clock support registered lb # [ 0.163716] usbcore: registered new interface driver usbfs client # [ 0.163149] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.165311] EDAC MC: Ver: 3.0.0 client # [ 0.163514] SCSI subsystem initialized lb # [ 0.163749] usbcore: registered new interface driver hub lb # [ 0.163774] usbcore: registered new device driver usb worker2 # [ 0.170085] scmi_core: SCMI protocol bus registered client # [ 0.165509] usbcore: registered new interface driver usbfs lb # [ 0.164055] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.171155] FPGA manager framework client # [ 0.165541] usbcore: registered new interface driver hub worker2 # [ 0.172130] vgaarb: loaded lb # [ 0.164061] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.165568] usbcore: registered new device driver usb lb # [ 0.164088] PTP clock support registered client # [ 0.165850] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.164145] EDAC MC: Ver: 3.0.0 worker2 # [ 0.172801] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.168804] scmi_core: SCMI protocol bus registered client # [ 0.165856] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.165867] PTP clock support registered client # [ 0.165918] EDAC MC: Ver: 3.0.0 lb # [ 0.169781] FPGA manager framework lb # [ 0.170756] vgaarb: loaded client # [ 0.170575] scmi_core: SCMI protocol bus registered worker2 # [ 0.175777] VFS: Disk quotas dquot_6.6.0 lb # [ 0.171415] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.147827] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.171554] FPGA manager framework worker2 # [ 0.175820] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.172496] vgaarb: loaded worker1 # [ 0.147846] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.147852] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.173151] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.147857] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.147861] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.174996] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.179701] netfs: FS-Cache loaded worker2 # [ 0.179865] pnp: PnP ACPI: disabled worker1 # [ 0.147865] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.175034] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.147870] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.147874] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.177614] VFS: Disk quotas dquot_6.6.0 lb # [ 0.177663] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.178801] netfs: FS-Cache loaded lb # [ 0.179351] netfs: FS-Cache loaded client # [ 0.178905] pnp: PnP ACPI: disabled worker1 # [ 0.155426] fbcon: Taking over console lb # [ 0.179937] pnp: PnP ACPI: disabled worker1 # [ 0.155443] ACPI: Interpreter disabled. worker2 # [ 0.184167] NET: Registered PF_INET protocol family worker2 # [ 0.184465] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.182882] NET: Registered PF_INET protocol family client # [ 0.183155] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.183533] NET: Registered PF_INET protocol family worker1 # [ 0.164130] iommu: Default domain type: Translated lb # [ 0.183826] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.164142] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.164488] SCSI subsystem initialized worker1 # [ 0.166516] usbcore: registered new interface driver usbfs worker1 # [ 0.166548] usbcore: registered new interface driver hub worker1 # [ 0.166566] usbcore: registered new device driver usb worker1 # [ 0.166885] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.166890] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.166901] PTP clock support registered worker1 # [ 0.166952] EDAC MC: Ver: 3.0.0 worker1 # [ 0.171646] scmi_core: SCMI protocol bus registered worker1 # [ 0.172666] FPGA manager framework worker1 # [ 0.173719] vgaarb: loaded worker1 # [ 0.174400] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.179080] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.179121] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.180802] netfs: FS-Cache loaded worker1 # [ 0.180937] pnp: PnP ACPI: disabled worker1 # [ 0.184822] NET: Registered PF_INET protocol family worker1 # [ 0.185099] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.216216] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.216279] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.216319] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.216412] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.215094] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.216557] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.215155] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.216665] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.215190] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.216708] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.215277] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.216751] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.219249] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.219347] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.219386] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.213480] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.213540] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.213574] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.213663] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.213808] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.213901] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.213949] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.221931] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.213988] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.224072] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.222039] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.214100] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.224103] NET: Registered PF_XDP protocol family lb # [ 0.222064] NET: Registered PF_XDP protocol family client # [ 0.214130] NET: Registered PF_XDP protocol family worker2 # [ 0.224126] PCI: CLS 0 bytes, default 64 lb # [ 0.222086] PCI: CLS 0 bytes, default 64 client # [ 0.214150] PCI: CLS 0 bytes, default 64 worker2 # [ 0.224394] Trying to unpack rootfs image as initramfs... lb # [ 0.222365] Trying to unpack rootfs image as initramfs... client # [ 0.214388] Trying to unpack rootfs image as initramfs... worker2 # [ 0.235338] kvm [1]: HYP mode not available client # [ 0.230897] kvm [1]: HYP mode not available lb # [ 0.235458] kvm [1]: HYP mode not available worker1 # [ 0.215839] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.215901] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.215935] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.216023] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.216168] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.216279] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.216320] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.216368] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.216475] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.216505] NET: Registered PF_XDP protocol family worker1 # [ 0.216524] PCI: CLS 0 bytes, default 64 worker1 # [ 0.216772] Trying to unpack rootfs image as initramfs... worker1 # [ 0.232440] kvm [1]: HYP mode not available worker2 # [ 0.353480] Initialise system trusted keyrings worker2 # [ 0.354290] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.355653] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.356426] 9p: Installing v9fs 9p2000 file system support client # [ 0.353800] Initialise system trusted keyrings client # [ 0.354579] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.355864] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.356630] 9p: Installing v9fs 9p2000 file system support lb # [ 0.360023] Initialise system trusted keyrings lb # [ 0.360806] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.362168] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.362953] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.355117] Initialise system trusted keyrings worker1 # [ 0.355902] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.385116] Key type asymmetric registered worker1 # [ 0.357236] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.385148] Asymmetric key parser 'x509' registered worker1 # [ 0.358021] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.385242] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.387409] io scheduler mq-deadline registered worker2 # [ 0.387421] io scheduler kyber registered client # [ 0.385286] Key type asymmetric registered client # [ 0.385316] Asymmetric key parser 'x509' registered client # [ 0.385389] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.387572] io scheduler mq-deadline registered client # [ 0.387583] io scheduler kyber registered lb # [ 0.391681] Key type asymmetric registered lb # [ 0.391710] Asymmetric key parser 'x509' registered worker2 # [ 0.396975] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.391782] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.393981] io scheduler mq-deadline registered lb # [ 0.393993] io scheduler kyber registered worker2 # [ 0.398462] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.398943] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.397321] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.398962] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.398975] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.398993] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.398763] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.399021] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.399161] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.399048] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.399181] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.399130] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.399141] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.403667] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.399194] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.399148] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.399202] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.399153] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.399232] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.399158] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.405110] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.399257] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.399222] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.405535] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.399334] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.399689] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.399344] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.399882] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.405553] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.399350] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.399900] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.386758] Key type asymmetric registered lb # [ 0.405565] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.399356] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.399931] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.386789] Asymmetric key parser 'x509' registered worker2 # [ 0.399947] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.399360] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.405574] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.386863] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.399452] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.388970] io scheduler mq-deadline registered worker2 # [ 0.400415] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.405595] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.388981] io scheduler kyber registered worker2 # [ 0.400605] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.399902] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.405622] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.400622] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.400089] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.405798] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.400652] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.400107] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.405808] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.400136] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.405815] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.400153] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.405820] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.400612] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.405826] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.400798] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.405886] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.400814] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.400844] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.406358] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.406551] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.406568] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.420406] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.406599] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.420599] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.406615] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.398538] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.420616] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.407068] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.420646] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.407257] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.425192] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.421114] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.425394] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.407273] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.425412] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.407303] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.399928] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.425443] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.400320] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.425916] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.426969] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.400337] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.426102] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.427158] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.426118] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.427175] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.400351] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.426151] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.427205] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.400359] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.426621] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.400392] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.426806] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.426822] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.400416] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.426875] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.400507] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.400517] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.427340] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.400523] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.427527] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.427543] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.400528] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.427574] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.400533] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.428046] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.400593] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.428235] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.401046] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.428252] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.401239] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.428282] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.401256] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.428299] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.401292] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.433377] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.401308] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.433408] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.401784] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.433441] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.401974] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.401991] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.433961] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.435786] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.434167] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.435993] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.445685] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.402021] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.436011] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.434184] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.445882] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.436044] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.434215] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.445913] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.436517] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.446395] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.434684] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.436701] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.434872] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.446583] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.436716] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.434889] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.446612] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.436746] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.434920] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.447018] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.437199] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.435391] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.447200] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.437381] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.435579] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.447456] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.437397] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.435596] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.447737] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.437426] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.435626] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.447755] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.435643] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.437880] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.447784] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.438070] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.436140] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.448280] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.438087] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.436332] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.448471] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.438131] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.436364] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.448487] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.438147] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.448518] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.436819] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.438605] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.437008] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.438794] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.437038] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.426535] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.438824] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.437444] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.426767] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.439288] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.426784] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.437627] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.439502] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.426813] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.437877] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.439533] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.438196] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.427305] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.438220] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.439928] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.427497] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.438249] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.440112] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.427513] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.427546] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.438720] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.440376] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.438913] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.440677] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.428015] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.438929] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.440694] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.428205] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.438960] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.440724] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.428221] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.439569] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.428251] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.441202] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.439581] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.441387] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.428727] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.441403] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.469346] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.439587] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.428924] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.441432] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.428940] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.469380] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.439633] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.442015] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.428970] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.469386] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.439682] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.442027] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.429443] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.469443] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.439731] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.429635] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.442032] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.469493] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.439778] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.429651] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.442077] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.429681] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.469542] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.439826] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.442139] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.429696] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.469591] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.439874] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.442187] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.430180] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.469640] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.439922] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.430372] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.442233] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.469689] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.439970] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.430415] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.442279] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.469739] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.440018] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.430893] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.442326] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.469788] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.440083] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.431087] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.442372] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.440130] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.469837] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.431117] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.442418] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.440153] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.470007] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.431525] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.442465] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.440176] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.470056] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.431715] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.440200] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.470078] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.442538] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.431969] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.440224] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.442584] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.470100] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.432290] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.440246] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.432307] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.442606] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.470124] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.440270] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.432338] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.470149] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.442628] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.440293] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.470171] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.442651] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.432812] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.440315] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.433000] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.442675] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.470193] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.440338] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.433016] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.442698] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.470215] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.440362] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.433046] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.470237] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.442720] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.440385] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.433633] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.470259] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.442742] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.440408] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.433644] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.442764] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.470284] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.440431] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.470307] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.442786] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.433650] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.440453] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.470328] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.442808] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.440475] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.433695] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.470350] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.442831] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.440498] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.433742] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.470371] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.442852] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.440520] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.470393] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.433788] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.442873] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.440543] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.470414] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.442895] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.440566] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.433834] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.470436] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.440589] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.442917] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.433881] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.470457] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.442938] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.440616] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.470479] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.433927] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.440627] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.442960] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.470501] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.442981] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.440631] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.433974] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.470529] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.443003] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.434021] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.470539] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.443025] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.470544] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.434067] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.443052] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.471763] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.443062] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.434145] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.443066] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.434192] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.434213] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.434235] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.434256] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.434280] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.434301] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.434323] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.434344] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.434366] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.434388] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.505896] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.508338] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.490503] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.490549] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.490573] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.490598] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.523245] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.490646] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.490668] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.490691] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.490714] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.490738] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.490761] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.490784] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.490820] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.490829] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.490835] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.492040] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.526942] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.529413] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.533581] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.540347] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.542896] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.537271] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.540889] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.543035] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.545046] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.544983] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.547242] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.549294] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.551667] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.529014] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.554473] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.555519] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.532263] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.557329] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.562115] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.564284] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.576065] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.565389] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.542522] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.569696] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.571976] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.544701] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.567632] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.546791] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.569849] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.572183] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.548960] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.574475] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.582134] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.584535] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.583234] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.559678] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.561917] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.584929] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.587393] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.601982] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.573845] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.593840] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.606434] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.609931] msm_serial: driver initialized worker2 # [ 0.610123] SuperH (H)SCI(F) driver initialized worker2 # [ 0.610183] STM32 USART driver initialized lb # [ 0.608740] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.584064] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.609189] msm_serial: driver initialized client # [ 0.609330] SuperH (H)SCI(F) driver initialized client # [ 0.609384] STM32 USART driver initialized lb # [ 0.611627] msm_serial: driver initialized lb # [ 0.611765] SuperH (H)SCI(F) driver initialized lb # [ 0.611823] STM32 USART driver initialized worker1 # [ 0.595130] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.601177] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.607772] msm_serial: driver initialized worker1 # [ 0.607949] SuperH (H)SCI(F) driver initialized worker1 # [ 0.608006] STM32 USART driver initialized worker2 # [ 0.640881] loop: module loaded worker2 # [ 0.641085] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.641896] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.646383] loop: module loaded client # [ 0.646607] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.648083] loop: module loaded client # [ 0.647387] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.648304] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.649027] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.653560] megasas: 07.734.00.00-rc1 worker2 # [ 0.654364] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.656465] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.656501] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.653877] megasas: 07.734.00.00-rc1 client # [ 0.654698] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.656663] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.656690] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.661875] Using buffer write method worker2 # [ 0.661970] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.663864] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.663901] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.660263] megasas: 07.734.00.00-rc1 lb # [ 0.661041] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.666691] Using buffer write method lb # [ 0.663164] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.666777] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.663195] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.668369] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.668404] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.665046] Using buffer write method worker1 # [ 0.646749] loop: module loaded lb # [ 0.665130] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.646977] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.666998] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.647859] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.667031] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.681927] Using buffer write method worker2 # [ 0.681992] Concatenating MTD devices: worker2 # [ 0.681997] (0): "0.flash" worker2 # [ 0.682001] (1): "0.flash" worker2 # [ 0.682005] into device "0.flash" worker1 # [ 0.652286] megasas: 07.734.00.00-rc1 client # [ 0.682374] Using buffer write method client # [ 0.682421] Concatenating MTD devices: client # [ 0.682425] (0): "0.flash" worker1 # [ 0.653044] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.682429] (1): "0.flash" client # [ 0.682433] into device "0.flash" worker1 # [ 0.656252] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.656281] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.658039] Using buffer write method lb # [ 0.687157] Using buffer write method worker1 # [ 0.658112] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.687203] Concatenating MTD devices: lb # [ 0.687207] (0): "0.flash" lb # [ 0.687212] (1): "0.flash" lb # [ 0.687215] into device "0.flash" worker1 # [ 0.671556] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.671599] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.673043] Using buffer write method worker1 # [ 0.673074] Concatenating MTD devices: worker1 # [ 0.673078] (0): "0.flash" worker1 # [ 0.673082] (1): "0.flash" worker1 # [ 0.673085] into device "0.flash" client # [ 0.936232] Freeing initrd memory: 26160K worker2 # [ 0.941865] Freeing initrd memory: 26148K client # [ 0.942364] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.948179] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.943729] Freeing initrd memory: 26140K worker2 # [ 0.952113] thunder_xcv, ver 1.0 worker2 # [ 0.952166] thunder_bgx, ver 1.0 worker2 # [ 0.952190] nicpf, ver 1.0 worker2 # [ 0.952773] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.949793] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.946262] thunder_xcv, ver 1.0 worker2 # [ 0.952781] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.946308] thunder_bgx, ver 1.0 client # [ 0.946331] nicpf, ver 1.0 client # [ 0.946901] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.946908] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.955396] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.946932] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.955412] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.946939] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.955456] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.946970] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.955462] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.946975] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.955488] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.953718] thunder_xcv, ver 1.0 client # [ 0.947004] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.953768] thunder_bgx, ver 1.0 worker2 # [ 0.955494] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.953792] nicpf, ver 1.0 client # [ 0.947010] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.955647] sky2: driver version 1.30 lb # [ 0.954363] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.947152] sky2: driver version 1.30 lb # [ 0.954371] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.948764] usbcore: registered new interface driver usb-storage lb # [ 0.954395] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.948819] usbcore: registered new interface driver usbserial_generic lb # [ 0.954404] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.948834] usbserial: USB Serial support registered for generic worker2 # [ 0.962174] usbcore: registered new interface driver usb-storage lb # [ 0.954435] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.949876] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.962235] usbcore: registered new interface driver usbserial_generic lb # [ 0.954441] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.949902] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.962250] usbserial: USB Serial support registered for generic lb # [ 0.954465] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.962927] hv_vmbus: registering driver hyperv_keyboard client # [ 0.950120] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.954470] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.954608] sky2: driver version 1.30 client # [ 0.961807] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.967252] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.962158] hub 1-0:1.0: USB hub found client # [ 0.962193] hub 1-0:1.0: 6 ports detected worker2 # [ 0.967286] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.967577] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.964641] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.963482] usbcore: registered new interface driver usb-storage worker2 # [ 0.970256] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.963543] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.943782] Freeing initrd memory: 26148K client # [ 0.966249] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.963559] usbserial: USB Serial support registered for generic worker2 # [ 0.970291] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:22:41 UTC (1789906961) lb # [ 0.964208] hv_vmbus: registering driver hyperv_keyboard client # [ 0.966285] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:22:41 UTC (1789906961) worker2 # [ 0.970659] i2c_dev: i2c /dev entries driver client # [ 0.966589] i2c_dev: i2c /dev entries driver lb # [ 0.965617] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.965643] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 0.965876] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.971373] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.971404] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:22:41 UTC (1789906961) worker2 # [ 0.975885] sdhci: Secure Digital Host Controller Interface driver client # [ 0.971443] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.949915] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.975899] sdhci: Copyright(c) Pierre Ossman client # [ 0.971453] sdhci: Copyright(c) Pierre Ossman lb # [ 0.973553] i2c_dev: i2c /dev entries driver worker2 # [ 0.976177] Synopsys Designware Multimedia Card Interface Driver client # [ 0.971716] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.976569] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 0.972091] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.976839] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.977200] hub 1-0:1.0: USB hub found worker2 # [ 0.977224] hub 1-0:1.0: 6 ports detected client # [ 0.976640] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.953993] thunder_xcv, ver 1.0 client # [ 0.976890] usbcore: registered new interface driver usbhid worker1 # [ 0.954040] thunder_bgx, ver 1.0 client # [ 0.976896] usbhid: USB HID core driver worker1 # [ 0.954063] nicpf, ver 1.0 worker2 # [ 0.983760] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.976879] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.984007] usbcore: registered new interface driver usbhid lb # [ 0.976891] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.984014] usbhid: USB HID core driver lb # [ 0.977168] Synopsys Designware Multimedia Card Interface Driver client # [ 0.979810] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.977571] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.979262] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.955905] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.982457] drop_monitor: Initializing network drop monitor service lb # [ 0.979463] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.955917] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.982604] NET: Registered PF_INET6 protocol family lb # [ 0.979777] hub 1-0:1.0: USB hub found worker1 # [ 0.955942] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.979797] hub 1-0:1.0: 6 ports detected worker2 # [ 0.986989] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.984585] Segment Routing with IPv6 worker1 # [ 0.955951] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.984609] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.988588] drop_monitor: Initializing network drop monitor service worker1 # [ 0.955980] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.984640] NET: Registered PF_PACKET protocol family worker2 # [ 0.988788] NET: Registered PF_INET6 protocol family worker1 # [ 0.955986] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.985220] usbcore: registered new interface driver usbhid lb # [ 0.985230] usbhid: USB HID core driver worker1 # [ 0.956009] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.991761] Segment Routing with IPv6 worker2 # [ 0.991782] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.956015] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.991823] NET: Registered PF_PACKET protocol family worker1 # [ 0.956151] sky2: driver version 1.30 worker1 # [ 0.957760] usbcore: registered new interface driver usb-storage client # [ 0.986528] 9pnet: Installing 9P2000 support client # [ 0.988757] Key type dns_resolver registered worker1 # [ 0.957846] usbcore: registered new interface driver usbserial_generic lb # [ 0.987591] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.957861] usbserial: USB Serial support registered for generic lb # [ 0.989150] drop_monitor: Initializing network drop monitor service worker1 # [ 0.959142] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.989304] NET: Registered PF_INET6 protocol family worker1 # [ 0.959174] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.993563] 9pnet: Installing 9P2000 support lb # [ 0.992385] Segment Routing with IPv6 worker2 # [ 0.995843] Key type dns_resolver registered worker1 # [ 0.959350] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.992417] In-situ OAM (IOAM) with IPv6 lb # [ 0.992448] NET: Registered PF_PACKET protocol family worker1 # [ 0.970048] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.970450] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.994140] 9pnet: Installing 9P2000 support worker1 # [ 0.972581] hub 1-0:1.0: USB hub found worker1 # [ 0.973091] hub 1-0:1.0: 6 ports detected client # [ 0.995600] registered taskstats version 1 client # [ 0.995759] Loading compiled-in X.509 certificates worker1 # [ 0.974203] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.974234] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T12:22:41 UTC (1789906961) lb # [ 0.996994] Key type dns_resolver registered worker2 # [ 1.002939] registered taskstats version 1 worker1 # [ 0.976417] i2c_dev: i2c /dev entries driver worker2 # [ 1.003108] Loading compiled-in X.509 certificates client # [ 1.004683] Demotion targets for Node 0: null client # [ 1.004800] Key type .fscrypt registered worker1 # [ 0.979736] sdhci: Secure Digital Host Controller Interface driver client # [ 1.004807] Key type fscrypt-provisioning registered worker1 # [ 0.979745] sdhci: Copyright(c) Pierre Ossman client # [ 1.004903] ima: No TPM chip found, activating TPM-bypass! lb # [ 1.003440] registered taskstats version 1 worker1 # [ 0.980016] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 1.011727] Demotion targets for Node 0: null client # [ 1.004923] ima: Allocated hash algorithm: sha1 worker2 # [ 1.011848] Key type .fscrypt registered lb # [ 1.003609] Loading compiled-in X.509 certificates client # [ 1.004946] ima: No architecture policies found worker1 # [ 0.980391] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 1.011855] Key type fscrypt-provisioning registered worker1 # [ 0.982099] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 1.011953] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.982329] usbcore: registered new interface driver usbhid client # [ 1.009134] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 1.011973] ima: Allocated hash algorithm: sha1 worker1 # [ 0.982335] usbhid: USB HID core driver worker2 # [ 1.011994] ima: No architecture policies found worker2 # [ 1.016219] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 1.012496] Demotion targets for Node 0: null lb # [ 1.012612] Key type .fscrypt registered worker1 # [ 0.988008] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 1.012618] Key type fscrypt-provisioning registered lb # [ 1.012718] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.989514] drop_monitor: Initializing network drop monitor service lb # [ 1.012738] ima: Allocated hash algorithm: sha1 worker1 # [ 0.989662] NET: Registered PF_INET6 protocol family lb # [ 1.012766] ima: No architecture policies found worker1 # [ 0.992878] Segment Routing with IPv6 worker1 # [ 0.992898] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.992951] NET: Registered PF_PACKET protocol family lb # [ 1.017351] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.994906] 9pnet: Installing 9P2000 support worker1 # [ 0.997456] Key type dns_resolver registered client # [ 1.027436] clk: Disabling unused clocks client # [ 1.027477] PM: genpd: Disabling unused power domains worker1 # [ 1.004518] registered taskstats version 1 worker1 # [ 1.004673] Loading compiled-in X.509 certificates worker2 # [ 1.034789] clk: Disabling unused clocks client # [ 1.031773] Freeing unused kernel memory: 4736K worker2 # [ 1.034852] PM: genpd: Disabling unused power domains client # [ 1.031977] Run /init as init process worker2 # [ 1.039215] Freeing unused kernel memory: 4736K worker2 # [ 1.039412] Run /init as init process worker1 # [ 1.013446] Demotion targets for Node 0: null worker1 # [ 1.013567] Key type .fscrypt registered lb # [ 1.036149] clk: Disabling unused clocks worker1 # [ 1.013574] Key type fscrypt-provisioning registered lb # [ 1.036186] PM: genpd: Disabling unused power domains worker1 # [ 1.013681] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 1.013701] ima: Allocated hash algorithm: sha1 worker1 # [ 1.013723] ima: No architecture policies found lb # [ 1.040532] Freeing unused kernel memory: 4736K lb # [ 1.040724] Run /init as init process worker1 # [ 1.017983] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 1.047506] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.055814] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.057782] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.036893] clk: Disabling unused clocks worker1 # [ 1.036929] PM: genpd: Disabling unused power domains worker1 # [ 1.041327] Freeing unused kernel memory: 4736K worker1 # [ 1.041532] Run /init as init process worker1 # [ 1.056841] systemd[1]: Successfully made /usr/ read-only. client # [ 1.209254] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.224910] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.231500] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.218490] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.359085] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.379652] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.382285] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.383923] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.388932] systemd[1]: Detected virtualization qemu. client # [ 1.388987] systemd[1]: Detected architecture arm64. client # [ 1.388996] systemd[1]: Running in initrd. client # [ 1.389606] systemd[1]: Initializing machine ID from random generator. client # [ 1.389762] systemd[1]: Hostname set to . worker2 # [ 1.390894] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.402390] systemd[1]: Detected virtualization qemu. worker2 # [ 1.404221] systemd[1]: Detected architecture arm64. worker1 # [ 1.372999] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.405989] systemd[1]: Running in initrd. lb # [ 1.392708] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.408363] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.411078] systemd[1]: Hostname set to . lb # [ 1.405322] systemd[1]: Detected virtualization qemu. lb # [ 1.405422] systemd[1]: Detected architecture arm64. lb # [ 1.405449] systemd[1]: Running in initrd. lb # [ 1.406449] systemd[1]: Initializing machine ID from random generator. lb # [ 1.406739] systemd[1]: Hostname set to . worker1 # [ 1.391738] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.404026] systemd[1]: Detected virtualization qemu. worker1 # [ 1.406090] systemd[1]: Detected architecture arm64. worker1 # [ 1.408148] systemd[1]: Running in initrd. worker1 # [ 1.410925] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.413747] systemd[1]: Hostname set to . client # [ 1.441363] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.465131] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.471737] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.458746] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.561252] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.584914] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.591505] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.578500] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.654938] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.703488] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.716781] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.720105] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.721969] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.727227] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.728168] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.729268] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.729763] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.729301] systemd[1]: Reached target Path Units. client # [ 1.729318] systemd[1]: Reached target Slice Units. client # [ 1.729334] systemd[1]: Reached target Swaps. client # [ 1.729351] systemd[1]: Reached target Timer Units. client # [ 1.729524] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.729647] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.711550] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.729767] systemd[1]: Listening on Journal Sockets. client # [ 1.729875] systemd[1]: Listening on udev Control Socket. client # [ 1.729967] systemd[1]: Listening on udev Kernel Socket. client # [ 1.729986] systemd[1]: Reached target Socket Units. worker2 # [ 1.740292] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.738984] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.740554] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.748626] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.749767] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.749825] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.759800] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.762437] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.741591] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.743878] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.781326] systemd[1]: Starting Journal Service... client # [ 1.793547] systemd[1]: Starting Load Kernel Modules... client # [ 1.793661] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.810175] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.783240] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.813370] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.819197] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.792509] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.820369] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.821749] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.793528] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.822802] systemd[1]: Reached target Path Units. worker1 # [ 1.794781] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.823689] systemd[1]: Reached target Slice Units. worker1 # [ 1.795656] systemd[1]: Reached target Path Units. worker1 # [ 1.796323] systemd[1]: Reached target Slice Units. worker2 # [ 1.824509] systemd[1]: Reached target Swaps. worker1 # [ 1.796996] systemd[1]: Reached target Swaps. worker2 # [ 1.825291] systemd[1]: Reached target Timer Units. worker1 # [ 1.797603] systemd[1]: Reached target Timer Units. worker2 # [ 1.826305] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.798464] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.827515] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.799480] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.800409] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.828620] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.801237] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.802252] systemd[1]: Listening on udev Kernel Socket. client # [ 1.825971] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.829720] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.803085] systemd[1]: Reached target Socket Units. client # [ 1.827001] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.829836] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.829861] systemd[1]: Reached target Socket Units. worker1 # [ 1.805189] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.828701] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.833999] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.811690] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.812666] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.844610] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.845962] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.841624] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.841974] systemd[1]: Mounted Kernel Configuration File System. client # [ 1.845086] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.822481] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.847261] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.858488] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.858999] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.860267] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.836976] systemd[1]: Starting Journal Service... lb # [ 1.861609] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.862705] systemd[1]: Reached target Path Units. lb # [ 1.863551] systemd[1]: Reached target Slice Units. lb # [ 1.864383] systemd[1]: Reached target Swaps. lb # [ 1.865133] systemd[1]: Reached target Timer Units. lb # [ 1.866174] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.867420] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.868576] systemd[1]: Listening on Journal Sockets. lb # [ 1.869580] systemd[1]: Listening on udev Control Socket. lb # [ 1.870655] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.871615] systemd[1]: Reached target Socket Units. client # [ 1.872228] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.874219] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.881166] systemd[1]: Starting Journal Service... worker1 # [ 1.854179] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.883701] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.855279] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.884614] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.881216] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.883650] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.884837] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.889036] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 1.891725] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.898435] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.870853] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.905419] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.905444] [drm] features: -context_init client # [ 1.906234] [drm] number of scanouts: 1 client # [ 1.906253] [drm] number of cap sets: 0 worker1 # [ 1.882646] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.883600] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.883900] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.909512] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.884136] systemd[1]: Mounted Kernel Configuration File System. client # [ 1.912169] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.912191] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.917017] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.917913] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.918203] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.918434] systemd[1]: Mounted Kernel Configuration File System. client # [ 1.917638] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.919673] systemd[1]: Starting Journal Service... lb # [ 1.922177] systemd[1]: Starting Load Kernel Modules... lb # [ 1.923082] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.906843] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.911321] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.937283] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.912916] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.936862] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.949129] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.926537] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.956301] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.956855] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.935397] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.935654] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.935663] [drm] features: -context_init worker1 # [ 1.936407] [drm] number of scanouts: 1 worker1 # [ 1.936424] [drm] number of cap sets: 0 lb # [ 1.963957] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.964293] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.975813] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.973080] Console: switching to colour frame buffer device 160x50 lb # [ 1.971793] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.951161] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.973845] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.980908] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.954832] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.982622] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.958936] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.983023] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.983061] systemd[1]: Reached target Local File Systems. worker1 # [ 1.958961] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.993946] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.989619] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.994188] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 1.991143] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.994198] [drm] features: -context_init worker2 # [ 1.994974] [drm] number of scanouts: 1 worker2 # [ 1.994993] [drm] number of cap sets: 0 worker2 # [ 2.001531] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 2.005172] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 2.005315] systemd[1]: Finished Load Kernel Modules. lb # [ 2.011486] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 2.013544] systemd[1]: Starting Apply Kernel Variables... client # [ 2.013730] systemd[1]: Started Journal Service. worker1 # [ 1.986707] Console: switching to colour frame buffer device 160x50 worker2 # [ 2.017184] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.993665] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 2.017208] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 2.002004] systemd-modules-load[75]: Inserted module 'dm_mod' client # [ 2.009158] systemd-modules-load[75]: Module 'virtio_balloon' is built in client # [ 2.010250] systemd-modules-load[75]: Module 'virtio_console' is built in client # [ 2.011413] systemd-modules-load[75]: Inserted module 'virtio_gpu' client # [ 2.016387] systemd-modules-load[75]: Module 'virtio_rng' is built in lb # [ 2.023484] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 2.028273] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 2.028515] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 2.028524] [drm] features: -context_init lb # [ 2.029245] [drm] number of scanouts: 1 lb # [ 2.029263] [drm] number of cap sets: 0 lb # [ 2.036075] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 2.038766] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 2.015116] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 2.015517] systemd[1]: Reached target Preparation for Local File Systems. client # [ 2.029230] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.015554] systemd[1]: Reached target Local File Systems. worker1 # [ 2.023040] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.041120] Console: switching to colour frame buffer device 160x50 client # [ 2.048293] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.069509] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.070786] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 2.071845] systemd[1]: Reached target Local File Systems. lb # [ 2.059903] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 2.059931] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 2.047014] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.077478] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 2.050876] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.081041] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.087855] Console: switching to colour frame buffer device 160x50 client # [ 2.094020] systemd[1]: Finished Create System Files and Directories. lb # [ 2.108197] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 2.097390] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 2.108604] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 2.113140] systemd[1]: Finished Load Kernel Modules. lb # [ 2.108631] systemd[1]: Reached target Local File Systems. lb # [ 2.112628] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.116708] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.117086] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 2.100971] systemd[1]: Started Journal Service. worker1 # [ 2.096704] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.097950] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.099000] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.140104] systemd[1]: Finished Load Kernel Modules. client # [ 2.128660] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.147675] systemd[1]: Started Journal Service. worker1 # [ 2.107374] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.147851] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.116372] systemd-modules-load[74]: Module 'virtio_rng' is built in worker1 # [ 2.121715] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.152351] systemd-modules-load[74]: Inserted module 'dm_mod' worker2 # [ 2.153694] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.124368] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.154813] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.155895] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.136636] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker2 # [ 2.168638] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.169688] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.170756] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.146147] systemd[1]: Finished Create System Files and Directories. lb # [ 2.180837] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.197445] systemd[1]: Started Journal Service. lb # [ 2.185569] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.188352] systemd[1]: Starting Virtual Console Setup... lb # [ 2.186774] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.194676] systemd[1]: Finished Create System Files and Directories. lb # [ 2.187885] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.169917] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.204649] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 2.200456] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.205713] systemd[1]: Starting Create System Files and Directories... lb # [ 2.211187] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 2.218876] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.228781] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.248552] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.252242] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.228111] systemd[1]: Starting Virtual Console Setup... lb # [ 2.254512] systemd[1]: Finished Create System Files and Directories. lb # [ 2.261626] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.286165] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.284588] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.288145] systemd[1]: Finished Virtual Console Setup. lb # [ 2.324138] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.344582] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.348408] systemd[1]: Finished Virtual Console Setup. lb # [ 2.376554] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.380377] systemd[1]: Finished Virtual Console Setup. client # [ 2.822864] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.828128] systemd[1]: Reached target System Initialization. client # [ 2.829042] systemd[1]: Reached target Basic System. worker1 # [ 2.905961] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.935797] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.906973] systemd[1]: Reached target System Initialization. worker2 # [ 2.936912] systemd[1]: Reached target System Initialization. worker2 # [ 2.937897] systemd[1]: Reached target Basic System. worker1 # [ 2.908683] systemd[1]: Reached target Basic System. lb # [ 2.958127] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.959166] systemd[1]: Reached target System Initialization. lb # [ 2.960220] systemd[1]: Reached target Basic System. client # [ 2.963908] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.987363] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.018344] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.035993] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.082412] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.091881] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.097443] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.071760] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.103537] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.100212] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.076906] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.108781] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.111426] (udev-worker)[107]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.143213] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.149558] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.148261] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.155472] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.160610] systemd[1]: Mounting /sysroot... worker2 # [ 3.184509] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.186844] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.192666] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.167991] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.172892] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.176828] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.208395] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.212342] systemd[1]: Reached target Initrd Root Device. lb # [ 3.216936] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.249082] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.225323] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.273033] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.489494] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.460239] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.492315] systemd[1]: Mounting /sysroot... client # [ 3.499189] EXT4-fs (vda): mounted filesystem d9d6b65f-b122-4009-b3a5-9eb885862862 r/w with ordered data mode. Quota mode: none. worker1 # [ 3.465691] systemd[1]: Mounting /sysroot... lb # [ 3.488290] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.491195] systemd[1]: Mounted /sysroot. lb # [ 3.490129] systemd[1]: Mounting /sysroot... client # [ 3.493249] systemd[1]: Reached target Initrd Root File System. client # [ 3.494538] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.519014] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.539479] EXT4-fs (vda): mounted filesystem 7c01e191-bd07-4db9-a5f4-b693d5ad70b2 r/w with ordered data mode. Quota mode: none. client # [ 3.524179] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.528219] systemd[1]: Reloading... worker2 # [ 3.535360] systemd[1]: Mounted /sysroot. lb # [ 3.542814] EXT4-fs (vda): mounted filesystem 905076c0-e181-4080-837f-daf948d134a9 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.537384] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.524043] EXT4-fs (vda): mounted filesystem 080bd0e5-fce3-4c48-8ebe-ab778c805ed6 r/w with ordered data mode. Quota mode: none. lb # [ 3.535215] systemd[1]: Mounted /sysroot. worker2 # [ 3.544148] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.537259] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.515723] systemd[1]: Mounted /sysroot. worker1 # [ 3.517917] systemd[1]: Reached target Initrd Root File System. lb # [ 3.541266] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.522990] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.568364] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.568455] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.575620] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.579316] systemd[1]: Reloading... lb # [ 3.574583] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.555443] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.579537] systemd[1]: Reloading... worker1 # [ 3.560103] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.563669] systemd[1]: Reloading... client # [ 3.743652] systemd[1]: Reloading finished in 219 ms. client # [ 3.773129] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... client # [ 3.777310] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.783056] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.785747] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.793478] systemd[1]: Reloading finished in 215 ms. client # [ 3.791226] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.792385] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.791722] systemd[1]: Reloading finished in 214 ms. worker1 # [ 3.774178] systemd[1]: Reloading finished in 214 ms. client # [ 3.817850] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.823696] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.827927] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.823374] systemd-sysroot-fstab-check[121]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.835116] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.806844] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... lb # [ 3.829548] systemd-sysroot-fstab-check[121]: Requesting swap.target/start/replace... client # [ 3.835416] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.810996] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... worker2 # [ 3.841125] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.836917] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.836719] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.844833] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.839919] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.845966] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.817116] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.819974] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.846348] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.848957] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.827271] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.830380] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.853378] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.863289] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.868596] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 3.871914] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.866003] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.867693] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.854462] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.857707] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.887150] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.863353] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.875423] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.900739] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.909091] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.889358] systemd[1]: Mounting /sysroot/run... client # [ 3.916608] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.919167] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.927014] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.932185] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.911379] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.941659] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.951975] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.925773] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.950971] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.953960] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.959548] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.965954] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.964485] systemd[1]: Mounting /sysroot/run... client # [ 3.975937] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.981711] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.986430] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.963934] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.996382] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.997802] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.974295] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 4.011669] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 4.006733] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 4.017903] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.991854] systemd[1]: Mounted /sysroot/run. worker1 # [ 4.004845] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.035228] systemd[1]: Mounted /sysroot/run. lb # [ 4.029884] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 4.008250] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 4.045946] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 4.019459] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 4.058194] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.061731] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.058911] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 4.043703] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.045816] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.071582] systemd[1]: Mounted /sysroot/run. lb # [ 4.082145] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 4.090094] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.091545] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.087767] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.094917] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.125212] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.126976] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.364749] (udev-worker)[92]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.370312] (udev-worker)[92]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.398001] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.403958] systemd[1]: Stopped Virtual Console Setup. client # [ 4.405443] systemd[1]: Stopping Virtual Console Setup... client # [ 4.406343] systemd[1]: Starting Virtual Console Setup... client # [ 4.422327] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.423838] systemd[1]: Stopped Virtual Console Setup. client # [ 4.428277] systemd[1]: Starting Virtual Console Setup... client # [ 4.456969] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.460444] systemd[1]: Finished Virtual Console Setup. worker1 # [ 4.446726] (udev-worker)[105]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.455762] (udev-worker)[105]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.495373] (udev-worker)[106]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker2 # [ 4.501550] (udev-worker)[106]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.482631] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.484198] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.488265] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.489327] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.520391] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.522288] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.526490] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 4.528147] systemd[1]: Starting Virtual Console Setup... lb # [ 4.522651] (udev-worker)[94]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.506632] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.527667] (udev-worker)[94]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.508262] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.512471] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.544831] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.546388] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.540965] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.548726] systemd[1]: Starting Virtual Console Setup... lb # [ 4.546458] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.548144] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.552187] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.541041] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 4.571010] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.565031] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.544627] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.574813] systemd[1]: Finished Virtual Console Setup. lb # [ 4.567441] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.568745] systemd[1]: Starting Virtual Console Setup... lb # [ 4.590872] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.594622] systemd[1]: Finished Virtual Console Setup. client # [ 4.819058] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.888198] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.863794] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.891459] systemd[1]: Reached target Initrd File Systems. client # [ 4.897280] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.911508] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.906047] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.943050] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.931306] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.936507] systemd[1]: Reached target Initrd File Systems. client # [ 4.964214] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.942174] systemd[1]: Starting Find NixOS closure... client # [ 4.968349] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.977163] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.980998] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.952474] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.986136] systemd[1]: Starting Find NixOS closure... client # [ 4.985144] systemd[1]: Finished Find NixOS closure. client # [ 4.988255] systemd[1]: Reached target Initrd Default Target. client # [ 4.990292] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.996772] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 5.009281] systemd[1]: Mounted /sysroot/nix/store. lb # [ 5.013128] systemd[1]: Reached target Initrd File Systems. client # [ 5.017988] systemd[1]: Stopped target Initrd Default Target. client # [ 5.019474] systemd[1]: Stopped target Basic System. lb # [ 5.018406] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.996197] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 5.024393] systemd[1]: Stopped target Initrd Root Device. client # [ 5.025401] systemd[1]: Stopped target Path Units. client # [ 5.026157] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.027269] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.029445] systemd[1]: Stopped target Slice Units. worker1 # [ 5.004529] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 5.031819] systemd[1]: Stopped target Socket Units. client # [ 5.033285] systemd[1]: Stopped target System Initialization. lb # [ 5.032531] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 5.037922] systemd[1]: Stopped target Swaps. client # [ 5.040212] systemd[1]: Stopped target Timer Units. worker1 # [ 5.015730] systemd[1]: Finished Find NixOS closure. worker1 # [ 5.017905] systemd[1]: Reached target Initrd Default Target. client # [ 5.046146] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 5.050326] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.021479] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.048302] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 5.055751] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 5.052209] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.056809] systemd[1]: Stopped Find NixOS closure. client # [ 5.057710] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.060252] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.061325] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.065756] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.071148] systemd[1]: Finished Find NixOS closure. client # [ 5.067717] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 5.074151] systemd[1]: Reached target Initrd Default Target. client # [ 5.071135] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 5.076366] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.073761] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.052898] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.056499] systemd[1]: Stopped target Basic System. worker1 # [ 5.057552] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.079763] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 5.075967] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.060302] systemd[1]: Stopped target Path Units. lb # [ 5.081987] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 5.062326] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.088197] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.089494] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.065708] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.068193] systemd[1]: Stopped target Slice Units. client # [ 5.096785] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.072234] systemd[1]: Stopped target Socket Units. worker1 # [ 5.073194] systemd[1]: Stopped target System Initialization. worker1 # [ 5.074166] systemd[1]: Stopped target Swaps. lb # [ 5.097433] systemd[1]: Finished Find NixOS closure. client # [ 5.100444] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.076147] systemd[1]: Stopped target Timer Units. lb # [ 5.099667] systemd[1]: Reached target Initrd Default Target. client # [ 5.103740] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.080127] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 5.103527] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.106512] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.082460] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 5.112240] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.108345] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.111179] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.116318] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.087095] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.113773] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 5.118663] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.090315] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.091175] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.116387] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 5.122737] systemd[1]: Stopped target Basic System. worker2 # [ 5.123730] systemd[1]: Stopped target Initrd Root Device. client # [ 5.120290] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.121540] systemd[1]: systemd-udevd.service: Consumed 1.404s CPU time over 3.099s wall clock time, 22.4M memory peak. worker2 # [ 5.128201] systemd[1]: Stopped target Path Units. client # [ 5.123543] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 5.129158] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.124941] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.100921] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 5.130485] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.125959] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 5.131744] systemd[1]: Stopped target Slice Units. worker1 # [ 5.101949] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.127013] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.103137] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.127913] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.103979] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.129211] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 5.134562] systemd[1]: Stopped target Socket Units. client # [ 5.130092] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.131156] systemd[1]: Closed udev Control Socket. worker2 # [ 5.136156] systemd[1]: Stopped target System Initialization. client # [ 5.131909] systemd[1]: Starting Cleanup udev Database... worker2 # [ 5.138039] systemd[1]: Stopped target Swaps. client # [ 5.136416] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 5.143913] systemd[1]: Stopped target Timer Units. client # [ 5.139219] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.137501] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.115638] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 5.145909] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 5.147089] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.139477] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.117322] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 5.147956] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.118428] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.119515] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.144646] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.145945] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.143757] systemd[1]: Stopped target Initrd Default Target. client # [ 5.146999] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 5.145033] systemd[1]: Stopped target Basic System. lb # [ 5.145989] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.154885] systemd[1]: Stopped Find NixOS closure. client # [ 5.147993] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.150299] systemd[1]: Stopped target Path Units. worker1 # [ 5.128353] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.151256] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.129394] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.130315] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 5.153535] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.131255] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.160196] systemd[1]: Stopped target Slice Units. worker2 # [ 5.167920] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.161111] systemd[1]: Stopped target Socket Units. worker1 # [ 5.139114] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 5.169154] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.161957] systemd[1]: Stopped target System Initialization. lb # [ 5.162905] systemd[1]: Stopped target Swaps. lb # [ 5.163648] systemd[1]: Stopped target Timer Units. worker1 # [ 5.142455] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.172343] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.143535] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 5.168295] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 5.169298] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.170272] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 5.178046] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.148684] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.171553] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.149443] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.150344] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.151213] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.176211] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 5.154005] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 5.183887] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.154894] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 5.185257] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.155815] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.180910] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.179337] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.157131] systemd[1]: systemd-udevd.service: Consumed 1.420s CPU time over 3.127s wall clock time, 22.5M memory peak. worker1 # [ 5.158530] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 5.188437] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.183718] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.159497] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.182213] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.189588] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.185096] systemd[1]: Reached target Switch Root. worker1 # [ 5.160423] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.161390] systemd[1]: Closed udev Control Socket. lb # [ 5.184262] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.162085] systemd[1]: Starting Cleanup udev Database... worker2 # [ 5.191960] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.162829] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.188204] systemd[1]: Starting NixOS Activation... worker1 # [ 5.163867] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.187721] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 5.195787] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 5.196978] systemd[1]: Stopped target Local File Systems. worker2 # [ 5.198536] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 5.199534] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 5.200842] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 5.201640] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.172380] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 5.202711] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.173559] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.196454] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 5.203761] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.174816] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 5.197277] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 5.200778] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 5.208858] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.180244] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.212169] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 5.208510] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 5.216166] systemd[1]: systemd-udevd.service: Consumed 1.417s CPU time over 3.112s wall clock time, 22.5M memory peak. worker2 # [ 5.217697] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.211929] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 5.220341] systemd[1]: Closed udev Control Socket. worker2 # [ 5.221096] systemd[1]: Starting Cleanup udev Database... lb # [ 5.214365] systemd[1]: Stopped target Local File Systems. lb # [ 5.216227] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 5.224116] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 5.225227] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.218829] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.220831] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 5.228320] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 5.229498] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.224483] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.232309] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 5.225649] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.233340] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.228319] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 5.236357] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.229146] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 5.237440] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 5.230168] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.207745] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.231030] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.231949] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 5.240318] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.211071] systemd[1]: Finished Cleanup udev Database. lb # [ 5.233678] systemd[1]: systemd-udevd.service: Consumed 1.415s CPU time over 3.116s wall clock time, 22.5M memory peak. worker1 # [ 5.211849] systemd[1]: Reached target Switch Root. lb # [ 5.235151] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.236231] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 5.244292] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.237056] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.238068] systemd[1]: Closed udev Control Socket. worker1 # [ 5.216143] systemd[1]: Starting NixOS Activation... lb # [ 5.238789] systemd[1]: Starting Cleanup udev Database... lb # [ 5.239564] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.244346] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.245317] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.248429] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.252222] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 5.253287] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.263407] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 5.264671] systemd[1]: Finished Cleanup udev Database. worker2 # [ 5.268626] systemd[1]: Reached target Switch Root. worker2 # [ 5.269462] systemd[1]: Starting NixOS Activation... lb # [ 5.287104] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.288391] systemd[1]: Finished Cleanup udev Database. lb # [ 5.289163] systemd[1]: Reached target Switch Root. lb # [ 5.292262] systemd[1]: Starting NixOS Activation... client # [ 5.364887] initrd-nixos-activation-start[181]: booting system configuration /nix/store/48jbsm9kd5qiv7f4kb30g64m8mnnbmi9-nixos-system-client-test worker1 # [ 5.380277] initrd-nixos-activation-start[181]: booting system configuration /nix/store/xrykcgrr46dyc1l2vn0lvwkl791ca1wb-nixos-system-worker1-test client # [ 5.436608] initrd-nixos-activation-start[181]: running activation script... worker2 # [ 5.444224] initrd-nixos-activation-start[181]: booting system configuration /nix/store/ni25qis79is9vbds50baywbk2s5jd3jl-nixos-system-worker2-test lb # [ 5.466291] initrd-nixos-activation-start[181]: booting system configuration /nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test worker1 # [ 5.446192] initrd-nixos-activation-start[181]: running activation script... worker2 # [ 5.511942] initrd-nixos-activation-start[181]: running activation script... lb # [ 5.535656] initrd-nixos-activation-start[181]: running activation script... client # [ 5.878090] initrd-nixos-activation-start[204]: setting up /etc... worker1 # [ 5.882461] initrd-nixos-activation-start[204]: setting up /etc... worker2 # [ 5.950292] initrd-nixos-activation-start[204]: setting up /etc... lb # [ 5.970894] initrd-nixos-activation-start[204]: setting up /etc... client # [ 6.149942] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.152888] systemd[1]: Finished NixOS Activation. client # [ 6.156220] systemd[1]: Starting Switch Root... worker1 # [ 6.144256] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.145873] systemd[1]: Finished NixOS Activation. worker1 # [ 6.148231] systemd[1]: Starting Switch Root... client # [ 6.176520] systemd[1]: Switching root. worker1 # [ 6.172458] systemd[1]: Switching root. worker2 # [ 6.225828] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 6.228180] systemd[1]: Finished NixOS Activation. worker2 # [ 6.229954] systemd[1]: Starting Switch Root... lb # [ 6.240583] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 6.243423] systemd[1]: Finished NixOS Activation. worker2 # [ 6.253446] systemd[1]: Switching root. lb # [ 6.248330] systemd[1]: Starting Switch Root... lb # [ 6.268607] systemd[1]: Switching root. client # [ 6.364745] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.350085] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.429339] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.458904] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.938726] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.971004] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.950794] systemd[1]: Detected virtualization qemu. client # [ 6.977067] systemd[1]: Detected virtualization qemu. worker1 # [ 6.953942] systemd[1]: Detected architecture arm64. client # [ 6.979168] systemd[1]: Detected architecture arm64. worker1 # [ 6.956867] systemd[1]: Detected first boot. client # [ 6.982157] systemd[1]: Detected first boot. client # [ 6.987290] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.964757] systemd[1]: Initializing machine ID from random generator. worker2 # [ 7.043776] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 7.057053] systemd[1]: Detected virtualization qemu. worker2 # [ 7.060317] systemd[1]: Detected architecture arm64. worker2 # [ 7.064294] systemd[1]: Detected first boot. worker2 # [ 7.073035] systemd[1]: Initializing machine ID from random generator. lb # [ 7.074837] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 7.088197] systemd[1]: Detected virtualization qemu. lb # [ 7.091525] systemd[1]: Detected architecture arm64. lb # [ 7.095581] systemd[1]: Detected first boot. lb # [ 7.103363] systemd[1]: Initializing machine ID from random generator. worker1 # [ 7.137095] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.280129] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 7.300495] systemd[1]: Applying preset policy. worker2 # [ 7.412308] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 7.443054] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.477024] systemd[1]: Applying preset policy. worker2 # [ 7.616037] systemd[1]: Applying preset policy. lb # [ 7.612709] systemd[1]: Applying preset policy. worker1 # [ 7.765288] systemd[1]: Populated /etc with preset unit settings. client # [ 7.958513] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 8.118784] systemd[1]: Populated /etc with preset unit settings. lb # [ 8.128393] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 8.262962] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 8.264300] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.268603] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 8.272419] systemd[1]: Created slice Slice /system/getty. worker1 # [ 8.274069] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.275476] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 8.277435] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.280487] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 8.281508] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.283301] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 8.285922] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 8.287116] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.289684] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 8.290894] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.293570] systemd[1]: Reached target Path Units. worker1 # [ 8.294613] systemd[1]: Reached target Remote File Systems. worker1 # [ 8.297141] systemd[1]: Reached target Slice Units. worker1 # [ 8.298122] systemd[1]: Reached target Swaps. worker1 # [ 8.303029] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.308180] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.313241] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 8.317320] systemd[1]: Listening on Factory Reset Management. worker1 # [ 8.318652] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.324784] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.326951] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.331374] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 8.333075] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.334900] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.337225] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 8.349582] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.351130] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.352903] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.357777] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.362176] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 8.367378] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 8.379540] systemd[1]: Mounting Kernel Trace File System... client # [ 8.415427] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.416852] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.393989] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.420412] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.424278] systemd[1]: Created slice Slice /system/getty. client # [ 8.426970] systemd[1]: Created slice User and Session Slice. client # [ 8.428347] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.430455] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.432651] systemd[1]: Expecting device /dev/hvc0... client # [ 8.433812] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.409819] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 8.410224] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.435782] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.437682] systemd[1]: Stopped target initrd-fs.target. client # [ 8.439457] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.441537] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.443444] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.445454] systemd[1]: Reached target Path Units. client # [ 8.447169] systemd[1]: Reached target Remote File Systems. client # [ 8.448886] systemd[1]: Reached target Slice Units. worker1 # [ 8.425391] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.450745] systemd[1]: Reached target Swaps. worker1 # [ 8.428454] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.455393] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.435604] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 8.460254] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.464449] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.469247] systemd[1]: Listening on Factory Reset Management. client # [ 8.471704] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.447756] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.448203] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.479082] systemd[1]: Starting Journal Log Access Socket... client # [ 8.482160] systemd[1]: Listening on Journal Audit Socket. client # [ 8.487848] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.491589] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.469941] systemd[1]: Starting Journal Service... client # [ 8.494337] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.497068] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.508746] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.511333] systemd[1]: Listening on udev Control Socket. client # [ 8.513426] systemd[1]: Listening on udev Varlink Socket. client # [ 8.518517] systemd[1]: Mounting Huge Pages File System... client # [ 8.524243] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.537323] systemd[1]: Mounting Kernel Debug File System... client # [ 8.542963] systemd[1]: Mounting Kernel Trace File System... client # [ 8.560336] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 8.535064] systemd[1]: Starting Load Kernel Modules... worker1 # [ 8.551862] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 8.576977] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.578874] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.601368] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 8.577379] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 8.603272] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.606549] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.583082] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.619043] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.621402] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.601581] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 8.612050] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 8.614834] systemd[1]: Mounted Huge Pages File System. worker1 # [ 8.617185] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 8.619652] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 8.622344] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 8.625325] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 8.670276] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 8.671674] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.674852] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.678874] systemd[1]: Created slice Slice /system/getty. client # [ 8.673852] systemd[1]: Starting Journal Service... worker2 # [ 8.680629] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.682332] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.684251] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 8.686951] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.688952] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 8.690932] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 8.693085] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 8.695077] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.667193] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 8.697199] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 8.694867] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 8.699277] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 8.701483] systemd[1]: Reached target Path Units. lb # [ 8.696594] systemd[1]: Stopped initrd-switch-root.service. lb # [ 8.698291] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.703396] systemd[1]: Reached target Remote File Systems. worker1 # [ 8.675619] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 8.705473] systemd[1]: Reached target Slice Units. worker2 # [ 8.707420] systemd[1]: Reached target Swaps. lb # [ 8.703668] systemd[1]: Created slice Slice /system/getty. lb # [ 8.706504] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.711731] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 8.709073] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 8.710604] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 8.713328] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.717086] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.714388] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 8.716996] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.716195] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.721826] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 8.718178] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.719868] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.722399] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.726555] systemd[1]: Listening on Factory Reset Management. lb # [ 8.723620] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 8.728938] systemd[1]: Listening on Hostname Service Socket. lb # [ 8.726193] systemd[1]: Reached target Path Units. lb # [ 8.727196] systemd[1]: Reached target Remote File Systems. lb # [ 8.728788] systemd[1]: Reached target Slice Units. worker2 # [ 8.735089] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.730337] systemd[1]: Reached target Swaps. worker2 # [ 8.738364] systemd[1]: Listening on Journal Audit Socket. lb # [ 8.735331] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.743572] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.740482] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 8.746792] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.742517] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.744703] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.749847] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.752595] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.749389] systemd[1]: Listening on Factory Reset Management. lb # [ 8.750866] systemd[1]: Listening on Hostname Service Socket. lb # [ 8.758574] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.761594] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 8.764332] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 8.764912] systemd[1]: Listening on udev Control Socket. worker2 # [ 8.765279] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 8.772082] systemd[1]: Mounting Huge Pages File System... lb # [ 8.767875] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.770622] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.747445] EXT4-fs (vda): re-mounted 080bd0e5-fce3-4c48-8ebe-ab778c805ed6. worker2 # [ 8.776760] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 8.773130] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.775890] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 8.752523] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 8.755505] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 8.785035] systemd[1]: Mounting Kernel Debug File System... client # [ 8.784358] fuse: init (API version 7.45) lb # [ 8.787084] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.788662] systemd[1]: Listening on udev Control Socket. lb # [ 8.790394] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 8.794678] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.795594] systemd[1]: Mounting Huge Pages File System... client # [ 8.795142] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.771354] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 8.772037] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 8.772338] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 8.800795] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 8.783230] systemd[1]: Starting Load/Save OS Random Seed... client # [ 8.806288] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.812968] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 8.785010] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.811604] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 8.828083] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.826796] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 8.832184] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.837916] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.840624] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 8.844239] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 8.817231] systemd[1]: Finished Load Kernel Modules. worker2 # [ 8.849118] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.822041] systemd-journald[275]: Collecting audit messages is enabled. worker2 # [ 8.851623] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.829369] systemd[1]: Starting Firewall... client # [ 8.849705] systemd-journald[275]: Collecting audit messages is enabled. lb # [ 8.854004] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.857564] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.864168] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.860448] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 8.864623] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.846058] fuse: init (API version 7.45) client # [ 8.860322] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 8.851527] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.880175] systemd[1]: Starting Journal Service... client # [ 8.864605] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.879677] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.886486] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.886631] systemd[1]: Started Journal Service. worker1 # [ 8.850481] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 8.866122] systemd[1]: Started Journal Service. lb # [ 8.893329] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 8.882601] systemd-modules-load[276]: Module 'atkbd' is built in worker1 # [ 8.861404] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 8.887974] systemd-modules-load[276]: Module 'loop' is built in client # [ 8.891027] systemd[1]: Mounted Huge Pages File System. client # [ 8.898725] systemd[1]: Mounted POSIX Message Queue File System. client # [ 8.907355] systemd[1]: Mounted Kernel Debug File System. client # [ 8.912731] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 8.890057] systemd-modules-load[276]: Module 'atkbd' is built in client # [ 8.919787] systemd[1]: Finished Create List of Static Device Nodes. client # [ 8.923177] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 8.900576] systemd-modules-load[276]: Module 'loop' is built in client # [ 8.931084] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.933687] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 8.949644] systemd[1]: Starting Load Kernel Modules... worker1 # [ 8.910894] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 8.939412] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.945334] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.958526] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.950187] systemd[1]: Finished Load Kernel Modules. lb # [ 8.962811] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.928881] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.966118] EXT4-fs (vda): re-mounted d9d6b65f-b122-4009-b3a5-9eb885862862. worker2 # [ 8.977731] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 8.960791] systemd-oomd[277]: No swap; memory pressure usage will be degraded client # [ 8.964424] systemd[1]: Mounting FUSE Control File System... worker1 # [ 8.942155] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.969165] systemd[1]: Starting Apply Kernel Variables... client # [ 8.975959] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 8.957513] systemd-oomd[277]: No swap; memory pressure usage will be degraded client # [ 8.985657] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 9.001743] systemd[1]: Starting Journal Service... worker2 # [ 9.005593] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 9.006037] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.971028] systemd[1]: Finished Load/Save OS Random Seed. client # [ 8.997044] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 9.027115] systemd[1]: Starting Coldplug All udev Devices... lb # [ 9.025100] systemd[1]: Starting Load Kernel Modules... worker1 # [ 8.983152] systemd[1]: Reached target First Boot Complete. client # [ 9.014674] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 9.032641] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 8.993586] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 9.038187] systemd[1]: Mounted Huge Pages File System. worker2 # [ 9.041573] systemd[1]: Mounted POSIX Message Queue File System. client # [ 9.028956] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 9.045171] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 9.045699] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 9.046101] systemd[1]: Mounted Kernel Configuration File System. client # [ 9.030981] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 9.047552] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 9.032188] systemd-journald[275]: Received client request to flush runtime journal. lb # [ 9.062094] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 9.068476] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 9.064092] systemd[1]: Starting Load/Save OS Random Seed... client # [ 9.067620] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 9.084821] fuse: init (API version 7.45) worker2 # [ 9.101541] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 9.107771] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 9.114583] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 9.151256] systemd-journald[275]: Collecting audit messages is enabled. client # [ 9.150747] systemd[1]: Mounted FUSE Control File System. lb # [ 9.161872] systemd[1]: Listening on Journal Log Access Socket. lb # [ 9.162436] systemd[1]: Mounted Huge Pages File System. lb # [ 9.162874] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 9.169381] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 9.163280] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 9.128872] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 9.172926] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 9.169587] systemd[1]: Mounted Kernel Trace File System. client # [ 9.174194] systemd-journald[275]: Received client request to flush runtime journal. worker1 # [ 9.137535] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.179570] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 9.167664] systemd[1]: Queued start job for default target Multi-User System. lb # [ 9.185181] systemd[1]: Started Journal Service. worker1 # [ 9.144385] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.187564] EXT4-fs (vda): re-mounted 905076c0-e181-4080-837f-daf948d134a9. worker1 # [ 9.152434] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 9.195536] systemd[1]: Finished Load Kernel Modules. lb # [ 9.175633] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 9.201898] systemd[1]: Starting Firewall... lb # [ 9.184728] systemd-modules-load[276]: Module 'atkbd' is built in worker2 # [ 9.205097] EXT4-fs (vda): re-mounted 7c01e191-bd07-4db9-a5f4-b693d5ad70b2. lb # [ 9.190146] systemd-modules-load[276]: Module 'loop' is built in lb # [ 9.194941] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 9.217746] systemd[1]: Starting Apply Kernel Variables... lb # [ 9.201622] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 9.206804] systemd[1]: Mounted Kernel Configuration File System. lb # [ 9.211857] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 9.220315] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 9.239095] systemd-journald[275]: Collecting audit messages is enabled. lb # [ 9.223126] systemd[1]: Finished Load Kernel Modules. client # [ 9.226505] systemd[1]: Finished Apply Kernel Variables. client # [ 9.227464] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.225370] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 9.230455] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 9.250040] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 9.236727] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 9.253321] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 9.238764] systemd[1]: Reached target First Boot Complete. lb # [ 9.237756] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 9.255727] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 9.239897] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 9.266496] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 9.246843] systemd[1]: Mounting FUSE Control File System... worker2 # [ 9.267997] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.233771] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 9.258866] systemd[1]: Starting Firewall... worker1 # [ 9.237892] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 9.263875] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 9.283091] systemd[1]: Started Journal Service. worker1 # [ 9.240628] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.265743] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 9.282724] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 9.284800] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 9.280392] systemd-oomd[278]: No swap; memory pressure usage will be degraded worker1 # [ 9.262282] systemd[1]: Mounting /run/wrappers... worker2 # [ 9.306385] fuse: init (API version 7.45) worker2 # [ 9.305266] systemd-modules-load[276]: Module 'atkbd' is built in worker1 # [ 9.280506] systemd[1]: Mounting FUSE Control File System... lb # [ 9.308479] systemd[1]: Starting Load/Save OS Random Seed... client # [ 9.314656] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.315896] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.318476] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.317736] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 9.323567] systemd-modules-load[276]: Module 'loop' is built in worker2 # [ 9.337522] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 9.321381] systemd[1]: Mounted FUSE Control File System. worker2 # [ 9.352145] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 9.357536] systemd[1]: Finished Load Kernel Module fuse. lb # [ 9.352482] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 9.358015] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 9.372773] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 9.382690] systemd-oomd[277]: No swap; memory pressure usage will be degraded worker1 # [ 9.357488] systemd[1]: Mounted /run/wrappers. worker1 # [ 9.364886] systemd[1]: Reached target Local File Systems. worker1 # [ 9.366007] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 9.397200] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 9.372473] systemd[1]: Starting register-nix-paths.service... lb # [ 9.413036] systemd-journald[275]: Received client request to flush runtime journal. worker1 # [ 9.384647] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.409772] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.386111] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 9.438339] systemd-journald[275]: Received client request to flush runtime journal. worker1 # [ 9.408642] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 9.440670] systemd-udevd[307]: Using default interface naming scheme 'v261'. worker1 # [ 9.417139] systemd[1]: Starting Create System Files and Directories... client # [ 9.472411] systemd[1]: Mounted /run/wrappers. client # [ 9.474046] systemd[1]: Reached target Local File Systems. client # [ 9.476818] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.484273] systemd[1]: Starting register-nix-paths.service... client # [ 9.493830] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 9.504522] systemd[1]: Finished Apply Kernel Variables. client # [ 9.496429] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 9.507761] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 9.514373] systemd[1]: Reached target First Boot Complete. client # [ 9.509647] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 9.514220] systemd[1]: Mounted FUSE Control File System. worker2 # [ 9.524523] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 9.527344] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.522009] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 9.530784] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 9.523537] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 9.502115] systemd-udevd[314]: Using default interface naming scheme 'v261'. lb # [ 9.525856] systemd[1]: Reached target First Boot Complete. worker1 # [ 9.514787] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.542563] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.521651] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 9.557532] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.582738] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.585920] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 9.605948] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.612888] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 9.623439] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 9.624689] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 9.627401] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 9.664162] systemd[1]: Mounting /run/wrappers... worker2 # [ 9.668151] systemd[1]: Mounting FUSE Control File System... worker1 # [ 9.647253] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.654506] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.695461] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 9.663009] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.694664] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 9.697576] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 9.702905] systemd[1]: Mounting /run/wrappers... worker2 # [ 9.720841] systemd[1]: Mounted FUSE Control File System. lb # [ 9.713387] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 9.766524] systemd[1]: Mounted /run/wrappers. worker2 # [ 9.768251] systemd[1]: Reached target Local File Systems. client # [ 9.770619] systemd[1]: Finished Create System Files and Directories. worker2 # [ 9.776391] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.782042] systemd[1]: Mounted /run/wrappers. client # [ 9.786031] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 9.784222] systemd[1]: Reached target Local File Systems. worker2 # [ 9.781774] systemd[1]: Starting register-nix-paths.service... worker2 # [ 9.796593] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.792524] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.796664] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.800132] systemd[1]: Starting register-nix-paths.service... worker2 # [ 9.808091] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.782446] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 9.816939] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 9.828182] systemd[1]: Starting Create System Files and Directories... lb # [ 9.821186] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.824610] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 9.841768] systemd-udevd[315]: Using default interface naming scheme 'v261'. lb # [ 9.849831] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.833458] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.877822] systemd[1]: Starting Create System Files and Directories... worker2 # [ 9.906298] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.901701] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.877910] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 9.902064] systemd-udevd[320]: Using default interface naming scheme 'v261'. worker1 # [ 9.881633] systemd[1]: Starting Update is Completed... worker2 # [ 9.914800] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.943226] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.953575] systemd[1]: Starting Update is Completed... lb # [ 9.988591] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 10.005768] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.994026] systemd[1]: Finished Update is Completed. client # [ 10.028707] systemd[1]: Finished Update is Completed. worker2 # [ 10.046957] systemd[1]: Finished Create System Files and Directories. worker2 # [ 10.064303] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 10.070130] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 10.127295] systemd[1]: Finished Create System Files and Directories. lb # [ 10.133737] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 10.157232] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 10.187071] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 10.217045] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 10.211575] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 10.309253] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 10.317733] systemd[1]: Starting Update is Completed... lb # [ 10.324960] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 10.368126] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 10.377167] systemd[1]: Starting Update is Completed... worker2 # [ 10.427091] systemd[1]: Finished Update is Completed. client # [ 10.440145] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.442859] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 10.445496] systemd[1]: Finished Update is Completed. worker1 # [ 10.464879] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 10.469772] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.718229] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.778841] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 10.897428] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 10.901667] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.986046] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 10.987790] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 10.993654] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 11.031728] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 11.148754] systemd[1]: Finished Firewall. worker1 # [ 11.196182] systemd[1]: Finished Coldplug All udev Devices. client # [ 11.236135] systemd[1]: Finished register-nix-paths.service. client # [ 11.238809] systemd[1]: Reached target System Initialization. client # [ 11.243091] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.244708] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.246460] systemd[1]: Reached target Timer Units. client # [ 11.251030] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.252989] systemd[1]: Listening on Nix Daemon Socket. client # [ 11.261568] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.262894] systemd[1]: Reached target Socket Units. client # [ 11.263938] systemd[1]: Reached target Basic System. client # [ 11.266031] systemd[1]: Started backdoor.service. client # [ 11.268304] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.272215] systemd[1]: Starting nftables firewall... worker1 # [ 11.248465] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 11.289110] systemd[1]: Finished register-nix-paths.service. client # [ 11.303617] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.317400] systemd[1]: Starting Post-Boot Actions... client # [ 11.361110] systemd[1]: Started Reset console on configuration changes. client # [ 11.388969] systemd[1]: Starting resolvconf update... lb # [ 11.439346] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.443950] systemd[1]: Reached target System Initialization. client # [ 11.448557] (udev-worker)[327]: Network interface NamePolicy= disabled on kernel command line. lb # [ 11.449133] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 11.450958] systemd[1]: Started niks3 garbage collection timer. client # connecting to host... lb # [ 11.459718] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 11.437207] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 11.462279] systemd[1]: Reached target Timer Units. lb # [ 11.469001] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 11.474243] systemd[1]: Listening on niks3 server socket. client # [ 11.479426] systemd[1]: Finished Post-Boot Actions. lb # [ 11.480344] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.484247] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.486188] (udev-worker)[332]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 11.486230] systemd[1]: Reached target Socket Units. lb # [ 11.488409] systemd[1]: Reached target Basic System. lb # [ 11.493157] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 11.477722] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 11.500324] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.506783] (udev-worker)[332]: Network interface NamePolicy= disabled on kernel command line. client: Guest shell says: b'Spawning backdoor root shell...\n' lb # [ 11.507839] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.516478] systemd[1]: Finished Firewall. worker1 # [ 11.504263] systemd[1]: Finished register-nix-paths.service. client # [ 11.521133] nsncd[398]: Sep 20 12:22:52.064 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.508259] systemd[1]: Reached target System Initialization. client # [ 11.533699] systemd[1]: Started Name Service Cache Daemon (nsncd). client: connected to guest root shell lb # [ 11.522700] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.510953] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.548408] systemd[1]: Finished Import lastlog data into lastlog2 database. client: (connecting took 12.05 seconds) lb # [ 11.573297] systemd[1]: Starting resolvconf update... worker1 # [ 11.513768] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.555244] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.517801] systemd[1]: Reached target Timer Units. client # [ 11.560596] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.519507] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.565653] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 11.526420] systemd[1]: Listening on Nix Daemon Socket. client: (finished: waiting for the VM to finish booting, in 12.05 seconds) worker1 # [ 11.528405] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 11.537426] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.545658] systemd[1]: Reached target Socket Units. worker1 # [ 11.557130] systemd[1]: Reached target Basic System. worker1 # [ 11.559053] systemd[1]: Started backdoor.service. worker1 # [ 11.570931] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.593864] systemd[1]: Started rustfs.service. client # [ 11.599372] systemd[1]: Starting User Login Management... worker2 # [ 11.606951] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 11.584733] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.589101] systemd[1]: Starting Post-Boot Actions... worker1 # [ 11.598289] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.609613] systemd[1]: Starting resolvconf update... lb # [ 11.634128] systemd[1]: Starting rustfs-bucket.service... worker1 # [ 11.618356] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.657326] nsncd[482]: Sep 20 12:22:52.200 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.672629] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 11.669988] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.675824] systemd[1]: Finished Post-Boot Actions. worker1 # [ 11.705165] systemd[1]: Finished Post-Boot Actions. lb # [ 11.740508] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.746032] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.760217] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.763800] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 11.751696] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # connecting to host... worker1 # [ 11.759810] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.768711] nsncd[498]: Sep 20 12:22:52.293 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.770753] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.771595] systemd[1]: Starting User Login Management... lb # [ 11.799396] systemd[1]: Starting User Login Management... lb # [ 11.806287] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 11.812559] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.857640] dbus-broker-launch[429]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 11.875815] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 11.884683] systemd-logind[431]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 11.889670] systemd-logind[431]: New seat seat0. client # [ 11.890366] dbus-broker-launch[429]: NSS returned no entry for 'systemd-timesync' client # [ 11.891336] dbus-broker-launch[429]: Invalid user-name in /nix/store/i87y3v12qnxz4jgnndbs0w0ih92vmmjw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 11.881659] dbus-broker-launch[502]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.915583] systemd[1]: Started User Login Management. worker2 # [ 11.925246] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client # [ 11.922270] systemd[1]: Starting linger-users.service... worker1 # [ 11.901573] dbus-broker-launch[502]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.905981] dbus-broker-launch[502]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 11.947558] systemd[1]: Finished register-nix-paths.service. worker2 # [ 11.951496] systemd[1]: Reached target System Initialization. client # [ 11.947598] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 11.953820] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 11.955929] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.951402] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.954250] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 11.961784] systemd[1]: Reached target Timer Units. client # [ 11.960652] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.963253] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.961702] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.959981] systemd[1]: Finished Firewall. client # [ 11.962580] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 11.968280] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.977016] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 11.949694] systemd[1]: Started D-Bus System Message Bus. client # [ 11.977007] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.985276] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.989017] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 11.996419] systemd[1]: Reached target Socket Units. worker2 # [ 11.999292] systemd[1]: Reached target Basic System. worker2 # [ 12.009024] systemd[1]: Started backdoor.service. worker1 # [ 11.976770] systemd-logind[512]: New seat seat0. worker1 # [ 11.980962] systemd[1]: Started User Login Management. worker1 # [ 11.989933] systemd[1]: Starting linger-users.service... worker2 # [ 12.024670] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 12.027148] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 12.008720] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 12.035232] dbus-broker-launch[429]: Ready worker2 # [ 12.043830] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 12.013990] systemd[1]: Stopping Host and Network Name Lookups... client # [ 12.047020] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 12.053140] systemd[1]: Starting Post-Boot Actions... lb # [ 12.046190] dbus-broker-launch[517]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 12.028694] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 12.056360] dbus-broker-launch[517]: NSS returned no entry for 'systemd-timesync' worker1 # [ 12.036327] systemd[1]: Stopping User and Group Name Lookups... client # [ 12.067536] systemd[1]: Finished linger-users.service. worker2 # [ 12.062965] systemd[1]: Started Reset console on configuration changes. worker1 # [ 12.045818] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 12.046823] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 12.047748] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 12.078835] systemd[1]: Starting resolvconf update... lb # [ 12.065502] dbus-broker-launch[517]: Invalid user-name in /nix/store/r3k08synkldj3yxnxmc97ljig0y68d44-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 12.057879] dbus-broker-launch[502]: Ready worker2 # [ 12.087544] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 12.063945] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 12.109891] systemd[1]: Started D-Bus System Message Bus. client # [ 12.126665] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 12.125038] systemd-logind[520]: New seat seat0. client # [ 12.133067] nsncd[500]: Sep 20 12:22:52.675 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 12.132875] systemd[1]: Started User Login Management. client # [ 12.141813] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 12.151242] systemd[1]: Finished Post-Boot Actions. worker1 # [ 12.121287] systemd[1]: linger-users.service: Deactivated successfully. client # [ 12.147066] systemd[1]: Reached target User and Group Name Lookups. client # [ 12.147984] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.125877] systemd[1]: Finished linger-users.service. lb # [ 12.149289] systemd[1]: Starting linger-users.service... client # [ 12.154487] systemd[1]: Finished resolvconf update. client # [ 12.161109] systemd[1]: Starting DHCP Client... worker1 # [ 12.145153] nsncd[570]: Sep 20 12:22:52.684 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 12.153944] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 12.156916] systemd[1]: Reached target Host and Network Name Lookups. worker2 # connecting to host... worker1 # [ 12.159542] systemd[1]: Reached target User and Group Name Lookups. lb # [ 12.186288] dbus-broker-launch[517]: Ready worker1 # [ 12.164717] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.177494] (udev-worker)[380]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 12.179597] (udev-worker)[380]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.212903] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 12.214282] nsncd[497]: Sep 20 12:22:52.755 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 12.192449] systemd[1]: Finished resolvconf update. worker1 # [ 12.193249] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.199544] systemd[1]: Starting DHCP Client... worker2 # [ 12.231074] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 12.203128] systemd[1]: Starting Extra networking commands.... lb # [ 12.219539] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 12.235874] systemd[1]: Reached target User and Group Name Lookups. lb # [ 12.229062] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 12.246478] systemd[1]: Starting User Login Management... lb # [ 12.234810] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 12.252412] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 12.245232] systemd[1]: Stopping User and Group Name Lookups... lb # [ 12.253492] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 12.274477] mousedev: PS/2 mouse device common for all mice lb # [ 12.261353] systemd[1]: nscd.service: Deactivated successfully. lb # [ 12.271082] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 12.288439] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 12.292987] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 12.298637] systemd[1]: Finished linger-users.service. worker2 # [ 12.321429] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'... client # [ 12.320186] systemd-logind[431]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 12.340169] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync' worker2 # [ 12.346137] dbus-broker-launch[501]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 12.368223] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 12.391922] systemd[1]: Started D-Bus System Message Bus. client # [ 12.387372] dhcpcd[533]: dhcpcd-10.3.2 starting client # [ 12.403858] dhcpcd[543]: dev: loaded udev lb # [ 12.404190] systemd[1]: Finished resolvconf update. lb # [ 12.409698] systemd[1]: Reached target Preparation for Network. lb # [ 12.418764] nsncd[589]: Sep 20 12:22:52.961 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 12.427116] systemd[1]: Starting DHCP Client... client # [ 12.435396] systemd[1]: Finished nftables firewall. client # [ 12.437955] systemd[1]: Reached target Preparation for Network. worker2 # [ 12.440160] systemd-logind[513]: New seat seat0. worker2 # [ 12.446180] systemd[1]: Started User Login Management. lb # [ 12.443856] systemd[1]: Starting Extra networking commands.... worker2 # [ 12.452001] systemd[1]: Starting linger-users.service... client # [ 12.449761] systemd[1]: Starting Address configuration of eth1... worker2 # [ 12.455676] dbus-broker-launch[501]: Ready client # [ 12.453250] systemd[1]: Starting Extra networking commands.... lb # [ 12.453066] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 12.474824] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.479599] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 12.486019] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 12.487119] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 12.487990] systemd[1]: Stopping User and Group Name Lookups... lb # [ 12.482630] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 12.464605] dhcpcd[605]: dhcpcd-10.3.2 starting lb # [ 12.491122] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 12.496213] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 12.505348] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 12.506385] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 12.507336] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 12.503608] systemd[1]: Started backdoor.service. worker1 # [ 12.485784] dhcpcd[637]: dev: loaded udev worker2 # [ 12.518458] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 12.539025] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 12.545015] systemd-logind[512]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 12.571913] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 12.548333] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.579237] systemd[1]: Finished linger-users.service. worker1 # [ 12.553392] systemd[1]: Starting Address configuration of eth1... client # [ 12.597567] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 12.604885] (udev-worker)[383]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.611896] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 12.616562] nsncd[571]: Sep 20 12:22:53.151 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 12.622333] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 12.624627] systemd[1]: Reached target User and Group Name Lookups. client # [ 12.631165] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 12.628199] (udev-worker)[466]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 12.633610] (udev-worker)[466]: Network interface NamePolicy= disabled on kernel command line. client # [ 12.640770] network-addresses-eth1-start[547]: adding address 192.168.1.1/24... done worker2 # [ 12.646503] systemd[1]: Finished resolvconf update. worker1 # [ 12.631779] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.658144] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.658662] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.651283] systemd[1]: Reached target Preparation for Network. worker2 # [ 12.656498] systemd[1]: Starting DHCP Client... worker1 # [ 12.627497] systemd[1]: Finished Extra networking commands.. client # [ 12.664515] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.664872] cfg80211: failed to load regulatory.db worker2 # [ 12.660796] systemd[1]: Starting Extra networking commands.... worker1 # [ 12.631617] systemd[1]: Reached target Network. worker1 # [ 12.633590] systemd[1]: Starting Permit User Sessions... lb # connecting to host... client # [ 12.670283] network-addresses-eth1-start[547]: adding address 2001:db8:1::1/64... done worker1 # [ 12.674284] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.676893] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.681586] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 12.681935] cfg80211: failed to load regulatory.db client # [ 12.706560] systemd[1]: Finished Address configuration of eth1. worker1 # [ 12.716523] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.720463] systemd[1]: Started Getty on tty1. worker1 # [ 12.723610] systemd[1]: Reached target Login Prompts. client # [ 12.756513] dhcpcd[603]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (550) - Operation not permitted client # [ 12.758478] dhcpcd[603]: .resolvconf-wrapped: clearing stale lock pid 550 worker1 # [ 12.765847] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 12.779242] network-addresses-eth1-start[656]: adding address 192.168.1.3/24... done client # [ 12.823210] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.813090] dhcpcd[543]: eth0: waiting for carrier worker1 # [ 12.803064] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.816613] dhcpcd[543]: eth0: carrier acquired worker1 # [ 12.791484] dhcpcd[637]: eth0: waiting for carrier worker1 # [ 12.795974] dhcpcd[637]: eth0: waiting for carrier worker1 # [ 12.797498] dhcpcd[637]: eth0: carrier acquired worker1 # [ 12.805722] network-addresses-eth1-start[656]: adding address 2001:db8:1::3/64... done client # [ 12.827353] systemd[1]: Finished Extra networking commands.. client # [ 12.831854] systemd[1]: Reached target Network. lb # [ 12.833379] dhcpcd[623]: dhcpcd-10.3.2 starting client # [ 12.837687] systemd[1]: Starting Permit User Sessions... client # [ 12.840543] dhcpcd[543]: DUID 00:01:00:01:32:42:8c:9d:52:54:00:12:34:56 worker1 # [ 12.817851] dhcpcd[637]: DUID 00:01:00:01:32:42:8c:9d:52:54:00:12:34:56 worker1 # [ 12.818867] dhcpcd[637]: eth0: IAID 00:12:34:56 client # [ 12.844941] dhcpcd[543]: eth0: IAID 00:12:34:56 client # [ 12.845637] dhcpcd[543]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 12.819524] dhcpcd[637]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.859457] systemd-logind[513]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 12.853484] dhcpcd[667]: dev: loaded udev worker1 # [ 12.833702] systemd[1]: Finished Address configuration of eth1. client # [ 12.892363] systemd[1]: Finished Permit User Sessions. worker2 # [ 12.898161] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 12.901107] systemd[1]: Started Getty on tty1. worker2 # [ 12.907320] systemd[1]: Starting Address configuration of eth1... lb # [ 12.902324] systemd[1]: Finished Extra networking commands.. client # [ 12.903879] systemd[1]: Reached target Login Prompts. lb # [ 12.905757] systemd[1]: Reached target Network. lb # [ 12.923370] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.918357] systemd[1]: Starting PostgreSQL Server... worker2 # [ 12.926817] dhcpcd[604]: dhcpcd-10.3.2 starting lb # [ 12.923933] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.949212] dhcpcd[643]: dev: loaded udev worker1 # [ 12.935210] mousedev: PS/2 mouse device common for all mice worker1 # [ 12.955528] systemd-logind[512]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 13.002639] 8021q: 802.1Q VLAN Support v1.8 client: (finished: waiting for unit network-addresses-eth1.service, in 13.48 seconds) lb # [ 13.016485] systemd[1]: Finished Permit User Sessions. worker2 # [ 13.026325] systemd[1]: Finished Extra networking commands.. client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } worker2 # [ 13.029990] systemd[1]: Reached target Network. worker2 # [ 13.037396] systemd[1]: Starting Permit User Sessions... lb # [ 13.032766] systemd[1]: Started Getty on tty1. lb # [ 13.043674] systemd[1]: Reached target Login Prompts. client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2 # [ 13.102598] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 13.108744] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 13.122250] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 13.144895] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 13.145426] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 13.150778] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 13.151127] cfg80211: failed to load regulatory.db worker2 # [ 13.141652] network-addresses-eth1-start[635]: adding address 192.168.1.4/24... done worker2 # [ 13.155738] systemd[1]: Finished Permit User Sessions. worker2 # [ 13.159758] systemd[1]: Started Getty on tty1. worker2 # [ 13.163018] systemd[1]: Reached target Login Prompts. lb # [ 13.177979] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 13.178527] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 13.185581] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 13.185939] cfg80211: failed to load regulatory.db worker2 # [ 13.180810] network-addresses-eth1-start[635]: adding address 2001:db8:1::4/64... done lb # [ 13.180614] dhcpcd[667]: no valid interfaces found lb # [ 13.182525] dhcpcd[667]: no valid interfaces found lb # [ 13.186854] dhcpcd[667]: libudev: received NULL device lb # [ 13.192229] dhcpcd[667]: libudev: received NULL device worker2 # [ 13.205425] systemd[1]: Finished Address configuration of eth1. lb # [ 13.237374] (udev-worker)[694]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 13.247108] (udev-worker)[694]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 13.277283] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 13.267911] dhcpcd[643]: eth0: waiting for carrier worker2 # [ 13.269959] dhcpcd[643]: eth0: carrier acquired worker2 # [ 13.286349] dhcpcd[643]: DUID 00:01:00:01:32:42:8c:9d:52:54:00:12:34:56 worker2 # [ 13.287384] dhcpcd[643]: eth0: IAID 00:12:34:56 worker2 # [ 13.289614] dhcpcd[643]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 13.287968] (udev-worker)[693]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 13.344068] mousedev: PS/2 mouse device common for all mice worker2 # [ 13.369477] systemd-logind[513]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 13.435062] postgresql-pre-start[708]: The files belonging to this database system will be owned by user "postgres". lb # [ 13.439762] postgresql-pre-start[708]: This user must also own the server process. lb # [ 13.452140] postgresql-pre-start[708]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 13.453508] postgresql-pre-start[708]: The default database encoding has accordingly been set to "UTF8". lb # [ 13.454718] postgresql-pre-start[708]: The default text search configuration will be set to "english". lb # [ 13.455884] postgresql-pre-start[708]: Data page checksums are enabled. lb # [ 13.464337] postgresql-pre-start[708]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 13.469506] postgresql-pre-start[708]: creating subdirectories ... ok lb # [ 13.472301] postgresql-pre-start[708]: selecting dynamic shared memory implementation ... posix client # [ 13.571833] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.641204] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 13.637699] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.654348] systemd-logind[520]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 13.655663] systemd[1]: Starting Address configuration of eth1... client # [ 13.686558] dhcpcd[543]: eth0: soliciting a DHCP lease client # [ 13.692596] dhcpcd[543]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 13.697196] postgresql-pre-start[708]: selecting default "max_connections" ... 100 client # [ 13.700258] dhcpcd[543]: eth0: probing address 10.0.2.15/24 lb # [ 13.836089] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 13.875040] network-addresses-eth1-start[726]: adding address 192.168.1.2/24... done client # [ 13.900929] systemd[1]: Starting Virtual Console Setup... lb # [ 13.914349] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 13.902775] dhcpcd[667]: eth0: waiting for carrier lb # [ 13.906800] dhcpcd[667]: eth0: carrier acquired lb # [ 13.916975] network-addresses-eth1-start[726]: adding address 2001:db8:1::2/64... done client # [ 13.932695] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 13.937933] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 13.941168] systemd[1]: Stopped Virtual Console Setup. lb # [ 13.946094] dhcpcd[667]: DUID 00:01:00:01:32:42:8c:9e:52:54:00:12:34:56 lb # [ 13.947254] dhcpcd[667]: eth0: IAID 00:12:34:56 lb # [ 13.947934] dhcpcd[667]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 13.950332] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.933511] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 13.959398] systemd[1]: Finished Address configuration of eth1. lb # [ 13.978173] postgresql-pre-start[708]: selecting default "shared_buffers" ... 128MB worker1 # [ 13.966435] systemd[1]: Starting Virtual Console Setup... client # [ 14.006727] systemd-logind[431]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 13.990436] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.994556] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 13.996857] systemd[1]: Starting Virtual Console Setup... worker2 # [ 14.086884] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker1 # [ 14.050953] systemd-logind[512]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 14.092761] dhcpcd[643]: eth0: soliciting a DHCP lease lb # [ 14.105456] mousedev: PS/2 mouse device common for all mice worker2 # [ 14.100646] dhcpcd[643]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 14.108251] dhcpcd[643]: eth0: probing address 10.0.2.15/24 lb # [ 14.268485] systemd-logind[520]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 14.311980] dhcpcd[543]: eth0: soliciting an IPv6 router client # [ 14.313470] dhcpcd[543]: eth0: Router Advertisement from fe80::2 client # [ 14.314431] dhcpcd[543]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 14.315610] dhcpcd[543]: eth0: adding route to fec0::/64 client # [ 14.316606] dhcpcd[543]: eth0: adding default route via fe80::2 client # [ 14.365710] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 14.369850] systemd[1]: Finished Virtual Console Setup. worker1 # [ 14.372937] dhcpcd[637]: eth0: soliciting a DHCP lease worker1 # [ 14.376668] dhcpcd[637]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 14.384225] dhcpcd[637]: eth0: probing address 10.0.2.15/24 worker1 # [ 14.396126] systemd-vconsole-setup[701]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.426924] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 14.399903] systemd[1]: Finished Virtual Console Setup. lb: (finished: waiting for unit network-addresses-eth1.service, in 1.36 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker2 # [ 14.442057] systemd[1]: Starting Virtual Console Setup... worker2 # [ 14.469414] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 14.474656] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 14.478814] systemd[1]: Starting Virtual Console Setup... lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.06 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2 # [ 14.543600] systemd-logind[513]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds) lb: waiting for unit niks3.service worker2 # [ 14.943859] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.948291] systemd[1]: Finished Virtual Console Setup. worker1 # [ 15.098361] dhcpcd[637]: eth0: soliciting an IPv6 router worker1 # [ 15.100730] dhcpcd[637]: eth0: Router Advertisement from fe80::2 worker1 # [ 15.102417] dhcpcd[637]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 15.104745] dhcpcd[637]: eth0: adding route to fec0::/64 worker1 # [ 15.106268] dhcpcd[637]: eth0: adding default route via fe80::2 lb # [ 15.361493] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker2 # [ 15.382035] dhcpcd[643]: eth0: soliciting an IPv6 router worker2 # [ 15.384533] dhcpcd[643]: eth0: Router Advertisement from fe80::2 worker2 # [ 15.386288] dhcpcd[643]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 15.388006] dhcpcd[643]: eth0: adding route to fec0::/64 worker2 # [ 15.389456] dhcpcd[643]: eth0: adding default route via fe80::2 lb # [ 15.871159] dhcpcd[667]: eth0: soliciting a DHCP lease lb # [ 15.880798] dhcpcd[667]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 15.889069] dhcpcd[667]: eth0: probing address 10.0.2.15/24 lb # [ 15.931370] systemd[1]: Starting Virtual Console Setup... lb # [ 16.154335] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 16.220287] systemd-logind[520]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 16.477091] systemd-vconsole-setup[775]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 16.481775] systemd[1]: Finished Virtual Console Setup. lb # [ 16.536452] postgresql-pre-start[708]: selecting default time zone ... UTC lb # [ 16.540381] postgresql-pre-start[708]: creating configuration files ... ok lb # [ 16.813789] postgresql-pre-start[708]: running bootstrap script ... ok lb # [ 16.907348] dhcpcd[667]: eth0: soliciting an IPv6 router lb # [ 16.910223] dhcpcd[667]: eth0: Router Advertisement from fe80::2 lb # [ 16.911142] dhcpcd[667]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 16.913254] dhcpcd[667]: eth0: adding route to fec0::/64 lb # [ 16.914066] dhcpcd[667]: eth0: adding default route via fe80::2 lb # [ 17.486963] postgresql-pre-start[708]: performing post-bootstrap initialization ... ok lb # [ 17.622468] postgresql-pre-start[708]: syncing data to disk ... ok lb # [ 17.624746] postgresql-pre-start[708]: initdb: warning: enabling "trust" authentication for local connections lb # [ 17.626134] postgresql-pre-start[708]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 17.628260] postgresql-pre-start[708]: Success. You can now start the database server using: lb # [ 17.629477] postgresql-pre-start[708]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 17.753065] postgres[810]: [810] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.757530] postgres[810]: [810] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.758801] postgres[810]: [810] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.760909] postgres[810]: [810] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.775760] postgres[819]: [819] LOG: database system was shut down at 2026-09-20 12:22:58 GMT lb # [ 17.781802] postgres[810]: [810] LOG: database system is ready to accept connections lb # [ 17.788731] systemd[1]: Started PostgreSQL Server. lb # [ 17.795738] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 18.028477] postgresql-setup-start[830]: CREATE DATABASE lb # [ 18.083002] postgresql-setup-start[835]: CREATE ROLE lb # [ 18.117418] postgresql-setup-start[837]: ALTER DATABASE lb # [ 18.127352] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 18.129464] systemd[1]: Reached target PostgreSQL. client # [ 19.013117] dhcpcd[543]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 19.016830] dhcpcd[543]: eth0: adding route to 10.0.2.0/24 client # [ 19.017002] dhcpcd[543]: eth0: adding default route via 10.0.2.2 client # [ 19.200305] systemd[1]: Started DHCP Client. client # [ 19.206008] systemd[1]: Reached target Multi-User System. client # [ 19.206917] systemd[1]: Startup finished in 1.023s (kernel) + 5.453s (initrd) + 12.729s (userspace) = 19.205s. worker2 # [ 19.245134] dhcpcd[643]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 19.249358] dhcpcd[643]: eth0: adding route to 10.0.2.0/24 worker2 # [ 19.251842] dhcpcd[643]: eth0: adding default route via 10.0.2.2 worker2 # [ 19.393579] systemd[1]: Started DHCP Client. worker2 # [ 19.396220] systemd[1]: Reached target Multi-User System. worker2 # [ 19.397171] systemd[1]: Startup finished in 1.031s (kernel) + 5.513s (initrd) + 12.850s (userspace) = 19.395s. worker1 # [ 20.059343] dhcpcd[637]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 20.063005] dhcpcd[637]: eth0: adding route to 10.0.2.0/24 worker1 # [ 20.066476] dhcpcd[637]: eth0: adding default route via 10.0.2.2 worker1 # [ 20.242188] systemd[1]: Started DHCP Client. worker1 # [ 20.244002] systemd[1]: Reached target Multi-User System. worker1 # [ 20.245084] systemd[1]: Startup finished in 1.031s (kernel) + 5.419s (initrd) + 13.792s (userspace) = 20.243s. lb # [ 21.676654] dhcpcd[667]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 21.680219] dhcpcd[667]: eth0: adding route to 10.0.2.0/24 lb # [ 21.680492] dhcpcd[667]: eth0: adding default route via 10.0.2.2 lb # [ 21.833759] systemd[1]: Started DHCP Client. lb # [ 21.840293] systemd[1]: Reached target Network is Online. lb # [ 21.843605] systemd[1]: Started Envoy reverse proxy. lb # [ 21.848417] systemd[1]: Started mock-oidc.service. lb # [ 21.946795] mock-oidc-server[938]: Mock OIDC Server running lb # [ 21.947892] mock-oidc-server[938]: OIDC Address: 192.168.1.2:8080 lb # [ 21.949878] mock-oidc-server[938]: Issue Address: 0.0.0.0:8081 lb # [ 21.951194] mock-oidc-server[938]: Issuer: http://192.168.1.2:8080/oidc lb # [ 21.952692] mock-oidc-server[938]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 21.954118] mock-oidc-server[938]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 21.955642] mock-oidc-server[938]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 22.458589] envoy[937]: [2026-09-20 12:23:03.002][937][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 22.461824] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 22.463808] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 22.466083] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 22.468877] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 22.474748] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 22.496156] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 22.499136] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 22.501775] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 22.505485] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 22.507375] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 22.510213] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 22.512606] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 22.515235] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 22.519741] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 22.522045] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 22.525975] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 22.527699] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 22.535111] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 22.537238] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 22.543157] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 22.546648] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 22.552137] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 22.557216] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 22.562352] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 22.564541] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 22.566601] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 22.569995] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 22.574185] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 22.575843] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 22.578052] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 22.579975] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 22.583266] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 22.590828] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 22.595756] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 22.599613] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 22.602206] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 22.604350] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 22.611891] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 22.614695] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 22.616755] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 22.618820] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 22.621770] envoy[937]: [2026-09-20 12:23:03.004][937][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 22.657113] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 22.666373] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 22.668872] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 22.672791] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 22.674907] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 22.678273] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 22.681392] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 22.685177] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 22.689954] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 22.693163] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 22.695106] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 22.697662] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 22.700009] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 22.704166] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 22.707725] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 22.721316] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 22.723730] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 22.728225] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 22.739816] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 22.742672] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 22.745763] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 22.747694] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 22.752863] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 22.755757] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 22.762062] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 22.767341] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 22.777900] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 22.780521] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 22.782658] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 22.785805] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 22.789661] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 22.791965] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 22.794905] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 22.797497] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 22.800798] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 22.803969] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 22.806702] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 22.810645] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 22.813325] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 22.819228] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 22.833989] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 22.837163] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 22.839179] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 22.842319] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 22.845397] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 22.851021] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 22.857346] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 22.863985] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 22.874136] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 22.879559] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 22.883370] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 22.889624] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 22.896570] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 22.901352] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 22.905897] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 22.911138] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 22.913947] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 22.926385] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 22.929873] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 22.933289] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff worker2 # [ 22.941089] systemd[1]: Reached target Network is Online. worker1 # [ 22.912977] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 22.936570] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based worker2 # [ 22.948623] systemd[1]: Starting scheduler-token.service... lb # [ 22.941269] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 22.944081] envoy[937]: [2026-09-20 12:23:03.005][937][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 22.950361] envoy[937]: [2026-09-20 12:23:03.033][937][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 22.954876] envoy[937]: [2026-09-20 12:23:03.036][937][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 22.971898] envoy[937]: [2026-09-20 12:23:03.036][937][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 22.974361] envoy[937]: [2026-09-20 12:23:03.036][937][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 22.984459] envoy[937]: [2026-09-20 12:23:03.036][937][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 22.986376] envoy[937]: [2026-09-20 12:23:03.241][937][info][main] [source/server/server.cc:968] runtime: {} lb # [ 22.987798] envoy[937]: [2026-09-20 12:23:03.262][937][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 22.991403] envoy[937]: [2026-09-20 12:23:03.262][937][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 22.993995] envoy[937]: [2026-09-20 12:23:03.263][937][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 22.995623] envoy[937]: [2026-09-20 12:23:03.264][937][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 23.000052] envoy[937]: [2026-09-20 12:23:03.264][937][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 23.002077] envoy[937]: [2026-09-20 12:23:03.264][937][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 23.004140] envoy[937]: [2026-09-20 12:23:03.467][937][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 23.005849] envoy[937]: [2026-09-20 12:23:03.539][937][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 23.007659] envoy[937]: [2026-09-20 12:23:03.542][937][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 23.013882] envoy[937]: [2026-09-20 12:23:03.542][937][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 23.089601] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 23.094430] systemd[1]: Finished scheduler-token.service. worker2 # [ 23.095717] systemd[1]: scheduler-token.service: Consumed 57ms CPU time over 143ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 23.100547] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 23.144804] nix-grpc-daemon[776]: ts=2026-09-20T12:23:03Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 23.157175] nix-grpc-daemon[776]: ts=2026-09-20T12:23:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 23.159435] nix-grpc-daemon[776]: ts=2026-09-20T12:23:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 23.210022] nix-grpc-daemon[776]: ts=2026-09-20T12:23:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 23.211803] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 23.242869] nix-grpc-daemon[776]: ts=2026-09-20T12:23:03Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 23.269690] envoy[937]: [2026-09-20 12:23:03.812][937][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 23.276750] envoy[937]: [2026-09-20 12:23:03.813][937][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 23.282533] envoy[937]: [2026-09-20 12:23:03.813][937][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 23.287800] envoy[937]: [2026-09-20 12:23:03.813][937][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 23.317652] nix-grpc-daemon[777]: ts=2026-09-20T12:23:03Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 23.330647] nix-grpc-daemon[777]: ts=2026-09-20T12:23:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 23.333062] nix-grpc-daemon[777]: ts=2026-09-20T12:23:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 23.380673] nix-grpc-daemon[777]: ts=2026-09-20T12:23:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 23.386393] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 23.424461] nix-grpc-daemon[777]: ts=2026-09-20T12:23:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.429018] nix-grpc-daemon[777]: ts=2026-09-20T12:23:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.443491] nix-grpc-daemon[776]: ts=2026-09-20T12:23:03Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 23.630778] nix-grpc-daemon[777]: ts=2026-09-20T12:23:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.636435] nix-grpc-daemon[777]: ts=2026-09-20T12:23:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.837749] nix-grpc-daemon[777]: ts=2026-09-20T12:23:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.843459] nix-grpc-daemon[777]: ts=2026-09-20T12:23:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.843970] nix-grpc-daemon[776]: ts=2026-09-20T12:23:04Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 24.044986] nix-grpc-daemon[777]: ts=2026-09-20T12:23:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.050409] nix-grpc-daemon[777]: ts=2026-09-20T12:23:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.251795] nix-grpc-daemon[777]: ts=2026-09-20T12:23:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.257318] nix-grpc-daemon[777]: ts=2026-09-20T12:23:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.460270] nix-grpc-daemon[777]: ts=2026-09-20T12:23:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.464361] nix-grpc-daemon[777]: ts=2026-09-20T12:23:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.660912] nix-grpc-daemon[777]: ts=2026-09-20T12:23:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.666214] nix-grpc-daemon[777]: ts=2026-09-20T12:23:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.646279] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.646517] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.867720] nix-grpc-daemon[777]: ts=2026-09-20T12:23:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.873299] nix-grpc-daemon[777]: ts=2026-09-20T12:23:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.847413] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.853125] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.074646] nix-grpc-daemon[777]: ts=2026-09-20T12:23:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.080486] nix-grpc-daemon[777]: ts=2026-09-20T12:23:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.054182] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.059871] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.281507] nix-grpc-daemon[777]: ts=2026-09-20T12:23:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.284843] nix-grpc-daemon[777]: ts=2026-09-20T12:23:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.260669] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.265950] nix-grpc-daemon[776]: ts=2026-09-20T12:23:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.487290] nix-grpc-daemon[777]: ts=2026-09-20T12:23:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.490551] nix-grpc-daemon[777]: ts=2026-09-20T12:23:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.467235] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.472762] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.688680] nix-grpc-daemon[777]: ts=2026-09-20T12:23:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.694108] nix-grpc-daemon[777]: ts=2026-09-20T12:23:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.675778] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.680195] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.895306] nix-grpc-daemon[777]: ts=2026-09-20T12:23:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.901107] nix-grpc-daemon[777]: ts=2026-09-20T12:23:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.877732] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.882209] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.102375] nix-grpc-daemon[777]: ts=2026-09-20T12:23:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.108154] nix-grpc-daemon[777]: ts=2026-09-20T12:23:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.079057] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.084734] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.310140] nix-grpc-daemon[777]: ts=2026-09-20T12:23:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.285715] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.315814] nix-grpc-daemon[777]: ts=2026-09-20T12:23:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.291014] nix-grpc-daemon[776]: ts=2026-09-20T12:23:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 26.505379] rustfs-bucket-start[988]: mb s3://farm lb # [ 26.512557] systemd[1]: Finished rustfs-bucket.service. worker2 # [ 26.518690] nix-grpc-daemon[777]: ts=2026-09-20T12:23:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.492116] nix-grpc-daemon[776]: ts=2026-09-20T12:23:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.524201] nix-grpc-daemon[777]: ts=2026-09-20T12:23:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 26.523465] systemd[1]: Starting niks3 server... worker1 # [ 26.497518] nix-grpc-daemon[776]: ts=2026-09-20T12:23:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.725557] nix-grpc-daemon[777]: ts=2026-09-20T12:23:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.700553] nix-grpc-daemon[776]: ts=2026-09-20T12:23:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.731128] nix-grpc-daemon[777]: ts=2026-09-20T12:23:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.704737] nix-grpc-daemon[776]: ts=2026-09-20T12:23:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 26.732401] postgres[1008]: [1008] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 26.733711] postgres[1008]: [1008] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 26.764764] niks3-server[1002]: 2026/09/20 12:23:07 OK 20241026095416_initial_model.sql (18.3ms) lb # [ 26.768472] niks3-server[1002]: 2026/09/20 12:23:07 OK 20251210153512_drop_unused_gin_index.sql (4.44ms) lb # [ 26.774013] niks3-server[1002]: 2026/09/20 12:23:07 OK 20251218171726_add_pins.sql (5.48ms) lb # [ 26.778849] niks3-server[1002]: 2026/09/20 12:23:07 OK 20260628120000_add_object_size_and_stats.sql (4.79ms) lb # [ 26.784331] niks3-server[1002]: 2026/09/20 12:23:07 OK 20260905000000_add_claims.sql (5.44ms) lb # [ 26.789046] niks3-server[1002]: 2026/09/20 12:23:07 OK 20260920000000_drop_claims.sql (4.55ms) lb # [ 26.791048] niks3-server[1002]: 2026/09/20 12:23:07 goose: successfully migrated database to version: 20260920000000 lb # [ 26.795633] niks3-server[1002]: 2026/09/20 12:23:07 OK 1_commit_pending_closure.sql (6.57ms) lb # [ 26.798544] niks3-server[1002]: 2026/09/20 12:23:07 OK 2_object_stats_trigger.sql (2.73ms) lb # [ 26.799944] niks3-server[1002]: 2026/09/20 12:23:07 goose: up to current file version: 2 lb # [ 26.803991] niks3-server[1002]: 2026/09/20 12:23:07 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 26.851914] niks3-server[1002]: 2026/09/20 12:23:07 INFO Read proxy enabled — serving cache objects from S3 lb # [ 26.853778] niks3-server[1002]: 2026/09/20 12:23:07 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 26.858433] niks3-server[1002]: 2026/09/20 12:23:07 INFO systemd watchdog enabled interval=15s lb # [ 26.863429] niks3-server[1002]: 2026/09/20 12:23:07 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 26.867862] systemd[1]: Started niks3 server. lb # [ 26.868858] niks3-server[1002]: 2026/09/20 12:23:07 INFO lead: acquired remote=192.168.1.4:54518 lb # [ 26.870021] systemd[1]: Reached target Multi-User System. lb # [ 26.870797] systemd[1]: Startup finished in 1.029s (kernel) + 5.544s (initrd) + 20.287s (userspace) = 26.861s. worker2 # [ 26.877186] nix-grpc-daemon[777]: ts=2026-09-20T12:23:07Z level=info event=scheduler_take_over worker1 # [ 26.900777] nix-grpc-daemon[776]: ts=2026-09-20T12:23:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.932556] nix-grpc-daemon[777]: ts=2026-09-20T12:23:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.906331] nix-grpc-daemon[776]: ts=2026-09-20T12:23:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.937875] nix-grpc-daemon[777]: ts=2026-09-20T12:23:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.135295] nix-grpc-daemon[777]: ts=2026-09-20T12:23:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.107648] nix-grpc-daemon[776]: ts=2026-09-20T12:23:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.141046] nix-grpc-daemon[777]: ts=2026-09-20T12:23:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.113265] nix-grpc-daemon[776]: ts=2026-09-20T12:23:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.342305] nix-grpc-daemon[777]: ts=2026-09-20T12:23:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.313808] nix-grpc-daemon[776]: ts=2026-09-20T12:23:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.318555] nix-grpc-daemon[776]: ts=2026-09-20T12:23:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.347894] nix-grpc-daemon[777]: ts=2026-09-20T12:23:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.519628] nix-grpc-daemon[776]: ts=2026-09-20T12:23:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.552502] nix-grpc-daemon[777]: ts=2026-09-20T12:23:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.561085] nix-grpc-daemon[777]: ts=2026-09-20T12:23:08Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:39074 worker2 # [ 27.567443] nix-grpc-daemon[777]: ts=2026-09-20T12:23:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 27.580177] nix-grpc-daemon[777]: ts=2026-09-20T12:23:08Z level=info event=oidc_jwks provider=mock keys=1 lb: (finished: waiting for unit niks3.service, in 12.86 seconds) lb: waiting for TCP port 5751 on localhost worker2 # [ 27.584624] nix-grpc-daemon[777]: ts=2026-09-20T12:23:08Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:39074 worker2 # [ 27.589978] nix-grpc-daemon[777]: ts=2026-09-20T12:23:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.07 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 27.780820] envoy[937]: conn peer=[::1]:43672 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds) worker2 # [ 27.975923] systemd[1]: Starting scheduler-token.service... worker2 # [ 28.073009] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 28.074552] systemd[1]: Finished scheduler-token.service. worker2 # [ 28.077531] systemd[1]: scheduler-token.service: Consumed 39ms CPU time over 97ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy ??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 128 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.34 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 28.837699] nix-grpc-daemon[777]: ts=2026-09-20T12:23:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 28.854638] systemd[1]: Started Nix Daemon. worker2 # [ 29.167825] nix-daemon[844]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 29.205659] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5) worker2 # [ 29.277442] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 29 ms (attempt 2/5) worker2 # [ 29.314316] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 230 ms (attempt 3/5) worker2 # [ 29.552312] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 267 ms (attempt 4/5) worker2 # [ 29.821901] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 29.837471] nix-grpc-daemon[776]: ts=2026-09-20T12:23:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 29.850075] systemd[1]: Started Nix Daemon. worker1 # [ 30.135986] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 30.161330] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 1/5) worker1 # [ 30.203480] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 2/5) worker1 # [ 30.266342] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 3/5) worker1 # [ 30.290961] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 751 ms (attempt 4/5) worker1 # [ 31.053454] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 31.070013] nix-grpc-daemon[776]: ts=2026-09-20T12:23:11Z level=debug event=path_info_miss path=48jbsm9kd5qiv7f4kb30g64m8mnnbmi9-nixos-system-client-test error="error: path '/nix/store/48jbsm9kd5qiv7f4kb30g64m8mnnbmi9-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 31.083414] nix-grpc-daemon[776]: ts=2026-09-20T12:23:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 31.096110] nix-grpc-daemon[776]: ts=2026-09-20T12:23:11Z level=debug event=path_info_miss path=48jbsm9kd5qiv7f4kb30g64m8mnnbmi9-nixos-system-client-test error="error: path '/nix/store/48jbsm9kd5qiv7f4kb30g64m8mnnbmi9-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.11 seconds) client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds) worker1 # [ 31.540436] nix-grpc-daemon[776]: ts=2026-09-20T12:23:12Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 31.546641] nix-grpc-daemon[776]: ts=2026-09-20T12:23:12Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:57522 worker2 # [ 31.594821] nix-grpc-daemon[777]: ts=2026-09-20T12:23:12Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:39080 worker1 # [ 31.585726] nix-grpc-daemon[776]: ts=2026-09-20T12:23:12Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:57522 worker2 # [ 31.610043] nix-grpc-daemon[777]: ts=2026-09-20T12:23:12Z level=debug event=path_info_miss path=48jbsm9kd5qiv7f4kb30g64m8mnnbmi9-nixos-system-client-test error="error: path '/nix/store/48jbsm9kd5qiv7f4kb30g64m8mnnbmi9-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 31.598268] nix-grpc-daemon[776]: ts=2026-09-20T12:23:12Z level=debug event=path_info_miss path=48jbsm9kd5qiv7f4kb30g64m8mnnbmi9-nixos-system-client-test error="error: path '/nix/store/48jbsm9kd5qiv7f4kb30g64m8mnnbmi9-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds) worker1 # [ 31.898367] nix-grpc-daemon[776]: ts=2026-09-20T12:23:12Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 32.146567] nix-grpc-daemon[776]: ts=2026-09-20T12:23:12Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.69 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 32.397651] nix-grpc-daemon[776]: ts=2026-09-20T12:23:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57522 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 32.412134] nix-grpc-daemon[776]: ts=2026-09-20T12:23:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57522 worker2 # [ 32.482978] nix-grpc-daemon[777]: ts=2026-09-20T12:23:13Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 32.489582] nix-grpc-daemon[777]: ts=2026-09-20T12:23:13Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 32.501839] nix-grpc-daemon[776]: ts=2026-09-20T12:23:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 32.529192] nix-grpc-daemon[776]: ts=2026-09-20T12:23:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57522 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 32.542615] nix-grpc-daemon[776]: ts=2026-09-20T12:23:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 32.563891] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 32.596185] nix-grpc-daemon[776]: ts=2026-09-20T12:23:13Z level=info event=niks3_push_started pid=841 worker1 # [ 32.889332] nix-grpc-daemon[841]: time=2026-09-20T12:23:13.427Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" lb # [ 32.928297] envoy[937]: conn peer=[2001:db8:1::1]:45144 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2331 lb # [ 32.933598] envoy[937]: conn peer=[2001:db8:1::1]:39722 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=83 lb # [ 32.939364] envoy[937]: conn peer=[2001:db8:1::1]:39732 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=13 lb # [ 32.945017] envoy[937]: conn peer=[2001:db8:1::1]:39742 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=19 worker1 # [ 33.094288] nix-daemon[832]: accepted connection from pid 855, user nix-grpc-daemon (trusted) worker1 # [ 33.113649] nix-daemon[832]: reaped child process 858, status = succeeded worker1 # [ 33.288359] nix-daemon[832]: accepted connection from pid 860, user nix-grpc-daemon (trusted) worker1 # [ 33.306070] nix-daemon[832]: reaped child process 863, status = succeeded lb # [ 33.341554] niks3-server[1002]: 2026/09/20 12:23:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 33.341486] nix-grpc-daemon[841]: time=2026-09-20T12:23:13.881Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 33.345009] nix-grpc-daemon[841]: time=2026-09-20T12:23:13.883Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 33.404376] niks3-server[1002]: 2026/09/20 12:23:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 33.437935] niks3-server[1002]: 2026/09/20 12:23:13 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 33.454989] niks3-server[1002]: 2026/09/20 12:23:13 INFO Signed narinfos id=1 count=1 worker1 # [ 33.435780] nix-grpc-daemon[841]: time=2026-09-20T12:23:13.975Z level=INFO msg="Uploading 1 narinfos" lb # [ 33.463276] niks3-server[1002]: 2026/09/20 12:23:14 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 33.473156] niks3-server[1002]: 2026/09/20 12:23:14 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 33.485005] niks3-server[1002]: 2026/09/20 12:23:14 INFO Completed upload id=1 worker1 # [ 33.463057] nix-grpc-daemon[841]: time=2026-09-20T12:23:14.003Z level=INFO msg="Upload complete. (566ms)" lb # [ 33.495622] niks3-server[1002]: 2026/09/20 12:23:14 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo worker1 # [ 33.474940] nix-grpc-daemon[776]: ts=2026-09-20T12:23:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 33.495589] nix-grpc-daemon[776]: ts=2026-09-20T12:23:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 33.506384] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 33.515975] nix-daemon[832]: reaped child process 839, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... worker1 # [ 33.524926] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv client # farm-a> LOG-farm-a-t1 worker1 # [ 34.351462] nix-daemon[832]: reaped child process 867, status = succeeded worker1 # [ 34.526110] nix-daemon[832]: accepted connection from pid 882, user nix-grpc-daemon (trusted) worker1 # [ 34.551168] nix-daemon[832]: reaped child process 885, status = succeeded lb # [ 34.586248] niks3-server[1002]: 2026/09/20 12:23:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 34.586616] nix-grpc-daemon[841]: time=2026-09-20T12:23:15.124Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 34.589239] nix-grpc-daemon[841]: time=2026-09-20T12:23:15.124Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 34.662635] niks3-server[1002]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 34.677189] niks3-server[1002]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 34.683874] niks3-server[1002]: 2026/09/20 12:23:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign worker1 # [ 34.668221] nix-grpc-daemon[841]: time=2026-09-20T12:23:15.206Z level=INFO msg="Uploading 1 narinfos" lb # [ 34.692382] niks3-server[1002]: 2026/09/20 12:23:15 INFO Signed narinfos id=2 count=1 lb # [ 34.696910] niks3-server[1002]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 34.707946] niks3-server[1002]: 2026/09/20 12:23:15 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 34.723803] niks3-server[1002]: 2026/09/20 12:23:15 INFO Completed upload id=2 worker1 # [ 34.701675] nix-grpc-daemon[841]: time=2026-09-20T12:23:15.241Z level=INFO msg="Upload complete. (366ms)" lb # [ 34.726478] niks3-server[1002]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 34.717695] nix-grpc-daemon[776]: ts=2026-09-20T12:23:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 34.758253] nix-grpc-daemon[777]: ts=2026-09-20T12:23:15Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 34.764999] nix-grpc-daemon[777]: ts=2026-09-20T12:23:15Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 34.740307] nix-daemon[832]: reaped child process 865, status = succeeded worker1 # [ 34.783435] nix-grpc-daemon[776]: ts=2026-09-20T12:23:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 34.805006] nix-grpc-daemon[776]: ts=2026-09-20T12:23:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 34.823871] nix-grpc-daemon[841]: time=2026-09-20T12:23:15.363Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 34.837530] nix-grpc-daemon[776]: ts=2026-09-20T12:23:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 34.861074] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 35.084732] nix-daemon[832]: accepted connection from pid 889, user nix-grpc-daemon (trusted) worker1 # [ 35.106169] nix-daemon[832]: reaped child process 892, status = succeeded worker1 # [ 35.288127] nix-daemon[832]: accepted connection from pid 894, user nix-grpc-daemon (trusted) worker1 # [ 35.309294] nix-daemon[832]: reaped child process 897, status = succeeded lb # [ 35.343178] niks3-server[1002]: 2026/09/20 12:23:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 35.337286] nix-grpc-daemon[841]: time=2026-09-20T12:23:15.876Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 35.338838] nix-grpc-daemon[841]: time=2026-09-20T12:23:15.876Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 35.387794] niks3-server[1002]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst worker1 # [ 35.379810] nix-grpc-daemon[841]: time=2026-09-20T12:23:15.919Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.405117] niks3-server[1002]: 2026/09/20 12:23:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 35.415358] niks3-server[1002]: 2026/09/20 12:23:15 INFO Signed narinfos id=3 count=1 lb # [ 35.420772] niks3-server[1002]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 35.428418] niks3-server[1002]: 2026/09/20 12:23:15 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 35.434714] niks3-server[1002]: 2026/09/20 12:23:15 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo lb # [ 35.439887] niks3-server[1002]: 2026/09/20 12:23:15 INFO Completed upload id=3 worker1 # [ 35.417781] nix-grpc-daemon[841]: time=2026-09-20T12:23:15.957Z level=INFO msg="Upload complete. (537ms)" worker1 # [ 35.428421] nix-grpc-daemon[776]: ts=2026-09-20T12:23:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 35.447560] nix-grpc-daemon[776]: ts=2026-09-20T12:23:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 35.455315] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 35.461663] nix-daemon[832]: reaped child process 887, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker1 # [ 35.478277] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-t1 worker1 # [ 36.716759] nix-daemon[832]: reaped child process 901, status = succeeded worker1 # [ 36.899266] nix-daemon[832]: accepted connection from pid 917, user nix-grpc-daemon (trusted) worker1 # [ 36.919941] nix-daemon[832]: reaped child process 920, status = succeeded lb # [ 36.958451] niks3-server[1002]: 2026/09/20 12:23:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 36.948549] nix-grpc-daemon[841]: time=2026-09-20T12:23:17.487Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 36.950211] nix-grpc-daemon[841]: time=2026-09-20T12:23:17.487Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 37.000371] niks3-server[1002]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 37.019022] niks3-server[1002]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 37.030919] niks3-server[1002]: 2026/09/20 12:23:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 37.038483] niks3-server[1002]: 2026/09/20 12:23:17 INFO Signed narinfos id=4 count=1 worker1 # [ 37.016692] nix-grpc-daemon[841]: time=2026-09-20T12:23:17.556Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.043505] niks3-server[1002]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 37.056537] niks3-server[1002]: 2026/09/20 12:23:17 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete worker1 # [ 37.041751] nix-grpc-daemon[841]: time=2026-09-20T12:23:17.581Z level=INFO msg="Upload complete. (351ms)" lb # [ 37.066490] niks3-server[1002]: 2026/09/20 12:23:17 INFO Completed upload id=4 lb # [ 37.069473] niks3-server[1002]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker1 # [ 37.057307] nix-grpc-daemon[776]: ts=2026-09-20T12:23:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 37.093430] nix-grpc-daemon[777]: ts=2026-09-20T12:23:17Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 37.099954] nix-grpc-daemon[777]: ts=2026-09-20T12:23:17Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 37.078783] nix-daemon[832]: reaped child process 899, status = succeeded worker1 # [ 37.120000] nix-grpc-daemon[776]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 37.139076] nix-grpc-daemon[776]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 37.159284] nix-grpc-daemon[841]: time=2026-09-20T12:23:17.699Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 37.172087] nix-grpc-daemon[776]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 37.196924] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 37.432958] nix-daemon[832]: accepted connection from pid 924, user nix-grpc-daemon (trusted) worker1 # [ 37.454875] nix-daemon[832]: reaped child process 927, status = succeeded worker1 # [ 37.647657] nix-daemon[832]: accepted connection from pid 929, user nix-grpc-daemon (trusted) worker1 # [ 37.669642] nix-daemon[832]: reaped child process 932, status = succeeded lb # [ 37.707649] niks3-server[1002]: 2026/09/20 12:23:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.700466] nix-grpc-daemon[841]: time=2026-09-20T12:23:18.240Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 37.702056] nix-grpc-daemon[841]: time=2026-09-20T12:23:18.240Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 37.754862] niks3-server[1002]: 2026/09/20 12:23:18 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 37.769378] niks3-server[1002]: 2026/09/20 12:23:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 37.754364] nix-grpc-daemon[841]: time=2026-09-20T12:23:18.294Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.779799] niks3-server[1002]: 2026/09/20 12:23:18 INFO Signed narinfos id=5 count=1 lb # [ 37.786743] niks3-server[1002]: 2026/09/20 12:23:18 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 37.804299] niks3-server[1002]: 2026/09/20 12:23:18 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 37.813346] niks3-server[1002]: 2026/09/20 12:23:18 INFO Completed upload id=5 worker1 # [ 37.791161] nix-grpc-daemon[841]: time=2026-09-20T12:23:18.331Z level=INFO msg="Upload complete. (571ms)" lb # [ 37.816722] niks3-server[1002]: 2026/09/20 12:23:18 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 37.804800] nix-grpc-daemon[776]: ts=2026-09-20T12:23:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 37.820419] nix-grpc-daemon[776]: ts=2026-09-20T12:23:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 37.831016] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 37.837891] nix-daemon[832]: reaped child process 922, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 37.859779] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1 worker1 # [ 39.292855] nix-daemon[832]: reaped child process 936, status = succeeded worker1 # [ 39.477904] nix-daemon[832]: accepted connection from pid 952, user nix-grpc-daemon (trusted) worker1 # [ 39.498163] nix-daemon[832]: reaped child process 955, status = succeeded lb # [ 39.533368] niks3-server[1002]: 2026/09/20 12:23:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 39.527321] nix-grpc-daemon[841]: time=2026-09-20T12:23:20.065Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 39.529121] nix-grpc-daemon[841]: time=2026-09-20T12:23:20.065Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 39.596389] niks3-server[1002]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 39.606634] niks3-server[1002]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 39.612927] niks3-server[1002]: 2026/09/20 12:23:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker1 # [ 39.595901] nix-grpc-daemon[841]: time=2026-09-20T12:23:20.135Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.620505] niks3-server[1002]: 2026/09/20 12:23:20 INFO Signed narinfos id=6 count=1 lb # [ 39.629220] niks3-server[1002]: 2026/09/20 12:23:20 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 39.635653] niks3-server[1002]: 2026/09/20 12:23:20 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 39.641150] niks3-server[1002]: 2026/09/20 12:23:20 INFO Completed upload id=6 worker1 # [ 39.618335] nix-grpc-daemon[841]: time=2026-09-20T12:23:20.158Z level=INFO msg="Upload complete. (343ms)" worker1 # [ 39.632611] nix-grpc-daemon[841]: time=2026-09-20T12:23:20.159Z level=WARN msg="Failed to register uploaded object" key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 39.653746] nix-grpc-daemon[776]: ts=2026-09-20T12:23:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker1 # [ 39.661509] nix-daemon[832]: reaped child process 934, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.52 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.27 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.33 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.28 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker2 # [ 41.347615] nix-grpc-daemon[777]: ts=2026-09-20T12:23:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39080 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 41.357843] nix-grpc-daemon[777]: ts=2026-09-20T12:23:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 41.393759] nix-grpc-daemon[777]: ts=2026-09-20T12:23:21Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.34 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.22 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.52 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 42.445132] nix-grpc-daemon[776]: ts=2026-09-20T12:23:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57522 worker2 # [ 42.485723] nix-grpc-daemon[777]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 42.501329] nix-grpc-daemon[777]: ts=2026-09-20T12:23:23Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 42.507794] nix-grpc-daemon[777]: ts=2026-09-20T12:23:23Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 42.519661] nix-grpc-daemon[776]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 42.536724] nix-grpc-daemon[776]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57522 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker1 # [ 42.549083] nix-grpc-daemon[841]: time=2026-09-20T12:23:23.087Z level=INFO msg="All 2 paths already cached" worker1 # [ 42.555594] nix-grpc-daemon[776]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 42.571710] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 42.783334] nix-daemon[832]: accepted connection from pid 972, user nix-grpc-daemon (trusted) worker1 # [ 42.804919] nix-daemon[832]: reaped child process 976, status = succeeded lb # [ 42.926391] envoy[937]: conn peer=[2001:db8:1::1]:39758 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9566 tx=3857 ms=7258 lb # [ 42.931743] envoy[937]: conn peer=[2001:db8:1::1]:41412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=481 ms=71 worker1 # [ 42.985635] nix-daemon[832]: accepted connection from pid 978, user nix-grpc-daemon (trusted) worker1 # [ 43.004909] nix-daemon[832]: reaped child process 981, status = succeeded lb # [ 43.039646] niks3-server[1002]: 2026/09/20 12:23:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.036378] nix-grpc-daemon[841]: time=2026-09-20T12:23:23.575Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 43.037956] nix-grpc-daemon[841]: time=2026-09-20T12:23:23.576Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 43.102870] niks3-server[1002]: 2026/09/20 12:23:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker1 # [ 43.085747] nix-grpc-daemon[841]: time=2026-09-20T12:23:23.625Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.111309] niks3-server[1002]: 2026/09/20 12:23:23 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 43.119510] niks3-server[1002]: 2026/09/20 12:23:23 INFO Signed narinfos id=7 count=1 lb # [ 43.122991] niks3-server[1002]: 2026/09/20 12:23:23 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls worker1 # [ 43.107235] nix-grpc-daemon[841]: time=2026-09-20T12:23:23.647Z level=INFO msg="Upload complete. (512ms)" lb # [ 43.131622] niks3-server[1002]: 2026/09/20 12:23:23 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 43.135794] niks3-server[1002]: 2026/09/20 12:23:23 INFO Completed upload id=7 lb # [ 43.139286] niks3-server[1002]: 2026/09/20 12:23:23 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker1 # [ 43.117315] nix-grpc-daemon[776]: ts=2026-09-20T12:23:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 43.132501] nix-grpc-daemon[776]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 43.138843] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 43.144847] nix-daemon[832]: reaped child process 970, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 43.160790] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1b worker1 # [ 43.783457] nix-daemon[832]: reaped child process 985, status = succeeded worker1 # [ 43.945808] nix-daemon[832]: accepted connection from pid 1000, user nix-grpc-daemon (trusted) worker1 # [ 43.965861] nix-daemon[832]: reaped child process 1003, status = succeeded lb # [ 43.999132] niks3-server[1002]: 2026/09/20 12:23:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.988439] nix-grpc-daemon[841]: time=2026-09-20T12:23:24.527Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 43.989947] nix-grpc-daemon[841]: time=2026-09-20T12:23:24.527Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 44.041754] niks3-server[1002]: 2026/09/20 12:23:24 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 44.059101] niks3-server[1002]: 2026/09/20 12:23:24 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 44.070614] niks3-server[1002]: 2026/09/20 12:23:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 44.077451] niks3-server[1002]: 2026/09/20 12:23:24 INFO Signed narinfos id=8 count=1 worker1 # [ 44.055273] nix-grpc-daemon[841]: time=2026-09-20T12:23:24.594Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.081233] niks3-server[1002]: 2026/09/20 12:23:24 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 44.094810] niks3-server[1002]: 2026/09/20 12:23:24 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 44.101866] niks3-server[1002]: 2026/09/20 12:23:24 INFO Completed upload id=8 worker1 # [ 44.079744] nix-grpc-daemon[841]: time=2026-09-20T12:23:24.619Z level=INFO msg="Upload complete. (308ms)" lb # [ 44.105935] niks3-server[1002]: 2026/09/20 12:23:24 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker1 # [ 44.093149] nix-grpc-daemon[776]: ts=2026-09-20T12:23:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker1 # [ 44.108997] nix-daemon[832]: reaped child process 983, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 1.96 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.60 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 44.685289] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: b4ab2ec9fc1e49c2ae99a0e092b72593 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 44.950810] nix[882]: don't know how to build these paths: client # [ 44.951863] nix[882]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 44.955170] nix-grpc-daemon[777]: ts=2026-09-20T12:23:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 44.970788] nix-grpc-daemon[777]: ts=2026-09-20T12:23:25Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 44.978724] nix-grpc-daemon[777]: ts=2026-09-20T12:23:25Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 45.016116] nix-grpc-daemon[777]: ts=2026-09-20T12:23:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 45.036967] nix-grpc-daemon[777]: ts=2026-09-20T12:23:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39080 client # [ 45.044599] nix[882]: copying 1 paths to 'lb:50051'... client # [ 45.050857] nix[882]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 45.055605] nix-grpc-daemon[777]: ts=2026-09-20T12:23:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 45.072588] nix-daemon[844]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 45.111321] nix-grpc-daemon[777]: ts=2026-09-20T12:23:25Z level=info event=niks3_push_started pid=896 worker2 # [ 45.383505] nix-grpc-daemon[896]: time=2026-09-20T12:23:25.924Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 45.586011] nix-daemon[844]: accepted connection from pid 909, user nix-grpc-daemon (trusted) worker2 # [ 45.608375] nix-daemon[844]: reaped child process 912, status = succeeded worker2 # [ 45.791247] nix-daemon[844]: accepted connection from pid 914, user nix-grpc-daemon (trusted) worker2 # [ 45.811435] nix-daemon[844]: reaped child process 917, status = succeeded lb # [ 45.817157] niks3-server[1002]: 2026/09/20 12:23:26 INFO Received uploads request method=POST path=/api/pending_closures client # [ 45.817232] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. worker2 # [ 45.834945] nix-grpc-daemon[896]: time=2026-09-20T12:23:26.377Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 45.838609] nix-grpc-daemon[896]: time=2026-09-20T12:23:26.379Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.15 seconds) lb # [ 45.858190] niks3-server[1002]: 2026/09/20 12:23:26 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst lb # [ 45.871852] niks3-server[1002]: 2026/09/20 12:23:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker2 # [ 45.885871] nix-grpc-daemon[896]: time=2026-09-20T12:23:26.427Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.882090] niks3-server[1002]: 2026/09/20 12:23:26 INFO Signed narinfos id=9 count=1 lb # [ 45.890345] niks3-server[1002]: 2026/09/20 12:23:26 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 45.902127] niks3-server[1002]: 2026/09/20 12:23:26 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 45.915163] niks3-server[1002]: 2026/09/20 12:23:26 INFO Completed upload id=9 worker2 # [ 45.922970] nix-grpc-daemon[896]: time=2026-09-20T12:23:26.465Z level=INFO msg="Upload complete. (530ms)" lb # [ 45.919374] niks3-server[1002]: 2026/09/20 12:23:26 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 45.932393] nix-grpc-daemon[777]: ts=2026-09-20T12:23:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39080 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 45.948695] nix-grpc-daemon[777]: ts=2026-09-20T12:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 45.958268] nix-daemon[844]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 45.962205] nix-daemon[844]: reaped child process 894, status = succeeded client # Running as unit: dedup2.service; invocation ID: 4183450fbe9e4a06ae177b14355d723b client # [ 45.966771] nix[882]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 45.975734] nix-daemon[844]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # [ 46.177570] nix[897]: don't know how to build these paths: client # [ 46.179476] nix[897]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 46.152120] nix-grpc-daemon[776]: ts=2026-09-20T12:23:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57522 worker2 # [ 46.196635] nix-grpc-daemon[777]: ts=2026-09-20T12:23:26Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 client # [ 46.200819] nix[897]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 46.203919] nix-grpc-daemon[777]: ts=2026-09-20T12:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39080 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.07 seconds) ??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 client: waiting for success: ! systemctl is-active dedup1 dedup2 ??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 worker2 # [ 49.625566] nix-daemon[844]: reaped child process 921, status = succeeded worker2 # [ 49.812283] nix-daemon[844]: accepted connection from pid 953, user nix-grpc-daemon (trusted) worker2 # [ 49.831589] nix-daemon[844]: reaped child process 956, status = succeeded lb # [ 49.838595] niks3-server[1002]: 2026/09/20 12:23:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 49.858374] nix-grpc-daemon[896]: time=2026-09-20T12:23:30.400Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 49.860977] nix-grpc-daemon[896]: time=2026-09-20T12:23:30.402Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 49.892435] niks3-server[1002]: 2026/09/20 12:23:30 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 49.904788] niks3-server[1002]: 2026/09/20 12:23:30 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 49.916199] niks3-server[1002]: 2026/09/20 12:23:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 49.922393] niks3-server[1002]: 2026/09/20 12:23:30 INFO Signed narinfos id=10 count=1 worker2 # [ 49.931959] nix-grpc-daemon[896]: time=2026-09-20T12:23:30.472Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.925653] niks3-server[1002]: 2026/09/20 12:23:30 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 49.939434] niks3-server[1002]: 2026/09/20 12:23:30 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 49.947664] niks3-server[1002]: 2026/09/20 12:23:30 INFO Completed upload id=10 worker2 # [ 49.955427] nix-grpc-daemon[896]: time=2026-09-20T12:23:30.497Z level=INFO msg="Upload complete. (364ms)" lb # [ 49.950694] niks3-server[1002]: 2026/09/20 12:23:30 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 49.969265] nix-grpc-daemon[777]: ts=2026-09-20T12:23:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39080 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 49.988748] nix-grpc-daemon[777]: ts=2026-09-20T12:23:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39080 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 49.997114] nix-daemon[844]: reaped child process 919, status = succeeded client # [ 50.006752] systemd[1]: dedup2.service: Deactivated successfully. client # [ 50.013338] systemd[1]: dedup2.service: Consumed 183ms CPU time over 4.194s wall clock time, 28.9M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic. client # [ 50.052717] systemd[1]: dedup1.service: Deactivated successfully. client # [ 50.055013] systemd[1]: dedup1.service: Consumed 162ms CPU time over 5.371s wall clock time, 39.2M memory peak, 8.4K incoming IP traffic, 9.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.06 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.35 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 51.183447] systemd[1]: Started Nix Daemon. client # [ 51.373444] nix-daemon[939]: accepted connection from pid 936, user root (trusted) worker2 # [ 51.583106] nix-grpc-daemon[777]: ts=2026-09-20T12:23:32Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:39080 worker1 # [ 51.559826] nix-grpc-daemon[776]: ts=2026-09-20T12:23:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57522 worker2 # [ 51.604276] nix-grpc-daemon[777]: ts=2026-09-20T12:23:32Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 51.610544] nix-grpc-daemon[777]: ts=2026-09-20T12:23:32Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 51.626116] nix-grpc-daemon[776]: ts=2026-09-20T12:23:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 51.642149] nix-grpc-daemon[776]: ts=2026-09-20T12:23:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 51.657893] nix-grpc-daemon[776]: ts=2026-09-20T12:23:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 51.677696] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 51.896192] nix-daemon[832]: accepted connection from pid 1029, user nix-grpc-daemon (trusted) worker1 # [ 51.918516] nix-daemon[832]: reaped child process 1032, status = succeeded worker1 # [ 52.095722] nix-daemon[832]: accepted connection from pid 1034, user nix-grpc-daemon (trusted) worker1 # [ 52.116505] nix-daemon[832]: reaped child process 1037, status = succeeded lb # [ 52.151296] niks3-server[1002]: 2026/09/20 12:23:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.139020] nix-grpc-daemon[841]: time=2026-09-20T12:23:32.678Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.140649] nix-grpc-daemon[841]: time=2026-09-20T12:23:32.678Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 52.181207] niks3-server[1002]: 2026/09/20 12:23:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker1 # [ 52.167478] nix-grpc-daemon[841]: time=2026-09-20T12:23:32.707Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.192465] niks3-server[1002]: 2026/09/20 12:23:32 INFO Signed narinfos id=11 count=1 lb # [ 52.201623] niks3-server[1002]: 2026/09/20 12:23:32 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 52.211505] niks3-server[1002]: 2026/09/20 12:23:32 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst worker1 # [ 52.202312] nix-grpc-daemon[841]: time=2026-09-20T12:23:32.742Z level=INFO msg="Upload complete. (507ms)" lb # [ 52.225126] niks3-server[1002]: 2026/09/20 12:23:32 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 52.231750] niks3-server[1002]: 2026/09/20 12:23:32 INFO Completed upload id=11 lb # [ 52.235310] niks3-server[1002]: 2026/09/20 12:23:32 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker1 # [ 52.212321] nix-grpc-daemon[776]: ts=2026-09-20T12:23:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 52.224073] nix-grpc-daemon[776]: ts=2026-09-20T12:23:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 52.233624] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 52.236354] nix-daemon[832]: reaped child process 1027, status = succeeded worker1 # [ 52.247481] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) lb # [ 52.928421] envoy[937]: conn peer=[2001:db8:1::1]:41428 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4159 tx=1724 ms=1682 lb # [ 52.928682] envoy[937]: conn peer=[2001:db8:1::1]:41456 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=3806 lb # [ 52.928867] envoy[937]: conn peer=[2001:db8:1::1]:41444 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1397 ms=5075 worker1 # [ 53.479008] nix-daemon[832]: reaped child process 1041, status = succeeded worker1 # [ 53.644219] nix-daemon[832]: accepted connection from pid 1056, user nix-grpc-daemon (trusted) worker1 # [ 53.665031] nix-daemon[832]: reaped child process 1059, status = succeeded lb # [ 53.699648] niks3-server[1002]: 2026/09/20 12:23:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.688260] nix-grpc-daemon[841]: time=2026-09-20T12:23:34.226Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 53.689732] nix-grpc-daemon[841]: time=2026-09-20T12:23:34.226Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 53.732834] niks3-server[1002]: 2026/09/20 12:23:34 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 53.750138] niks3-server[1002]: 2026/09/20 12:23:34 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 53.757650] niks3-server[1002]: 2026/09/20 12:23:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker1 # [ 53.740757] nix-grpc-daemon[841]: time=2026-09-20T12:23:34.280Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.766051] niks3-server[1002]: 2026/09/20 12:23:34 INFO Signed narinfos id=12 count=1 lb # [ 53.775745] niks3-server[1002]: 2026/09/20 12:23:34 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 53.783344] niks3-server[1002]: 2026/09/20 12:23:34 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 53.790580] niks3-server[1002]: 2026/09/20 12:23:34 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo lb # [ 53.796796] niks3-server[1002]: 2026/09/20 12:23:34 INFO Completed upload id=12 worker1 # [ 53.774671] nix-grpc-daemon[841]: time=2026-09-20T12:23:34.314Z level=INFO msg="Upload complete. (314ms)" worker1 # [ 53.785150] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker1 # [ 53.804563] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 53.808981] nix-daemon[832]: reaped child process 1039, status = succeeded worker1 # [ 53.830137] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 53.837071] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 54.134140] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 54.141622] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 54.148435] nix-grpc-daemon[841]: time=2026-09-20T12:23:34.687Z level=INFO msg="All 1 paths already cached" worker2 # [ 54.194189] nix-grpc-daemon[777]: ts=2026-09-20T12:23:34Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 54.200596] nix-grpc-daemon[777]: ts=2026-09-20T12:23:34Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 54.174192] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 54.189133] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 54.203577] nix-grpc-daemon[841]: time=2026-09-20T12:23:34.743Z level=INFO msg="All 1 paths already cached" worker1 # [ 54.212942] nix-grpc-daemon[776]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 54.226894] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 54.434788] nix-daemon[832]: accepted connection from pid 1063, user nix-grpc-daemon (trusted) worker1 # [ 54.455115] nix-daemon[832]: reaped child process 1066, status = succeeded worker1 # [ 54.633281] nix-daemon[832]: accepted connection from pid 1068, user nix-grpc-daemon (trusted) worker1 # [ 54.651609] nix-daemon[832]: reaped child process 1071, status = succeeded lb # [ 54.685320] niks3-server[1002]: 2026/09/20 12:23:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 54.673035] nix-grpc-daemon[841]: time=2026-09-20T12:23:35.212Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 54.674549] nix-grpc-daemon[841]: time=2026-09-20T12:23:35.212Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 54.717047] niks3-server[1002]: 2026/09/20 12:23:35 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst lb # [ 54.730468] niks3-server[1002]: 2026/09/20 12:23:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker1 # [ 54.715072] nix-grpc-daemon[841]: time=2026-09-20T12:23:35.254Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.741804] niks3-server[1002]: 2026/09/20 12:23:35 INFO Signed narinfos id=13 count=1 lb # [ 54.747489] niks3-server[1002]: 2026/09/20 12:23:35 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls worker1 # [ 54.733152] nix-grpc-daemon[841]: time=2026-09-20T12:23:35.273Z level=INFO msg="Upload complete. (488ms)" lb # [ 54.756116] niks3-server[1002]: 2026/09/20 12:23:35 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 54.761250] niks3-server[1002]: 2026/09/20 12:23:35 INFO Completed upload id=13 worker1 # [ 54.740103] nix-grpc-daemon[776]: ts=2026-09-20T12:23:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 54.764581] niks3-server[1002]: 2026/09/20 12:23:35 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker1 # [ 54.751808] nix-grpc-daemon[776]: ts=2026-09-20T12:23:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 54.758521] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 54.763299] nix-daemon[832]: reaped child process 1061, status = succeeded worker1 # [ 54.776272] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 55.402425] nix-daemon[832]: reaped child process 1075, status = succeeded worker1 # [ 55.571082] nix-daemon[832]: accepted connection from pid 1090, user nix-grpc-daemon (trusted) worker1 # [ 55.589388] nix-daemon[832]: reaped child process 1093, status = succeeded lb # [ 55.625513] niks3-server[1002]: 2026/09/20 12:23:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 55.613929] nix-grpc-daemon[841]: time=2026-09-20T12:23:36.153Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 55.615493] nix-grpc-daemon[841]: time=2026-09-20T12:23:36.153Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 55.664886] niks3-server[1002]: 2026/09/20 12:23:36 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst worker1 # [ 55.658630] nix-grpc-daemon[841]: time=2026-09-20T12:23:36.198Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.680597] niks3-server[1002]: 2026/09/20 12:23:36 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 55.691460] niks3-server[1002]: 2026/09/20 12:23:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 55.700273] niks3-server[1002]: 2026/09/20 12:23:36 INFO Signed narinfos id=14 count=1 worker1 # [ 55.686253] nix-grpc-daemon[841]: time=2026-09-20T12:23:36.226Z level=INFO msg="Upload complete. (301ms)" lb # [ 55.709123] niks3-server[1002]: 2026/09/20 12:23:36 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 55.715232] niks3-server[1002]: 2026/09/20 12:23:36 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 55.720413] niks3-server[1002]: 2026/09/20 12:23:36 INFO Completed upload id=14 lb # [ 55.723079] niks3-server[1002]: 2026/09/20 12:23:36 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker1 # [ 55.700473] nix-grpc-daemon[776]: ts=2026-09-20T12:23:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker1 # [ 55.712449] nix-daemon[832]: reaped child process 1073, status = succeeded worker1 # [ 55.742146] nix-grpc-daemon[776]: ts=2026-09-20T12:23:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 55.773714] nix-grpc-daemon[776]: ts=2026-09-20T12:23:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 55.779141] nix-grpc-daemon[776]: ts=2026-09-20T12:23:36Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 56.111250] nix-grpc-daemon[777]: ts=2026-09-20T12:23:36Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 56.120106] nix-grpc-daemon[777]: ts=2026-09-20T12:23:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 56.150846] nix-grpc-daemon[777]: ts=2026-09-20T12:23:36Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 56.156843] nix-grpc-daemon[777]: ts=2026-09-20T12:23:36Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 56.166455] nix-grpc-daemon[776]: ts=2026-09-20T12:23:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 56.183111] nix-grpc-daemon[776]: ts=2026-09-20T12:23:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 56.199697] nix-grpc-daemon[841]: time=2026-09-20T12:23:36.738Z level=INFO msg="All 2 paths already cached" worker1 # [ 56.209094] nix-grpc-daemon[776]: ts=2026-09-20T12:23:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 56.223187] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 56.433406] nix-daemon[832]: accepted connection from pid 1097, user nix-grpc-daemon (trusted) worker1 # [ 56.454093] nix-daemon[832]: reaped child process 1100, status = succeeded worker1 # [ 56.631541] nix-daemon[832]: accepted connection from pid 1102, user nix-grpc-daemon (trusted) worker1 # [ 56.649125] nix-daemon[832]: reaped child process 1105, status = succeeded lb # [ 56.685771] niks3-server[1002]: 2026/09/20 12:23:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 56.673482] nix-grpc-daemon[841]: time=2026-09-20T12:23:37.213Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 56.674987] nix-grpc-daemon[841]: time=2026-09-20T12:23:37.213Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 56.713769] niks3-server[1002]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker1 # [ 56.706044] nix-grpc-daemon[841]: time=2026-09-20T12:23:37.245Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.733827] niks3-server[1002]: 2026/09/20 12:23:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 56.744562] niks3-server[1002]: 2026/09/20 12:23:37 INFO Signed narinfos id=15 count=1 lb # [ 56.747219] niks3-server[1002]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 56.758017] niks3-server[1002]: 2026/09/20 12:23:37 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 56.764779] niks3-server[1002]: 2026/09/20 12:23:37 INFO Completed upload id=15 worker1 # [ 56.742550] nix-grpc-daemon[841]: time=2026-09-20T12:23:37.282Z level=INFO msg="Upload complete. (500ms)" lb # [ 56.768083] niks3-server[1002]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker1 # [ 56.753784] nix-grpc-daemon[776]: ts=2026-09-20T12:23:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 56.765405] nix-grpc-daemon[776]: ts=2026-09-20T12:23:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 56.772755] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 56.777646] nix-daemon[832]: reaped child process 1095, status = succeeded worker1 # [ 56.791407] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 58.240923] nix-daemon[832]: reaped child process 1109, status = succeeded worker1 # [ 58.425046] nix-daemon[832]: accepted connection from pid 1124, user nix-grpc-daemon (trusted) worker1 # [ 58.443544] nix-daemon[832]: reaped child process 1127, status = succeeded lb # [ 58.478358] niks3-server[1002]: 2026/09/20 12:23:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 58.466720] nix-grpc-daemon[841]: time=2026-09-20T12:23:39.006Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 58.471744] nix-grpc-daemon[841]: time=2026-09-20T12:23:39.008Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 58.522778] niks3-server[1002]: 2026/09/20 12:23:39 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 58.539054] niks3-server[1002]: 2026/09/20 12:23:39 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 58.549465] niks3-server[1002]: 2026/09/20 12:23:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker1 # [ 58.532442] nix-grpc-daemon[841]: time=2026-09-20T12:23:39.072Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.558377] niks3-server[1002]: 2026/09/20 12:23:39 INFO Signed narinfos id=16 count=1 lb # [ 58.563417] niks3-server[1002]: 2026/09/20 12:23:39 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 58.571075] niks3-server[1002]: 2026/09/20 12:23:39 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 58.579987] niks3-server[1002]: 2026/09/20 12:23:39 INFO Completed upload id=16 worker1 # [ 58.557833] nix-grpc-daemon[841]: time=2026-09-20T12:23:39.097Z level=INFO msg="Upload complete. (355ms)" lb # [ 58.583435] niks3-server[1002]: 2026/09/20 12:23:39 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 58.569152] nix-grpc-daemon[776]: ts=2026-09-20T12:23:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker1 # [ 58.590572] nix-grpc-daemon[776]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 58.595842] nix-daemon[832]: reaped child process 1107, status = succeeded worker1 # [ 58.606524] nix-grpc-daemon[776]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 58.611870] nix-grpc-daemon[776]: ts=2026-09-20T12:23:39Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_out=232 client # [ 58.766723] nix-daemon[939]: reaped child process 941, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.83 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.97 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.46 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.24 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 60.106791] nix-daemon[939]: accepted connection from pid 1017, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 60.318951] nix-grpc-daemon[777]: ts=2026-09-20T12:23:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:39080 client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 60.326690] nix-grpc-daemon[777]: ts=2026-09-20T12:23:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39080 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker1 # [ 60.315035] nix-grpc-daemon[776]: ts=2026-09-20T12:23:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 60.332460] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 60.545498] nix-daemon[832]: accepted connection from pid 1136, user nix-grpc-daemon (trusted) worker1 # [ 60.565448] nix-daemon[832]: reaped child process 1139, status = succeeded lb # [ 60.602088] niks3-server[1002]: 2026/09/20 12:23:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 60.587810] nix-grpc-daemon[841]: time=2026-09-20T12:23:41.127Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 60.589504] nix-grpc-daemon[841]: time=2026-09-20T12:23:41.127Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 60.628402] niks3-server[1002]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker1 # [ 60.620783] nix-grpc-daemon[841]: time=2026-09-20T12:23:41.160Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.647272] niks3-server[1002]: 2026/09/20 12:23:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 60.656675] niks3-server[1002]: 2026/09/20 12:23:41 INFO Signed narinfos id=17 count=1 worker1 # [ 60.645344] nix-grpc-daemon[841]: time=2026-09-20T12:23:41.185Z level=INFO msg="Upload complete. (298ms)" lb # [ 60.662270] niks3-server[1002]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 60.672706] niks3-server[1002]: 2026/09/20 12:23:41 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete worker1 # [ 60.652108] nix-grpc-daemon[776]: ts=2026-09-20T12:23:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_in=120 lb # [ 60.676131] niks3-server[1002]: 2026/09/20 12:23:41 INFO Completed upload id=17 lb # [ 60.678119] niks3-server[1002]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker1 # [ 60.660670] nix-daemon[832]: reaped child process 1134, status = succeeded worker2 # [ 60.698862] nix-grpc-daemon[777]: ts=2026-09-20T12:23:41Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 60.706985] nix-grpc-daemon[777]: ts=2026-09-20T12:23:41Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 60.744516] nix-grpc-daemon[777]: ts=2026-09-20T12:23:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 60.761667] nix-grpc-daemon[777]: ts=2026-09-20T12:23:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39080 client # copying 2 paths to 'lb:50051'... worker2 # [ 60.781930] nix-grpc-daemon[777]: ts=2026-09-20T12:23:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39080 client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 60.799611] nix-daemon[844]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 61.014055] nix-daemon[844]: accepted connection from pid 980, user nix-grpc-daemon (trusted) worker2 # [ 61.034863] nix-daemon[844]: reaped child process 983, status = succeeded worker2 # [ 61.210797] nix-daemon[844]: accepted connection from pid 985, user nix-grpc-daemon (trusted) worker2 # [ 61.229740] nix-daemon[844]: reaped child process 988, status = succeeded lb # [ 61.232781] niks3-server[1002]: 2026/09/20 12:23:41 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 61.242296] niks3-server[1002]: 2026/09/20 12:23:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 61.260643] nix-grpc-daemon[896]: time=2026-09-20T12:23:41.802Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 61.262134] nix-grpc-daemon[896]: time=2026-09-20T12:23:41.802Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" worker2 # [ 61.263820] nix-grpc-daemon[896]: time=2026-09-20T12:23:41.802Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" lb # [ 61.275931] niks3-server[1002]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 61.295089] niks3-server[1002]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 61.303719] niks3-server[1002]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 61.312678] niks3-server[1002]: 2026/09/20 12:23:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 61.318219] niks3-server[1002]: 2026/09/20 12:23:41 INFO Signed narinfos id=18 count=1 worker2 # [ 61.327091] nix-grpc-daemon[896]: time=2026-09-20T12:23:41.868Z level=INFO msg="Uploading 3 narinfos" lb # [ 61.321246] niks3-server[1002]: 2026/09/20 12:23:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 61.327530] niks3-server[1002]: 2026/09/20 12:23:41 INFO Signed narinfos id=19 count=2 lb # [ 61.331836] niks3-server[1002]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 61.345319] niks3-server[1002]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 61.352496] niks3-server[1002]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 61.359123] niks3-server[1002]: 2026/09/20 12:23:41 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 61.365584] niks3-server[1002]: 2026/09/20 12:23:41 INFO Completed upload id=18 lb # [ 61.367084] niks3-server[1002]: 2026/09/20 12:23:41 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 61.369447] niks3-server[1002]: 2026/09/20 12:23:41 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 61.371934] niks3-server[1002]: 2026/09/20 12:23:41 INFO Completed upload id=19 worker2 # [ 61.379662] nix-grpc-daemon[896]: time=2026-09-20T12:23:41.921Z level=INFO msg="Upload complete. (560ms)" worker2 # [ 61.393216] nix-grpc-daemon[777]: ts=2026-09-20T12:23:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39080 duration_s=0 paths=2 nar_bytes_in=984 worker2 # [ 61.409980] nix-grpc-daemon[777]: ts=2026-09-20T12:23:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 61.421214] nix-daemon[844]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 61.424407] nix-daemon[844]: reaped child process 978, status = succeeded worker2 # [ 61.442340] nix-grpc-daemon[777]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker2 # [ 61.464248] nix-daemon[844]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 62.497232] nix-daemon[844]: reaped child process 993, status = succeeded worker2 # [ 62.664122] nix-daemon[844]: accepted connection from pid 1008, user nix-grpc-daemon (trusted) worker2 # [ 62.683767] nix-daemon[844]: reaped child process 1011, status = succeeded lb # [ 62.688807] niks3-server[1002]: 2026/09/20 12:23:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 62.705880] nix-grpc-daemon[896]: time=2026-09-20T12:23:43.247Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 62.718786] niks3-server[1002]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 62.726055] niks3-server[1002]: 2026/09/20 12:23:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker2 # [ 62.739498] nix-grpc-daemon[896]: time=2026-09-20T12:23:43.281Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.737478] niks3-server[1002]: 2026/09/20 12:23:43 INFO Signed narinfos id=20 count=1 lb # [ 62.744479] niks3-server[1002]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 62.753237] niks3-server[1002]: 2026/09/20 12:23:43 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 62.759804] niks3-server[1002]: 2026/09/20 12:23:43 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo lb # [ 62.764173] niks3-server[1002]: 2026/09/20 12:23:43 INFO Completed upload id=20 worker2 # [ 62.771561] nix-grpc-daemon[896]: time=2026-09-20T12:23:43.313Z level=INFO msg="Upload complete. (286ms)" worker2 # [ 62.780992] nix-grpc-daemon[777]: ts=2026-09-20T12:23:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39080 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker2 # [ 62.796340] nix-daemon[844]: reaped child process 990, status = succeeded client # copying 1 paths... worker1 # [ 62.801596] nix-grpc-daemon[776]: ts=2026-09-20T12:23:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 62.817271] nix-grpc-daemon[776]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 62.868154] nix-grpc-daemon[776]: ts=2026-09-20T12:23:43Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 62.874750] nix-grpc-daemon[776]: ts=2026-09-20T12:23:43Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_out=120 lb # [ 62.927825] envoy[937]: conn peer=[2001:db8:1::1]:59840 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=74 lb # [ 62.932811] envoy[937]: conn peer=[2001:db8:1::1]:59838 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3390 tx=1663 ms=2344 lb # [ 62.937596] envoy[937]: conn peer=[2001:db8:1::1]:59856 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3888 tx=1852 ms=1701 lb # [ 62.943415] envoy[937]: conn peer=[2001:db8:1::1]:59870 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=68 lb # [ 62.949607] envoy[937]: conn peer=[2001:db8:1::1]:59876 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4352 tx=2087 ms=2587 lb # [ 62.954525] envoy[937]: conn peer=[2001:db8:1::1]:59878 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=65 client # [ 63.034029] nix-daemon[939]: reaped child process 1020, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.17 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 63.251206] nix-daemon[939]: accepted connection from pid 1038, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 63.423612] nix-grpc-daemon[776]: ts=2026-09-20T12:23:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:57522 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 63.458150] nix-grpc-daemon[777]: ts=2026-09-20T12:23:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 63.469066] nix-grpc-daemon[896]: time=2026-09-20T12:23:44.011Z level=INFO msg="All 1 paths already cached" worker2 # [ 63.486787] nix-grpc-daemon[777]: ts=2026-09-20T12:23:44Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 63.493517] nix-grpc-daemon[777]: ts=2026-09-20T12:23:44Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 63.466489] nix-grpc-daemon[776]: ts=2026-09-20T12:23:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 63.482400] nix-grpc-daemon[776]: ts=2026-09-20T12:23:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57522 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 63.503782] nix-grpc-daemon[776]: ts=2026-09-20T12:23:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 63.518970] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 63.541916] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 1/5) worker1 # [ 63.563273] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 2/5) worker1 # [ 63.583823] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 227 ms (attempt 3/5) worker1 # [ 63.812527] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 464 ms (attempt 4/5) worker1 # [ 64.277049] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 64.287377] nix-grpc-daemon[776]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 64.529281] nix-daemon[832]: accepted connection from pid 1148, user nix-grpc-daemon (trusted) worker1 # [ 64.550914] nix-daemon[832]: reaped child process 1151, status = succeeded worker1 # [ 64.726879] nix-daemon[832]: accepted connection from pid 1153, user nix-grpc-daemon (trusted) worker1 # [ 64.746591] nix-daemon[832]: reaped child process 1156, status = succeeded lb # [ 64.782273] niks3-server[1002]: 2026/09/20 12:23:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 64.769397] nix-grpc-daemon[841]: time=2026-09-20T12:23:45.309Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 64.771326] nix-grpc-daemon[841]: time=2026-09-20T12:23:45.311Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 64.816728] niks3-server[1002]: 2026/09/20 12:23:45 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst lb # [ 64.831001] niks3-server[1002]: 2026/09/20 12:23:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker1 # [ 64.814265] nix-grpc-daemon[841]: time=2026-09-20T12:23:45.354Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.839082] niks3-server[1002]: 2026/09/20 12:23:45 INFO Signed narinfos id=21 count=1 lb # [ 64.847017] niks3-server[1002]: 2026/09/20 12:23:45 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 64.855748] niks3-server[1002]: 2026/09/20 12:23:45 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 64.862568] niks3-server[1002]: 2026/09/20 12:23:45 INFO Completed upload id=21 worker1 # [ 64.839765] nix-grpc-daemon[841]: time=2026-09-20T12:23:45.379Z level=INFO msg="Upload complete. (518ms)" lb # [ 64.864664] niks3-server[1002]: 2026/09/20 12:23:45 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker1 # [ 64.848944] nix-grpc-daemon[776]: ts=2026-09-20T12:23:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=1 paths=1 nar_bytes_in=568 worker1 # [ 64.859437] nix-grpc-daemon[776]: ts=2026-09-20T12:23:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 64.872123] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 64.877224] nix-daemon[832]: reaped child process 1142, status = succeeded client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 64.890962] nix-daemon[832]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 66.137301] nix-daemon[832]: reaped child process 1160, status = succeeded worker1 # [ 66.318189] nix-daemon[832]: accepted connection from pid 1175, user nix-grpc-daemon (trusted) worker1 # [ 66.338545] nix-daemon[832]: reaped child process 1178, status = succeeded lb # [ 66.373846] niks3-server[1002]: 2026/09/20 12:23:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 66.362054] nix-grpc-daemon[841]: time=2026-09-20T12:23:46.900Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 66.404682] niks3-server[1002]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 66.391786] nix-grpc-daemon[841]: time=2026-09-20T12:23:46.931Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.415734] niks3-server[1002]: 2026/09/20 12:23:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 66.428148] niks3-server[1002]: 2026/09/20 12:23:46 INFO Signed narinfos id=22 count=1 lb # [ 66.435011] niks3-server[1002]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls worker1 # [ 66.421453] nix-grpc-daemon[841]: time=2026-09-20T12:23:46.961Z level=INFO msg="Upload complete. (319ms)" lb # [ 66.445935] niks3-server[1002]: 2026/09/20 12:23:46 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 66.452138] niks3-server[1002]: 2026/09/20 12:23:46 INFO Completed upload id=22 worker1 # [ 66.430007] nix-grpc-daemon[776]: ts=2026-09-20T12:23:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 lb # [ 66.455803] niks3-server[1002]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker1 # [ 66.446011] nix-daemon[832]: reaped child process 1158, status = succeeded client # copying 1 paths... worker1 # [ 66.479088] nix-grpc-daemon[776]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57522 client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 66.515234] nix-grpc-daemon[776]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 66.520766] nix-grpc-daemon[776]: ts=2026-09-20T12:23:47Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57522 duration_s=0 paths=1 nar_bytes_out=120 client # [ 66.673093] nix-daemon[939]: reaped child process 1041, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.63 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 66.890998] nix-daemon[939]: accepted connection from pid 1059, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 67.067193] nix-grpc-daemon[776]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:57522 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 67.102438] nix-grpc-daemon[777]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 67.351310] nix-grpc-daemon[896]: time=2026-09-20T12:23:47.892Z level=INFO msg="All 1 paths already cached" worker2 # [ 67.375223] nix-grpc-daemon[777]: ts=2026-09-20T12:23:47Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 67.385655] nix-grpc-daemon[777]: ts=2026-09-20T12:23:47Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 67.392846] nix-grpc-daemon[777]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 67.404455] nix-grpc-daemon[777]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 67.421062] nix-grpc-daemon[896]: time=2026-09-20T12:23:47.963Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 67.432363] nix-grpc-daemon[777]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 67.447299] nix-daemon[844]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 67.654226] nix-daemon[844]: accepted connection from pid 1019, user nix-grpc-daemon (trusted) worker2 # [ 67.672941] nix-daemon[844]: reaped child process 1022, status = succeeded worker2 # [ 67.850345] nix-daemon[844]: accepted connection from pid 1024, user nix-grpc-daemon (trusted) worker2 # [ 67.868440] nix-daemon[844]: reaped child process 1027, status = succeeded lb # [ 67.873326] niks3-server[1002]: 2026/09/20 12:23:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 67.890141] nix-grpc-daemon[896]: time=2026-09-20T12:23:48.432Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 67.891707] nix-grpc-daemon[896]: time=2026-09-20T12:23:48.432Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 67.900306] niks3-server[1002]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 67.915723] niks3-server[1002]: 2026/09/20 12:23:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker2 # [ 67.930589] nix-grpc-daemon[896]: time=2026-09-20T12:23:48.472Z level=INFO msg="Uploading 1 narinfos" lb # [ 67.929595] niks3-server[1002]: 2026/09/20 12:23:48 INFO Signed narinfos id=23 count=1 lb # [ 67.934902] niks3-server[1002]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls worker2 # [ 67.950415] nix-grpc-daemon[896]: time=2026-09-20T12:23:48.492Z level=INFO msg="Upload complete. (486ms)" lb # [ 67.944665] niks3-server[1002]: 2026/09/20 12:23:48 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 67.950331] niks3-server[1002]: 2026/09/20 12:23:48 INFO Completed upload id=23 lb # [ 67.953892] niks3-server[1002]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker2 # [ 67.956450] nix-grpc-daemon[777]: ts=2026-09-20T12:23:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39080 duration_s=0 paths=1 nar_bytes_in=568 worker2 # [ 67.970275] nix-grpc-daemon[777]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 67.976005] nix-daemon[844]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 67.981242] nix-daemon[844]: reaped child process 1017, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker2 # [ 67.994040] nix-daemon[844]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 69.040901] nix-daemon[844]: reaped child process 1031, status = succeeded worker2 # [ 69.231073] nix-daemon[844]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 69.249323] nix-daemon[844]: reaped child process 1049, status = succeeded lb # [ 69.257266] niks3-server[1002]: 2026/09/20 12:23:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 69.276450] nix-grpc-daemon[896]: time=2026-09-20T12:23:49.817Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 69.287538] niks3-server[1002]: 2026/09/20 12:23:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker2 # [ 69.305948] nix-grpc-daemon[896]: time=2026-09-20T12:23:49.848Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.301347] niks3-server[1002]: 2026/09/20 12:23:49 INFO Signed narinfos id=24 count=1 lb # [ 69.308554] niks3-server[1002]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 69.324586] niks3-server[1002]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 69.338880] nix-grpc-daemon[896]: time=2026-09-20T12:23:49.881Z level=INFO msg="Upload complete. (334ms)" lb # [ 69.331840] niks3-server[1002]: 2026/09/20 12:23:49 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 69.337102] niks3-server[1002]: 2026/09/20 12:23:49 INFO Completed upload id=24 lb # [ 69.339715] niks3-server[1002]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker2 # [ 69.348987] nix-grpc-daemon[777]: ts=2026-09-20T12:23:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39080 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker2 # [ 69.363162] nix-daemon[844]: reaped child process 1029, status = succeeded client # copying 1 paths... worker2 # [ 69.393382] nix-grpc-daemon[777]: ts=2026-09-20T12:23:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:39080 client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 69.424004] nix-grpc-daemon[777]: ts=2026-09-20T12:23:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39080 worker2 # [ 69.430801] nix-grpc-daemon[777]: ts=2026-09-20T12:23:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:39080 duration_s=0 paths=1 nar_bytes_out=120 client # [ 69.555448] nix-daemon[939]: reaped child process 1062, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.88 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 10.64 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.61 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.46 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds) worker2 # [ 71.175904] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 71.415960] nix-grpc-daemon[777]: ts=2026-09-20T12:23:51Z level=info event=signal_exit worker2 # [ 71.656550] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=scheduler_yield worker2 # [ 71.661655] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 71.659115] niks3-server[1002]: 2026/09/20 12:23:52 INFO lead: released remote=192.168.1.4:54518 worker2 # [ 71.667395] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39074 worker2 # [ 71.672199] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 71.643766] nix-grpc-daemon[776]: ts=2026-09-20T12:23:52Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 71.677934] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39074 worker2 # [ 71.682441] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 71.863159] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:50051 lb # [ 71.861615] niks3-server[1002]: 2026/09/20 12:23:52 INFO lead: acquired remote=192.168.1.3:52924 worker2 # [ 71.868539] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 71.844463] nix-grpc-daemon[776]: ts=2026-09-20T12:23:52Z level=info event=scheduler_take_over worker1 # [ 71.849773] nix-grpc-daemon[776]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 71.853905] nix-grpc-daemon[776]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 72.069703] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 72.074964] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 72.050841] nix-grpc-daemon[776]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 72.056571] nix-grpc-daemon[776]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 72.276108] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 72.281750] nix-grpc-daemon[777]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 72.257505] nix-grpc-daemon[776]: ts=2026-09-20T12:23:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 72.262971] nix-grpc-daemon[776]: ts=2026-09-20T12:23:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 72.484382] nix-grpc-daemon[777]: ts=2026-09-20T12:23:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 72.488645] nix-grpc-daemon[777]: ts=2026-09-20T12:23:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 72.463966] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 72.469409] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 72.662939] nix-grpc-daemon[777]: ts=2026-09-20T12:23:53Z level=info event=scheduler_restarting worker1 # [ 72.671501] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 72.703418] nix-grpc-daemon[777]: ts=2026-09-20T12:23:53Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 72.679721] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 72.885548] nix-daemon[844]: reaped child process 846, status = succeeded worker1 # [ 72.880876] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 72.886173] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 72.926618] envoy[937]: conn peer=[2001:db8:1::1]:59880 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4244 tx=1866 ms=2649 lb # [ 72.931720] envoy[937]: conn peer=[2001:db8:1::1]:34924 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=74 lb # [ 72.936552] envoy[937]: conn peer=[2001:db8:1::1]:34926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3724 tx=1824 ms=3150 lb # [ 72.941460] envoy[937]: conn peer=[2001:db8:1::1]:34940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=65 lb # [ 72.946199] envoy[937]: conn peer=[2001:db8:1::1]:34956 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3742 tx=1821 ms=2391 lb # [ 72.951131] envoy[937]: conn peer=[2001:db8:1::1]:34966 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=72 lb # [ 72.955945] envoy[937]: conn peer=[2001:db8:1::4]:52602 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=20006 tx=1321 ms=49280 worker2 # [ 73.029170] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 73.035749] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 73.042911] systemd[1]: nix-grpc-daemon.service: Consumed 1.770s CPU time over 49.925s wall clock time, 51.5M memory peak, 49K incoming IP traffic, 103.9K outgoing IP traffic. worker2 # [ 73.057749] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 73.059629] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 73.061900] systemd[1]: nix-grpc-daemon.socket: Consumed 716us CPU time over 1min 1.102s wall clock time, 256K memory peak, 65.9K incoming IP traffic, 55K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 73.087235] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 73.092896] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 73.293860] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 73.299472] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 73.379003] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57522 worker1 # [ 73.389207] nix-grpc-daemon[776]: ts=2026-09-20T12:23:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57522 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.30 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker1 # [ 73.500261] nix-grpc-daemon[776]: ts=2026-09-20T12:23:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 73.520138] nix-grpc-daemon[776]: ts=2026-09-20T12:23:54Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:36522 worker1 # [ 73.526352] nix-grpc-daemon[776]: ts=2026-09-20T12:23:54Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 73.565933] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 73.617332] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 74.248798] nix-grpc-daemon[776]: ts=2026-09-20T12:23:54Z level=info event=signal_exit worker1 # [ 74.507921] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=scheduler_yield lb # [ 74.533981] niks3-server[1002]: 2026/09/20 12:23:55 INFO lead: released remote=192.168.1.3:52924 worker1 # [ 74.514047] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 74.546493] systemd[1]: Starting scheduler-token.service... worker1 # [ 74.526642] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36522 worker1 # [ 74.532146] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 74.679162] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 74.684784] systemd[1]: Finished scheduler-token.service. worker2 # [ 74.686558] systemd[1]: scheduler-token.service: Consumed 70ms CPU time over 139ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 74.698280] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 74.715467] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.721417] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.917745] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 74.920683] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 74.925772] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 74.937925] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 74.939823] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 74.922564] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 74.961356] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:55Z level=info event=scheduler_take_over lb # [ 74.954078] niks3-server[1002]: 2026/09/20 12:23:55 INFO lead: acquired remote=192.168.1.4:41688 worker1 # [ 74.942144] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.977355] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 74.980827] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.143965] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.149768] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 75.183455] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 75.189225] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.354020] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.358554] nix-grpc-daemon[776]: ts=2026-09-20T12:23:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 75.390705] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 75.396496] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.514077] nix-grpc-daemon[776]: ts=2026-09-20T12:23:56Z level=info event=scheduler_restarting worker2 # [ 75.598211] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 75.604188] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.584219] nix-grpc-daemon[776]: ts=2026-09-20T12:23:56Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 75.593711] nix-daemon[832]: reaped child process 834, status = succeeded worker2 # [ 75.807352] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 75.814035] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 76.024240] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 76.048312] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:56Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 76.054907] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:56Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:51978 worker2 # [ 76.060456] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:56Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 76.372636] nix-grpc-daemon[776]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 76.377633] nix-grpc-daemon[776]: E0000 00:00:1789907036.910447 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 76.386439] nix-grpc-daemon[776]: E0000 00:00:1789907036.925754 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 76.914523] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 76.924863] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 76.927189] systemd[1]: nix-grpc-daemon.service: Consumed 3.649s CPU time over 53.998s wall clock time, 56.4M memory peak, 83.1K incoming IP traffic, 148.6K outgoing IP traffic. worker1 # [ 76.942523] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 76.945174] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 76.948832] systemd[1]: nix-grpc-daemon.socket: Consumed 632us CPU time over 1min 5.429s wall clock time, 256K memory peak, 80.1K incoming IP traffic, 66.5K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 77.331567] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51990 worker2 # [ 77.339013] nix-daemon[844]: accepted connection from pid 1073, user nix-grpc-daemon (trusted) worker2 # [ 77.357099] nix-grpc-daemon[1073]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 69 ms (attempt 1/5) worker2 # [ 77.430065] nix-grpc-daemon[1073]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 2/5) worker2 # [ 77.466817] nix-grpc-daemon[1073]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 307 ms (attempt 3/5) worker2 # [ 77.781585] nix-grpc-daemon[1073]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 302 ms (attempt 4/5) worker2 # [ 78.093757] nix-grpc-daemon[1073]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 78.122956] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51990 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 78.140224] nix-daemon[844]: accepted connection from pid 1073, user nix-grpc-daemon (trusted) worker2 # [ 78.176416] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:58Z level=info event=niks3_push_started pid=1129 worker2 # [ 78.403674] nix-grpc-daemon[1129]: time=2026-09-20T12:23:58.945Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 78.586334] nix-daemon[844]: accepted connection from pid 1142, user nix-grpc-daemon (trusted) worker2 # [ 78.605843] nix-daemon[844]: reaped child process 1145, status = succeeded lb # [ 78.611383] niks3-server[1002]: 2026/09/20 12:23:59 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 78.622900] niks3-server[1002]: 2026/09/20 12:23:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 78.643737] nix-grpc-daemon[1129]: time=2026-09-20T12:23:59.183Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 78.646344] nix-grpc-daemon[1129]: time=2026-09-20T12:23:59.183Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 78.648589] nix-grpc-daemon[1129]: time=2026-09-20T12:23:59.184Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 78.675239] niks3-server[1002]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 78.691244] niks3-server[1002]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 78.704779] niks3-server[1002]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 78.716342] niks3-server[1002]: 2026/09/20 12:23:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 78.718734] niks3-server[1002]: 2026/09/20 12:23:59 INFO Signed narinfos id=25 count=1 worker2 # [ 78.723825] nix-grpc-daemon[1129]: time=2026-09-20T12:23:59.265Z level=INFO msg="Uploading 3 narinfos" lb # [ 78.728269] niks3-server[1002]: 2026/09/20 12:23:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 78.730612] niks3-server[1002]: 2026/09/20 12:23:59 INFO Signed narinfos id=26 count=2 lb # [ 78.757832] niks3-server[1002]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 78.768155] niks3-server[1002]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 78.776761] niks3-server[1002]: 2026/09/20 12:23:59 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 78.787689] niks3-server[1002]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 78.793531] niks3-server[1002]: 2026/09/20 12:23:59 INFO Completed upload id=25 lb # [ 78.796335] niks3-server[1002]: 2026/09/20 12:23:59 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 78.799931] niks3-server[1002]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 78.802599] niks3-server[1002]: 2026/09/20 12:23:59 INFO Completed upload id=26 worker2 # [ 78.810497] nix-grpc-daemon[1129]: time=2026-09-20T12:23:59.352Z level=INFO msg="Upload complete. (402ms)" worker2 # [ 78.821271] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51990 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 78.840101] nix-daemon[844]: reaped child process 1127, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.79 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds) worker1 # [ 78.964954] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 78.973783] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 79.183712] nix-grpc-daemon[1201]: ts=2026-09-20T12:23:59Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 79.186387] nix-grpc-daemon[1201]: ts=2026-09-20T12:23:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 79.190651] nix-grpc-daemon[1201]: ts=2026-09-20T12:23:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 79.199378] nix-grpc-daemon[1201]: ts=2026-09-20T12:23:59Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 79.207245] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 79.227758] nix-grpc-daemon[1201]: ts=2026-09-20T12:23:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.259714] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:59Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:51978 worker2 # [ 79.265491] nix-grpc-daemon[1073]: ts=2026-09-20T12:23:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.19 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.86 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 80.705062] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 80.949292] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:01Z level=info event=signal_exit worker2 # [ 81.159444] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:01Z level=info event=scheduler_yield lb # [ 81.161649] niks3-server[1002]: 2026/09/20 12:24:01 INFO lead: released remote=192.168.1.4:41688 worker1 # [ 81.140402] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:01Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 81.170613] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:51978 worker2 # [ 81.178889] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:01Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 81.183305] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:01Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 81.187574] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:01Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:51978 worker2 # [ 81.192307] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:01Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 81.340517] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.346756] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.379075] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.384729] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.547402] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.552882] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.585950] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.591466] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.753707] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.758899] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.792671] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.797964] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.959637] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.965092] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.001161] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.008331] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.165060] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:02Z level=info event=scheduler_restarting worker2 # [ 82.197253] nix-daemon[844]: reaped child process 1122, status = succeeded worker1 # [ 82.167109] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.172604] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.219380] nix-grpc-daemon[1073]: ts=2026-09-20T12:24:02Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 82.373598] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.378917] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.579734] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.585067] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.785838] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.791035] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 82.926107] envoy[937]: conn peer=[2001:db8:1::1]:32870 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=34 lb # [ 82.931059] envoy[937]: conn peer=[2001:db8:1::3]:39806 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5727 tx=1826 ms=51500 lb # [ 82.936167] envoy[937]: conn peer=[2001:db8:1::1]:32876 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1009 tx=305 ms=1506 lb # [ 82.941392] envoy[937]: conn peer=[2001:db8:1::4]:60532 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7963 tx=535 ms=7244 worker2 # [ 82.972928] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 82.980298] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 82.982873] systemd[1]: nix-grpc-daemon.service: Consumed 528ms CPU time over 8.270s wall clock time, 31.1M memory peak, 19.9K incoming IP traffic, 30.5K outgoing IP traffic. worker2 # [ 82.997162] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 82.999364] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 83.001661] systemd[1]: nix-grpc-daemon.socket: Consumed 823us CPU time over 9.438s wall clock time, 256K memory peak, 17.5K incoming IP traffic, 14.9K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 82.993344] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.998480] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1 # [ 83.196331] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.201240] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.397464] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.402713] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.603753] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.609107] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.809879] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.815187] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.016109] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.021440] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker1 # [ 84.212487] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:04Z level=info event=scheduler_take_over lb # [ 84.235052] niks3-server[1002]: 2026/09/20 12:24:04 INFO lead: acquired remote=192.168.1.3:33362 worker1 # [ 84.221865] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.225463] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.426461] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.431734] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.632545] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.637664] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.838599] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.843835] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.044646] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.053636] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:05Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:50890 worker1 # [ 85.059018] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:05Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker1 # [ 85.547561] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 85.562264] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 85.584804] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 85.601105] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 1/5) worker1 # [ 85.659623] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 174 ms (attempt 2/5) worker1 # [ 85.834108] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 219 ms (attempt 3/5) worker1 # [ 86.053491] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 245 ms (attempt 4/5) worker1 # [ 86.299404] nix-grpc-daemon[1201]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 86.334986] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:06Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 86.342166] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:06Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 86.382368] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 86.399734] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50892 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 86.414690] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 86.429519] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 86.458171] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:06Z level=info event=niks3_push_started pid=1274 worker1 # [ 86.674048] nix-grpc-daemon[1274]: time=2026-09-20T12:24:07.213Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 86.848299] nix-daemon[832]: accepted connection from pid 1287, user nix-grpc-daemon (trusted) worker1 # [ 86.866955] nix-daemon[832]: reaped child process 1290, status = succeeded worker1 # [ 87.043123] nix-daemon[832]: accepted connection from pid 1292, user nix-grpc-daemon (trusted) worker1 # [ 87.061732] nix-daemon[832]: reaped child process 1295, status = succeeded lb # [ 87.099477] niks3-server[1002]: 2026/09/20 12:24:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 87.092103] nix-grpc-daemon[1274]: time=2026-09-20T12:24:07.630Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 87.093641] nix-grpc-daemon[1274]: time=2026-09-20T12:24:07.630Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 87.147944] niks3-server[1002]: 2026/09/20 12:24:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 87.166300] niks3-server[1002]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 87.176560] niks3-server[1002]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 87.183369] niks3-server[1002]: 2026/09/20 12:24:07 INFO Signed narinfos id=27 count=1 worker1 # [ 87.161939] nix-grpc-daemon[1274]: time=2026-09-20T12:24:07.701Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.193016] niks3-server[1002]: 2026/09/20 12:24:07 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 87.202656] niks3-server[1002]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo lb # [ 87.216563] niks3-server[1002]: 2026/09/20 12:24:07 INFO Completed upload id=27 worker1 # [ 87.194593] nix-grpc-daemon[1274]: time=2026-09-20T12:24:07.734Z level=INFO msg="Upload complete. (516ms)" worker1 # [ 87.209241] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50892 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 87.224855] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 87.235691] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 87.238639] nix-daemon[832]: reaped child process 1272, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker1 # [ 87.256000] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-on-standby worker1 # [ 88.102361] nix-daemon[832]: reaped child process 1299, status = succeeded worker1 # [ 88.289986] nix-daemon[832]: accepted connection from pid 1314, user nix-grpc-daemon (trusted) worker1 # [ 88.310550] nix-daemon[832]: reaped child process 1317, status = succeeded lb # [ 88.345778] niks3-server[1002]: 2026/09/20 12:24:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 88.335380] nix-grpc-daemon[1274]: time=2026-09-20T12:24:08.875Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 88.340947] nix-grpc-daemon[1274]: time=2026-09-20T12:24:08.877Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 88.384395] niks3-server[1002]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 88.398916] niks3-server[1002]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 88.414052] niks3-server[1002]: 2026/09/20 12:24:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker1 # [ 88.399882] nix-grpc-daemon[1274]: time=2026-09-20T12:24:08.938Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.424599] niks3-server[1002]: 2026/09/20 12:24:08 INFO Signed narinfos id=28 count=1 lb # [ 88.431943] niks3-server[1002]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 88.439727] niks3-server[1002]: 2026/09/20 12:24:08 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 88.452222] niks3-server[1002]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo lb # [ 88.458343] niks3-server[1002]: 2026/09/20 12:24:09 INFO Completed upload id=28 worker1 # [ 88.436281] nix-grpc-daemon[1274]: time=2026-09-20T12:24:08.976Z level=INFO msg="Upload complete. (367ms)" worker1 # [ 88.464255] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 88.476389] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:08Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 88.480890] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:08Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 88.485043] nix-daemon[832]: reaped child process 1297, status = succeeded worker1 # [ 88.506375] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 88.522504] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 88.537115] nix-grpc-daemon[1274]: time=2026-09-20T12:24:09.077Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 88.547405] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 88.562136] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 88.766809] nix-daemon[832]: accepted connection from pid 1323, user nix-grpc-daemon (trusted) worker1 # [ 88.786291] nix-daemon[832]: reaped child process 1326, status = succeeded worker1 # [ 88.966986] nix-daemon[832]: accepted connection from pid 1328, user nix-grpc-daemon (trusted) worker1 # [ 88.984731] nix-daemon[832]: reaped child process 1331, status = succeeded lb # [ 89.017408] niks3-server[1002]: 2026/09/20 12:24:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 89.008212] nix-grpc-daemon[1274]: time=2026-09-20T12:24:09.548Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 89.009729] nix-grpc-daemon[1274]: time=2026-09-20T12:24:09.548Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 89.055011] niks3-server[1002]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 89.065837] niks3-server[1002]: 2026/09/20 12:24:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign worker1 # [ 89.051560] nix-grpc-daemon[1274]: time=2026-09-20T12:24:09.591Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.073959] niks3-server[1002]: 2026/09/20 12:24:09 INFO Signed narinfos id=29 count=1 lb # [ 89.082574] niks3-server[1002]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 89.091681] niks3-server[1002]: 2026/09/20 12:24:09 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 89.099118] niks3-server[1002]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo lb # [ 89.105442] niks3-server[1002]: 2026/09/20 12:24:09 INFO Completed upload id=29 worker1 # [ 89.083289] nix-grpc-daemon[1274]: time=2026-09-20T12:24:09.623Z level=INFO msg="Upload complete. (504ms)" worker1 # [ 89.091624] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50892 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 89.107397] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 89.114886] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 89.119697] nix-daemon[832]: reaped child process 1321, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker1 # [ 89.134300] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-on-standby worker1 # [ 90.574630] nix-daemon[832]: reaped child process 1335, status = succeeded worker1 # [ 90.748122] nix-daemon[832]: accepted connection from pid 1350, user nix-grpc-daemon (trusted) worker1 # [ 90.766615] nix-daemon[832]: reaped child process 1353, status = succeeded lb # [ 90.803159] niks3-server[1002]: 2026/09/20 12:24:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 90.791698] nix-grpc-daemon[1274]: time=2026-09-20T12:24:11.330Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 90.793377] nix-grpc-daemon[1274]: time=2026-09-20T12:24:11.330Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 90.835575] niks3-server[1002]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 90.851087] niks3-server[1002]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 90.864324] niks3-server[1002]: 2026/09/20 12:24:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker1 # [ 90.847882] nix-grpc-daemon[1274]: time=2026-09-20T12:24:11.387Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.874418] niks3-server[1002]: 2026/09/20 12:24:11 INFO Signed narinfos id=30 count=1 lb # [ 90.879974] niks3-server[1002]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 90.888602] niks3-server[1002]: 2026/09/20 12:24:11 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 90.895693] niks3-server[1002]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo lb # [ 90.901577] niks3-server[1002]: 2026/09/20 12:24:11 INFO Completed upload id=30 worker1 # [ 90.879469] nix-grpc-daemon[1274]: time=2026-09-20T12:24:11.419Z level=INFO msg="Upload complete. (333ms)" worker1 # [ 90.900710] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 90.912315] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:11Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 90.918340] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:11Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 90.922455] nix-daemon[832]: reaped child process 1333, status = succeeded worker1 # [ 90.942180] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 90.959153] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 90.974457] nix-grpc-daemon[1274]: time=2026-09-20T12:24:11.514Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 90.985119] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 90.999630] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 91.202143] nix-daemon[832]: accepted connection from pid 1359, user nix-grpc-daemon (trusted) worker1 # [ 91.220619] nix-daemon[832]: reaped child process 1362, status = succeeded worker1 # [ 91.393239] nix-daemon[832]: accepted connection from pid 1364, user nix-grpc-daemon (trusted) worker1 # [ 91.411300] nix-daemon[832]: reaped child process 1367, status = succeeded lb # [ 91.444672] niks3-server[1002]: 2026/09/20 12:24:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 91.432190] nix-grpc-daemon[1274]: time=2026-09-20T12:24:11.971Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 91.433688] nix-grpc-daemon[1274]: time=2026-09-20T12:24:11.971Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 91.473888] niks3-server[1002]: 2026/09/20 12:24:12 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst lb # [ 91.485863] niks3-server[1002]: 2026/09/20 12:24:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker1 # [ 91.471124] nix-grpc-daemon[1274]: time=2026-09-20T12:24:12.010Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.495879] niks3-server[1002]: 2026/09/20 12:24:12 INFO Signed narinfos id=31 count=1 lb # [ 91.501946] niks3-server[1002]: 2026/09/20 12:24:12 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 91.510609] niks3-server[1002]: 2026/09/20 12:24:12 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 91.516912] niks3-server[1002]: 2026/09/20 12:24:12 INFO Completed upload id=31 worker1 # [ 91.494720] nix-grpc-daemon[1274]: time=2026-09-20T12:24:12.034Z level=INFO msg="Upload complete. (478ms)" lb # [ 91.519445] niks3-server[1002]: 2026/09/20 12:24:12 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker1 # [ 91.504132] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50892 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 91.514070] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 91.520590] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 91.525420] nix-daemon[832]: reaped child process 1357, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 91.538162] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-on-standby worker1 # [ 93.187464] nix-daemon[832]: reaped child process 1371, status = succeeded worker1 # [ 93.364671] nix-daemon[832]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker1 # [ 93.385112] nix-daemon[832]: reaped child process 1389, status = succeeded lb # [ 93.422156] niks3-server[1002]: 2026/09/20 12:24:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 93.411686] nix-grpc-daemon[1274]: time=2026-09-20T12:24:13.948Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 93.414105] nix-grpc-daemon[1274]: time=2026-09-20T12:24:13.948Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 93.456308] niks3-server[1002]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 93.478448] niks3-server[1002]: 2026/09/20 12:24:14 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 93.487796] niks3-server[1002]: 2026/09/20 12:24:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker1 # [ 93.465524] nix-grpc-daemon[1274]: time=2026-09-20T12:24:14.005Z level=INFO msg="Uploading 1 narinfos" lb # [ 93.496910] niks3-server[1002]: 2026/09/20 12:24:14 INFO Signed narinfos id=32 count=1 lb # [ 93.502361] niks3-server[1002]: 2026/09/20 12:24:14 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 93.511245] niks3-server[1002]: 2026/09/20 12:24:14 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 93.517238] niks3-server[1002]: 2026/09/20 12:24:14 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo lb # [ 93.521451] niks3-server[1002]: 2026/09/20 12:24:14 INFO Completed upload id=32 worker1 # [ 93.499346] nix-grpc-daemon[1274]: time=2026-09-20T12:24:14.039Z level=INFO msg="Upload complete. (349ms)" worker1 # [ 93.513259] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 duration_s=2 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 93.531497] nix-daemon[832]: reaped child process 1369, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.27 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds) worker2 # [ 93.910740] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 93.920632] systemd[1]: Starting scheduler-token.service... worker2 # [ 94.019816] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 94.024554] systemd[1]: Finished scheduler-token.service. worker2 # [ 94.025820] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 102ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 94.034524] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 94.211231] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:14Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 94.213850] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 94.217936] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 94.226008] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 94.227786] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 94.262345] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.244177] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:14Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 94.250166] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:14Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:50890 worker1 # [ 94.255561] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:14Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.19 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 94.693723] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: f20dafaece794c69adb58a923e74c4ee client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds) worker1 # [ 94.901287] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:50892 client # [ 94.933350] nix[1161]: don't know how to build these paths: client # [ 94.934436] nix[1161]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 94.920288] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:15Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 94.927458] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:15Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 94.965540] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 94.982091] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50892 client # [ 95.020478] nix[1161]: copying 1 paths to 'lb:50051'... worker1 # [ 94.997213] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50892 client # [ 95.024981] nix[1161]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 95.013113] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 95.215110] nix-daemon[832]: accepted connection from pid 1402, user nix-grpc-daemon (trusted) worker1 # [ 95.235345] nix-daemon[832]: reaped child process 1405, status = succeeded worker1 # [ 95.408132] nix-daemon[832]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker1 # [ 95.427418] nix-daemon[832]: reaped child process 1410, status = succeeded lb # [ 95.462569] niks3-server[1002]: 2026/09/20 12:24:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 95.451610] nix-grpc-daemon[1274]: time=2026-09-20T12:24:15.991Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 95.453219] nix-grpc-daemon[1274]: time=2026-09-20T12:24:15.991Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 95.491546] niks3-server[1002]: 2026/09/20 12:24:16 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 95.507188] niks3-server[1002]: 2026/09/20 12:24:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker1 # [ 95.490474] nix-grpc-daemon[1274]: time=2026-09-20T12:24:16.030Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.519902] niks3-server[1002]: 2026/09/20 12:24:16 INFO Signed narinfos id=33 count=1 lb # [ 95.526011] niks3-server[1002]: 2026/09/20 12:24:16 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 95.532880] niks3-server[1002]: 2026/09/20 12:24:16 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 95.539776] niks3-server[1002]: 2026/09/20 12:24:16 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo lb # [ 95.543821] niks3-server[1002]: 2026/09/20 12:24:16 INFO Completed upload id=33 worker1 # [ 95.521633] nix-grpc-daemon[1274]: time=2026-09-20T12:24:16.061Z level=INFO msg="Upload complete. (492ms)" worker1 # [ 95.528338] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50892 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 95.542936] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 worker1 # [ 95.550481] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 95.555498] nix-daemon[832]: reaped child process 1400, status = succeeded worker1 # [ 95.566706] nix-daemon[832]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) client # [ 95.590244] nix[1161]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 97.655422] systemd-journald[275]: Received client request to rotate journal, rotating. worker2 # [ 97.676919] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/6c693b20bda84b3b96a64e45e99719c4. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 97.702368] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds) ??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 573 client: must succeed: sleep 5.0 worker1 # [ 98.217361] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:18Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.06 seconds) lb # [ 102.926454] envoy[937]: conn peer=[2001:db8:1::1]:56358 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=3862 ms=7981 worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 103.224912] nix-daemon[832]: reaped child process 1414, status = succeeded worker1 # [ 103.411716] nix-daemon[832]: accepted connection from pid 1454, user nix-grpc-daemon (trusted) worker1 # [ 103.429966] nix-daemon[832]: reaped child process 1457, status = succeeded lb # [ 103.466066] niks3-server[1002]: 2026/09/20 12:24:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 103.456873] nix-grpc-daemon[1274]: time=2026-09-20T12:24:23.995Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 103.458488] nix-grpc-daemon[1274]: time=2026-09-20T12:24:23.995Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 103.513264] niks3-server[1002]: 2026/09/20 12:24:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker1 # [ 103.498659] nix-grpc-daemon[1274]: time=2026-09-20T12:24:24.038Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.533191] niks3-server[1002]: 2026/09/20 12:24:24 INFO Signed narinfos id=34 count=1 lb # [ 103.545568] niks3-server[1002]: 2026/09/20 12:24:24 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 103.552436] niks3-server[1002]: 2026/09/20 12:24:24 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 103.562095] niks3-server[1002]: 2026/09/20 12:24:24 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 103.565615] niks3-server[1002]: 2026/09/20 12:24:24 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 103.570455] niks3-server[1002]: 2026/09/20 12:24:24 INFO Completed upload id=34 worker1 # [ 103.547602] nix-grpc-daemon[1274]: time=2026-09-20T12:24:24.087Z level=INFO msg="Upload complete. (359ms)" lb # [ 103.573263] niks3-server[1002]: 2026/09/20 12:24:24 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 103.561158] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50892 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 103.581324] nix-daemon[832]: reaped child process 1412, status = succeeded client # [ 103.628942] systemd[1]: rs.service: Deactivated successfully. client # [ 103.633434] systemd[1]: rs.service: Consumed 156ms CPU time over 8.939s wall clock time, 39M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic. worker1 # [ 104.222034] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:24Z level=info event=signal_exit worker1 # [ 104.438521] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:24Z level=info event=scheduler_yield lb # [ 104.464229] niks3-server[1002]: 2026/09/20 12:24:25 INFO lead: released remote=192.168.1.3:33362 worker1 # [ 104.444521] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:24Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 104.475532] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:25Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 104.453228] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50890 worker1 # [ 104.457941] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:24Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 104.462047] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50890 worker1 # [ 104.466516] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:24Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 104.675834] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 104.646730] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 104.654086] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 104.684059] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 104.855210] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.885541] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 104.862247] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 104.893021] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 105.063601] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.094410] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.069284] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.100080] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.19 seconds) client: waiting for success: ! systemctl is-active rs worker1 # [ 105.269937] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.301409] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.275522] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.306430] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 105.444116] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:25Z level=info event=scheduler_restarting worker2 # [ 105.509025] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.513994] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.498333] nix-daemon[832]: reaped child process 1265, status = succeeded worker1 # [ 105.501201] nix-grpc-daemon[1201]: ts=2026-09-20T12:24:26Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2 # [ 105.711491] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.716828] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.918137] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.923587] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.967743] nix-grpc-daemon[1201]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 105.972460] nix-grpc-daemon[1201]: E0000 00:00:1789907066.506535 1244 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 105.980159] nix-grpc-daemon[1201]: E0000 00:00:1789907066.519960 1244 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 106.124768] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.129928] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.331080] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.336215] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.443664] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 106.451611] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 106.457730] systemd[1]: nix-grpc-daemon.service: Consumed 1.888s CPU time over 27.467s wall clock time, 34.5M memory peak, 50K incoming IP traffic, 91.4K outgoing IP traffic. worker1 # [ 106.473391] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 106.539166] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.543391] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1 # [ 106.667660] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 106.670339] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 106.674441] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 106.683795] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 106.687084] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 106.693922] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=scheduler_take_over lb # [ 106.716870] niks3-server[1002]: 2026/09/20 12:24:27 INFO lead: acquired remote=192.168.1.3:55962 worker1 # [ 106.708867] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.711280] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.739916] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.745049] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.913023] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.946073] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.918426] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.951182] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.119499] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.152286] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.125258] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.157360] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.326117] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.358411] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.331721] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.363606] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.532452] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.565739] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.542414] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:28Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:33646 worker1 # [ 107.547928] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 107.559978] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:28Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 107.564340] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:28Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:33646 worker1 # [ 107.569604] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:28Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.16 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 107.857049] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 611947a503764496a41eb33214f00f8b client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds) worker1 # [ 108.075846] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33650 worker1 # [ 108.089247] nix-daemon[832]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # [ 108.130966] nix[1196]: don't know how to build these paths: client # [ 108.132314] nix[1196]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 108.120607] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:28Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 108.127312] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:28Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 108.174073] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33650 worker1 # [ 108.191351] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 1/5) worker1 # [ 108.200202] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 187 ms (attempt 2/5) worker1 # [ 108.387415] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 289 ms (attempt 3/5) worker1 # [ 108.677005] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 457 ms (attempt 4/5) worker1 # [ 109.143158] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 109.165016] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33650 client # [ 109.208332] nix[1196]: copying 1 paths to 'lb:50051'... worker1 # [ 109.182900] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33650 client # [ 109.208647] nix[1196]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker1 # [ 109.198207] nix-daemon[832]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 109.226510] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:29Z level=info event=niks3_push_started pid=1533 worker1 # [ 109.442294] nix-grpc-daemon[1533]: time=2026-09-20T12:24:29.981Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 109.619135] nix-daemon[832]: accepted connection from pid 1546, user nix-grpc-daemon (trusted) worker1 # [ 109.640665] nix-daemon[832]: reaped child process 1549, status = succeeded worker1 # [ 109.819541] nix-daemon[832]: accepted connection from pid 1551, user nix-grpc-daemon (trusted) worker1 # [ 109.837612] nix-daemon[832]: reaped child process 1554, status = succeeded lb # [ 109.874525] niks3-server[1002]: 2026/09/20 12:24:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 109.866577] nix-grpc-daemon[1533]: time=2026-09-20T12:24:30.405Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 109.868487] nix-grpc-daemon[1533]: time=2026-09-20T12:24:30.405Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 109.914704] niks3-server[1002]: 2026/09/20 12:24:30 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst lb # [ 109.931400] niks3-server[1002]: 2026/09/20 12:24:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign worker1 # [ 109.916174] nix-grpc-daemon[1533]: time=2026-09-20T12:24:30.456Z level=INFO msg="Uploading 1 narinfos" lb # [ 109.945531] niks3-server[1002]: 2026/09/20 12:24:30 INFO Signed narinfos id=35 count=1 lb # [ 109.951672] niks3-server[1002]: 2026/09/20 12:24:30 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 109.963196] niks3-server[1002]: 2026/09/20 12:24:30 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete worker1 # [ 109.952644] nix-grpc-daemon[1533]: time=2026-09-20T12:24:30.492Z level=INFO msg="Upload complete. (506ms)" lb # [ 109.974920] niks3-server[1002]: 2026/09/20 12:24:30 INFO Completed upload id=35 lb # [ 109.979002] niks3-server[1002]: 2026/09/20 12:24:30 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo worker1 # [ 109.965126] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33650 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 109.972440] nix-grpc-daemon[1464]: ts=2026-09-20T12:24:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33650 worker1 # [ 109.984493] nix-daemon[832]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 109.989954] nix-daemon[832]: reaped child process 1531, status = succeeded client # [ 110.025375] nix[1196]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker1 # [ 110.002617] nix-daemon[832]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 112.010249] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1464 (nix-grpc-daemon) on client request. worker1 # [ 112.012574] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 112.038356] niks3-server[1002]: 2026/09/20 12:24:32 INFO lead: released remote=192.168.1.3:55962 client # [ 112.059280] nix[1196]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 112.063535] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 112.065075] nix[1196]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 112.048639] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 112.050274] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1 # [ 112.051551] systemd[1]: nix-grpc-daemon.service: Consumed 522ms CPU time over 5.569s wall clock time, 31.3M memory peak, 14.2K incoming IP traffic, 16.9K outgoing IP traffic. worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.11 seconds) client: must succeed: sleep 5.0 worker1 # [ 112.073433] nix-daemon[832]: reaped child process 1556, status = succeeded worker1 # [ 112.074567] nix-daemon[832]: reaped child process 1520, status = succeeded worker1 # [ 112.084418] nix-daemon[1558]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 112.089259] nix-daemon[832]: reaped child process 1558, status = failed with exit code 1 worker2 # [ 112.264077] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.239045] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker1 # [ 112.253567] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 112.481489] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 112.484329] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 112.487384] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 112.495638] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 112.508602] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 112.516050] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=info event=scheduler_take_over lb # [ 112.538390] niks3-server[1002]: 2026/09/20 12:24:33 INFO lead: acquired remote=192.168.1.3:50208 worker1 # [ 112.536148] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.540866] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:36282 worker1 # [ 112.545563] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 112.547724] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 112.549489] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:36282 worker1 # [ 112.551324] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 112.554116] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 112.556619] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 112.606098] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36310 worker1 # [ 112.614539] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) worker1 # [ 112.625808] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) client # [ 112.663351] nix[1196]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker1 # [ 112.639317] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) lb # [ 112.927732] envoy[937]: conn peer=[2001:db8:1::1]:51694 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2940 tx=1349 ms=8673 lb # [ 112.933088] envoy[937]: conn peer=[2001:db8:1::3]:48128 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4430 tx=1377 ms=26265 lb # [ 112.938274] envoy[937]: conn peer=[2001:db8:1::3]:44386 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1015 tx=411 ms=5331 client: (finished: must succeed: sleep 5.0, in 5.07 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 117.460501] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:37Z level=info event=niks3_push_started pid=1673 worker1 # [ 117.490241] nix-daemon[832]: reaped child process 1649, status = succeeded worker1 # [ 117.683887] nix-grpc-daemon[1673]: time=2026-09-20T12:24:38.223Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 117.861404] nix-daemon[832]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker1 # [ 117.880455] nix-daemon[832]: reaped child process 1689, status = succeeded lb # [ 117.920950] niks3-server[1002]: 2026/09/20 12:24:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 117.911434] nix-grpc-daemon[1673]: time=2026-09-20T12:24:38.449Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 117.914335] nix-grpc-daemon[1673]: time=2026-09-20T12:24:38.449Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 117.989644] niks3-server[1002]: 2026/09/20 12:24:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign worker1 # [ 117.974750] nix-grpc-daemon[1673]: time=2026-09-20T12:24:38.513Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.001570] niks3-server[1002]: 2026/09/20 12:24:38 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 118.003819] niks3-server[1002]: 2026/09/20 12:24:38 INFO Signed narinfos id=36 count=1 lb # [ 118.016652] niks3-server[1002]: 2026/09/20 12:24:38 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 118.025436] niks3-server[1002]: 2026/09/20 12:24:38 INFO Completed upload id=36 worker1 # [ 118.001455] nix-grpc-daemon[1673]: time=2026-09-20T12:24:38.541Z level=INFO msg="Upload complete. (313ms)" lb # [ 118.027083] niks3-server[1002]: 2026/09/20 12:24:38 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 118.034284] niks3-server[1002]: 2026/09/20 12:24:38 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 118.037053] niks3-server[1002]: 2026/09/20 12:24:38 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo worker1 # [ 118.014444] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36310 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 118.030339] nix-daemon[832]: reaped child process 1647, status = succeeded client # [ 118.078972] systemd[1]: mid.service: Deactivated successfully. client # [ 118.083413] systemd[1]: mid.service: Consumed 173ms CPU time over 10.226s wall clock time, 36.9M memory peak, 9.4K incoming IP traffic, 10.6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.87 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 118.701699] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 005615c982f1477a8d442587b36077b8 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) worker2 # [ 118.957053] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 118.973053] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) client # [ 118.987200] nix[1230]: don't know how to build these paths: client # [ 118.990143] nix[1230]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker1 # [ 118.978017] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:39Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker1 # [ 118.984101] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:39Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 119.053231] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 119.071774] nix-grpc-daemon[1169]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 1/5) worker2 # [ 119.128452] nix-grpc-daemon[1169]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 177 ms (attempt 2/5) worker2 # [ 119.313168] nix-grpc-daemon[1169]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 3/5) worker2 # [ 119.486267] nix-grpc-daemon[1169]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 582 ms (attempt 4/5) worker2 # [ 120.077414] nix-grpc-daemon[1169]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 120.098156] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36752 client # [ 120.107363] nix[1230]: copying 1 paths to 'lb:50051'... worker2 # [ 120.115614] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 client # [ 120.113983] nix[1230]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker2 # [ 120.131601] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 120.159204] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:40Z level=info event=niks3_push_started pid=1311 worker2 # [ 120.382276] nix-grpc-daemon[1311]: time=2026-09-20T12:24:40.924Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 120.554653] nix-daemon[844]: accepted connection from pid 1324, user nix-grpc-daemon (trusted) worker2 # [ 120.572322] nix-daemon[844]: reaped child process 1327, status = succeeded worker2 # [ 120.748130] nix-daemon[844]: accepted connection from pid 1329, user nix-grpc-daemon (trusted) worker2 # [ 120.764272] nix-daemon[844]: reaped child process 1332, status = succeeded lb # [ 120.773362] niks3-server[1002]: 2026/09/20 12:24:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 120.797322] nix-grpc-daemon[1311]: time=2026-09-20T12:24:41.338Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 120.798816] nix-grpc-daemon[1311]: time=2026-09-20T12:24:41.338Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 120.816423] niks3-server[1002]: 2026/09/20 12:24:41 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 120.827948] niks3-server[1002]: 2026/09/20 12:24:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign worker2 # [ 120.843496] nix-grpc-daemon[1311]: time=2026-09-20T12:24:41.385Z level=INFO msg="Uploading 1 narinfos" lb # [ 120.840827] niks3-server[1002]: 2026/09/20 12:24:41 INFO Signed narinfos id=37 count=1 lb # [ 120.853786] niks3-server[1002]: 2026/09/20 12:24:41 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 120.860416] niks3-server[1002]: 2026/09/20 12:24:41 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 120.873960] niks3-server[1002]: 2026/09/20 12:24:41 INFO Completed upload id=37 worker2 # [ 120.881647] nix-grpc-daemon[1311]: time=2026-09-20T12:24:41.424Z level=INFO msg="Upload complete. (495ms)" lb # [ 120.876633] niks3-server[1002]: 2026/09/20 12:24:41 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker2 # [ 120.892818] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 120.905838] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 120.912988] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 120.918284] nix-daemon[844]: reaped child process 1309, status = succeeded client # [ 120.923407] nix[1230]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker2 # [ 120.932853] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 122.440396] systemd[1]: intr.service: Sent signal SIGINT to main process 1230 (nix) on client request. client # [ 122.447328] nix[1230]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 122.450144] nix[1230]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) client # [ 122.489291] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 122.492004] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 122.495595] systemd[1]: intr.service: Consumed 154ms CPU time over 3.792s wall clock time, 41.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic. worker2 # [ 122.563612] nix-daemon[844]: reaped child process 1334, status = succeeded worker2 # [ 122.567602] nix-daemon[1336]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 122.579359] nix-daemon[844]: reaped child process 1336, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.95 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 122.675078] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 6064aa01465948a5a0bbbd6a81ff5243 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds) client # [ 122.910545] nix[1249]: don't know how to build these paths: client # [ 122.911489] nix[1249]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker1 # [ 122.885117] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36310 worker1 # [ 122.899412] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:43Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 lb # [ 122.929364] envoy[937]: conn peer=[2001:db8:1::1]:51790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3854 tx=1659 ms=9958 worker1 # [ 122.906694] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:43Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=1 lb # [ 122.934404] envoy[937]: conn peer=[2001:db8:1::1]:37536 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=757 ms=3538 worker1 # [ 122.946115] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36310 worker1 # [ 122.962511] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 1/5) worker1 # [ 123.051533] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 2/5) worker1 # [ 123.162235] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 276 ms (attempt 3/5) worker1 # [ 123.445789] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 482 ms (attempt 4/5) worker1 # [ 123.936937] nix-grpc-daemon[1594]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 123.958980] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36310 client # [ 124.001238] nix[1249]: copying 1 paths to 'lb:50051'... worker1 # [ 123.975609] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36310 client # [ 124.001506] nix[1249]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 123.994369] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) worker1 # [ 124.199873] nix-daemon[832]: accepted connection from pid 1728, user nix-grpc-daemon (trusted) worker1 # [ 124.220195] nix-daemon[832]: reaped child process 1731, status = succeeded worker1 # [ 124.397889] nix-daemon[832]: accepted connection from pid 1733, user nix-grpc-daemon (trusted) worker1 # [ 124.417223] nix-daemon[832]: reaped child process 1736, status = succeeded lb # [ 124.451144] niks3-server[1002]: 2026/09/20 12:24:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 124.441023] nix-grpc-daemon[1673]: time=2026-09-20T12:24:44.980Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 124.442529] nix-grpc-daemon[1673]: time=2026-09-20T12:24:44.980Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 124.484545] niks3-server[1002]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst lb # [ 124.498928] niks3-server[1002]: 2026/09/20 12:24:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker1 # [ 124.483586] nix-grpc-daemon[1673]: time=2026-09-20T12:24:45.023Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.510573] niks3-server[1002]: 2026/09/20 12:24:45 INFO Signed narinfos id=38 count=1 lb # [ 124.516744] niks3-server[1002]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 124.532958] niks3-server[1002]: 2026/09/20 12:24:45 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 124.540122] niks3-server[1002]: 2026/09/20 12:24:45 INFO Completed upload id=38 worker1 # [ 124.518228] nix-grpc-daemon[1673]: time=2026-09-20T12:24:45.058Z level=INFO msg="Upload complete. (506ms)" lb # [ 124.543668] niks3-server[1002]: 2026/09/20 12:24:45 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker1 # [ 124.529541] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36310 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 124.543666] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36310 worker1 # [ 124.550259] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) worker1 # [ 124.555707] nix-daemon[832]: reaped child process 1726, status = succeeded worker1 # [ 124.567949] nix-daemon[832]: accepted connection from pid 1594, user nix-grpc-daemon (trusted) client # [ 124.591277] nix[1249]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 126.523229] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 126.579670] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 worker1 # [ 126.897883] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36310 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 126.939074] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36752 worker1 # [ 126.936219] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:47Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker1 # [ 126.938155] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:47Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 127.017477] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 127.033632] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36752 client # copying 1 paths to 'lb:50051'... worker2 # [ 127.049980] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker2 # [ 127.073792] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 127.286307] nix-daemon[844]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 127.306286] nix-daemon[844]: reaped child process 1389, status = succeeded worker2 # [ 127.485464] nix-daemon[844]: accepted connection from pid 1391, user nix-grpc-daemon (trusted) worker2 # [ 127.506041] nix-daemon[844]: reaped child process 1394, status = succeeded lb # [ 127.513643] niks3-server[1002]: 2026/09/20 12:24:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 127.534849] nix-grpc-daemon[1311]: time=2026-09-20T12:24:48.076Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 127.536610] nix-grpc-daemon[1311]: time=2026-09-20T12:24:48.076Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" worker1 # [ 127.509367] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:48Z level=info event=draining lb # [ 127.547614] niks3-server[1002]: 2026/09/20 12:24:48 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst lb # [ 127.563775] niks3-server[1002]: 2026/09/20 12:24:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign worker2 # [ 127.577233] nix-grpc-daemon[1311]: time=2026-09-20T12:24:48.119Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.576943] niks3-server[1002]: 2026/09/20 12:24:48 INFO Signed narinfos id=39 count=1 lb # [ 127.584296] niks3-server[1002]: 2026/09/20 12:24:48 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls worker2 # [ 127.603126] nix-grpc-daemon[1311]: time=2026-09-20T12:24:48.145Z level=INFO msg="Upload complete. (511ms)" lb # [ 127.594887] niks3-server[1002]: 2026/09/20 12:24:48 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 127.603110] niks3-server[1002]: 2026/09/20 12:24:48 INFO Completed upload id=39 worker2 # [ 127.610013] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=0 paths=1 nar_bytes_in=528 lb # [ 127.607543] niks3-server[1002]: 2026/09/20 12:24:48 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker2 # [ 127.620356] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 127.634631] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 127.636982] nix-daemon[844]: reaped child process 1384, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker2 # [ 127.650754] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-during-drain worker2 # [ 128.292498] nix-daemon[844]: reaped child process 1398, status = succeeded worker2 # [ 128.465308] nix-daemon[844]: accepted connection from pid 1413, user nix-grpc-daemon (trusted) worker2 # [ 128.484279] nix-daemon[844]: reaped child process 1416, status = succeeded lb # [ 128.491100] niks3-server[1002]: 2026/09/20 12:24:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 128.511865] nix-grpc-daemon[1311]: time=2026-09-20T12:24:49.051Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 128.514467] nix-grpc-daemon[1311]: time=2026-09-20T12:24:49.051Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 128.529849] niks3-server[1002]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 128.543069] niks3-server[1002]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 128.558212] niks3-server[1002]: 2026/09/20 12:24:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 128.565519] niks3-server[1002]: 2026/09/20 12:24:49 INFO Signed narinfos id=40 count=1 worker2 # [ 128.573083] nix-grpc-daemon[1311]: time=2026-09-20T12:24:49.113Z level=INFO msg="Uploading 1 narinfos" lb # [ 128.569086] niks3-server[1002]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 128.582165] niks3-server[1002]: 2026/09/20 12:24:49 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 128.592605] niks3-server[1002]: 2026/09/20 12:24:49 INFO Completed upload id=40 worker2 # [ 128.600367] nix-grpc-daemon[1311]: time=2026-09-20T12:24:49.142Z level=INFO msg="Upload complete. (340ms)" lb # [ 128.596135] niks3-server[1002]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker1 # [ 128.585645] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:49Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker1 # [ 128.587872] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:49Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 128.613167] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=0 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker2 # [ 128.633181] nix-daemon[844]: reaped child process 1396, status = succeeded worker2 # [ 128.670252] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 128.685590] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 128.701175] nix-grpc-daemon[1311]: time=2026-09-20T12:24:49.243Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 128.711735] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker2 # [ 128.737255] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 128.944485] nix-daemon[844]: accepted connection from pid 1420, user nix-grpc-daemon (trusted) worker2 # [ 128.962912] nix-daemon[844]: reaped child process 1423, status = succeeded worker2 # [ 129.137812] nix-daemon[844]: accepted connection from pid 1425, user nix-grpc-daemon (trusted) worker2 # [ 129.154691] nix-daemon[844]: reaped child process 1428, status = succeeded lb # [ 129.162999] niks3-server[1002]: 2026/09/20 12:24:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 129.180718] nix-grpc-daemon[1311]: time=2026-09-20T12:24:49.722Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 129.182264] nix-grpc-daemon[1311]: time=2026-09-20T12:24:49.722Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 129.194782] niks3-server[1002]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst worker2 # [ 129.213245] nix-grpc-daemon[1311]: time=2026-09-20T12:24:49.755Z level=INFO msg="Uploading 1 narinfos" lb # [ 129.211670] niks3-server[1002]: 2026/09/20 12:24:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 129.223517] niks3-server[1002]: 2026/09/20 12:24:49 INFO Signed narinfos id=41 count=1 worker2 # [ 129.235647] nix-grpc-daemon[1311]: time=2026-09-20T12:24:49.778Z level=INFO msg="Upload complete. (480ms)" lb # [ 129.229723] niks3-server[1002]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls worker2 # [ 129.242643] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 129.236607] niks3-server[1002]: 2026/09/20 12:24:49 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 129.240465] niks3-server[1002]: 2026/09/20 12:24:49 INFO Completed upload id=41 lb # [ 129.242710] niks3-server[1002]: 2026/09/20 12:24:49 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker2 # [ 129.255945] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 129.261742] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 129.266486] nix-daemon[844]: reaped child process 1418, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... worker2 # [ 129.277178] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv client # farm-b> LOG-farm-b-during-drain worker2 # [ 130.326575] nix-daemon[844]: reaped child process 1432, status = succeeded worker2 # [ 130.512577] nix-daemon[844]: accepted connection from pid 1447, user nix-grpc-daemon (trusted) worker2 # [ 130.530230] nix-daemon[844]: reaped child process 1450, status = succeeded lb # [ 130.538144] niks3-server[1002]: 2026/09/20 12:24:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 130.554428] nix-grpc-daemon[1311]: time=2026-09-20T12:24:51.095Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 130.556236] nix-grpc-daemon[1311]: time=2026-09-20T12:24:51.095Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 130.574545] niks3-server[1002]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 130.592134] niks3-server[1002]: 2026/09/20 12:24:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker2 # [ 130.608295] nix-grpc-daemon[1311]: time=2026-09-20T12:24:51.150Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.602189] niks3-server[1002]: 2026/09/20 12:24:51 INFO Signed narinfos id=42 count=1 lb # [ 130.613017] niks3-server[1002]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 130.625266] niks3-server[1002]: 2026/09/20 12:24:51 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 130.633284] niks3-server[1002]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 130.638417] niks3-server[1002]: 2026/09/20 12:24:51 INFO Completed upload id=42 worker2 # [ 130.646077] nix-grpc-daemon[1311]: time=2026-09-20T12:24:51.188Z level=INFO msg="Upload complete. (356ms)" lb # [ 130.641418] niks3-server[1002]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker1 # [ 130.632627] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:51Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker2 # [ 130.657330] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker1 # [ 130.634454] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:51Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 130.679463] nix-daemon[844]: reaped child process 1430, status = succeeded worker2 # [ 130.708659] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 130.724202] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 130.739966] nix-grpc-daemon[1311]: time=2026-09-20T12:24:51.282Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 130.750579] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker2 # [ 130.774754] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 130.979296] nix-daemon[844]: accepted connection from pid 1454, user nix-grpc-daemon (trusted) worker2 # [ 131.001610] nix-daemon[844]: reaped child process 1457, status = succeeded worker2 # [ 131.170773] nix-daemon[844]: accepted connection from pid 1459, user nix-grpc-daemon (trusted) worker2 # [ 131.188811] nix-daemon[844]: reaped child process 1462, status = succeeded lb # [ 131.193433] niks3-server[1002]: 2026/09/20 12:24:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 131.212103] nix-grpc-daemon[1311]: time=2026-09-20T12:24:51.754Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 131.213679] nix-grpc-daemon[1311]: time=2026-09-20T12:24:51.754Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 131.223165] niks3-server[1002]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst worker2 # [ 131.243029] nix-grpc-daemon[1311]: time=2026-09-20T12:24:51.785Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.236907] niks3-server[1002]: 2026/09/20 12:24:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 131.248594] niks3-server[1002]: 2026/09/20 12:24:51 INFO Signed narinfos id=43 count=1 lb # [ 131.251857] niks3-server[1002]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls worker2 # [ 131.272797] nix-grpc-daemon[1311]: time=2026-09-20T12:24:51.815Z level=INFO msg="Upload complete. (477ms)" lb # [ 131.265994] niks3-server[1002]: 2026/09/20 12:24:51 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 131.271537] niks3-server[1002]: 2026/09/20 12:24:51 INFO Completed upload id=43 worker2 # [ 131.278842] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 131.274921] niks3-server[1002]: 2026/09/20 12:24:51 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker2 # [ 131.288525] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 131.300178] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 131.303702] nix-daemon[844]: reaped child process 1452, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 131.317242] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 132.538821] nix-daemon[844]: reaped child process 1466, status = succeeded client # farm-top> LOG-farm-top-during-drain worker2 # [ 132.700116] nix-daemon[844]: accepted connection from pid 1481, user nix-grpc-daemon (trusted) worker2 # [ 132.717217] nix-daemon[844]: reaped child process 1484, status = succeeded lb # [ 132.724733] niks3-server[1002]: 2026/09/20 12:24:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 132.744181] nix-grpc-daemon[1311]: time=2026-09-20T12:24:53.284Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 132.745680] nix-grpc-daemon[1311]: time=2026-09-20T12:24:53.284Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 132.763285] niks3-server[1002]: 2026/09/20 12:24:53 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst worker2 # [ 132.783966] nix-grpc-daemon[1311]: time=2026-09-20T12:24:53.326Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.778498] niks3-server[1002]: 2026/09/20 12:24:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 132.787684] niks3-server[1002]: 2026/09/20 12:24:53 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 132.794181] niks3-server[1002]: 2026/09/20 12:24:53 INFO Signed narinfos id=44 count=1 lb # [ 132.800430] niks3-server[1002]: 2026/09/20 12:24:53 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 132.803753] niks3-server[1002]: 2026/09/20 12:24:53 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 132.807935] niks3-server[1002]: 2026/09/20 12:24:53 INFO Completed upload id=44 worker2 # [ 132.815117] nix-grpc-daemon[1311]: time=2026-09-20T12:24:53.357Z level=INFO msg="Upload complete. (288ms)" lb # [ 132.810667] niks3-server[1002]: 2026/09/20 12:24:53 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker2 # [ 132.825061] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker2 # [ 132.839022] nix-daemon[844]: reaped child process 1464, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.20 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath lb # [ 132.926198] envoy[937]: conn peer=[2001:db8:1::1]:45354 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9569 tx=3830 ms=5913 client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 133.206555] nix-daemon[832]: reaped child process 1740, status = succeeded worker1 # [ 133.367502] nix-daemon[832]: accepted connection from pid 1787, user nix-grpc-daemon (trusted) worker1 # [ 133.385287] nix-daemon[832]: reaped child process 1790, status = succeeded lb # [ 133.421599] niks3-server[1002]: 2026/09/20 12:24:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.409556] nix-grpc-daemon[1673]: time=2026-09-20T12:24:53.948Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 133.411086] nix-grpc-daemon[1673]: time=2026-09-20T12:24:53.948Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 133.448665] niks3-server[1002]: 2026/09/20 12:24:53 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 133.468427] niks3-server[1002]: 2026/09/20 12:24:54 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst worker1 # [ 133.458405] nix-grpc-daemon[1673]: time=2026-09-20T12:24:53.997Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.480090] niks3-server[1002]: 2026/09/20 12:24:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 133.491173] niks3-server[1002]: 2026/09/20 12:24:54 INFO Signed narinfos id=45 count=1 lb # [ 133.498315] niks3-server[1002]: 2026/09/20 12:24:54 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls worker1 # [ 133.488608] nix-grpc-daemon[1673]: time=2026-09-20T12:24:54.028Z level=INFO msg="Upload complete. (296ms)" lb # [ 133.511318] niks3-server[1002]: 2026/09/20 12:24:54 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 133.517036] niks3-server[1002]: 2026/09/20 12:24:54 INFO Completed upload id=45 lb # [ 133.521515] niks3-server[1002]: 2026/09/20 12:24:54 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker1 # [ 133.504140] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36310 duration_s=8 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 133.516342] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=signal_exit worker1 # [ 133.521044] nix-daemon[832]: reaped child process 1738, status = succeeded client # [ 133.570934] systemd[1]: sw.service: Deactivated successfully. client # [ 133.576267] systemd[1]: sw.service: Consumed 156ms CPU time over 10.896s wall clock time, 39M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic. worker1 # [ 133.728914] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=scheduler_yield worker2 # [ 133.762084] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:54Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 133.735135] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36282 worker1 # [ 133.742135] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=worker_gone addr=192.168.1.4:50051 lb # [ 133.757289] niks3-server[1002]: 2026/09/20 12:24:54 INFO lead: released remote=192.168.1.3:50208 worker1 # [ 133.746360] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 133.750369] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:36282 worker1 # [ 133.754810] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 133.965831] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 133.970245] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 133.942055] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 133.947162] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 134.166765] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 134.172171] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 134.147973] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 134.153148] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 134.243127] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:54Z level=info event=scheduler_take_over lb # [ 134.235230] niks3-server[1002]: 2026/09/20 12:24:54 INFO lead: acquired remote=192.168.1.4:55306 client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 134.373135] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 134.378655] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 134.354291] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 134.364287] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 134.579838] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 134.585141] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 134.563553] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 134.567799] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 134.735063] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:55Z level=info event=scheduler_restarting worker2 # [ 134.786243] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 134.791525] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 134.782963] nix-daemon[832]: reaped child process 1645, status = succeeded worker1 # [ 134.786051] nix-grpc-daemon[1594]: ts=2026-09-20T12:24:55Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 134.994465] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 134.998704] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 135.195597] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 135.200957] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 135.401850] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 135.428174] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 135.434249] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:40868 worker2 # [ 135.439660] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:55Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 135.602021] nix-grpc-daemon[1594]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 135.602560] nix-grpc-daemon[1594]: E0000 00:00:1789907096.140672 1637 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 135.602682] nix-grpc-daemon[1594]: E0000 00:00:1789907096.140937 1637 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 136.549195] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 136.554970] systemd[1]: nix-grpc-daemon.service: Consumed 861ms CPU time over 24.504s wall clock time, 32.1M memory peak, 26.1K incoming IP traffic, 33.4K outgoing IP traffic. worker1 # [ 136.575855] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 136.778242] nix-grpc-daemon[1804]: ts=2026-09-20T12:24:57Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 136.780960] nix-grpc-daemon[1804]: ts=2026-09-20T12:24:57Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 136.784951] nix-grpc-daemon[1804]: ts=2026-09-20T12:24:57Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 136.792794] nix-grpc-daemon[1804]: ts=2026-09-20T12:24:57Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 136.794528] systemd[1]: Started Nix worker-protocol over gRPC. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.47 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 136.815351] nix-grpc-daemon[1804]: ts=2026-09-20T12:24:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 136.850074] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:57Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:40868 worker2 # [ 136.855202] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:57Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.54 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 138.385314] nix-grpc-daemon[1804]: ts=2026-09-20T12:24:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 138.401231] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker2 # [ 138.454950] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 138.502105] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:59Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker2 # [ 138.508277] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:59Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 138.514191] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:59Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker2 # [ 138.519396] nix-grpc-daemon[1169]: ts=2026-09-20T12:24:59Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 138.519048] nix-grpc-daemon[1804]: ts=2026-09-20T12:24:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 138.537269] nix-grpc-daemon[1804]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5) worker1 # [ 138.641910] nix-grpc-daemon[1804]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 162 ms (attempt 2/5) worker1 # [ 138.811629] nix-grpc-daemon[1804]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 345 ms (attempt 3/5) worker1 # [ 139.164377] nix-grpc-daemon[1804]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 4/5) worker1 # [ 139.213053] nix-grpc-daemon[1804]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 139.234047] nix-grpc-daemon[1804]: ts=2026-09-20T12:24:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 139.250755] nix-grpc-daemon[1804]: ts=2026-09-20T12:24:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 139.265564] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 139.296441] nix-grpc-daemon[1804]: ts=2026-09-20T12:24:59Z level=info event=niks3_push_started pid=1860 worker1 # [ 139.519646] nix-grpc-daemon[1860]: time=2026-09-20T12:25:00.058Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 139.698178] nix-daemon[832]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker1 # [ 139.717304] nix-daemon[832]: reaped child process 1876, status = succeeded worker1 # [ 139.892033] nix-daemon[832]: accepted connection from pid 1878, user nix-grpc-daemon (trusted) worker1 # [ 139.911907] nix-daemon[832]: reaped child process 1881, status = succeeded lb # [ 139.947986] niks3-server[1002]: 2026/09/20 12:25:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 139.937726] nix-grpc-daemon[1860]: time=2026-09-20T12:25:00.476Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 139.939228] nix-grpc-daemon[1860]: time=2026-09-20T12:25:00.476Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 139.988904] niks3-server[1002]: 2026/09/20 12:25:00 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst lb # [ 140.004159] niks3-server[1002]: 2026/09/20 12:25:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign worker1 # [ 139.988864] nix-grpc-daemon[1860]: time=2026-09-20T12:25:00.528Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.013233] niks3-server[1002]: 2026/09/20 12:25:00 INFO Signed narinfos id=46 count=1 lb # [ 140.021494] niks3-server[1002]: 2026/09/20 12:25:00 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 140.035770] niks3-server[1002]: 2026/09/20 12:25:00 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 140.042745] niks3-server[1002]: 2026/09/20 12:25:00 INFO Completed upload id=46 worker1 # [ 140.020421] nix-grpc-daemon[1860]: time=2026-09-20T12:25:00.560Z level=INFO msg="Upload complete. (497ms)" lb # [ 140.046035] niks3-server[1002]: 2026/09/20 12:25:00 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 140.028960] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 140.045800] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 140.052631] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 140.058060] nix-daemon[832]: reaped child process 1858, status = succeeded worker1 # [ 140.072549] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 141.299186] nix-daemon[832]: reaped child process 1885, status = succeeded worker1 # [ 141.468090] nix-daemon[832]: accepted connection from pid 1900, user nix-grpc-daemon (trusted) worker1 # [ 141.488439] nix-daemon[832]: reaped child process 1903, status = succeeded lb # [ 141.522832] niks3-server[1002]: 2026/09/20 12:25:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 141.512466] nix-grpc-daemon[1860]: time=2026-09-20T12:25:02.049Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 141.513985] nix-grpc-daemon[1860]: time=2026-09-20T12:25:02.049Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 141.556985] niks3-server[1002]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 141.571150] niks3-server[1002]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 141.588289] niks3-server[1002]: 2026/09/20 12:25:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 141.573099] nix-grpc-daemon[1860]: time=2026-09-20T12:25:02.111Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.595445] niks3-server[1002]: 2026/09/20 12:25:02 INFO Signed narinfos id=47 count=1 lb # [ 141.602984] niks3-server[1002]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 141.612591] niks3-server[1002]: 2026/09/20 12:25:02 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete worker1 # [ 141.598867] nix-grpc-daemon[1860]: time=2026-09-20T12:25:02.138Z level=INFO msg="Upload complete. (315ms)" lb # [ 141.622518] niks3-server[1002]: 2026/09/20 12:25:02 INFO Completed upload id=47 lb # [ 141.627395] niks3-server[1002]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker2 # [ 141.644196] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:02Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 141.652084] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:02Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 141.609145] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=1 worker1 # [ 141.630364] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 141.636178] nix-daemon[832]: reaped child process 1883, status = succeeded worker1 # [ 141.639709] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 141.652933] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 141.664476] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 141.855374] nix-daemon[832]: accepted connection from pid 1907, user nix-grpc-daemon (trusted) worker1 # [ 141.875600] nix-daemon[832]: reaped child process 1910, status = succeeded worker1 # [ 142.048944] nix-daemon[832]: accepted connection from pid 1912, user nix-grpc-daemon (trusted) worker1 # [ 142.067391] nix-daemon[832]: reaped child process 1915, status = succeeded lb # [ 142.100877] niks3-server[1002]: 2026/09/20 12:25:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 142.088041] nix-grpc-daemon[1860]: time=2026-09-20T12:25:02.627Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 142.089702] nix-grpc-daemon[1860]: time=2026-09-20T12:25:02.627Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 142.132782] niks3-server[1002]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst lb # [ 142.147086] niks3-server[1002]: 2026/09/20 12:25:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker1 # [ 142.130223] nix-grpc-daemon[1860]: time=2026-09-20T12:25:02.669Z level=INFO msg="Uploading 1 narinfos" lb # [ 142.158720] niks3-server[1002]: 2026/09/20 12:25:02 INFO Signed narinfos id=48 count=1 lb # [ 142.164308] niks3-server[1002]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 142.173255] niks3-server[1002]: 2026/09/20 12:25:02 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 142.177250] niks3-server[1002]: 2026/09/20 12:25:02 INFO Completed upload id=48 worker1 # [ 142.154761] nix-grpc-daemon[1860]: time=2026-09-20T12:25:02.694Z level=INFO msg="Upload complete. (477ms)" lb # [ 142.179821] niks3-server[1002]: 2026/09/20 12:25:02 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 142.164436] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 142.175593] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 142.182845] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 142.187672] nix-daemon[832]: reaped child process 1905, status = succeeded worker1 # [ 142.201656] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) lb # [ 142.927401] envoy[937]: conn peer=[2001:db8:1::1]:45340 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2952 tx=1375 ms=10635 lb # [ 142.932495] envoy[937]: conn peer=[2001:db8:1::3]:44160 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1426 tx=539 ms=22245 worker1 # [ 143.849864] nix-daemon[832]: reaped child process 1919, status = succeeded worker1 # [ 144.024596] nix-daemon[832]: accepted connection from pid 1934, user nix-grpc-daemon (trusted) worker1 # [ 144.042296] nix-daemon[832]: reaped child process 1937, status = succeeded lb # [ 144.078608] niks3-server[1002]: 2026/09/20 12:25:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.067139] nix-grpc-daemon[1860]: time=2026-09-20T12:25:04.606Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 144.068750] nix-grpc-daemon[1860]: time=2026-09-20T12:25:04.606Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 144.116498] niks3-server[1002]: 2026/09/20 12:25:04 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker1 # [ 144.106209] nix-grpc-daemon[1860]: time=2026-09-20T12:25:04.645Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.126601] niks3-server[1002]: 2026/09/20 12:25:04 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 144.142318] niks3-server[1002]: 2026/09/20 12:25:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 144.147472] niks3-server[1002]: 2026/09/20 12:25:04 INFO Signed narinfos id=49 count=1 lb # [ 144.155489] niks3-server[1002]: 2026/09/20 12:25:04 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 144.161154] niks3-server[1002]: 2026/09/20 12:25:04 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete worker1 # [ 144.133055] nix-grpc-daemon[1860]: time=2026-09-20T12:25:04.673Z level=INFO msg="Upload complete. (320ms)" lb # [ 144.166085] niks3-server[1002]: 2026/09/20 12:25:04 INFO Completed upload id=49 worker2 # [ 144.170700] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:04Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 lb # [ 144.168660] niks3-server[1002]: 2026/09/20 12:25:04 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker1 # [ 144.145162] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=1 worker2 # [ 144.185571] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:04Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 144.160301] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 144.169790] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 144.174733] nix-daemon[832]: reaped child process 1917, status = succeeded worker1 # [ 144.181655] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 144.192213] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 144.378292] nix-daemon[832]: accepted connection from pid 1941, user nix-grpc-daemon (trusted) worker1 # [ 144.398278] nix-daemon[832]: reaped child process 1944, status = succeeded worker1 # [ 144.572705] nix-daemon[832]: accepted connection from pid 1946, user nix-grpc-daemon (trusted) worker1 # [ 144.590694] nix-daemon[832]: reaped child process 1949, status = succeeded lb # [ 144.625493] niks3-server[1002]: 2026/09/20 12:25:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.612822] nix-grpc-daemon[1860]: time=2026-09-20T12:25:05.152Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 144.614266] nix-grpc-daemon[1860]: time=2026-09-20T12:25:05.152Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 144.657832] niks3-server[1002]: 2026/09/20 12:25:05 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst worker1 # [ 144.644692] nix-grpc-daemon[1860]: time=2026-09-20T12:25:05.184Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.672612] niks3-server[1002]: 2026/09/20 12:25:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 144.686855] niks3-server[1002]: 2026/09/20 12:25:05 INFO Signed narinfos id=50 count=1 worker1 # [ 144.667912] nix-grpc-daemon[1860]: time=2026-09-20T12:25:05.207Z level=INFO msg="Upload complete. (464ms)" lb # [ 144.691683] niks3-server[1002]: 2026/09/20 12:25:05 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 144.698901] niks3-server[1002]: 2026/09/20 12:25:05 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete worker1 # [ 144.677044] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 144.702595] niks3-server[1002]: 2026/09/20 12:25:05 INFO Completed upload id=50 lb # [ 144.704742] niks3-server[1002]: 2026/09/20 12:25:05 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 144.686662] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 144.692148] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 144.696226] nix-daemon[832]: reaped child process 1939, status = succeeded worker1 # [ 144.705825] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 145.738106] nix-daemon[832]: reaped child process 1953, status = succeeded worker1 # [ 145.901208] nix-daemon[832]: accepted connection from pid 1968, user nix-grpc-daemon (trusted) worker1 # [ 145.920858] nix-daemon[832]: reaped child process 1971, status = succeeded lb # [ 145.955349] niks3-server[1002]: 2026/09/20 12:25:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 145.944155] nix-grpc-daemon[1860]: time=2026-09-20T12:25:06.482Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 145.945655] nix-grpc-daemon[1860]: time=2026-09-20T12:25:06.482Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 145.993155] niks3-server[1002]: 2026/09/20 12:25:06 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 146.004847] niks3-server[1002]: 2026/09/20 12:25:06 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 146.015284] niks3-server[1002]: 2026/09/20 12:25:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 145.997728] nix-grpc-daemon[1860]: time=2026-09-20T12:25:06.537Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.025065] niks3-server[1002]: 2026/09/20 12:25:06 INFO Signed narinfos id=51 count=1 lb # [ 146.027563] niks3-server[1002]: 2026/09/20 12:25:06 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 146.037206] niks3-server[1002]: 2026/09/20 12:25:06 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 146.043250] niks3-server[1002]: 2026/09/20 12:25:06 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo lb # [ 146.048747] niks3-server[1002]: 2026/09/20 12:25:06 INFO Completed upload id=51 worker1 # [ 146.026631] nix-grpc-daemon[1860]: time=2026-09-20T12:25:06.566Z level=INFO msg="Upload complete. (309ms)" worker2 # [ 146.068119] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:06Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 146.038295] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=1 worker2 # [ 146.076995] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:06Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 146.056470] nix-daemon[832]: reaped child process 1951, status = succeeded worker1 # [ 146.082466] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 146.098668] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 146.113053] nix-grpc-daemon[1860]: time=2026-09-20T12:25:06.653Z level=INFO msg="All 1 paths already cached" worker1 # [ 146.123904] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 146.137016] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 146.335412] nix-daemon[832]: accepted connection from pid 1975, user nix-grpc-daemon (trusted) worker1 # [ 146.355091] nix-daemon[832]: reaped child process 1978, status = succeeded worker1 # [ 146.530895] nix-daemon[832]: accepted connection from pid 1980, user nix-grpc-daemon (trusted) worker1 # [ 146.548800] nix-daemon[832]: reaped child process 1983, status = succeeded lb # [ 146.582491] niks3-server[1002]: 2026/09/20 12:25:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.570636] nix-grpc-daemon[1860]: time=2026-09-20T12:25:07.110Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 146.572245] nix-grpc-daemon[1860]: time=2026-09-20T12:25:07.110Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 146.610207] niks3-server[1002]: 2026/09/20 12:25:07 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst lb # [ 146.624589] niks3-server[1002]: 2026/09/20 12:25:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker1 # [ 146.607349] nix-grpc-daemon[1860]: time=2026-09-20T12:25:07.147Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.635530] niks3-server[1002]: 2026/09/20 12:25:07 INFO Signed narinfos id=52 count=1 lb # [ 146.641282] niks3-server[1002]: 2026/09/20 12:25:07 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 146.649578] niks3-server[1002]: 2026/09/20 12:25:07 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete worker1 # [ 146.631095] nix-grpc-daemon[1860]: time=2026-09-20T12:25:07.171Z level=INFO msg="Upload complete. (476ms)" lb # [ 146.654538] niks3-server[1002]: 2026/09/20 12:25:07 INFO Completed upload id=52 lb # [ 146.657871] niks3-server[1002]: 2026/09/20 12:25:07 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 146.636804] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 146.644594] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 146.656198] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 146.659144] nix-daemon[832]: reaped child process 1973, status = succeeded worker1 # [ 146.671673] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 147.899896] nix-daemon[832]: reaped child process 1987, status = succeeded worker1 # [ 148.061223] nix-daemon[832]: accepted connection from pid 2002, user nix-grpc-daemon (trusted) worker1 # [ 148.081602] nix-daemon[832]: reaped child process 2005, status = succeeded lb # [ 148.117555] niks3-server[1002]: 2026/09/20 12:25:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.104394] nix-grpc-daemon[1860]: time=2026-09-20T12:25:08.643Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 148.105843] nix-grpc-daemon[1860]: time=2026-09-20T12:25:08.643Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 148.153319] niks3-server[1002]: 2026/09/20 12:25:08 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst worker1 # [ 148.148473] nix-grpc-daemon[1860]: time=2026-09-20T12:25:08.687Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.169947] niks3-server[1002]: 2026/09/20 12:25:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 148.182895] niks3-server[1002]: 2026/09/20 12:25:08 INFO Signed narinfos id=53 count=1 lb # [ 148.189716] niks3-server[1002]: 2026/09/20 12:25:08 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 148.197379] niks3-server[1002]: 2026/09/20 12:25:08 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 148.205651] niks3-server[1002]: 2026/09/20 12:25:08 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete worker1 # [ 148.188147] nix-grpc-daemon[1860]: time=2026-09-20T12:25:08.728Z level=INFO msg="Upload complete. (307ms)" lb # [ 148.211249] niks3-server[1002]: 2026/09/20 12:25:08 INFO Completed upload id=53 lb # [ 148.214417] niks3-server[1002]: 2026/09/20 12:25:08 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker1 # [ 148.197005] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=1 worker2 # [ 148.229641] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:08Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 148.242947] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:08Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 148.215085] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 148.220621] nix-daemon[832]: reaped child process 1985, status = succeeded worker1 # [ 148.228148] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 148.240393] nix-grpc-daemon[1860]: time=2026-09-20T12:25:08.780Z level=INFO msg="All 1 paths already cached" worker1 # [ 148.248496] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 148.259494] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 148.448250] nix-daemon[832]: accepted connection from pid 2009, user nix-grpc-daemon (trusted) worker1 # [ 148.465439] nix-daemon[832]: reaped child process 2012, status = succeeded worker1 # [ 148.644352] nix-daemon[832]: accepted connection from pid 2014, user nix-grpc-daemon (trusted) worker1 # [ 148.662447] nix-daemon[832]: reaped child process 2017, status = succeeded lb # [ 148.698985] niks3-server[1002]: 2026/09/20 12:25:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.685570] nix-grpc-daemon[1860]: time=2026-09-20T12:25:09.225Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 148.687099] nix-grpc-daemon[1860]: time=2026-09-20T12:25:09.225Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 148.725137] niks3-server[1002]: 2026/09/20 12:25:09 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst worker1 # [ 148.715905] nix-grpc-daemon[1860]: time=2026-09-20T12:25:09.255Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.739958] niks3-server[1002]: 2026/09/20 12:25:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 148.751110] niks3-server[1002]: 2026/09/20 12:25:09 INFO Signed narinfos id=54 count=1 lb # [ 148.757368] niks3-server[1002]: 2026/09/20 12:25:09 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 148.766342] niks3-server[1002]: 2026/09/20 12:25:09 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker1 # [ 148.750427] nix-grpc-daemon[1860]: time=2026-09-20T12:25:09.290Z level=INFO msg="Upload complete. (478ms)" lb # [ 148.773366] niks3-server[1002]: 2026/09/20 12:25:09 INFO Completed upload id=54 worker1 # [ 148.756251] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 148.778866] niks3-server[1002]: 2026/09/20 12:25:09 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 148.770358] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 148.775873] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 148.781003] nix-daemon[832]: reaped child process 2007, status = succeeded worker1 # [ 148.794507] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 149.854554] nix-daemon[832]: reaped child process 2021, status = succeeded worker1 # [ 150.068604] nix-daemon[832]: accepted connection from pid 2036, user nix-grpc-daemon (trusted) worker1 # [ 150.089461] nix-daemon[832]: reaped child process 2039, status = succeeded lb # [ 150.125135] niks3-server[1002]: 2026/09/20 12:25:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.116554] nix-grpc-daemon[1860]: time=2026-09-20T12:25:10.654Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 150.118062] nix-grpc-daemon[1860]: time=2026-09-20T12:25:10.654Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 150.169946] niks3-server[1002]: 2026/09/20 12:25:10 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 150.188463] niks3-server[1002]: 2026/09/20 12:25:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 150.172191] nix-grpc-daemon[1860]: time=2026-09-20T12:25:10.711Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.197762] niks3-server[1002]: 2026/09/20 12:25:10 INFO Signed narinfos id=55 count=1 lb # [ 150.204871] niks3-server[1002]: 2026/09/20 12:25:10 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 150.213611] niks3-server[1002]: 2026/09/20 12:25:10 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls worker1 # [ 150.198972] nix-grpc-daemon[1860]: time=2026-09-20T12:25:10.738Z level=INFO msg="Upload complete. (392ms)" lb # [ 150.222812] niks3-server[1002]: 2026/09/20 12:25:10 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 150.229187] niks3-server[1002]: 2026/09/20 12:25:10 INFO Completed upload id=55 lb # [ 150.233577] niks3-server[1002]: 2026/09/20 12:25:10 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker2 # [ 150.246922] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:10Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 150.218695] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=1 worker2 # [ 150.255635] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:10Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 150.232773] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 150.251285] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 150.257099] nix-daemon[832]: reaped child process 2019, status = succeeded worker1 # [ 150.265672] nix-grpc-daemon[1860]: time=2026-09-20T12:25:10.805Z level=INFO msg="All 1 paths already cached" worker1 # [ 150.274896] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 150.288127] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 150.511773] nix-daemon[832]: accepted connection from pid 2043, user nix-grpc-daemon (trusted) worker1 # [ 150.534372] nix-daemon[832]: reaped child process 2046, status = succeeded worker1 # [ 150.735927] nix-daemon[832]: accepted connection from pid 2048, user nix-grpc-daemon (trusted) worker1 # [ 150.755242] nix-daemon[832]: reaped child process 2051, status = succeeded lb # [ 150.792044] niks3-server[1002]: 2026/09/20 12:25:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.780962] nix-grpc-daemon[1860]: time=2026-09-20T12:25:11.320Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 150.782491] nix-grpc-daemon[1860]: time=2026-09-20T12:25:11.320Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 150.834742] niks3-server[1002]: 2026/09/20 12:25:11 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst worker1 # [ 150.825063] nix-grpc-daemon[1860]: time=2026-09-20T12:25:11.364Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.851498] niks3-server[1002]: 2026/09/20 12:25:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 150.862629] niks3-server[1002]: 2026/09/20 12:25:11 INFO Signed narinfos id=56 count=1 lb # [ 150.869034] niks3-server[1002]: 2026/09/20 12:25:11 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 150.875857] niks3-server[1002]: 2026/09/20 12:25:11 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 150.884689] niks3-server[1002]: 2026/09/20 12:25:11 INFO Completed upload id=56 worker1 # [ 150.861934] nix-grpc-daemon[1860]: time=2026-09-20T12:25:11.401Z level=INFO msg="Upload complete. (557ms)" lb # [ 150.887459] niks3-server[1002]: 2026/09/20 12:25:11 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 150.872378] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 150.884694] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 150.895925] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 150.908304] nix-daemon[832]: reaped child process 2041, status = succeeded worker1 # [ 150.917621] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 151.764257] nix-daemon[832]: reaped child process 2055, status = succeeded worker1 # [ 151.971941] nix-daemon[832]: accepted connection from pid 2070, user nix-grpc-daemon (trusted) worker1 # [ 151.991964] nix-daemon[832]: reaped child process 2073, status = succeeded lb # [ 152.031048] niks3-server[1002]: 2026/09/20 12:25:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.020478] nix-grpc-daemon[1860]: time=2026-09-20T12:25:12.558Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 152.021984] nix-grpc-daemon[1860]: time=2026-09-20T12:25:12.559Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 152.079282] niks3-server[1002]: 2026/09/20 12:25:12 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 152.092578] niks3-server[1002]: 2026/09/20 12:25:12 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 152.100084] niks3-server[1002]: 2026/09/20 12:25:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 152.108758] niks3-server[1002]: 2026/09/20 12:25:12 INFO Signed narinfos id=57 count=1 worker1 # [ 152.084943] nix-grpc-daemon[1860]: time=2026-09-20T12:25:12.624Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.113111] niks3-server[1002]: 2026/09/20 12:25:12 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 152.120579] niks3-server[1002]: 2026/09/20 12:25:12 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 152.126321] niks3-server[1002]: 2026/09/20 12:25:12 INFO Completed upload id=57 worker1 # [ 152.102301] nix-grpc-daemon[1860]: time=2026-09-20T12:25:12.642Z level=INFO msg="Upload complete. (373ms)" lb # [ 152.128507] niks3-server[1002]: 2026/09/20 12:25:12 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker2 # [ 152.150775] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:12Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 152.120435] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=1 worker2 # [ 152.158642] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:12Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 152.139680] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 152.146327] nix-daemon[832]: reaped child process 2053, status = succeeded worker1 # [ 152.151050] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 152.165898] nix-grpc-daemon[1860]: time=2026-09-20T12:25:12.705Z level=INFO msg="All 2 paths already cached" worker1 # [ 152.175928] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 152.189919] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 152.419000] nix-daemon[832]: accepted connection from pid 2077, user nix-grpc-daemon (trusted) worker1 # [ 152.442490] nix-daemon[832]: reaped child process 2080, status = succeeded worker1 # [ 152.644242] nix-daemon[832]: accepted connection from pid 2082, user nix-grpc-daemon (trusted) worker1 # [ 152.667641] nix-daemon[832]: reaped child process 2085, status = succeeded lb # [ 152.702899] niks3-server[1002]: 2026/09/20 12:25:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.692135] nix-grpc-daemon[1860]: time=2026-09-20T12:25:13.231Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 152.693664] nix-grpc-daemon[1860]: time=2026-09-20T12:25:13.231Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 152.743631] niks3-server[1002]: 2026/09/20 12:25:13 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 152.760796] niks3-server[1002]: 2026/09/20 12:25:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign worker1 # [ 152.745902] nix-grpc-daemon[1860]: time=2026-09-20T12:25:13.285Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.773225] niks3-server[1002]: 2026/09/20 12:25:13 INFO Signed narinfos id=58 count=1 lb # [ 152.779841] niks3-server[1002]: 2026/09/20 12:25:13 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 152.792511] niks3-server[1002]: 2026/09/20 12:25:13 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 152.798177] niks3-server[1002]: 2026/09/20 12:25:13 INFO Completed upload id=58 worker1 # [ 152.775909] nix-grpc-daemon[1860]: time=2026-09-20T12:25:13.315Z level=INFO msg="Upload complete. (568ms)" lb # [ 152.801452] niks3-server[1002]: 2026/09/20 12:25:13 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 152.788292] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 152.800365] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 152.820815] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 152.824522] nix-daemon[832]: reaped child process 2075, status = succeeded worker1 # [ 152.844217] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 153.696404] nix-daemon[832]: reaped child process 2089, status = succeeded worker1 # [ 153.919944] nix-daemon[832]: accepted connection from pid 2104, user nix-grpc-daemon (trusted) worker1 # [ 153.941018] nix-daemon[832]: reaped child process 2107, status = succeeded lb # [ 153.979390] niks3-server[1002]: 2026/09/20 12:25:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.972565] nix-grpc-daemon[1860]: time=2026-09-20T12:25:14.508Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 153.974877] nix-grpc-daemon[1860]: time=2026-09-20T12:25:14.508Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 154.042762] niks3-server[1002]: 2026/09/20 12:25:14 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 154.055577] niks3-server[1002]: 2026/09/20 12:25:14 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 154.063517] niks3-server[1002]: 2026/09/20 12:25:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker1 # [ 154.047546] nix-grpc-daemon[1860]: time=2026-09-20T12:25:14.586Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.075785] niks3-server[1002]: 2026/09/20 12:25:14 INFO Signed narinfos id=59 count=1 lb # [ 154.082433] niks3-server[1002]: 2026/09/20 12:25:14 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 154.092805] niks3-server[1002]: 2026/09/20 12:25:14 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 154.102159] niks3-server[1002]: 2026/09/20 12:25:14 INFO Completed upload id=59 worker1 # [ 154.079580] nix-grpc-daemon[1860]: time=2026-09-20T12:25:14.619Z level=INFO msg="Upload complete. (421ms)" lb # [ 154.105041] niks3-server[1002]: 2026/09/20 12:25:14 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker2 # [ 154.121602] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:14Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 154.097583] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=1 worker1 # [ 154.118208] nix-daemon[832]: reaped child process 2087, status = succeeded worker1 # [ 154.139290] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 154.161630] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 154.178635] nix-grpc-daemon[1860]: time=2026-09-20T12:25:14.718Z level=INFO msg="All 2 paths already cached" worker1 # [ 154.190895] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 154.208214] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 154.460690] nix-daemon[832]: accepted connection from pid 2111, user nix-grpc-daemon (trusted) worker1 # [ 154.481763] nix-daemon[832]: reaped child process 2114, status = succeeded worker1 # [ 154.685945] nix-daemon[832]: accepted connection from pid 2116, user nix-grpc-daemon (trusted) worker1 # [ 154.706711] nix-daemon[832]: reaped child process 2119, status = succeeded lb # [ 154.745650] niks3-server[1002]: 2026/09/20 12:25:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.734763] nix-grpc-daemon[1860]: time=2026-09-20T12:25:15.274Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 154.736445] nix-grpc-daemon[1860]: time=2026-09-20T12:25:15.274Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 154.784302] niks3-server[1002]: 2026/09/20 12:25:15 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst lb # [ 154.802890] niks3-server[1002]: 2026/09/20 12:25:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign worker1 # [ 154.787024] nix-grpc-daemon[1860]: time=2026-09-20T12:25:15.326Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.816439] niks3-server[1002]: 2026/09/20 12:25:15 INFO Signed narinfos id=60 count=1 lb # [ 154.823442] niks3-server[1002]: 2026/09/20 12:25:15 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 154.832114] niks3-server[1002]: 2026/09/20 12:25:15 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 154.841408] niks3-server[1002]: 2026/09/20 12:25:15 INFO Completed upload id=60 worker1 # [ 154.817855] nix-grpc-daemon[1860]: time=2026-09-20T12:25:15.357Z level=INFO msg="Upload complete. (588ms)" lb # [ 154.844325] niks3-server[1002]: 2026/09/20 12:25:15 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 154.828393] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 154.844674] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 154.857420] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 154.872381] nix-daemon[832]: reaped child process 2109, status = succeeded worker1 # [ 154.881208] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 156.329088] nix-daemon[832]: reaped child process 2123, status = succeeded worker1 # [ 156.547980] nix-daemon[832]: accepted connection from pid 2138, user nix-grpc-daemon (trusted) worker1 # [ 156.573105] nix-daemon[832]: reaped child process 2141, status = succeeded lb # [ 156.617649] niks3-server[1002]: 2026/09/20 12:25:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.608537] nix-grpc-daemon[1860]: time=2026-09-20T12:25:17.145Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 156.610091] nix-grpc-daemon[1860]: time=2026-09-20T12:25:17.145Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 156.673004] niks3-server[1002]: 2026/09/20 12:25:17 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 156.689181] niks3-server[1002]: 2026/09/20 12:25:17 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 156.695865] niks3-server[1002]: 2026/09/20 12:25:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 156.702739] niks3-server[1002]: 2026/09/20 12:25:17 INFO Signed narinfos id=61 count=1 worker1 # [ 156.679237] nix-grpc-daemon[1860]: time=2026-09-20T12:25:17.218Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.710129] niks3-server[1002]: 2026/09/20 12:25:17 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 156.722506] niks3-server[1002]: 2026/09/20 12:25:17 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 156.730550] niks3-server[1002]: 2026/09/20 12:25:17 INFO Completed upload id=61 worker1 # [ 156.707748] nix-grpc-daemon[1860]: time=2026-09-20T12:25:17.247Z level=INFO msg="Upload complete. (410ms)" lb # [ 156.734278] niks3-server[1002]: 2026/09/20 12:25:17 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker2 # [ 156.750419] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:17Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 156.721844] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=1 worker1 # [ 156.749189] nix-daemon[832]: reaped child process 2121, status = succeeded worker1 # [ 156.777223] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 156.801556] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 156.821712] nix-grpc-daemon[1860]: time=2026-09-20T12:25:17.361Z level=INFO msg="All 2 paths already cached" worker1 # [ 156.835460] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 156.851427] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 157.108301] nix-daemon[832]: accepted connection from pid 2145, user nix-grpc-daemon (trusted) worker1 # [ 157.133345] nix-daemon[832]: reaped child process 2148, status = succeeded worker1 # [ 157.347586] nix-daemon[832]: accepted connection from pid 2150, user nix-grpc-daemon (trusted) worker1 # [ 157.370476] nix-daemon[832]: reaped child process 2153, status = succeeded lb # [ 157.405303] niks3-server[1002]: 2026/09/20 12:25:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.398073] nix-grpc-daemon[1860]: time=2026-09-20T12:25:17.937Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 157.399826] nix-grpc-daemon[1860]: time=2026-09-20T12:25:17.937Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 157.456821] niks3-server[1002]: 2026/09/20 12:25:18 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 157.443196] nix-grpc-daemon[1860]: time=2026-09-20T12:25:17.982Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.467750] niks3-server[1002]: 2026/09/20 12:25:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 157.477395] niks3-server[1002]: 2026/09/20 12:25:18 INFO Signed narinfos id=62 count=1 lb # [ 157.483279] niks3-server[1002]: 2026/09/20 12:25:18 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 157.491448] niks3-server[1002]: 2026/09/20 12:25:18 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 157.500958] niks3-server[1002]: 2026/09/20 12:25:18 INFO Completed upload id=62 worker1 # [ 157.478712] nix-grpc-daemon[1860]: time=2026-09-20T12:25:18.018Z level=INFO msg="Upload complete. (600ms)" lb # [ 157.504373] niks3-server[1002]: 2026/09/20 12:25:18 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 157.492083] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 157.504347] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 worker1 # [ 157.518976] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 157.525390] nix-daemon[832]: reaped child process 2143, status = succeeded worker1 # [ 157.541741] nix-daemon[832]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 158.568402] nix-daemon[832]: reaped child process 2157, status = succeeded worker1 # [ 158.733485] nix-daemon[832]: accepted connection from pid 2172, user nix-grpc-daemon (trusted) worker1 # [ 158.751320] nix-daemon[832]: reaped child process 2175, status = succeeded lb # [ 158.786865] niks3-server[1002]: 2026/09/20 12:25:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.784459] nix-grpc-daemon[1860]: time=2026-09-20T12:25:19.321Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 158.785951] nix-grpc-daemon[1860]: time=2026-09-20T12:25:19.321Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 158.828942] niks3-server[1002]: 2026/09/20 12:25:19 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 158.843640] niks3-server[1002]: 2026/09/20 12:25:19 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 158.852738] niks3-server[1002]: 2026/09/20 12:25:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign worker1 # [ 158.835470] nix-grpc-daemon[1860]: time=2026-09-20T12:25:19.375Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.859926] niks3-server[1002]: 2026/09/20 12:25:19 INFO Signed narinfos id=63 count=1 lb # [ 158.863457] niks3-server[1002]: 2026/09/20 12:25:19 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 158.872208] niks3-server[1002]: 2026/09/20 12:25:19 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 158.878796] niks3-server[1002]: 2026/09/20 12:25:19 INFO Completed upload id=63 lb # [ 158.880878] niks3-server[1002]: 2026/09/20 12:25:19 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 158.856699] nix-grpc-daemon[1860]: time=2026-09-20T12:25:19.396Z level=INFO msg="Upload complete. (299ms)" worker1 # [ 158.869223] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59910 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=1 worker1 # [ 158.883402] nix-daemon[832]: reaped child process 2155, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.83 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1 worker2 # [ 159.319190] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36752 worker1 # [ 159.300116] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59910 worker2 # [ 159.357280] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:19Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.33 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 21.23 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 160.814862] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:21Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 worker1 # [ 161.851259] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59910 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 161.894112] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 161.921662] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:22Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 161.929051] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:22Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 161.967652] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 161.983129] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36752 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 161.998231] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 162.019084] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 162.238888] nix-daemon[844]: accepted connection from pid 1509, user nix-grpc-daemon (trusted) worker2 # [ 162.260530] nix-daemon[844]: reaped child process 1512, status = succeeded worker2 # [ 162.431715] nix-daemon[844]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 162.448835] nix-daemon[844]: reaped child process 1517, status = succeeded lb # [ 162.455994] niks3-server[1002]: 2026/09/20 12:25:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 162.473834] nix-grpc-daemon[1311]: time=2026-09-20T12:25:23.015Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 162.475310] nix-grpc-daemon[1311]: time=2026-09-20T12:25:23.015Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 162.484171] niks3-server[1002]: 2026/09/20 12:25:23 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst worker2 # [ 162.503013] nix-grpc-daemon[1311]: time=2026-09-20T12:25:23.045Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.500676] niks3-server[1002]: 2026/09/20 12:25:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 162.510930] niks3-server[1002]: 2026/09/20 12:25:23 INFO Signed narinfos id=64 count=1 lb # [ 162.514443] niks3-server[1002]: 2026/09/20 12:25:23 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 162.522249] niks3-server[1002]: 2026/09/20 12:25:23 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 162.527385] niks3-server[1002]: 2026/09/20 12:25:23 INFO Completed upload id=64 worker2 # [ 162.534591] nix-grpc-daemon[1311]: time=2026-09-20T12:25:23.077Z level=INFO msg="Upload complete. (495ms)" lb # [ 162.530213] niks3-server[1002]: 2026/09/20 12:25:23 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 162.544270] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 162.554416] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 162.563565] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 162.566062] nix-daemon[844]: reaped child process 1507, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... worker2 # [ 162.576915] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 162.927911] envoy[937]: conn peer=[2001:db8:1::1]:43254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27161 tx=10877 ms=20503 lb # [ 162.933076] envoy[937]: conn peer=[2001:db8:1::1]:38620 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=880 tx=483 ms=61 client # farm-a> LOG-farm-a-drain worker2 # [ 163.625802] nix-daemon[844]: reaped child process 1521, status = succeeded worker2 # [ 163.805146] nix-daemon[844]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker2 # [ 163.822995] nix-daemon[844]: reaped child process 1539, status = succeeded lb # [ 163.828584] niks3-server[1002]: 2026/09/20 12:25:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 163.848476] nix-grpc-daemon[1311]: time=2026-09-20T12:25:24.387Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 163.850407] nix-grpc-daemon[1311]: time=2026-09-20T12:25:24.387Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 163.860859] niks3-server[1002]: 2026/09/20 12:25:24 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 163.876215] niks3-server[1002]: 2026/09/20 12:25:24 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 163.888265] niks3-server[1002]: 2026/09/20 12:25:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 163.902617] nix-grpc-daemon[1311]: time=2026-09-20T12:25:24.444Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.898214] niks3-server[1002]: 2026/09/20 12:25:24 INFO Signed narinfos id=65 count=1 lb # [ 163.904234] niks3-server[1002]: 2026/09/20 12:25:24 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 163.912735] niks3-server[1002]: 2026/09/20 12:25:24 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 163.919096] niks3-server[1002]: 2026/09/20 12:25:24 INFO Completed upload id=65 worker2 # [ 163.926605] nix-grpc-daemon[1311]: time=2026-09-20T12:25:24.468Z level=INFO msg="Upload complete. (337ms)" lb # [ 163.921705] niks3-server[1002]: 2026/09/20 12:25:24 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 163.945042] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=1 worker2 # [ 163.962711] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:24Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker2 # [ 163.967008] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:24Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 163.971321] nix-daemon[844]: reaped child process 1519, status = succeeded worker2 # [ 163.989077] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 164.003826] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 164.018341] nix-grpc-daemon[1311]: time=2026-09-20T12:25:24.560Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 164.028368] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 164.044548] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 164.249268] nix-daemon[844]: accepted connection from pid 1545, user nix-grpc-daemon (trusted) worker2 # [ 164.268583] nix-daemon[844]: reaped child process 1548, status = succeeded worker2 # [ 164.445786] nix-daemon[844]: accepted connection from pid 1550, user nix-grpc-daemon (trusted) worker2 # [ 164.463793] nix-daemon[844]: reaped child process 1553, status = succeeded lb # [ 164.468504] niks3-server[1002]: 2026/09/20 12:25:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 164.485681] nix-grpc-daemon[1311]: time=2026-09-20T12:25:25.028Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 164.487620] nix-grpc-daemon[1311]: time=2026-09-20T12:25:25.029Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 164.498194] niks3-server[1002]: 2026/09/20 12:25:25 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 164.518907] nix-grpc-daemon[1311]: time=2026-09-20T12:25:25.061Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.515031] niks3-server[1002]: 2026/09/20 12:25:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 164.526611] niks3-server[1002]: 2026/09/20 12:25:25 INFO Signed narinfos id=66 count=1 lb # [ 164.540235] niks3-server[1002]: 2026/09/20 12:25:25 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls worker2 # [ 164.552213] nix-grpc-daemon[1311]: time=2026-09-20T12:25:25.094Z level=INFO msg="Upload complete. (490ms)" lb # [ 164.544734] niks3-server[1002]: 2026/09/20 12:25:25 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 164.549861] niks3-server[1002]: 2026/09/20 12:25:25 INFO Completed upload id=66 lb # [ 164.553283] niks3-server[1002]: 2026/09/20 12:25:25 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 164.560105] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 164.570448] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 164.578681] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 164.583506] nix-daemon[844]: reaped child process 1543, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... worker2 # [ 164.594729] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv client # farm-b> LOG-farm-b-drain worker2 # [ 165.243424] nix-daemon[844]: reaped child process 1557, status = succeeded worker2 # [ 165.421765] nix-daemon[844]: accepted connection from pid 1572, user nix-grpc-daemon (trusted) worker2 # [ 165.438447] nix-daemon[844]: reaped child process 1575, status = succeeded lb # [ 165.446359] niks3-server[1002]: 2026/09/20 12:25:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 165.464434] nix-grpc-daemon[1311]: time=2026-09-20T12:25:26.004Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 165.467511] nix-grpc-daemon[1311]: time=2026-09-20T12:25:26.004Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 165.482088] niks3-server[1002]: 2026/09/20 12:25:26 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 165.494507] niks3-server[1002]: 2026/09/20 12:25:26 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 165.506121] niks3-server[1002]: 2026/09/20 12:25:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 165.512788] niks3-server[1002]: 2026/09/20 12:25:26 INFO Signed narinfos id=67 count=1 worker2 # [ 165.520271] nix-grpc-daemon[1311]: time=2026-09-20T12:25:26.062Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.518264] niks3-server[1002]: 2026/09/20 12:25:26 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 165.527508] niks3-server[1002]: 2026/09/20 12:25:26 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 165.537852] niks3-server[1002]: 2026/09/20 12:25:26 INFO Completed upload id=67 worker2 # [ 165.545298] nix-grpc-daemon[1311]: time=2026-09-20T12:25:26.087Z level=INFO msg="Upload complete. (335ms)" lb # [ 165.544634] niks3-server[1002]: 2026/09/20 12:25:26 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 165.560511] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=0 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=1 worker2 # [ 165.579007] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:26Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 165.583630] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:26Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 165.588545] nix-daemon[844]: reaped child process 1555, status = succeeded worker2 # [ 165.615437] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 165.632711] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 165.648862] nix-grpc-daemon[1311]: time=2026-09-20T12:25:26.191Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 165.659192] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 165.673730] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 165.879280] nix-daemon[844]: accepted connection from pid 1581, user nix-grpc-daemon (trusted) worker2 # [ 165.899313] nix-daemon[844]: reaped child process 1584, status = succeeded worker2 # [ 166.073158] nix-daemon[844]: accepted connection from pid 1586, user nix-grpc-daemon (trusted) worker2 # [ 166.089642] nix-daemon[844]: reaped child process 1589, status = succeeded lb # [ 166.093483] niks3-server[1002]: 2026/09/20 12:25:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 166.109994] nix-grpc-daemon[1311]: time=2026-09-20T12:25:26.652Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 166.111470] nix-grpc-daemon[1311]: time=2026-09-20T12:25:26.652Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 166.120513] niks3-server[1002]: 2026/09/20 12:25:26 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst lb # [ 166.132974] niks3-server[1002]: 2026/09/20 12:25:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign worker2 # [ 166.146720] nix-grpc-daemon[1311]: time=2026-09-20T12:25:26.688Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.143743] niks3-server[1002]: 2026/09/20 12:25:26 INFO Signed narinfos id=68 count=1 lb # [ 166.149877] niks3-server[1002]: 2026/09/20 12:25:26 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 166.157231] niks3-server[1002]: 2026/09/20 12:25:26 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 166.162969] niks3-server[1002]: 2026/09/20 12:25:26 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo lb # [ 166.168056] niks3-server[1002]: 2026/09/20 12:25:26 INFO Completed upload id=68 worker2 # [ 166.175579] nix-grpc-daemon[1311]: time=2026-09-20T12:25:26.718Z level=INFO msg="Upload complete. (484ms)" worker2 # [ 166.183191] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 166.195677] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 worker2 # [ 166.202016] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker2 # [ 166.206364] nix-daemon[844]: reaped child process 1579, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 166.219230] nix-daemon[844]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-drain worker2 # [ 167.441178] nix-daemon[844]: reaped child process 1593, status = succeeded worker2 # [ 167.599880] nix-daemon[844]: accepted connection from pid 1608, user nix-grpc-daemon (trusted) worker2 # [ 167.618957] nix-daemon[844]: reaped child process 1611, status = succeeded lb # [ 167.624441] niks3-server[1002]: 2026/09/20 12:25:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 167.642371] nix-grpc-daemon[1311]: time=2026-09-20T12:25:28.183Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 167.643837] nix-grpc-daemon[1311]: time=2026-09-20T12:25:28.183Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 167.651405] niks3-server[1002]: 2026/09/20 12:25:28 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 167.668559] niks3-server[1002]: 2026/09/20 12:25:28 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 167.683330] niks3-server[1002]: 2026/09/20 12:25:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker2 # [ 167.696751] nix-grpc-daemon[1311]: time=2026-09-20T12:25:28.238Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.695945] niks3-server[1002]: 2026/09/20 12:25:28 INFO Signed narinfos id=69 count=1 lb # [ 167.702359] niks3-server[1002]: 2026/09/20 12:25:28 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls worker2 # [ 167.718535] nix-grpc-daemon[1311]: time=2026-09-20T12:25:28.260Z level=INFO msg="Upload complete. (290ms)" lb # [ 167.712467] niks3-server[1002]: 2026/09/20 12:25:28 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 167.718458] niks3-server[1002]: 2026/09/20 12:25:28 INFO Completed upload id=69 lb # [ 167.721666] niks3-server[1002]: 2026/09/20 12:25:28 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 167.729592] nix-grpc-daemon[1169]: ts=2026-09-20T12:25:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36752 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=1 worker2 # [ 167.745136] nix-daemon[844]: reaped child process 1591, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.16 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 168.818407] nix-grpc-daemon[1804]: ts=2026-09-20T12:25:29Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.01 seconds) (finished: run the VM test script, in 170.42 seconds) test script finished in 170.71s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.24 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh