tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm client # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.eGWGSa3qhl', fmt=raw size=1073741824 client: QEMU running (pid 49) worker1 # Disk image does not exist, creating the virtualisation disk image... worker2 # Disk image does not exist, creating the virtualisation disk image... lb # Disk image does not exist, creating the virtualisation disk image... worker1 # Formatting '/build/vm-state-worker1/tmp.CWkteXR4Cx', fmt=raw size=1073741824 worker1: QEMU running (pid 52) worker2 # Formatting '/build/vm-state-worker2/tmp.MlipCtExtx', fmt=raw size=1073741824 lb # Formatting '/build/vm-state-lb/tmp.dyTHNZiaXE', fmt=raw size=1073741824 worker1 # mke2fs 1.47.4 (6-Mar-2025) client # mke2fs 1.47.4 (6-Mar-2025) worker2: QEMU running (pid 51) lb: QEMU running (pid 50) worker2 # mke2fs 1.47.4 (6-Mar-2025) lb # mke2fs 1.47.4 (6-Mar-2025) client # Discarding device blocks: 0/262144 done worker1 # Discarding device blocks: 0/262144 done worker2 # Discarding device blocks: 0/262144 done (finished: start all VMs, in 0.46 seconds) worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client: waiting for unit network-addresses-eth1.service worker1 # Filesystem UUID: cdabd6ab-a86f-4aee-a7be-f2bbcb022252 worker2 # Filesystem UUID: ebc981a5-c744-4b44-9a0f-db7807dd89a5 client: waiting for the VM to finish booting worker1 # Superblock backups stored on blocks: worker2 # Superblock backups stored on blocks: client # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Discarding device blocks: 0/262144 done worker1 # 32768, 98304, 163840, 229376 worker2 # 32768, 98304, 163840, 229376 client # Filesystem UUID: 459c0bb6-c725-42d8-b253-0a9ab86755fd lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # worker2 # client # Superblock backups stored on blocks: lb # Filesystem UUID: 24367d81-74ac-478d-a09f-1f4e8390f8c9 worker1 # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker2 # Allocating group tables: 0/8 done lb # Superblock backups stored on blocks: worker1 # Creating journal (8192 blocks): done client # 32768, 98304, 163840, 229376 worker1 # Writing superblocks and filesystem accounting information: 0/8 done client # lb # 32768, 98304, 163840, 229376 worker2 # Writing inode tables: 0/8 done worker1 # client # Allocating group tables: 0/8 done lb # worker2 # Creating journal (8192 blocks): done worker1 # Virtualisation disk image created. client # Writing inode tables: 0/8 done lb # Allocating group tables: 0/8 done client # Creating journal (8192 blocks): done lb # Writing inode tables: 0/8 done client # Writing superblocks and filesystem accounting information: 0/8 done lb # Creating journal (8192 blocks): done client # lb # Writing superblocks and filesystem accounting information: 0/8 done client # Virtualisation disk image created. lb # worker2 # Writing superblocks and filesystem accounting information: 0/8 done lb # Virtualisation disk image created. worker2 # worker2 # Virtualisation disk image created. worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] random: crng init done worker1 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] DMA32 empty client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] Normal empty client # [ 0.000000] KASLR enabled worker1 # [ 0.000000] Device empty client # [ 0.000000] random: crng init done worker1 # [ 0.000000] Movable zone start for each node client # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] Early memory node ranges client # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] Zone ranges: worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] DMA32 empty client # [ 0.000000] Normal empty worker1 # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] Device empty worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] Movable zone start for each node client # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] KASLR enabled lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] random: crng init done worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] KASLR enabled client # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] random: crng init done worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] DMA32 empty lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] Normal empty worker2 # [ 0.000000] Device empty lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Zone ranges: worker2 # [ 0.000000] Movable zone start for each node client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] Early memory node ranges client # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA32 empty client # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Normal empty worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bd8l1brw989alvvrp02daysj9ckfky9v-nixos-system-worker1-test/init regInfo=/nix/store/d8yni1hr6dr8cwacx46vd28l4c239im6-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] Device empty worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Movable zone start for each node client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/d8yni1hr6dr8cwacx46vd28l4c239im6-closure-info/registration", will be passed to user space. lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test/init regInfo=/nix/store/5w5n39zm4lsx78izjimsskk5ypfszqda-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/5w5n39zm4lsx78izjimsskk5ypfszqda-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] Policy zone: DMA client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/653izmi0ka8dwac3kpqd66p1v4c6d633-nixos-system-worker2-test/init regInfo=/nix/store/a21z6nrlwrspnl4pf7fkqnw4r5z0paf2-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/a21z6nrlwrspnl4pf7fkqnw4r5z0paf2-closure-info/registration", will be passed to user space. client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/1y76sp58sczakc84qnb2p7nq6lq4cpg2-nixos-system-lb-test/init regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/yf668d8xpf1l4919kivs4ak64gjacscd-closure-info/registration", will be passed to user space. client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 worker1 # [ 0.000031] arm-pv: using stolen time PV lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000547] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000725] Console: colour dummy device 80x25 worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000733] printk: legacy console [tty0] enabled lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000929] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000936] pid_max: default: 32768 minimum: 301 lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.001014] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.001165] landlock: Up and running. client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.001168] Yama: becoming mindful. lb # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000032] arm-pv: using stolen time PV worker1 # [ 0.001740] LSM support for eBPF active worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.001888] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000443] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000606] Console: colour dummy device 80x25 worker1 # [ 0.001922] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000614] printk: legacy console [tty0] enabled lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.003079] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.003838] rcu: Hierarchical SRCU implementation. lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000806] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.003842] rcu: Max phase no-delay instances is 1000. client # [ 0.000812] pid_max: default: 32768 minimum: 301 worker1 # [ 0.005047] fsl-mc MSI: its@8080000 domain created lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.005139] EFI services will not be available. client # [ 0.000907] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.001053] landlock: Up and running. worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.005254] smp: Bringing up secondary CPUs ... client # [ 0.001056] Yama: becoming mindful. worker1 # [ 0.005262] smp: Brought up 1 node, 1 CPU lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.001541] LSM support for eBPF active worker1 # [ 0.005265] SMP: Total of 1 processors activated. worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.001678] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.005271] CPU: All CPU(s) started at EL1 worker1 # [ 0.005282] CPU features: detected: Branch Target Identification worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.001717] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000028] arm-pv: using stolen time PV worker1 # [ 0.005287] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.002837] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.003567] rcu: Hierarchical SRCU implementation. worker2 # [ 0.000399] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.005291] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.003571] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.000567] Console: colour dummy device 80x25 lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.004787] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.005294] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.000575] printk: legacy console [tty0] enabled client # [ 0.004874] EFI services will not be available. lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.005298] CPU features: detected: Common not Private translations lb # [ 0.000030] arm-pv: using stolen time PV client # [ 0.004987] smp: Bringing up secondary CPUs ... worker2 # [ 0.000772] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.005301] CPU features: detected: CRC32 instructions client # [ 0.004995] smp: Brought up 1 node, 1 CPU worker2 # [ 0.000779] pid_max: default: 32768 minimum: 301 client # [ 0.004998] SMP: Total of 1 processors activated. lb # [ 0.000398] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.005304] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.005003] CPU: All CPU(s) started at EL1 worker2 # [ 0.000846] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000536] Console: colour dummy device 80x25 worker2 # [ 0.000963] landlock: Up and running. worker1 # [ 0.005308] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.005014] CPU features: detected: Branch Target Identification lb # [ 0.000544] printk: legacy console [tty0] enabled worker2 # [ 0.000966] Yama: becoming mindful. worker2 # [ 0.001402] LSM support for eBPF active worker1 # [ 0.005311] CPU features: detected: Data independent timing control (DIT) client # [ 0.005019] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.005314] CPU features: detected: E0PD lb # [ 0.000730] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.001542] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.005022] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.000736] pid_max: default: 32768 minimum: 301 worker1 # [ 0.005316] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.001574] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000812] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.005026] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.005319] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.000949] landlock: Up and running. worker2 # [ 0.002665] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.000952] Yama: becoming mindful. client # [ 0.005029] CPU features: detected: Common not Private translations worker1 # [ 0.005322] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.003392] rcu: Hierarchical SRCU implementation. lb # [ 0.001399] LSM support for eBPF active worker1 # [ 0.005325] CPU features: detected: Fine Grained Traps client # [ 0.005033] CPU features: detected: CRC32 instructions worker2 # [ 0.003396] rcu: Max phase no-delay instances is 1000. lb # [ 0.001522] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.004587] fsl-mc MSI: its@8080000 domain created client # [ 0.005036] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.005329] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.004674] EFI services will not be available. worker1 # [ 0.005335] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.001559] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.005039] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.004794] smp: Bringing up secondary CPUs ... worker1 # [ 0.005338] CPU features: detected: LSE atomic instructions lb # [ 0.002622] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.004801] smp: Brought up 1 node, 1 CPU client # [ 0.005042] CPU features: detected: Data independent timing control (DIT) lb # [ 0.003346] rcu: Hierarchical SRCU implementation. worker1 # [ 0.005341] CPU features: detected: Privileged Access Never worker2 # [ 0.004805] SMP: Total of 1 processors activated. client # [ 0.005045] CPU features: detected: E0PD worker2 # [ 0.004810] CPU: All CPU(s) started at EL1 lb # [ 0.003350] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.005343] CPU features: detected: PMUv3 client # [ 0.005048] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.005346] CPU features: detected: RAS Extension Support lb # [ 0.004489] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.004821] CPU features: detected: Branch Target Identification lb # [ 0.004586] EFI services will not be available. client # [ 0.005051] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.004826] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.005349] CPU features: detected: RASv1p1 Extension Support lb # [ 0.004653] smp: Bringing up secondary CPUs ... client # [ 0.005055] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.005352] CPU features: detected: Random Number Generator lb # [ 0.004660] smp: Brought up 1 node, 1 CPU worker2 # [ 0.004829] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.005058] CPU features: detected: Fine Grained Traps lb # [ 0.004663] SMP: Total of 1 processors activated. worker1 # [ 0.005354] CPU features: detected: Speculation barrier (SB) lb # [ 0.004668] CPU: All CPU(s) started at EL1 client # [ 0.005062] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.004833] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.005358] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.004679] CPU features: detected: Branch Target Identification client # [ 0.005067] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.005361] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.004837] CPU features: detected: Common not Private translations lb # [ 0.004684] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.005070] CPU features: detected: LSE atomic instructions worker2 # [ 0.004840] CPU features: detected: CRC32 instructions worker1 # [ 0.005365] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.005073] CPU features: detected: Privileged Access Never worker2 # [ 0.004843] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.005404] alternatives: applying system-wide alternatives lb # [ 0.004687] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.005076] CPU features: detected: PMUv3 worker2 # [ 0.004846] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.005079] CPU features: detected: RAS Extension Support worker1 # [ 0.008393] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.004691] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.005081] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.004850] CPU features: detected: Data independent timing control (DIT) lb # [ 0.004694] CPU features: detected: Common not Private translations worker2 # [ 0.004853] CPU features: detected: E0PD client # [ 0.005084] CPU features: detected: Random Number Generator lb # [ 0.004697] CPU features: detected: CRC32 instructions worker1 # [ 0.008546] Memory: 1406512K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.008924] devtmpfs: initialized worker2 # [ 0.004855] CPU features: detected: Enhanced Counter Virtualization client # [ 0.005087] CPU features: detected: Speculation barrier (SB) lb # [ 0.004700] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.005090] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.004858] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.010782] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.004704] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.004861] CPU features: detected: Enhanced Virtualization Traps client # [ 0.005093] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.010805] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.004707] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.004864] CPU features: detected: Fine Grained Traps client # [ 0.005097] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.004710] CPU features: detected: E0PD worker1 # [ 0.010978] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.005131] alternatives: applying system-wide alternatives worker2 # [ 0.004868] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.004713] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.004873] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.008142] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.004716] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.004876] CPU features: detected: LSE atomic instructions lb # [ 0.004719] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.004879] CPU features: detected: Privileged Access Never lb # [ 0.004722] CPU features: detected: Fine Grained Traps client # [ 0.008296] Memory: 1406560K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker2 # [ 0.004882] CPU features: detected: PMUv3 client # [ 0.008715] devtmpfs: initialized worker2 # [ 0.004884] CPU features: detected: RAS Extension Support lb # [ 0.004725] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.010490] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.004887] CPU features: detected: RASv1p1 Extension Support lb # [ 0.004730] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.004890] CPU features: detected: Random Number Generator client # [ 0.010514] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.004733] CPU features: detected: LSE atomic instructions worker2 # [ 0.004892] CPU features: detected: Speculation barrier (SB) client # [ 0.010692] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.004737] CPU features: detected: Privileged Access Never worker2 # [ 0.004895] CPU features: detected: Stage-2 Force Write-Back client # [ 0.010696] 0 pages in range for non-PLT usage lb # [ 0.004739] CPU features: detected: PMUv3 client # [ 0.010697] 508288 pages in range for PLT usage worker2 # [ 0.004898] CPU features: detected: TLB range maintenance instructions lb # [ 0.004742] CPU features: detected: RAS Extension Support client # [ 0.010823] pinctrl core: initialized pinctrl subsystem lb # [ 0.004745] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.004903] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.004747] CPU features: detected: Random Number Generator worker2 # [ 0.004937] alternatives: applying system-wide alternatives worker1 # [ 0.010983] 0 pages in range for non-PLT usage lb # [ 0.004750] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.010984] 508288 pages in range for PLT usage worker2 # [ 0.007827] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.004753] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.011089] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.011870] DMI not present or invalid. lb # [ 0.004756] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.008000] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.015121] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.008396] devtmpfs: initialized lb # [ 0.004760] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.017406] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.004796] alternatives: applying system-wide alternatives worker2 # [ 0.010141] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.017585] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.007733] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.010163] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.017782] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.010345] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.017804] audit: initializing netlink subsys (disabled) worker2 # [ 0.010349] 0 pages in range for non-PLT usage lb # [ 0.007959] Memory: 1406540K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) lb # [ 0.008382] devtmpfs: initialized worker1 # [ 0.018387] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.010350] 508288 pages in range for PLT usage worker2 # [ 0.010438] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.018389] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.010283] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.011165] DMI not present or invalid. client # [ 0.011531] DMI not present or invalid. worker1 # [ 0.018392] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.014325] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.010306] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.014783] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.018397] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.016516] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.016995] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.010500] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.018400] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.010505] 0 pages in range for non-PLT usage worker2 # [ 0.016698] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.017187] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.010506] 508288 pages in range for PLT usage worker1 # [ 0.018423] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.010595] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.018432] cpuidle: using governor ladder client # [ 0.017387] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.018438] cpuidle: using governor menu lb # [ 0.011342] DMI not present or invalid. client # [ 0.017421] audit: initializing netlink subsys (disabled) worker2 # [ 0.016899] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.014567] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.018619] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.017979] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.016921] audit: initializing netlink subsys (disabled) worker1 # [ 0.018634] ASID allocator initialised with 65536 entries lb # [ 0.016716] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.017432] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.017981] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.019794] Serial: AMBA PL011 UART driver lb # [ 0.016906] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.017435] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.017984] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.024870] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.017438] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.017990] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.024986] printk: console [ttyAMA0] enabled worker2 # [ 0.017444] thermal_sys: Registered thermal governor 'user_space' client # [ 0.017992] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.017446] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.143689] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.018024] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.143705] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.018032] cpuidle: using governor ladder worker2 # [ 0.017469] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.018038] cpuidle: using governor menu worker2 # [ 0.017479] cpuidle: using governor ladder worker1 # [ 0.143710] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.017485] cpuidle: using governor menu client # [ 0.018215] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.143714] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.017665] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.018230] ASID allocator initialised with 65536 entries worker1 # [ 0.143718] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.019391] Serial: AMBA PL011 UART driver worker2 # [ 0.017679] ASID allocator initialised with 65536 entries worker2 # [ 0.018886] Serial: AMBA PL011 UART driver worker1 # [ 0.143723] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.024501] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.143727] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.024653] printk: console [ttyAMA0] enabled worker2 # [ 0.023950] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.024122] printk: console [ttyAMA0] enabled worker1 # [ 0.143731] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.143538] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.143553] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.017099] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.017119] audit: initializing netlink subsys (disabled) worker1 # [ 0.150806] fbcon: Taking over console client # [ 0.143559] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.150819] ACPI: Interpreter disabled. lb # [ 0.017634] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.143563] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.152600] iommu: Default domain type: Translated lb # [ 0.017636] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.143567] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.152609] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.017639] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.143572] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.154193] SCSI subsystem initialized lb # [ 0.017644] thermal_sys: Registered thermal governor 'user_space' client # [ 0.143576] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.017646] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.143580] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.017668] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.140336] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.017678] cpuidle: using governor ladder worker2 # [ 0.140349] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.017683] cpuidle: using governor menu client # [ 0.150816] fbcon: Taking over console worker2 # [ 0.140354] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.017857] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.150829] ACPI: Interpreter disabled. worker2 # [ 0.140358] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.017881] ASID allocator initialised with 65536 entries client # [ 0.152667] iommu: Default domain type: Translated lb # [ 0.019034] Serial: AMBA PL011 UART driver worker2 # [ 0.140363] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.152677] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.140367] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.024166] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.154307] SCSI subsystem initialized lb # [ 0.024281] printk: console [ttyAMA0] enabled worker2 # [ 0.140371] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.140376] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.143728] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.161713] usbcore: registered new interface driver usbfs lb # [ 0.143743] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.161746] usbcore: registered new interface driver hub lb # [ 0.143748] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.161763] usbcore: registered new device driver usb worker2 # [ 0.147625] fbcon: Taking over console lb # [ 0.143753] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.147639] ACPI: Interpreter disabled. worker1 # [ 0.162020] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.143757] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.162026] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.143761] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.162035] PTP clock support registered worker1 # [ 0.162082] EDAC MC: Ver: 3.0.0 lb # [ 0.143765] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.159844] usbcore: registered new interface driver usbfs worker1 # [ 0.166654] scmi_core: SCMI protocol bus registered lb # [ 0.143769] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.159877] usbcore: registered new interface driver hub client # [ 0.159896] usbcore: registered new device driver usb worker1 # [ 0.167610] FPGA manager framework worker1 # [ 0.168499] vgaarb: loaded client # [ 0.160173] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.151092] fbcon: Taking over console client # [ 0.160179] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.151105] ACPI: Interpreter disabled. client # [ 0.160190] PTP clock support registered worker1 # [ 0.169129] clocksource: Switched to clocksource arch_sys_counter client # [ 0.160238] EDAC MC: Ver: 3.0.0 worker1 # [ 0.169701] VFS: Disk quotas dquot_6.6.0 lb # [ 0.152906] iommu: Default domain type: Translated client # [ 0.164888] scmi_core: SCMI protocol bus registered worker1 # [ 0.169733] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.152916] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.154549] SCSI subsystem initialized worker1 # [ 0.172026] netfs: FS-Cache loaded client # [ 0.165846] FPGA manager framework worker2 # [ 0.156613] iommu: Default domain type: Translated worker1 # [ 0.172117] pnp: PnP ACPI: disabled client # [ 0.166736] vgaarb: loaded worker2 # [ 0.156622] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.155190] usbcore: registered new interface driver usbfs worker2 # [ 0.157050] SCSI subsystem initialized client # [ 0.167340] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.155221] usbcore: registered new interface driver hub lb # [ 0.155238] usbcore: registered new device driver usb worker2 # [ 0.158986] usbcore: registered new interface driver usbfs lb # [ 0.155496] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.159017] usbcore: registered new interface driver hub worker2 # [ 0.159046] usbcore: registered new device driver usb lb # [ 0.155503] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.159309] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.155512] PTP clock support registered client # [ 0.170685] VFS: Disk quotas dquot_6.6.0 lb # [ 0.155567] EDAC MC: Ver: 3.0.0 client # [ 0.170714] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.159315] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.159325] PTP clock support registered worker2 # [ 0.159373] EDAC MC: Ver: 3.0.0 worker2 # [ 0.163962] scmi_core: SCMI protocol bus registered client # [ 0.174294] netfs: FS-Cache loaded worker2 # [ 0.164912] FPGA manager framework client # [ 0.174411] pnp: PnP ACPI: disabled worker2 # [ 0.165846] vgaarb: loaded worker1 # [ 0.177870] NET: Registered PF_INET protocol family worker2 # [ 0.166447] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.178148] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.166901] scmi_core: SCMI protocol bus registered client # [ 0.178313] NET: Registered PF_INET protocol family lb # [ 0.167913] FPGA manager framework lb # [ 0.168825] vgaarb: loaded client # [ 0.178569] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.172371] VFS: Disk quotas dquot_6.6.0 lb # [ 0.169437] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.170047] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.172412] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.170072] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.174039] netfs: FS-Cache loaded worker2 # [ 0.174167] pnp: PnP ACPI: disabled lb # [ 0.172398] netfs: FS-Cache loaded lb # [ 0.172506] pnp: PnP ACPI: disabled worker2 # [ 0.178030] NET: Registered PF_INET protocol family worker2 # [ 0.178292] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.178135] NET: Registered PF_INET protocol family lb # [ 0.178404] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.206598] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.206639] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.206663] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.206734] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.206876] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.206949] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.206983] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.207019] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.207108] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.207132] NET: Registered PF_XDP protocol family worker1 # [ 0.207148] PCI: CLS 0 bytes, default 64 client # [ 0.207476] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.207389] Trying to unpack rootfs image as initramfs... client # [ 0.207521] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.207549] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.207626] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.207769] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.207848] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.207884] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.207920] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.208007] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.222704] kvm [1]: HYP mode not available client # [ 0.208036] NET: Registered PF_XDP protocol family client # [ 0.208052] PCI: CLS 0 bytes, default 64 worker2 # [ 0.206778] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.208278] Trying to unpack rootfs image as initramfs... worker2 # [ 0.206826] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.206968] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.206854] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.207013] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.206930] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.207040] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.207073] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.207112] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.207154] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.207254] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.207187] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.207337] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.207222] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.207373] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.207312] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.207366] NET: Registered PF_XDP protocol family lb # [ 0.207409] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.207384] PCI: CLS 0 bytes, default 64 lb # [ 0.207496] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.207636] Trying to unpack rootfs image as initramfs... lb # [ 0.207518] NET: Registered PF_XDP protocol family lb # [ 0.207536] PCI: CLS 0 bytes, default 64 lb # [ 0.207783] Trying to unpack rootfs image as initramfs... worker2 # [ 0.224122] kvm [1]: HYP mode not available client # [ 0.231381] kvm [1]: HYP mode not available lb # [ 0.223126] kvm [1]: HYP mode not available worker1 # [ 0.313650] Initialise system trusted keyrings worker1 # [ 0.314392] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.315712] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.316474] 9p: Installing v9fs 9p2000 file system support client # [ 0.323940] Initialise system trusted keyrings worker2 # [ 0.315002] Initialise system trusted keyrings client # [ 0.324700] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.315739] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.313975] Initialise system trusted keyrings client # [ 0.326018] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.317016] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.314708] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.326767] 9p: Installing v9fs 9p2000 file system support lb # [ 0.315911] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.317767] 9p: Installing v9fs 9p2000 file system support lb # [ 0.316670] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.337014] Key type asymmetric registered worker1 # [ 0.337038] Asymmetric key parser 'x509' registered worker1 # [ 0.337110] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.345184] io scheduler mq-deadline registered worker1 # [ 0.345203] io scheduler kyber registered client # [ 0.347335] Key type asymmetric registered worker2 # [ 0.338383] Key type asymmetric registered worker1 # [ 0.353267] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.338405] Asymmetric key parser 'x509' registered lb # [ 0.337241] Key type asymmetric registered lb # [ 0.337264] Asymmetric key parser 'x509' registered lb # [ 0.337336] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.354611] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.354996] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.355013] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.355024] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.355033] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.355389] Asymmetric key parser 'x509' registered worker2 # [ 0.346542] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.355053] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.355457] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.347552] io scheduler mq-deadline registered lb # [ 0.345495] io scheduler mq-deadline registered client # [ 0.357036] io scheduler mq-deadline registered worker2 # [ 0.347563] io scheduler kyber registered worker1 # [ 0.355075] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.357047] io scheduler kyber registered lb # [ 0.345512] io scheduler kyber registered worker1 # [ 0.355147] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.355156] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.355162] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.355167] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.355172] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.355228] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.355678] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.355866] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.355882] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.355911] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.353559] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.355927] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.356380] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.356564] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.367458] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.356580] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.358560] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.354888] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.356609] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.355257] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.357057] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.355273] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.368757] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.359872] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.355285] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.369113] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.360262] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.355294] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.369130] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.360278] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.355319] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.369142] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.360290] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.355341] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.369150] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.360298] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.355437] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.369169] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.355447] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.360331] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.355453] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.369191] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.360354] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.355458] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.369265] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.360434] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.369275] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.355463] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.360443] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.369281] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.360449] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.355518] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.369286] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.360454] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.355951] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.369291] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.356137] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.360459] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.369347] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.356153] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.360514] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.356182] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.369781] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.360945] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.356198] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.369968] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.361130] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.369983] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.356651] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.361146] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.370012] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.356836] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.361175] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.356852] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.370028] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.361191] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.356881] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.370474] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.385289] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.361639] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.370656] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.385316] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.357332] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.361820] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.370672] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.385346] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.361836] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.370700] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.361865] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.385835] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.371150] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.386020] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.362310] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.371330] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.386036] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.391283] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.386068] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.381824] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.391315] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.381842] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.386533] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.381872] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.386715] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.386730] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.382327] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.386760] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.387209] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.393260] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.385595] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.393451] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.387392] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.385614] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.393466] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.387408] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.385645] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.387442] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.393497] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.386102] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.386283] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.393948] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.387925] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.394128] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.388109] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.386298] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.394144] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.388125] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.386327] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.394173] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.388154] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.381549] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.388170] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.381573] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.394620] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.394800] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.381602] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.388621] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.394815] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.388807] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.382092] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.394844] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.388836] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.382278] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.382294] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.395316] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.389298] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.382326] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.389484] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.389514] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.382783] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.382966] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.389909] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.382981] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.390092] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.383011] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.390347] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.383460] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.390644] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.383644] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.390660] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.383659] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.390690] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.383689] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.391156] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.384141] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.391339] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.384325] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.391354] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.384341] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.391384] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.384370] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.391955] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.384386] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.398839] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.391966] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.399036] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.384879] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.391972] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.399052] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.385067] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.392016] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.399081] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.385096] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.392064] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.399564] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.411567] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.385564] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.399747] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.411595] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.385751] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.392110] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.399761] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.411625] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.385780] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.392156] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.399790] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.411641] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.386173] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.392203] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.399806] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.412123] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.386355] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.392249] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.400275] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.412309] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.386603] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.400461] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.392295] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.412338] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.386878] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.400491] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.392341] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.386895] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.412785] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.400939] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.386924] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.412970] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.392388] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.401124] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.412999] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.387388] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.392463] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.401153] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.387570] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.413383] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.392508] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.387586] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.401542] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.413573] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.392529] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.387615] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.401720] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.392551] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.413816] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.388190] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.414065] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.401961] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.392572] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.402210] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.414082] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.388201] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.392596] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.402227] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.414111] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.388207] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.392617] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.402256] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.414566] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.392639] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.388251] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.414747] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.402730] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.392661] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.388297] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.402912] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.414763] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.392683] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.402927] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.388343] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.414792] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.392704] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.402956] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.415371] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.388389] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.392727] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.403525] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.415381] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.388434] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.392749] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.403535] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.415386] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.392770] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.388480] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.403540] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.392791] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.415436] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.388527] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.392812] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.403584] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.415485] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.388574] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.392833] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.403630] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.415536] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.392855] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.388619] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.403677] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.392876] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.415586] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.388679] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.392898] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.403723] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.415633] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.388724] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.392919] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker2 # [ 0.403769] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.388746] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.415679] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.392941] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.403815] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.388767] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.392967] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.415726] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.392977] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.388789] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.403861] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.415772] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.388813] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.392982] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.403908] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.415818] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.388835] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.403954] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.415889] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.388857] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.404014] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.415935] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.388879] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.404061] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.415956] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.388901] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.404082] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.415977] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.388924] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.404102] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.415999] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.388946] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.404124] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.416024] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.388969] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.404147] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.416046] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.388990] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.404177] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.389011] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.416068] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.389033] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.404198] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.416092] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.389054] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.404220] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.416114] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.389076] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.416136] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.404241] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.458203] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.389098] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.404263] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.416158] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.389119] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.404285] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.416180] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.389142] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.416201] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.404307] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.389163] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.416222] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.404329] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.389190] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.416243] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.404350] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.389200] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.416265] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.404370] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.389204] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.416286] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.404391] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.416307] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.404412] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.404433] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.416329] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.404455] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.416350] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker2 # [ 0.404476] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.416372] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.416406] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.404498] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.404524] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.416416] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.404534] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.416420] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.417570] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.404538] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.405681] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.454410] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.478590] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.480686] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.491718] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.489577] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.481599] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.479667] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.497703] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.499658] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.482830] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.484721] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.487770] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.495949] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.497999] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.489788] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker1 # [ 0.509654] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.511673] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.494837] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.496758] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.499856] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.501842] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.507982] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.509997] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.512055] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.514037] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.508084] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.513458] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.521686] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.524517] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.511057] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.526315] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.513051] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.528760] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.516469] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.532449] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.534863] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.523214] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.525211] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.538403] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.546370] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.528937] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.548890] msm_serial: driver initialized worker1 # [ 0.549048] SuperH (H)SCI(F) driver initialized worker1 # [ 0.549102] STM32 USART driver initialized worker2 # [ 0.526547] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.529018] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.541319] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.530778] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.532900] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) lb # [ 0.546700] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.560515] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.551634] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.563096] msm_serial: driver initialized worker2 # [ 0.554083] msm_serial: driver initialized client # [ 0.563231] SuperH (H)SCI(F) driver initialized worker2 # [ 0.554220] SuperH (H)SCI(F) driver initialized client # [ 0.563284] STM32 USART driver initialized worker2 # [ 0.554274] STM32 USART driver initialized lb # [ 0.554606] msm_serial: driver initialized lb # [ 0.554746] SuperH (H)SCI(F) driver initialized lb # [ 0.554802] STM32 USART driver initialized worker1 # [ 0.582360] loop: module loaded worker1 # [ 0.582524] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.583267] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.589697] megasas: 07.734.00.00-rc1 worker1 # [ 0.590409] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.593856] loop: module loaded worker2 # [ 0.585192] loop: module loaded client # [ 0.594029] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.585371] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.594742] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.584144] loop: module loaded worker2 # [ 0.586083] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.584311] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.585086] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.601176] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.601200] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.602781] Using buffer write method worker2 # [ 0.591021] megasas: 07.734.00.00-rc1 client # [ 0.599930] megasas: 07.734.00.00-rc1 worker1 # [ 0.602846] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.591710] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.600639] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.605759] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.589980] megasas: 07.734.00.00-rc1 worker1 # [ 0.605789] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.593775] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.603202] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.607116] Using buffer write method lb # [ 0.590698] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.593842] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.603230] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.607139] Concatenating MTD devices: worker1 # [ 0.607143] (0): "0.flash" lb # [ 0.592906] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.607147] (1): "0.flash" worker1 # [ 0.607150] into device "0.flash" lb # [ 0.592925] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.612357] Using buffer write method worker2 # [ 0.603490] Using buffer write method client # [ 0.612433] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.602388] Using buffer write method worker2 # [ 0.603553] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.615333] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.602453] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.605041] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.605067] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.605434] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.614484] Using buffer write method worker2 # [ 0.614507] Concatenating MTD devices: worker2 # [ 0.614511] (0): "0.flash" worker2 # [ 0.614515] (1): "0.flash" client # [ 0.623387] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.614519] into device "0.flash" client # [ 0.624980] Using buffer write method client # [ 0.625010] Concatenating MTD devices: client # [ 0.625015] (0): "0.flash" client # [ 0.625019] (1): "0.flash" lb # [ 0.613498] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.625022] into device "0.flash" lb # [ 0.615133] Using buffer write method lb # [ 0.615159] Concatenating MTD devices: lb # [ 0.615163] (0): "0.flash" lb # [ 0.615167] (1): "0.flash" lb # [ 0.615170] into device "0.flash" worker1 # [ 0.836172] Freeing initrd memory: 26148K worker1 # [ 0.842080] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.845762] thunder_xcv, ver 1.0 worker1 # [ 0.845808] thunder_bgx, ver 1.0 worker1 # [ 0.845829] nicpf, ver 1.0 worker1 # [ 0.846365] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.846372] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.846395] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.846403] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.846433] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.846438] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.837977] Freeing initrd memory: 26148K worker1 # [ 0.846461] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.838407] Freeing initrd memory: 26140K worker1 # [ 0.846467] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.846597] sky2: driver version 1.30 worker1 # [ 0.848227] usbcore: registered new interface driver usb-storage worker1 # [ 0.848316] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.848330] usbserial: USB Serial support registered for generic worker2 # [ 0.844035] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.848917] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.849831] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 0.849857] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.855521] Freeing initrd memory: 26160K worker1 # [ 0.850084] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.844333] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.862442] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.862845] hub 1-0:1.0: USB hub found worker1 # [ 0.862865] hub 1-0:1.0: 6 ports detected worker2 # [ 0.847857] thunder_xcv, ver 1.0 lb # [ 0.848075] thunder_xcv, ver 1.0 worker1 # [ 0.865744] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.847901] thunder_bgx, ver 1.0 lb # [ 0.848120] thunder_bgx, ver 1.0 worker2 # [ 0.847923] nicpf, ver 1.0 lb # [ 0.848141] nicpf, ver 1.0 client # [ 0.861586] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.865773] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:06 UTC (1789896726) worker2 # [ 0.848495] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.848686] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.866082] i2c_dev: i2c /dev entries driver worker2 # [ 0.848502] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.848693] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.848526] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.848717] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.848534] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.848725] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.848562] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.848752] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.848567] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.848758] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.848590] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.848780] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.848595] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.848786] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.848730] sky2: driver version 1.30 worker1 # [ 0.870917] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.848920] sky2: driver version 1.30 worker2 # [ 0.850339] usbcore: registered new interface driver usb-storage worker1 # [ 0.870927] sdhci: Copyright(c) Pierre Ossman client # [ 0.865246] thunder_xcv, ver 1.0 worker1 # [ 0.871192] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.850393] usbcore: registered new interface driver usbserial_generic client # [ 0.865298] thunder_bgx, ver 1.0 client # [ 0.865320] nicpf, ver 1.0 worker1 # [ 0.871564] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.850408] usbserial: USB Serial support registered for generic client # [ 0.865893] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.851189] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.858203] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.865900] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.851215] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.865923] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.858235] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.875887] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.851472] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.865931] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.858486] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.876124] usbcore: registered new interface driver usbhid client # [ 0.865960] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.876130] usbhid: USB HID core driver worker2 # [ 0.862720] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.865965] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.860833] usbcore: registered new interface driver usb-storage worker2 # [ 0.863024] hub 1-0:1.0: USB hub found client # [ 0.865989] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.863038] hub 1-0:1.0: 6 ports detected lb # [ 0.860928] usbcore: registered new interface driver usbserial_generic client # [ 0.865995] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.860943] usbserial: USB Serial support registered for generic client # [ 0.866130] sky2: driver version 1.30 worker1 # [ 0.879013] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.868068] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.865600] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.863761] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.880529] drop_monitor: Initializing network drop monitor service client # [ 0.868097] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.880665] NET: Registered PF_INET6 protocol family client # [ 0.868326] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.865235] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.867087] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.883726] Segment Routing with IPv6 worker1 # [ 0.883751] In-situ OAM (IOAM) with IPv6 lb # [ 0.865262] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:06 UTC (1789896726) worker2 # [ 0.867110] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:06 UTC (1789896726) worker1 # [ 0.883783] NET: Registered PF_PACKET protocol family worker2 # [ 0.867428] i2c_dev: i2c /dev entries driver client # [ 0.877950] usbcore: registered new interface driver usb-storage lb # [ 0.867315] i2c_dev: i2c /dev entries driver client # [ 0.878068] usbcore: registered new interface driver usbserial_generic client # [ 0.878083] usbserial: USB Serial support registered for generic client # [ 0.878661] hv_vmbus: registering driver hyperv_keyboard client # [ 0.882264] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.885563] 9pnet: Installing 9P2000 support client # [ 0.882571] hub 1-0:1.0: USB hub found worker1 # [ 0.887749] Key type dns_resolver registered client # [ 0.882596] hub 1-0:1.0: 6 ports detected worker2 # [ 0.872258] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.872267] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.872531] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.870564] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.870579] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.872913] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 0.884824] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.870845] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.871207] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 0.884852] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T09:32:06 UTC (1789896726) client # [ 0.885161] i2c_dev: i2c /dev entries driver lb # [ 0.872842] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.877215] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.873068] usbcore: registered new interface driver usbhid worker2 # [ 0.877491] usbcore: registered new interface driver usbhid lb # [ 0.873075] usbhid: USB HID core driver worker2 # [ 0.877498] usbhid: USB HID core driver lb # [ 0.877947] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.878978] hub 1-0:1.0: USB hub found lb # [ 0.879452] hub 1-0:1.0: 6 ports detected worker1 # [ 0.894500] registered taskstats version 1 client # [ 0.890104] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.880334] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.894661] Loading compiled-in X.509 certificates client # [ 0.890117] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.881845] drop_monitor: Initializing network drop monitor service client # [ 0.890375] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.881969] NET: Registered PF_INET6 protocol family client # [ 0.890734] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.881003] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.884945] Segment Routing with IPv6 worker2 # [ 0.884973] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.885001] NET: Registered PF_PACKET protocol family client # [ 0.895033] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.883590] drop_monitor: Initializing network drop monitor service client # [ 0.895290] usbcore: registered new interface driver usbhid lb # [ 0.883765] NET: Registered PF_INET6 protocol family client # [ 0.895297] usbhid: USB HID core driver lb # [ 0.885664] Segment Routing with IPv6 worker1 # [ 0.903087] Demotion targets for Node 0: null lb # [ 0.885681] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.903201] Key type .fscrypt registered lb # [ 0.885713] NET: Registered PF_PACKET protocol family worker1 # [ 0.903206] Key type fscrypt-provisioning registered worker1 # [ 0.903294] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.886776] 9pnet: Installing 9P2000 support worker1 # [ 0.903312] ima: Allocated hash algorithm: sha1 client # [ 0.898193] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.888828] Key type dns_resolver registered worker1 # [ 0.903334] ima: No architecture policies found lb # [ 0.887339] 9pnet: Installing 9P2000 support client # [ 0.900757] drop_monitor: Initializing network drop monitor service worker1 # [ 0.907293] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.900886] NET: Registered PF_INET6 protocol family client # [ 0.902814] Segment Routing with IPv6 client # [ 0.902834] In-situ OAM (IOAM) with IPv6 client # [ 0.902865] NET: Registered PF_PACKET protocol family lb # [ 0.890037] Key type dns_resolver registered client # [ 0.904508] 9pnet: Installing 9P2000 support worker2 # [ 0.895570] registered taskstats version 1 client # [ 0.906604] Key type dns_resolver registered worker2 # [ 0.895726] Loading compiled-in X.509 certificates lb # [ 0.896115] registered taskstats version 1 lb # [ 0.896270] Loading compiled-in X.509 certificates worker2 # [ 0.904321] Demotion targets for Node 0: null worker2 # [ 0.904434] Key type .fscrypt registered worker2 # [ 0.904440] Key type fscrypt-provisioning registered client # [ 0.913566] registered taskstats version 1 worker2 # [ 0.904532] ima: No TPM chip found, activating TPM-bypass! client # [ 0.913721] Loading compiled-in X.509 certificates worker2 # [ 0.904552] ima: Allocated hash algorithm: sha1 lb # [ 0.904834] Demotion targets for Node 0: null worker2 # [ 0.904573] ima: No architecture policies found lb # [ 0.904938] Key type .fscrypt registered lb # [ 0.904945] Key type fscrypt-provisioning registered worker2 # [ 0.908600] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.905040] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.905058] ima: Allocated hash algorithm: sha1 lb # [ 0.905079] ima: No architecture policies found lb # [ 0.909183] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.925569] clk: Disabling unused clocks worker1 # [ 0.925599] PM: genpd: Disabling unused power domains client # [ 0.922158] Demotion targets for Node 0: null client # [ 0.922266] Key type .fscrypt registered client # [ 0.922272] Key type fscrypt-provisioning registered worker1 # [ 0.929858] Freeing unused kernel memory: 4736K client # [ 0.922366] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.930078] Run /init as init process client # [ 0.922386] ima: Allocated hash algorithm: sha1 client # [ 0.922408] ima: No architecture policies found client # [ 0.926403] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.926176] clk: Disabling unused clocks worker2 # [ 0.926199] PM: genpd: Disabling unused power domains worker2 # [ 0.930409] Freeing unused kernel memory: 4736K worker2 # [ 0.931159] Run /init as init process lb # [ 0.926934] clk: Disabling unused clocks lb # [ 0.926958] PM: genpd: Disabling unused power domains worker1 # [ 0.947393] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.931175] Freeing unused kernel memory: 4736K lb # [ 0.931384] Run /init as init process client # [ 0.944792] clk: Disabling unused clocks client # [ 0.944822] PM: genpd: Disabling unused power domains client # [ 0.949057] Freeing unused kernel memory: 4736K client # [ 0.949261] Run /init as init process worker2 # [ 0.944609] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.947650] systemd[1]: Successfully made /usr/ read-only. client # [ 0.965594] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.109217] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.110557] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.131424] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.125525] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.261434] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.262742] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.282289] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.283774] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.294458] systemd[1]: Detected virtualization qemu. worker1 # [ 1.296476] systemd[1]: Detected architecture arm64. worker1 # [ 1.298463] systemd[1]: Running in initrd. lb # [ 1.277919] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.301022] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.304056] systemd[1]: Hostname set to . worker2 # [ 1.279414] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.291548] systemd[1]: Detected virtualization qemu. worker2 # [ 1.293606] systemd[1]: Detected architecture arm64. client # [ 1.300330] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.295576] systemd[1]: Running in initrd. client # [ 1.305977] systemd[1]: Detected virtualization qemu. lb # [ 1.284046] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.306930] systemd[1]: Detected architecture arm64. client # [ 1.307860] systemd[1]: Running in initrd. worker2 # [ 1.298206] systemd[1]: Initializing machine ID from random generator. client # [ 1.309135] systemd[1]: Initializing machine ID from random generator. lb # [ 1.296492] systemd[1]: Detected virtualization qemu. client # [ 1.310569] systemd[1]: Hostname set to . worker2 # [ 1.301225] systemd[1]: Hostname set to . lb # [ 1.296592] systemd[1]: Detected architecture arm64. lb # [ 1.296618] systemd[1]: Running in initrd. lb # [ 1.302916] systemd[1]: Initializing machine ID from random generator. lb # [ 1.305506] systemd[1]: Hostname set to . worker1 # [ 1.349449] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.346744] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.363660] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.361696] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.469228] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.466550] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.483464] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.481490] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.611281] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.607899] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.598975] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.625447] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.633444] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.618651] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.637598] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.630245] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.643600] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.635535] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.646301] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.653744] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.715460] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.708907] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.725659] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.716596] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.725818] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.717641] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.727014] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.718873] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.719782] systemd[1]: Reached target Path Units. worker1 # [ 1.735536] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.720488] systemd[1]: Reached target Slice Units. worker2 # [ 1.721207] systemd[1]: Reached target Swaps. client # [ 1.728437] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.721921] systemd[1]: Reached target Timer Units. worker1 # [ 1.736668] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.728474] systemd[1]: Reached target Path Units. worker1 # [ 1.738007] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.722833] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.728496] systemd[1]: Reached target Slice Units. worker1 # [ 1.739017] systemd[1]: Reached target Path Units. client # [ 1.728515] systemd[1]: Reached target Swaps. worker2 # [ 1.723884] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.739820] systemd[1]: Reached target Slice Units. client # [ 1.728535] systemd[1]: Reached target Timer Units. worker2 # [ 1.724874] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.740602] systemd[1]: Reached target Swaps. client # [ 1.728728] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.725715] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.741344] systemd[1]: Reached target Timer Units. client # [ 1.728893] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.726611] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.742288] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.727390] systemd[1]: Reached target Socket Units. client # [ 1.729035] systemd[1]: Listening on Journal Sockets. client # [ 1.729170] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.743498] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.729282] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.744593] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.729464] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.729306] systemd[1]: Reached target Socket Units. client # [ 1.740259] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.745556] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.745670] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.745692] systemd[1]: Reached target Socket Units. worker1 # [ 1.749635] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.735505] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.738271] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.739445] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.750738] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.757317] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.752074] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.758438] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.743857] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.745042] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.746461] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.747509] systemd[1]: Reached target Path Units. worker1 # [ 1.764866] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.748330] systemd[1]: Reached target Slice Units. lb # [ 1.749142] systemd[1]: Reached target Swaps. lb # [ 1.749948] systemd[1]: Reached target Timer Units. lb # [ 1.750947] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.751909] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.752153] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.753284] systemd[1]: Listening on Journal Sockets. client # [ 1.764860] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.754457] systemd[1]: Listening on udev Control Socket. lb # [ 1.754583] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.754608] systemd[1]: Reached target Socket Units. lb # [ 1.758740] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.784269] systemd[1]: Starting Journal Service... worker2 # [ 1.770745] systemd[1]: Starting Journal Service... lb # [ 1.769221] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.770630] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.787538] systemd[1]: Starting Journal Service... worker2 # [ 1.778659] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.794169] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.779556] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.795113] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.791574] systemd[1]: Starting Load Kernel Modules... client # [ 1.792482] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.783094] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.813981] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.802930] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.805723] systemd[1]: Starting Journal Service... client # [ 1.819559] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.809658] systemd[1]: Starting Load Kernel Modules... lb # [ 1.810587] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.823572] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.825312] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.833279] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.818070] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.834528] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.818374] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.831904] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.834842] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.819501] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.835096] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.819813] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.849533] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.846456] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.837642] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.852440] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.855906] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.857491] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.846644] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.851809] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.865703] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.863572] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.854811] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.852038] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.852046] [drm] features: -context_init worker2 # [ 1.852766] [drm] number of scanouts: 1 lb # [ 1.856625] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.852784] [drm] number of cap sets: 0 worker1 # [ 1.876689] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.861096] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.861731] systemd[1]: Mounted Kernel Configuration File System. client # [ 1.871677] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.871913] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.871923] [drm] features: -context_init client # [ 1.872657] [drm] number of scanouts: 1 lb # [ 1.861689] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.862050] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.862342] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.885191] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.868969] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.869924] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.872677] [drm] number of cap sets: 0 worker1 # [ 1.888004] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.879868] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 1.879891] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 1.897698] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.897946] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.897956] [drm] features: -context_init worker1 # [ 1.898681] [drm] number of scanouts: 1 worker1 # [ 1.898699] [drm] number of cap sets: 0 worker2 # [ 1.884893] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.877642] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.882804] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.895702] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.883034] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 1.883043] [drm] features: -context_init lb # [ 1.883746] [drm] number of scanouts: 1 lb # [ 1.883764] [drm] number of cap sets: 0 worker1 # [ 1.902466] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.898292] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.890821] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.903881] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.903902] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.896833] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 1.914325] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.914345] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.910104] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 1.910125] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.918817] Console: switching to colour frame buffer device 160x50 worker2 # [ 1.925217] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 1.939513] Console: switching to colour frame buffer device 160x50 lb # [ 1.934096] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.946004] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 1.936730] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.949478] Console: switching to colour frame buffer device 160x50 worker2 # [ 1.939093] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.939303] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.939337] systemd[1]: Reached target Local File Systems. client # [ 1.952037] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.952249] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.952285] systemd[1]: Reached target Local File Systems. worker2 # [ 1.946849] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.961771] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.961964] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.961989] systemd[1]: Reached target Local File Systems. lb # [ 1.941411] Console: switching to colour frame buffer device 160x50 client # [ 1.959743] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.965992] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.983480] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.974721] systemd[1]: Finished Load Kernel Modules. lb # [ 1.974325] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 1.987670] systemd[1]: Finished Load Kernel Modules. lb # [ 1.977775] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.978124] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.978152] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.997495] systemd[1]: Finished Load Kernel Modules. lb # [ 1.978190] systemd[1]: Reached target Local File Systems. worker1 # [ 2.000777] systemd[1]: Starting Apply Kernel Variables... client # [ 1.991101] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.984016] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.005625] systemd[1]: Finished Load Kernel Modules. lb # [ 2.008663] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.015240] systemd[1]: Finished Apply Kernel Variables. client # [ 2.028096] systemd[1]: Finished Apply Kernel Variables. client # [ 2.049231] systemd[1]: Started Journal Service. worker1 # [ 2.061831] systemd[1]: Finished Apply Kernel Variables. client # [ 2.044331] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.048508] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.049642] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.050717] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.051747] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.058057] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.064917] systemd-modules-load[74]: Inserted module 'dm_mod' worker2 # [ 2.061064] systemd[1]: Started Journal Service. worker1 # [ 2.079153] systemd[1]: Started Journal Service. worker2 # [ 2.052487] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.069312] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.061457] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.053630] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.070443] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.071514] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker2 # [ 2.057740] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.071088] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 2.081969] systemd-modules-load[74]: Module 'virtio_rng' is built in worker1 # [ 2.084737] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker2 # [ 2.068342] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker2 # [ 2.070850] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.081641] systemd[1]: Started Journal Service. worker1 # [ 2.089832] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.074555] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 2.072282] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.073424] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.074534] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.075636] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker2 # [ 2.084364] systemd[1]: Starting Create System Files and Directories... client # [ 2.099826] systemd[1]: Finished Create System Files and Directories. lb # [ 2.088424] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.089486] systemd[1]: Starting Create System Files and Directories... lb # [ 2.090837] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 2.096636] systemd[1]: Finished Create System Files and Directories. client # [ 2.110026] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.108799] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.127037] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.132573] systemd[1]: Finished Create System Files and Directories. lb # [ 2.121965] systemd[1]: Finished Create System Files and Directories. lb # [ 2.134139] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.164867] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.164542] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.185580] systemd[1]: Starting Virtual Console Setup... lb # [ 2.192329] systemd[1]: Starting Virtual Console Setup... client # [ 2.216480] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.219815] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.212461] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.215847] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.236484] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.239882] systemd[1]: Finished Virtual Console Setup. lb # [ 2.236453] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.239805] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.812727] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.814528] systemd[1]: Reached target System Initialization. worker2 # [ 2.816433] systemd[1]: Reached target Basic System. lb # [ 2.823835] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.825770] systemd[1]: Reached target System Initialization. worker1 # [ 2.854864] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.833109] systemd[1]: Reached target Basic System. worker1 # [ 2.856149] systemd[1]: Reached target System Initialization. worker1 # [ 2.860503] systemd[1]: Reached target Basic System. client # [ 2.853090] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.854063] systemd[1]: Reached target System Initialization. client # [ 2.854857] systemd[1]: Reached target Basic System. worker2 # [ 2.952194] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.975905] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.989632] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.992990] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.002315] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.006280] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.023010] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.029594] (udev-worker)[106]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.034198] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.049502] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.052730] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.059640] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.056384] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.059341] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.062672] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.064363] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.069196] systemd[1]: Reached target Initrd Root Device. lb # [ 3.080679] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.100450] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.103337] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.129563] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.124087] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.133294] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.117457] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.138421] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.124157] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.120219] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.126408] systemd[1]: Mounting /sysroot... lb # [ 3.128099] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.131843] systemd[1]: Mounting /sysroot... client # [ 3.155100] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.162166] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.168157] systemd[1]: Mounting /sysroot... worker1 # [ 3.179772] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.176468] EXT4-fs (vda): mounted filesystem ebc981a5-c744-4b44-9a0f-db7807dd89a5 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.167017] systemd[1]: Mounted /sysroot. worker2 # [ 3.168065] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.170124] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.186703] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.188171] systemd[1]: Mounting /sysroot... lb # [ 3.186427] EXT4-fs (vda): mounted filesystem 24367d81-74ac-478d-a09f-1f4e8390f8c9 r/w with ordered data mode. Quota mode: none. lb # [ 3.173710] systemd[1]: Mounted /sysroot. lb # [ 3.175490] systemd[1]: Reached target Initrd Root File System. lb # [ 3.180240] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.195467] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.219547] EXT4-fs (vda): mounted filesystem 459c0bb6-c725-42d8-b253-0a9ab86755fd r/w with ordered data mode. Quota mode: none. client # [ 3.209787] systemd[1]: Mounted /sysroot. worker2 # [ 3.201795] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.211912] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.207032] systemd[1]: Reloading... client # [ 3.216782] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.204190] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.237969] EXT4-fs (vda): mounted filesystem cdabd6ab-a86f-4aee-a7be-f2bbcb022252 r/w with ordered data mode. Quota mode: none. worker1 # [ 3.231749] systemd[1]: Mounted /sysroot. lb # [ 3.210902] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.234527] systemd[1]: Reached target Initrd Root File System. lb # [ 3.215609] systemd[1]: Reloading... worker1 # [ 3.238516] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.243064] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.250648] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.254346] systemd[1]: Reloading... worker1 # [ 3.263237] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.268275] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.272490] systemd[1]: Reloading... worker2 # [ 3.413894] systemd[1]: Reloading finished in 209 ms. lb # [ 3.420109] systemd[1]: Reloading finished in 207 ms. worker2 # [ 3.439161] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.443928] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker2 # [ 3.450316] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.461991] systemd[1]: Reloading finished in 212 ms. worker2 # [ 3.456208] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.453561] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.460744] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.455883] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.478217] systemd[1]: Reloading finished in 207 ms. worker2 # [ 3.461877] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.462793] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.466265] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.468122] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.477046] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.472390] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.478185] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.491063] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... client # [ 3.498284] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.506970] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... client # [ 3.500698] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.511696] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.492543] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.516302] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.496780] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.512491] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.524464] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.522515] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.523559] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.534704] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.535808] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.529736] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.532314] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.544808] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.547221] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.805525] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.792737] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.810699] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.822548] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.810537] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.827680] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.816491] systemd[1]: Mounting /sysroot/run... client # [ 3.828096] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.832111] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.831979] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.853230] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.838389] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.852918] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.862661] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.873776] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.866216] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.855814] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.888154] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.875310] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.881584] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.897881] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.886261] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.916130] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.902614] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.927347] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.905917] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.922875] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.915907] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.932992] systemd[1]: Mounted /sysroot/run. client # [ 3.925102] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.917617] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.926572] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.955206] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.948609] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.940639] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.958426] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.937617] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.943866] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.940105] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.959006] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.967196] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.968418] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.952700] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.972914] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 3.956758] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.967741] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.959929] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.972545] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.975383] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.967937] systemd[1]: Mounted /sysroot/run. lb # [ 3.978682] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 4.011281] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.012579] systemd[1]: Reached target Initrd File Systems. lb # [ 3.991870] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 4.016192] systemd[1]: Starting Find NixOS closure... lb # [ 3.996709] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.999312] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.006505] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.008119] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.010458] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.027416] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.019185] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.059429] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.049713] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.076292] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.079906] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.085642] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.071452] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.073699] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.076235] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.117228] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.119375] systemd[1]: Stopped target Basic System. worker2 # [ 4.107197] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.124170] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.124976] systemd[1]: Stopped target Path Units. worker1 # [ 4.125661] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.126698] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.110702] systemd[1]: Stopped target Basic System. worker1 # [ 4.127731] systemd[1]: Stopped target Slice Units. worker2 # [ 4.111736] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.116921] systemd[1]: Stopped target Path Units. worker2 # [ 4.117845] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.118871] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.119906] systemd[1]: Stopped target Slice Units. worker1 # [ 4.135532] systemd[1]: Stopped target Socket Units. worker1 # [ 4.141186] systemd[1]: Stopped target System Initialization. worker1 # [ 4.141997] systemd[1]: Stopped target Swaps. worker2 # [ 4.125656] systemd[1]: Stopped target Socket Units. worker1 # [ 4.142642] systemd[1]: Stopped target Timer Units. worker1 # [ 4.143323] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.131841] systemd[1]: Stopped target System Initialization. worker2 # [ 4.133970] systemd[1]: Stopped target Swaps. worker2 # [ 4.134630] systemd[1]: Stopped target Timer Units. worker2 # [ 4.135319] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.152210] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.153149] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.154318] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.138244] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.155016] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 4.155872] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.143648] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.152245] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.153018] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 4.169535] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.154047] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.171310] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.154958] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 4.174656] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.180516] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 4.184371] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.169042] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 4.187398] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.171416] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.174257] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.177064] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.195327] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.200297] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.183677] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.186087] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.188982] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.205624] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.207050] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.194340] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.195187] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.212481] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.213520] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.214301] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.215305] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.216836] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.200525] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.217584] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.201541] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.218624] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.202336] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.219445] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.203344] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.220484] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.204710] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.221391] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 4.205465] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 4.222400] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 4.206471] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 4.207299] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.208394] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.209212] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.210147] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.228086] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 4.230004] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.232178] systemd[1]: systemd-udevd.service: Consumed 1.068s CPU time over 2.273s wall clock time, 17.5M memory peak. worker2 # [ 4.216219] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.218207] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.236519] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.220125] systemd[1]: systemd-udevd.service: Consumed 1.095s CPU time over 2.282s wall clock time, 18.1M memory peak. worker1 # [ 4.237571] systemd[1]: Closed udev Control Socket. worker1 # [ 4.238561] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.239422] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 4.240629] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.224505] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 4.241490] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.225571] systemd[1]: Closed udev Control Socket. worker1 # [ 4.242618] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.226862] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.243594] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 4.227754] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.228968] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.229839] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.230927] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 4.248218] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 4.231927] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 4.237050] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.274810] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 4.277975] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.278796] systemd[1]: Reached target Switch Root. worker1 # [ 4.279911] systemd[1]: Starting NixOS Activation... worker2 # [ 4.265363] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.267776] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.272377] systemd[1]: Reached target Switch Root. worker2 # [ 4.273124] systemd[1]: Starting NixOS Activation... lb # [ 4.332793] (udev-worker)[95]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.340204] (udev-worker)[95]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory lb # [ 4.357690] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.360150] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.360955] systemd[1]: Stopping Virtual Console Setup... client # [ 4.376247] (udev-worker)[96]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.364877] systemd[1]: Starting Virtual Console Setup... client # [ 4.384185] (udev-worker)[96]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory lb # [ 4.376713] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.378135] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.380316] systemd[1]: Starting Virtual Console Setup... client # [ 4.400090] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.401185] systemd[1]: Stopped Virtual Console Setup. client # [ 4.403882] systemd[1]: Stopping Virtual Console Setup... client # [ 4.405543] systemd[1]: Starting Virtual Console Setup... lb # [ 4.401181] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.404331] systemd[1]: Finished Virtual Console Setup. client # [ 4.418423] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.420264] systemd[1]: Stopped Virtual Console Setup. client # [ 4.423017] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.432773] initrd-nixos-activation-start[172]: booting system configuration /nix/store/653izmi0ka8dwac3kpqd66p1v4c6d633-nixos-system-worker2-test worker1 # [ 4.449463] initrd-nixos-activation-start[172]: booting system configuration /nix/store/bd8l1brw989alvvrp02daysj9ckfky9v-nixos-system-worker1-test client # [ 4.443818] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.447338] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.496557] initrd-nixos-activation-start[172]: running activation script... worker1 # [ 4.513683] initrd-nixos-activation-start[172]: running activation script... client # [ 4.811540] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.839285] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.878239] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.881394] systemd[1]: Reached target Initrd File Systems. client # [ 4.886871] systemd[1]: Starting Find NixOS closure... client # [ 4.900514] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.897687] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.901148] systemd[1]: Reached target Initrd File Systems. lb # [ 4.906024] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.918645] initrd-nixos-activation-start[195]: setting up /etc... worker1 # [ 4.936502] initrd-nixos-activation-start[195]: setting up /etc... lb # [ 4.914729] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.943405] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.950742] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.963338] systemd[1]: Finished Find NixOS closure. client # [ 4.966553] systemd[1]: Reached target Initrd Default Target. client # [ 4.972417] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.966940] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.969292] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.998429] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.984991] systemd[1]: Finished Find NixOS closure. client # [ 5.000415] systemd[1]: Stopped target Basic System. lb # [ 4.987858] systemd[1]: Reached target Initrd Default Target. client # [ 5.001803] systemd[1]: Stopped target Initrd Root Device. client # [ 5.004255] systemd[1]: Stopped target Path Units. lb # [ 4.992288] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.008419] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.009877] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.016155] systemd[1]: Stopped target Slice Units. client # [ 5.017102] systemd[1]: Stopped target Socket Units. client # [ 5.017990] systemd[1]: Stopped target System Initialization. client # [ 5.018979] systemd[1]: Stopped target Swaps. client # [ 5.020102] systemd[1]: Stopped target Timer Units. client # [ 5.021760] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.024129] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.027057] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.032999] systemd[1]: Stopped Find NixOS closure. client # [ 5.033788] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.034728] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.021724] systemd[1]: Stopped target Initrd Default Target. client # [ 5.035600] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 5.024302] systemd[1]: Stopped target Basic System. lb # [ 5.026168] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.030462] systemd[1]: Stopped target Path Units. lb # [ 5.031506] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.047061] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.047863] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 5.034915] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.049894] systemd[1]: Stopped Load Kernel Modules. client # [ 5.051307] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.052540] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.053614] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 5.040236] systemd[1]: Stopped target Slice Units. client # [ 5.054652] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.041198] systemd[1]: Stopped target Socket Units. client # [ 5.055527] systemd[1]: Stopped target Local File Systems. lb # [ 5.042081] systemd[1]: Stopped target System Initialization. lb # [ 5.043083] systemd[1]: Stopped target Swaps. lb # [ 5.043872] systemd[1]: Stopped target Timer Units. lb # [ 5.048249] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 5.049266] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.051011] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.054807] systemd[1]: Stopped Find NixOS closure. client # [ 5.069447] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.070562] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.057851] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.071622] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.060963] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.077302] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.080824] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.083227] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.073215] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.087559] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.088768] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 5.076192] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.089674] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.090599] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.091567] systemd[1]: systemd-udevd.service: Consumed 1.397s CPU time over 3.124s wall clock time, 22.3M memory peak. client # [ 5.094302] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.081055] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.095323] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.096319] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.097299] systemd[1]: Closed udev Control Socket. client # [ 5.097990] systemd[1]: Starting Cleanup udev Database... lb # [ 5.085343] systemd[1]: Stopped Load Kernel Modules. client # [ 5.098763] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.099817] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.088213] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 5.092577] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 5.094797] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.108330] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.109515] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.096915] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.098672] systemd[1]: Stopped target Local File Systems. client # [ 5.112412] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.113407] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.100487] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.116189] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.103143] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.105344] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.120256] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.108459] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 5.109526] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 5.112215] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.113001] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.114055] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 5.115048] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.116132] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 5.116978] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.117877] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 5.118850] systemd[1]: systemd-udevd.service: Consumed 1.378s CPU time over 3.130s wall clock time, 22.2M memory peak. lb # [ 5.124197] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.125280] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.128275] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.129446] systemd[1]: Closed udev Control Socket. client # [ 5.144340] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.132238] systemd[1]: Starting Cleanup udev Database... client # [ 5.146702] systemd[1]: Finished Cleanup udev Database. lb # [ 5.133063] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.134120] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.148346] systemd[1]: Reached target Switch Root. lb # [ 5.136127] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.152146] systemd[1]: Starting NixOS Activation... lb # [ 5.140184] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.141194] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 5.144242] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.168436] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.169512] systemd[1]: Finished Cleanup udev Database. lb # [ 5.170238] systemd[1]: Reached target Switch Root. worker1 # [ 5.195547] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.180577] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.175833] systemd[1]: Starting NixOS Activation... worker1 # [ 5.198640] systemd[1]: Finished NixOS Activation. worker1 # [ 5.199827] systemd[1]: Starting Switch Root... worker2 # [ 5.183378] systemd[1]: Finished NixOS Activation. worker2 # [ 5.188248] systemd[1]: Starting Switch Root... worker2 # [ 5.207789] systemd[1]: Switching root. worker1 # [ 5.225032] systemd[1]: Switching root. client # [ 5.314167] initrd-nixos-activation-start[181]: booting system configuration /nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test lb # [ 5.339915] initrd-nixos-activation-start[180]: booting system configuration /nix/store/1y76sp58sczakc84qnb2p7nq6lq4cpg2-nixos-system-lb-test client # [ 5.377170] initrd-nixos-activation-start[181]: running activation script... worker1 # [ 5.412812] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.402009] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 5.405902] initrd-nixos-activation-start[180]: running activation script... client # [ 5.782724] initrd-nixos-activation-start[204]: setting up /etc... lb # [ 5.815526] initrd-nixos-activation-start[203]: setting up /etc... worker1 # [ 6.021024] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.034509] systemd[1]: Detected virtualization qemu. worker2 # [ 6.009943] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.037422] systemd[1]: Detected architecture arm64. worker2 # [ 6.022678] systemd[1]: Detected virtualization qemu. worker1 # [ 6.039514] systemd[1]: Detected first boot. worker2 # [ 6.025709] systemd[1]: Detected architecture arm64. worker2 # [ 6.029592] systemd[1]: Detected first boot. worker1 # [ 6.046497] systemd[1]: Initializing machine ID from random generator. worker2 # [ 6.036975] systemd[1]: Initializing machine ID from random generator. client # [ 6.042311] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.045144] systemd[1]: Finished NixOS Activation. client # [ 6.046445] systemd[1]: Starting Switch Root... client # [ 6.068160] systemd[1]: Switching root. lb # [ 6.078277] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 6.081026] systemd[1]: Finished NixOS Activation. lb # [ 6.082121] systemd[1]: Starting Switch Root... lb # [ 6.103305] systemd[1]: Switching root. client # [ 6.258936] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.296411] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.368976] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.369404] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 6.553005] systemd[1]: Applying preset policy. worker2 # [ 6.557844] systemd[1]: Applying preset policy. client # [ 6.869313] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.882021] systemd[1]: Detected virtualization qemu. client # [ 6.885040] systemd[1]: Detected architecture arm64. client # [ 6.888673] systemd[1]: Detected first boot. client # [ 6.895479] systemd[1]: Initializing machine ID from random generator. lb # [ 6.889832] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.902060] systemd[1]: Detected virtualization qemu. lb # [ 6.904912] systemd[1]: Detected architecture arm64. lb # [ 6.908502] systemd[1]: Detected first boot. lb # [ 6.915426] systemd[1]: Initializing machine ID from random generator. worker1 # [ 7.035322] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.041786] systemd[1]: Populated /etc with preset unit settings. client # [ 7.227773] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 7.233409] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.414360] systemd[1]: Applying preset policy. lb # [ 7.429638] systemd[1]: Applying preset policy. worker1 # [ 7.532704] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 7.534275] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 7.535807] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 7.540244] systemd[1]: Created slice Slice /system/getty. worker1 # [ 7.542410] systemd[1]: Created slice User and Session Slice. worker1 # [ 7.543659] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 7.545435] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 7.547751] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 7.548747] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.535910] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 7.550303] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.537283] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 7.552431] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 7.554277] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.540439] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 7.556092] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 7.558030] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.544352] systemd[1]: Created slice Slice /system/getty. worker1 # [ 7.559946] systemd[1]: Reached target Path Units. worker1 # [ 7.561704] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.547229] systemd[1]: Created slice User and Session Slice. worker1 # [ 7.563477] systemd[1]: Reached target Slice Units. worker2 # [ 7.549188] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 7.565182] systemd[1]: Reached target Swaps. worker2 # [ 7.551501] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.553565] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 7.569040] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.555331] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.557077] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.558978] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 7.573802] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.559994] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.561443] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 7.577766] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.562982] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.565192] systemd[1]: Reached target Path Units. worker2 # [ 7.566143] systemd[1]: Reached target Remote File Systems. worker1 # [ 7.581604] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.567622] systemd[1]: Reached target Slice Units. worker1 # [ 7.583534] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.569632] systemd[1]: Reached target Swaps. worker2 # [ 7.573383] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 7.588808] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 7.590928] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.578113] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 7.595023] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 7.596508] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.582094] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 7.598095] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.600192] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.585886] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.587143] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.592720] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 7.594726] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 7.611112] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 7.612464] systemd[1]: Listening on udev Control Socket. worker2 # [ 7.598617] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 7.614013] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.600331] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.601751] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.618187] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.603821] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.623262] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.628224] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.614963] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.617036] systemd[1]: Listening on udev Control Socket. worker2 # [ 7.618982] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.623559] systemd[1]: Mounting Huge Pages File System... worker1 # [ 7.639542] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 7.628784] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 7.633733] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 7.652840] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 7.645190] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 7.669409] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 7.671636] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 7.659869] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 7.679520] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 7.681401] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 7.684117] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.671546] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 7.675138] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 7.696565] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 7.696937] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.685130] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.685488] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.685749] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.708947] systemd[1]: Starting Journal Service... worker2 # [ 7.704320] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 7.709291] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.732727] systemd[1]: Starting Journal Service... worker1 # [ 7.769800] systemd[1]: Starting Load Kernel Modules... worker1 # [ 7.785709] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.778517] systemd[1]: Starting Load Kernel Modules... worker1 # [ 7.806431] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.793952] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 7.809114] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.830195] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 7.832866] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 7.819929] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.820340] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.838900] systemd[1]: Mounted Huge Pages File System. worker1 # [ 7.841747] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 7.826882] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 7.844758] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 7.849414] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 7.834073] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 7.849899] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 7.838081] systemd[1]: Mounted Huge Pages File System. worker2 # [ 7.842844] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 7.843314] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 7.843707] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 7.844117] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 7.879409] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 7.885696] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 7.894471] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.896152] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 7.903467] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 7.953380] EXT4-fs (vda): re-mounted cdabd6ab-a86f-4aee-a7be-f2bbcb022252. lb # [ 7.937884] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.959488] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 7.963786] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 7.971790] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 7.974470] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 7.960848] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 7.976678] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.962946] EXT4-fs (vda): re-mounted ebc981a5-c744-4b44-9a0f-db7807dd89a5. worker2 # [ 7.965241] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 7.987798] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 7.990169] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.979883] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 7.982319] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.997223] systemd[1]: Finished Load Kernel Modules. worker2 # [ 7.984603] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.992697] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 7.994980] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.012730] systemd[1]: Starting Firewall... worker2 # [ 7.999090] systemd[1]: Finished Load Kernel Modules. worker1 # [ 8.021417] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.011016] systemd[1]: Starting Firewall... worker2 # [ 8.022571] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 8.039208] systemd-journald[267]: Collecting audit messages is enabled. worker1 # [ 8.057928] fuse: init (API version 7.45) worker2 # [ 8.042942] systemd-journald[267]: Collecting audit messages is enabled. worker2 # [ 8.058989] fuse: init (API version 7.45) worker1 # [ 8.074978] systemd[1]: Started Journal Service. worker1 # [ 8.066126] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 8.072600] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.075341] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 8.076125] systemd[1]: Finished Load Kernel Module fuse. worker1 # [ 8.081949] systemd-modules-load[268]: Module 'atkbd' is built in worker2 # [ 8.089170] systemd[1]: Started Journal Service. worker1 # [ 8.094008] systemd-modules-load[268]: Module 'loop' is built in worker2 # [ 8.078980] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 8.105052] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 8.092949] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.101531] systemd-modules-load[268]: Module 'atkbd' is built in worker1 # [ 8.114164] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 8.123018] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 8.112899] systemd-modules-load[268]: Module 'loop' is built in worker1 # [ 8.133370] systemd-oomd[269]: No swap; memory pressure usage will be degraded worker2 # [ 8.121688] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 8.144421] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 8.148685] systemd[1]: Reached target First Boot Complete. worker2 # [ 8.132156] systemd-oomd[269]: No swap; memory pressure usage will be degraded worker1 # [ 8.155271] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.142337] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 8.151061] systemd[1]: Reached target First Boot Complete. worker2 # [ 8.161171] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.169360] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 8.204750] systemd-journald[267]: Received client request to flush runtime journal. worker2 # [ 8.204437] systemd-journald[267]: Received client request to flush runtime journal. worker1 # [ 8.247157] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 8.252449] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 8.256559] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 8.261598] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 8.264660] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 8.269570] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 8.272275] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.340083] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 8.344335] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 8.347219] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 8.352071] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 8.353156] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 8.358151] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 8.389297] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.390583] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.393029] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.396738] systemd[1]: Created slice Slice /system/getty. client # [ 8.398622] systemd[1]: Created slice User and Session Slice. client # [ 8.399929] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.402368] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.404554] systemd[1]: Expecting device /dev/hvc0... client # [ 8.405553] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.407757] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.408859] systemd[1]: Stopped target initrd-fs.target. client # [ 8.410288] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.411827] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.414022] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.415202] systemd[1]: Reached target Path Units. client # [ 8.416567] systemd[1]: Reached target Remote File Systems. client # [ 8.418005] systemd[1]: Reached target Slice Units. client # [ 8.420133] systemd[1]: Reached target Swaps. client # [ 8.423943] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.428611] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.432379] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.436168] systemd[1]: Listening on Factory Reset Management. client # [ 8.437383] systemd[1]: Listening on Hostname Service Socket. client # [ 8.442924] systemd[1]: Starting Journal Log Access Socket... client # [ 8.444996] systemd[1]: Listening on Journal Audit Socket. client # [ 8.449116] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.451413] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.453754] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.456273] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.467041] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.470014] systemd[1]: Listening on udev Control Socket. lb # [ 8.459477] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.472097] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.460741] systemd[1]: Stopped initrd-switch-root.service. lb # [ 8.464224] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.476728] systemd[1]: Mounting Huge Pages File System... lb # [ 8.469048] systemd[1]: Created slice Slice /system/getty. lb # [ 8.471072] systemd[1]: Created slice User and Session Slice. client # [ 8.481871] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 8.472325] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 8.474259] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 8.476771] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.477912] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.490293] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.479378] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.481011] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.482612] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.484932] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 8.487028] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.489034] systemd[1]: Reached target Path Units. lb # [ 8.490956] systemd[1]: Reached target Remote File Systems. client # [ 8.503493] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.492020] systemd[1]: Reached target Slice Units. lb # [ 8.494303] systemd[1]: Reached target Swaps. lb # [ 8.498232] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.512492] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.503102] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.507084] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 8.511047] systemd[1]: Listening on Factory Reset Management. client # [ 8.524691] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.513250] systemd[1]: Listening on Hostname Service Socket. client # [ 8.526775] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.518675] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.521580] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.527478] systemd[1]: Mounting /run/wrappers... worker1 # [ 8.529645] systemd[1]: Mounting FUSE Control File System... lb # [ 8.525995] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.528523] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 8.531274] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.533842] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.548407] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.549940] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 8.527652] systemd[1]: Mounting /run/wrappers... client # [ 8.552661] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.530088] systemd[1]: Mounting FUSE Control File System... lb # [ 8.544887] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.547256] systemd[1]: Listening on udev Control Socket. lb # [ 8.549348] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.554255] systemd[1]: Mounting Huge Pages File System... lb # [ 8.559339] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 8.572567] systemd[1]: Mounted FUSE Control File System. lb # [ 8.567804] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.577549] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 8.577434] systemd[1]: Mounted FUSE Control File System. lb # [ 8.595029] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.601299] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 8.608931] systemd[1]: Mounted /run/wrappers. lb # [ 8.604006] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.609931] systemd[1]: Reached target Local File Systems. client # [ 8.616970] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.618641] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.620375] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 8.615589] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 8.606058] systemd[1]: Mounted /run/wrappers. lb # [ 8.617610] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 8.607200] systemd[1]: Reached target Local File Systems. worker1 # [ 8.624143] systemd[1]: Starting register-nix-paths.service... lb # [ 8.619969] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.611399] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 8.627868] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 8.643753] systemd[1]: Starting Journal Service... worker2 # [ 8.620584] systemd[1]: Starting register-nix-paths.service... worker1 # [ 8.636823] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.622902] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 8.638875] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 8.628845] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.640825] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.655227] systemd[1]: Starting Load Kernel Modules... worker1 # [ 8.647401] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 8.657551] systemd[1]: Starting Create System Files and Directories... worker2 # [ 8.648798] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 8.650518] systemd[1]: Starting Create System Files and Directories... worker2 # [ 8.656993] systemd-udevd[307]: Using default interface naming scheme 'v261'. client # [ 8.692233] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 8.705653] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 8.711524] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.710245] systemd[1]: Starting Journal Service... worker1 # [ 8.724410] systemd-udevd[307]: Using default interface naming scheme 'v261'. client # [ 8.742224] systemd[1]: Starting Coldplug All udev Devices... client # [ 8.749879] fuse: init (API version 7.45) lb # [ 8.740886] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.730544] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 8.748318] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 8.755059] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 8.741105] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.766330] systemd-journald[275]: Collecting audit messages is enabled. client # [ 8.767607] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.786179] systemd[1]: Started Journal Service. client # [ 8.775340] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.781597] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 8.783640] systemd-modules-load[276]: Module 'atkbd' is built in client # [ 8.790537] systemd-modules-load[276]: Module 'loop' is built in client # [ 8.797203] systemd[1]: Listening on Journal Log Access Socket. client # [ 8.800490] systemd[1]: Mounted Huge Pages File System. client # [ 8.802984] systemd[1]: Mounted POSIX Message Queue File System. client # [ 8.823479] EXT4-fs (vda): re-mounted 459c0bb6-c725-42d8-b253-0a9ab86755fd. client # [ 8.811058] systemd[1]: Mounted Kernel Debug File System. lb # [ 8.814845] fuse: init (API version 7.45) lb # [ 8.820177] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 8.818605] systemd[1]: Mounted Kernel Trace File System. client # [ 8.819770] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.822801] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.823815] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 8.829970] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.839713] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.841849] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.842781] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.845478] systemd[1]: Starting Coldplug All udev Devices... client # [ 8.843531] systemd[1]: Finished Load Kernel Modules. lb # [ 8.847674] systemd-journald[274]: Collecting audit messages is enabled. client # [ 8.852181] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 8.853086] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 8.862053] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.843970] systemd[1]: Queued start job for default target Multi-User System. lb # [ 8.848580] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 8.863159] systemd[1]: Mounting FUSE Control File System... worker1 # [ 8.876956] systemd[1]: Finished Create System Files and Directories. lb # [ 8.855339] systemd-modules-load[275]: Module 'atkbd' is built in client # [ 8.871882] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.875485] systemd[1]: Started Journal Service. client # [ 8.872961] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.864003] systemd[1]: Finished Create System Files and Directories. worker1 # [ 8.888199] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 8.863612] systemd-modules-load[275]: Module 'loop' is built in lb # [ 8.868250] systemd[1]: Mounted Huge Pages File System. worker1 # [ 8.893407] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.885732] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 8.876703] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 8.877688] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.871335] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 8.878563] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 8.884299] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.892388] systemd-oomd[278]: No swap; memory pressure usage will be degraded lb # [ 8.879447] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.890531] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.897657] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 8.898635] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.899554] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.914551] systemd[1]: Starting Apply Kernel Variables... lb # [ 8.912730] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.913522] systemd[1]: Finished Load Kernel Modules. lb # [ 8.921716] systemd[1]: Mounting FUSE Control File System... client # [ 8.941185] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.930907] systemd[1]: Starting Firewall... client # [ 8.944302] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.956839] EXT4-fs (vda): re-mounted 24367d81-74ac-478d-a09f-1f4e8390f8c9. client # [ 8.956730] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 8.988098] systemd-journald[275]: Received client request to flush runtime journal. lb # [ 8.962014] systemd[1]: Starting Apply Kernel Variables... lb # [ 8.974073] systemd-oomd[277]: No swap; memory pressure usage will be degraded worker1 # [ 8.998971] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 8.987374] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 8.992111] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.995761] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 9.004861] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.009976] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 9.053369] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.034156] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 9.059582] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.068236] systemd[1]: Reached target First Boot Complete. client # [ 9.073144] systemd[1]: Mounted FUSE Control File System. lb # [ 9.055669] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 9.062203] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 9.076628] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 9.088258] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 9.075038] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 9.091643] systemd[1]: Starting Update is Completed... worker2 # [ 9.084336] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.093264] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.081401] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 9.088662] systemd[1]: Starting Update is Completed... client # [ 9.126201] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 9.128705] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.128724] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.144735] systemd[1]: Mounted FUSE Control File System. worker1 # [ 9.197421] systemd[1]: Finished Update is Completed. lb # [ 9.203512] systemd-journald[274]: Received client request to flush runtime journal. worker2 # [ 9.194921] systemd[1]: Finished Update is Completed. client # [ 9.216099] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.217129] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.221873] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.251528] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 9.258234] systemd[1]: Reached target First Boot Complete. lb # [ 9.261803] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.265719] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.270876] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 9.326325] systemd-udevd[307]: Using default interface naming scheme 'v261'. lb # [ 9.335715] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 9.340289] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 9.343079] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.377370] systemd[1]: Mounting /run/wrappers... client # [ 9.431673] systemd[1]: Mounted /run/wrappers. client # [ 9.437723] systemd[1]: Reached target Local File Systems. client # [ 9.440983] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.449822] systemd[1]: Starting register-nix-paths.service... client # [ 9.452835] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.455183] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 9.452063] systemd[1]: Mounting /run/wrappers... client # [ 9.465494] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 9.460702] systemd-udevd[319]: Using default interface naming scheme 'v261'. client # [ 9.485078] systemd[1]: Starting Create System Files and Directories... client # [ 9.502019] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.513426] systemd[1]: Mounted /run/wrappers. lb # [ 9.514402] systemd[1]: Reached target Local File Systems. lb # [ 9.525314] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.530478] systemd[1]: Starting register-nix-paths.service... lb # [ 9.534946] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.537635] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.589882] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 9.571322] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 9.596941] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 9.587604] systemd[1]: Starting Create System Files and Directories... client # [ 9.667242] systemd[1]: Finished Create System Files and Directories. client # [ 9.675763] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.681100] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.736675] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 9.739991] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 9.727521] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 9.733411] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 9.729732] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 9.740769] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.769187] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.773297] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.810404] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.820687] systemd[1]: Starting Update is Completed... lb # [ 9.808260] systemd[1]: Finished Create System Files and Directories. lb # [ 9.828151] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 9.849755] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 9.884061] systemd[1]: Finished Update is Completed. lb # [ 10.006368] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 10.071934] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 10.083208] systemd[1]: Starting Update is Completed... worker1 # [ 10.135038] systemd[1]: Finished Firewall. worker2 # [ 10.145528] systemd[1]: Finished Firewall. lb # [ 10.166422] systemd[1]: Finished Update is Completed. worker1 # [ 10.371495] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 10.393316] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.414640] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.420333] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.479726] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 10.510718] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 10.545840] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 10.557062] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 10.561689] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 10.646438] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker1 # [ 10.681198] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.682834] systemd[1]: Reached target System Initialization. worker1 # [ 10.684141] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 10.687998] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 10.689974] systemd[1]: Reached target Timer Units. worker1 # [ 10.696099] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 10.697295] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 10.698388] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 10.702352] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 10.711791] systemd[1]: Reached target Socket Units. worker1 # [ 10.714350] systemd[1]: Reached target Basic System. worker2 # [ 10.708816] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.725291] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 10.712213] systemd[1]: Reached target System Initialization. worker2 # [ 10.713092] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 10.714112] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 10.716499] systemd[1]: Reached target Timer Units. worker1 # [ 10.733953] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 10.728550] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 10.721318] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 10.722423] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 10.724618] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 10.743922] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.730463] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 10.732174] systemd[1]: Reached target Socket Units. worker2 # [ 10.738702] systemd[1]: Reached target Basic System. worker1 # [ 10.751395] systemd[1]: Started Reset console on configuration changes. worker1 # [ 10.762840] systemd[1]: Starting resolvconf update... worker2 # [ 10.747681] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 10.752394] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.771268] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 10.759754] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.773563] systemd[1]: Started Reset console on configuration changes. client # [ 10.781925] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 10.784991] systemd[1]: Starting resolvconf update... worker2 # [ 10.788856] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 10.853825] systemd[1]: Finished Post-Boot Actions. worker1 # [ 10.892378] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.879374] systemd[1]: Finished Post-Boot Actions. worker1 # [ 10.898123] nsncd[491]: Sep 20 09:32:16.538 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 10.909738] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.918240] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.922641] systemd[1]: Starting User Login Management... worker2 # [ 10.916681] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.938788] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 10.924332] nsncd[491]: Sep 20 09:32:16.563 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.934950] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 10.940407] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 10.942089] systemd[1]: Starting User Login Management... lb # [ 10.954243] systemd[1]: Finished register-nix-paths.service. worker2 # [ 10.955906] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 10.990335] dbus-broker-launch[495]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 11.017064] dbus-broker-launch[495]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.024338] dbus-broker-launch[495]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 11.013921] dbus-broker-launch[495]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.038867] (udev-worker)[320]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 11.033709] dbus-broker-launch[495]: NSS returned no entry for 'systemd-timesync' client # [ 11.044358] (udev-worker)[320]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.035965] dbus-broker-launch[495]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.048556] (udev-worker)[316]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 11.060581] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 11.072931] systemd-logind[512]: New seat seat0. worker1 # [ 11.079798] systemd[1]: Started User Login Management. worker1 # [ 11.084593] systemd[1]: Starting linger-users.service... worker2 # [ 11.077999] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.081244] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.082841] systemd[1]: Reached target System Initialization. lb # [ 11.085668] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.102680] systemd[1]: Finished register-nix-paths.service. client # [ 11.103670] systemd[1]: Reached target System Initialization. client # [ 11.106792] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 11.094316] systemd[1]: Started niks3 garbage collection timer. worker1 # [ 11.116223] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.095212] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.109442] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 11.097020] systemd[1]: Reached target Timer Units. client # [ 11.111828] systemd[1]: Reached target Timer Units. lb # [ 11.100259] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.115445] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 11.126034] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.119012] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.106844] systemd[1]: Listening on niks3 server socket. lb # [ 11.107838] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.109219] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.132332] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.124797] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.127137] systemd[1]: Reached target Socket Units. worker2 # [ 11.118948] systemd-logind[504]: New seat seat0. client # [ 11.129204] systemd[1]: Reached target Basic System. client # [ 11.130590] systemd[1]: Started backdoor.service. lb # [ 11.117268] systemd[1]: Reached target Socket Units. lb # [ 11.118022] systemd[1]: Reached target Basic System. lb # [ 11.118733] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.133129] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 11.141885] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.131169] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.126880] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.152940] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 11.154287] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.135362] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 11.155206] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 11.152098] systemd[1]: Starting nftables firewall... worker2 # [ 11.145593] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 11.163597] dbus-broker-launch[495]: Ready worker1 # [ 11.167936] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.149934] systemd[1]: Starting Post-Boot Actions... client # [ 11.163834] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.156370] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.162784] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.177031] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.171214] systemd[1]: Started User Login Management. worker2 # [ 11.173096] systemd[1]: Starting linger-users.service... worker2 # [ 11.175372] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.179788] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.178749] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.201534] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.187162] dbus-broker-launch[495]: Ready worker1 # [ 11.205068] systemd[1]: Finished linger-users.service. lb # [ 11.188765] systemd[1]: Starting resolvconf update... worker2 # [ 11.191205] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.199757] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.230933] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.237284] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.238813] nsncd[559]: Sep 20 09:32:16.877 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.242389] systemd[1]: Reached target User and Group Name Lookups. client # connecting to host... client # [ 11.237052] systemd[1]: Starting resolvconf update... lb # [ 11.229966] systemd[1]: Started rustfs.service. worker2 # [ 11.247804] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.251829] systemd[1]: Finished linger-users.service. lb # [ 11.250505] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 11.257932] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.260613] nsncd[559]: Sep 20 09:32:16.901 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.279181] systemd[1]: Finished resolvconf update. worker1 # [ 11.281291] systemd[1]: Reached target Preparation for Network. worker2 # [ 11.267089] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.270724] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.287990] systemd[1]: Starting DHCP Client... worker1 # [ 11.290800] systemd[1]: Starting Extra networking commands.... client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 11.307291] systemd[1]: Finished resolvconf update. worker2 # [ 11.308648] systemd[1]: Reached target Preparation for Network. lb # [ 11.302096] systemd[1]: Finished Post-Boot Actions. client # [ 11.337648] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 11.313474] systemd[1]: Starting DHCP Client... client # [ 11.341870] systemd[1]: Finished Post-Boot Actions. lb # [ 11.314170] systemd[1]: Started Name Service Cache Daemon (nsncd). client: connected to guest root shell client # [ 11.378220] nsncd[400]: Sep 20 09:32:17.007 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.317268] systemd[1]: Starting Extra networking commands.... lb # [ 11.320541] nsncd[490]: Sep 20 09:32:16.955 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client: (connecting took 11.81 seconds) lb # [ 11.356660] systemd[1]: Reached target Host and Network Name Lookups. client: (finished: waiting for the VM to finish booting, in 11.81 seconds) lb # [ 11.367080] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.389658] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.387219] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.392724] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 11.412192] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.418255] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.442668] systemd[1]: Starting User Login Management... lb # [ 11.432418] systemd[1]: Starting User Login Management... client # [ 11.447897] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 11.441354] systemd[1]: Starting Virtual Console Setup... lb # [ 11.438054] systemd[1]: Finished Firewall. lb # [ 11.459036] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 11.463800] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 11.470589] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 11.476691] systemd[1]: Starting Virtual Console Setup... worker2 # [ 11.498552] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 11.521332] dhcpcd[592]: dhcpcd-10.3.2 starting client # [ 11.520627] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 11.539966] dhcpcd[630]: dev: loaded udev worker1 # [ 11.545570] dhcpcd[630]: no valid interfaces found worker1 # [ 11.548423] dhcpcd[630]: no valid interfaces found worker1 # [ 11.588262] systemd[1]: Finished Extra networking commands.. worker1 # [ 11.592871] systemd[1]: Reached target Network. worker1 # [ 11.595267] systemd[1]: Starting Permit User Sessions... worker2 # [ 11.608651] dhcpcd[596]: dhcpcd-10.3.2 starting client # [ 11.617708] dbus-broker-launch[415]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 11.634276] systemd[1]: Starting Virtual Console Setup... worker2 # [ 11.628406] dhcpcd[637]: dev: loaded udev worker2 # [ 11.634740] dhcpcd[637]: no valid interfaces found worker2 # [ 11.637011] dhcpcd[637]: no valid interfaces found worker1 # [ 11.658314] systemd[1]: Finished Permit User Sessions. client # [ 11.653836] dbus-broker-launch[415]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.664179] systemd[1]: Started Getty on tty1. client # [ 11.654949] dbus-broker-launch[415]: Invalid user-name in /nix/store/i87y3v12qnxz4jgnndbs0w0ih92vmmjw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 11.666469] systemd[1]: Reached target Login Prompts. worker2 # [ 11.677652] systemd[1]: Finished Extra networking commands.. worker1 # [ 11.697990] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 11.680972] systemd[1]: Reached target Network. worker1 # [ 11.701100] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 11.684852] systemd[1]: Starting Permit User Sessions... lb # [ 11.680364] dbus-broker-launch[526]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 11.707489] systemd[1]: Starting Virtual Console Setup... client # [ 11.696408] systemd-logind[436]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 11.708578] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.696949] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 11.714560] systemd-logind[436]: New seat seat0. client # [ 11.715315] systemd[1]: Started User Login Management. lb # [ 11.705188] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.711236] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.729650] systemd[1]: Starting linger-users.service... lb # [ 11.719550] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.733346] systemd[1]: Finished Permit User Sessions. lb # [ 11.729181] dbus-broker-launch[526]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.737655] systemd[1]: Started Getty on tty1. worker2 # [ 11.740884] systemd[1]: Reached target Login Prompts. lb # [ 11.739196] dbus-broker-launch[526]: Invalid user-name in /nix/store/r3k08synkldj3yxnxmc97ljig0y68d44-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.754712] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.774925] dbus-broker-launch[415]: Ready lb # [ 11.762186] systemd[1]: nscd.service: Deactivated successfully. lb # [ 11.770623] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 11.799797] mousedev: PS/2 mouse device common for all mice lb # [ 11.780690] systemd-logind[528]: New seat seat0. client # [ 11.806319] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.787274] systemd[1]: Started User Login Management. client # [ 11.807295] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.794492] systemd[1]: Starting linger-users.service... worker1 # [ 11.823127] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 11.815951] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.821604] systemd[1]: Stopping User and Group Name Lookups... client # [ 11.822498] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.823339] systemd[1]: nscd.service: Deactivated successfully. lb # [ 11.809696] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.833324] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.820555] systemd[1]: Started D-Bus System Message Bus. client # [ 11.836651] systemd[1]: linger-users.service: Deactivated successfully. client # [ 11.837603] systemd[1]: Finished linger-users.service. client # [ 11.857543] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.863109] dbus-broker-launch[526]: Ready worker2 # [ 11.910632] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 11.933049] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.934088] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.943108] nsncd[501]: Sep 20 09:32:17.563 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.949994] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.944194] systemd[1]: Finished resolvconf update. lb # [ 11.946408] systemd[1]: Reached target Preparation for Network. client # [ 11.960777] systemd[1]: Finished resolvconf update. lb # [ 11.957726] systemd[1]: Starting DHCP Client... client # [ 11.971493] systemd[1]: Starting DHCP Client... lb # [ 11.968339] nsncd[586]: Sep 20 09:32:17.618 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.978272] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 11.981985] systemd[1]: Started backdoor.service. lb # [ 11.978204] systemd[1]: Starting Extra networking commands.... lb # [ 11.982000] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 12.007285] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 11.988446] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 11.999169] systemd[1]: Finished linger-users.service. lb # [ 12.002996] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 12.036155] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 12.040103] systemd[1]: Started backdoor.service. worker2 # [ 12.044459] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.034887] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 12.041351] systemd[1]: Reached target User and Group Name Lookups. lb # [ 12.045936] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 12.056968] systemd[1]: Started backdoor.service. worker1 # [ 12.119811] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.138077] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # connecting to host... client # [ 12.163676] systemd-logind[436]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 12.174078] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.174639] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.159122] (udev-worker)[658]: Network interface NamePolicy= disabled on kernel command line.[ 12.181049] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.181395] cfg80211: failed to load regulatory.db worker2 # worker2 # [ 12.182497] (udev-worker)[662]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 12.214135] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # connecting to host... worker2 # [ 12.187903] (udev-worker)[662]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.201455] systemd-vconsole-setup[603]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 12.215361] dhcpcd[532]: dhcpcd-10.3.2 starting lb # connecting to host... worker2 # [ 12.209366] systemd[1]: Finished Virtual Console Setup. client # [ 12.231938] dhcpcd[542]: dev: loaded udev worker1 # [ 12.252870] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.255354] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.259884] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 12.260252] cfg80211: failed to load regulatory.db client # [ 12.291436] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.292979] systemd[1]: Finished nftables firewall. client # [ 12.297007] systemd[1]: Reached target Preparation for Network. client # [ 12.302919] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.319203] (udev-worker)[662]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.328687] (udev-worker)[661]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 12.322461] systemd[1]: Starting Extra networking commands.... worker1 # [ 12.334011] (udev-worker)[661]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.343501] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 12.351007] systemd[1]: Finished Virtual Console Setup. worker2 # [ 12.334339] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.340974] systemd[1]: Starting Address configuration of eth1... lb # [ 12.362811] dhcpcd[623]: dhcpcd-10.3.2 starting lb # [ 12.380388] dhcpcd[673]: dev: loaded udev client # [ 12.433092] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 12.415642] systemd[1]: Finished Extra networking commands.. worker2 # [ 12.426350] systemd-logind[504]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 12.421718] systemd[1]: Reached target Network. worker2 # [ 12.447918] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 12.436969] dhcpcd[637]: eth0: waiting for carrier worker2 # [ 12.439043] dhcpcd[637]: eth0: carrier acquired lb # [ 12.431664] systemd[1]: Starting PostgreSQL Server...[ 12.450893] 8021q: 802.1Q VLAN Support v1.8 lb # client # [ 12.469970] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 12.444952] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.456128] dhcpcd[637]: DUID 00:01:00:01:32:42:64:a2:52:54:00:12:34:56 worker2 # [ 12.472699] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 12.482413] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.482883] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.462557] dhcpcd[637]: eth0: IAID 00:12:34:56 worker2 # [ 12.463368] dhcpcd[637]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 12.489625] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.489966] cfg80211: failed to load regulatory.db worker1 # [ 12.496407] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.480800] network-addresses-eth1-start[680]: adding address 192.168.1.4/24... done client # [ 12.489537] network-addresses-eth1-start[548]: adding address 192.168.1.1/24... done worker1 # [ 12.502699] systemd-logind[512]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 12.508816] systemd[1]: Starting Address configuration of eth1... worker2 # [ 12.496268] network-addresses-eth1-start[680]: adding address 2001:db8:1::4/64... done client # [ 12.512688] network-addresses-eth1-start[548]: adding address 2001:db8:1::1/64... done worker2 # [ 12.519059] systemd[1]: Finished Address configuration of eth1. client # [ 12.541488] systemd[1]: Finished Address configuration of eth1. lb # [ 12.535554] systemd[1]: Finished Permit User Sessions. lb # [ 12.550902] systemd[1]: Started Getty on tty1. lb # [ 12.554419] systemd[1]: Reached target Login Prompts. client # [ 12.572315] dhcpcd[585]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (550) - Operation not permitted client # [ 12.574220] dhcpcd[585]: .resolvconf-wrapped: clearing stale lock pid 550 worker1 # [ 12.607011] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 12.591638] mousedev: PS/2 mouse device common for all mice worker1 # [ 12.598374] dhcpcd[630]: eth0: waiting for carrier worker1 # [ 12.599146] dhcpcd[630]: eth0: carrier acquired worker1 # [ 12.618666] dhcpcd[630]: DUID 00:01:00:01:32:42:64:a2:52:54:00:12:34:56 worker1 # [ 12.619654] dhcpcd[630]: eth0: IAID 00:12:34:56 worker1 # [ 12.620824] dhcpcd[630]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 12.639739] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 12.624035] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.638249] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.628124] dhcpcd[542]: eth0: waiting for carrier client # [ 12.630151] dhcpcd[542]: libudev: received NULL device client # [ 12.632596] dhcpcd[542]: libudev: received NULL device client # [ 12.635819] dhcpcd[542]: eth0: carrier acquired worker1 # [ 12.645617] network-addresses-eth1-start[681]: adding address 192.168.1.3/24... done client # [ 12.650774] dhcpcd[542]: DUID 00:01:00:01:32:42:64:a2:52:54:00:12:34:56 client # [ 12.651911] dhcpcd[542]: eth0: IAID 00:12:34:56 worker1 # [ 12.660359] network-addresses-eth1-start[681]: adding address 2001:db8:1::3/64... done client # [ 12.654639] dhcpcd[542]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 12.669156] systemd[1]: Finished Extra networking commands.. lb # [ 12.671175] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 12.671691] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 12.673561] systemd[1]: Reached target Network. worker1 # [ 12.682226] systemd[1]: Finished Address configuration of eth1. lb # [ 12.677203] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 12.678766] cfg80211: failed to load regulatory.db client # [ 12.677158] systemd[1]: Starting Permit User Sessions... lb # [ 12.667127] dhcpcd[673]: no valid interfaces found lb # [ 12.671308] dhcpcd[673]: no valid interfaces found worker1 # [ 12.727646] mousedev: PS/2 mouse device common for all mice worker2 # [ 12.700287] systemd-logind[504]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 12.726074] systemd[1]: Finished Permit User Sessions. client # [ 12.733675] systemd[1]: Started Getty on tty1. client # [ 12.736829] systemd[1]: Reached target Login Prompts. worker1 # [ 12.774374] systemd-logind[512]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 12.789370] (udev-worker)[700]: Network interface NamePolicy= disabled on kernel command line. lb # [ 12.796276] (udev-worker)[701]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client: (finished: waiting for unit network-addresses-eth1.service, in 13.24 seconds) lb # [ 12.803650] (udev-worker)[701]: Network interface NamePolicy= disabled on kernel command line. client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) client # [ 12.876285] dhcpcd[542]: eth0: soliciting a DHCP lease client # [ 12.884521] dhcpcd[542]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 12.892238] dhcpcd[542]: eth0: probing address 10.0.2.15/24 lb # [ 12.901240] postgresql-pre-start[698]: The files belonging to this database system will be owned by user "postgres". lb # [ 12.902681] postgresql-pre-start[698]: This user must also own the server process. lb # [ 12.919580] postgresql-pre-start[698]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 12.922831] postgresql-pre-start[698]: The default database encoding has accordingly been set to "UTF8". lb # [ 12.931002] postgresql-pre-start[698]: The default text search configuration will be set to "english". lb # [ 12.938283] postgresql-pre-start[698]: Data page checksums are enabled. lb # [ 12.942288] postgresql-pre-start[698]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.943570] postgresql-pre-start[698]: creating subdirectories ... ok lb # [ 12.951856] postgresql-pre-start[698]: selecting dynamic shared memory implementation ... posix worker2 # [ 13.118779] dhcpcd[637]: eth0: soliciting a DHCP lease worker2 # [ 13.125633] dhcpcd[637]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 13.132240] dhcpcd[637]: eth0: probing address 10.0.2.15/24 lb # [ 13.156829] postgresql-pre-start[698]: selecting default "max_connections" ... 100 lb # [ 13.162632] systemd-logind[528]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 13.224322] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 13.238229] systemd[1]: Starting Address configuration of eth1... client # [ 13.375502] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.376986] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 13.362774] dhcpcd[673]: eth0: waiting for carrier lb # [ 13.367474] dhcpcd[673]: eth0: carrier acquired lb # [ 13.399562] dhcpcd[673]: DUID 00:01:00:01:32:42:64:a3:52:54:00:12:34:56 lb # [ 13.401726] dhcpcd[673]: eth0: IAID 00:12:34:56 lb # [ 13.404587] postgresql-pre-start[698]: selecting default "shared_buffers" ... 128MB lb # [ 13.407806] dhcpcd[673]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 13.431211] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 13.436828] network-addresses-eth1-start[734]: adding address 192.168.1.2/24... done lb # [ 13.453400] network-addresses-eth1-start[734]: adding address 2001:db8:1::2/64... done lb # [ 13.475077] systemd[1]: Finished Address configuration of eth1. lb # [ 13.528806] mousedev: PS/2 mouse device common for all mice worker2 # [ 13.609942] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 13.614225] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.618063] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.621126] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 13.621944] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.646728] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.652337] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.655235] systemd[1]: Starting Virtual Console Setup... client # [ 13.684332] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.690485] systemd-logind[504]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 13.686391] systemd-logind[528]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 13.723531] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 13.734625] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 13.735689] systemd[1]: Stopped Virtual Console Setup. client # [ 13.742299] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.774142] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 13.780269] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.781341] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 13.782071] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 13.788393] systemd[1]: Starting Virtual Console Setup... client # [ 13.783204] systemd-logind[436]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 13.810484] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.811551] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 13.815137] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.851386] systemd-logind[512]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 13.980662] systemd-vconsole-setup[704]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 13.985841] systemd[1]: Finished Virtual Console Setup. worker1 # [ 14.145500] systemd-vconsole-setup[704]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.150961] systemd[1]: Finished Virtual Console Setup. worker1 # [ 14.170423] dhcpcd[630]: eth0: soliciting a DHCP lease client # [ 14.164458] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones. lb: (finished: waiting for unit network-addresses-eth1.service, in 1.30 seconds) worker1 # [ 14.176775] dhcpcd[630]: eth0: offered 10.0.2.15 from 10.0.2.2 lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } client # [ 14.169121] systemd[1]: Finished Virtual Console Setup. worker1 # [ 14.184307] dhcpcd[630]: eth0: probing address 10.0.2.15/24 lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1 # [ 14.348599] dhcpcd[630]: eth0: soliciting an IPv6 router worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 14.350718] dhcpcd[630]: eth0: Router Advertisement from fe80::2 worker1 # [ 14.352279] dhcpcd[630]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 14.353362] dhcpcd[630]: eth0: adding route to fec0::/64 worker1 # [ 14.354270] dhcpcd[630]: eth0: adding default route via fe80::2 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds) lb: waiting for unit niks3.service worker2 # [ 14.533926] dhcpcd[637]: eth0: soliciting an IPv6 router worker2 # [ 14.537131] dhcpcd[637]: eth0: Router Advertisement from fe80::2 worker2 # [ 14.539440] dhcpcd[637]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 14.542146] dhcpcd[637]: eth0: adding route to fec0::/64 worker2 # [ 14.544224] dhcpcd[637]: eth0: adding default route via fe80::2 lb # [ 14.603171] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 14.671055] dhcpcd[542]: eth0: soliciting an IPv6 router client # [ 14.674955] dhcpcd[542]: eth0: Router Advertisement from fe80::2 client # [ 14.677613] dhcpcd[542]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 14.680485] dhcpcd[542]: eth0: adding route to fec0::/64 client # [ 14.682686] dhcpcd[542]: eth0: adding default route via fe80::2 lb # [ 14.840616] dhcpcd[673]: eth0: soliciting a DHCP lease lb # [ 14.852209] dhcpcd[673]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 14.860183] dhcpcd[673]: eth0: probing address 10.0.2.15/24 lb # [ 15.062880] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 15.073088] systemd[1]: Starting Virtual Console Setup... lb # [ 15.163944] systemd-logind[528]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 15.278751] dhcpcd[673]: eth0: soliciting an IPv6 router lb # [ 15.280237] dhcpcd[673]: eth0: Router Advertisement from fe80::2 lb # [ 15.281203] dhcpcd[673]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 15.283075] dhcpcd[673]: eth0: adding route to fec0::/64 lb # [ 15.288276] dhcpcd[673]: eth0: adding default route via fe80::2 lb # [ 15.552772] systemd-vconsole-setup[773]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 15.557492] systemd[1]: Finished Virtual Console Setup. lb # [ 15.920823] postgresql-pre-start[698]: selecting default time zone ... UTC lb # [ 15.925546] postgresql-pre-start[698]: creating configuration files ... ok lb # [ 16.186670] postgresql-pre-start[698]: running bootstrap script ... ok lb # [ 16.830397] postgresql-pre-start[698]: performing post-bootstrap initialization ... ok lb # [ 16.997873] postgresql-pre-start[698]: syncing data to disk ... ok lb # [ 16.999919] postgresql-pre-start[698]: initdb: warning: enabling "trust" authentication for local connections lb # [ 17.001947] postgresql-pre-start[698]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 17.004473] postgresql-pre-start[698]: Success. You can now start the database server using: lb # [ 17.005929] postgresql-pre-start[698]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 17.128888] postgres[807]: [807] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.133265] postgres[807]: [807] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.134509] postgres[807]: [807] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.136110] postgres[807]: [807] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.148651] postgres[816]: [816] LOG: database system was shut down at 2026-09-20 09:32:22 GMT lb # [ 17.154756] postgres[807]: [807] LOG: database system is ready to accept connections lb # [ 17.159961] systemd[1]: Started PostgreSQL Server. lb # [ 17.168786] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 17.389958] postgresql-setup-start[827]: CREATE DATABASE lb # [ 17.442918] postgresql-setup-start[832]: CREATE ROLE lb # [ 17.466600] postgresql-setup-start[834]: ALTER DATABASE lb # [ 17.473615] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 17.475437] systemd[1]: Reached target PostgreSQL. worker2 # [ 17.796301] dhcpcd[637]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 17.799520] dhcpcd[637]: eth0: adding route to 10.0.2.0/24 worker2 # [ 17.802676] dhcpcd[637]: eth0: adding default route via 10.0.2.2 worker2 # [ 17.968473] systemd[1]: Started DHCP Client. worker2 # [ 17.970462] systemd[1]: Reached target Multi-User System. worker2 # [ 17.971753] systemd[1]: Startup finished in 920ms (kernel) + 4.597s (initrd) + 12.453s (userspace) = 17.971s. client # [ 18.528456] dhcpcd[542]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 18.531781] dhcpcd[542]: eth0: adding route to 10.0.2.0/24 client # [ 18.534804] dhcpcd[542]: eth0: adding default route via 10.0.2.2 client # [ 18.696403] systemd[1]: Started DHCP Client. client # [ 18.698443] systemd[1]: Reached target Multi-User System. client # [ 18.699827] systemd[1]: Startup finished in 938ms (kernel) + 5.437s (initrd) + 12.324s (userspace) = 18.699s. worker1 # [ 19.370258] dhcpcd[630]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 19.373799] dhcpcd[630]: eth0: adding route to 10.0.2.0/24 worker1 # [ 19.374512] dhcpcd[630]: eth0: adding default route via 10.0.2.2 worker1 # [ 19.526411] systemd[1]: Started DHCP Client. worker1 # [ 19.530181] systemd[1]: Reached target Multi-User System. worker1 # [ 19.531008] systemd[1]: Startup finished in 921ms (kernel) + 4.608s (initrd) + 13.999s (userspace) = 19.529s. lb # [ 20.188617] dhcpcd[673]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 20.190410] dhcpcd[673]: eth0: adding route to 10.0.2.0/24 lb # [ 20.191659] dhcpcd[673]: eth0: adding default route via 10.0.2.2 lb # [ 20.307942] systemd[1]: Started DHCP Client. lb # [ 20.312329] systemd[1]: Reached target Network is Online. lb # [ 20.315123] systemd[1]: Started Envoy reverse proxy. lb # [ 20.321742] systemd[1]: Started mock-oidc.service. lb # [ 20.419437] mock-oidc-server[921]: Mock OIDC Server running lb # [ 20.420757] mock-oidc-server[921]: OIDC Address: 192.168.1.2:8080 lb # [ 20.422321] mock-oidc-server[921]: Issue Address: 0.0.0.0:8081 lb # [ 20.423501] mock-oidc-server[921]: Issuer: http://192.168.1.2:8080/oidc lb # [ 20.425063] mock-oidc-server[921]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 20.426614] mock-oidc-server[921]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 20.428160] mock-oidc-server[921]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 20.950474] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 20.952898] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 20.954509] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.957481] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 20.999053] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 21.006431] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 21.009267] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 21.011546] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 21.013819] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 21.016507] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 21.019841] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 21.022447] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 21.025273] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 21.027953] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 21.029984] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 21.035676] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 21.037646] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 21.040344] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 21.042020] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 21.046915] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 21.050255] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 21.052132] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 21.053717] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 21.057253] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 21.059216] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 21.061754] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 21.063991] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 21.066524] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 21.068835] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 21.071305] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 21.076383] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 21.079825] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 21.082552] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 21.090912] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 21.093453] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 21.099925] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 21.103760] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 21.106712] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 21.112315] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 21.119903] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 21.122314] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 21.124125] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 21.126464] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 21.128606] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 21.130541] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 21.133903] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 21.137361] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 21.139743] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 21.142499] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 21.147706] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 21.149684] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 21.156350] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 21.158448] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 21.161827] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 21.164985] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 21.167671] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 21.170497] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 21.172507] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 21.174463] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 21.176798] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 21.179392] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 21.182702] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 21.184772] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 21.186607] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 21.189626] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 21.191675] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 21.195296] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 21.198422] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 21.200521] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 21.203933] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 21.206473] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 21.214917] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 21.222566] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 21.227073] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 21.233459] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 21.236727] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 21.239547] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 21.243050] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 21.245518] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 21.248281] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 21.261353] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 21.270859] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 21.277079] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 21.283170] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 21.286711] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 21.290341] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 21.293041] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 21.295016] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 21.303761] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 21.306070] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 21.311392] envoy[920]: [2026-09-20 09:32:26.601][920][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 21.322088] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 21.325262] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 21.328386] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 21.342231] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 21.344439] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 21.347391] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 21.350831] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 21.353132] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 21.354842] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 21.357167] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 21.359333] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 21.361843] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 21.364867] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 21.367395] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 21.373313] envoy[920]: [2026-09-20 09:32:26.602][920][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 21.375081] envoy[920]: [2026-09-20 09:32:26.647][920][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 21.376772] envoy[920]: [2026-09-20 09:32:26.649][920][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 21.392839] envoy[920]: [2026-09-20 09:32:26.649][920][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 21.394364] envoy[920]: [2026-09-20 09:32:26.649][920][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 21.403555] envoy[920]: [2026-09-20 09:32:26.649][920][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 21.405611] envoy[920]: [2026-09-20 09:32:26.858][920][info][main] [source/server/server.cc:968] runtime: {} lb # [ 21.407244] envoy[920]: [2026-09-20 09:32:26.884][920][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 21.411037] envoy[920]: [2026-09-20 09:32:26.884][920][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 21.413013] envoy[920]: [2026-09-20 09:32:26.884][920][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 21.414986] envoy[920]: [2026-09-20 09:32:26.888][920][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 21.417213] envoy[920]: [2026-09-20 09:32:26.888][920][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 21.419096] envoy[920]: [2026-09-20 09:32:26.888][920][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 21.440920] envoy[920]: [2026-09-20 09:32:27.092][920][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 21.454557] envoy[920]: [2026-09-20 09:32:27.106][920][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker1 # [ 21.476194] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 21.457315] envoy[920]: [2026-09-20 09:32:27.109][920][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. worker2 # [ 21.464485] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 21.461164] envoy[920]: [2026-09-20 09:32:27.109][920][info][main] [source/server/server.cc:1077] starting main dispatch loop worker1 # [ 21.725547] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 21.711321] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 21.738542] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 21.722904] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 21.764427] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 21.781562] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 21.766237] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 21.786417] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 21.798701] envoy[920]: [2026-09-20 09:32:27.450][920][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 21.806982] envoy[920]: [2026-09-20 09:32:27.450][920][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 21.816255] envoy[920]: [2026-09-20 09:32:27.450][920][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 21.828228] envoy[920]: [2026-09-20 09:32:27.450][920][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 21.859821] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.843428] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.864333] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.847820] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.049419] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.065714] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.070968] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.060356] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.257872] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.271800] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.263033] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.282544] nix-grpc-daemon[778]: ts=2026-09-20T09:32:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.478049] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.464177] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.483468] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.469276] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.684428] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.670151] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.689650] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.675363] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.892283] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.877971] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.896511] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.882146] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.092788] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.078285] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.098174] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.083509] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.298716] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.301538] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.284660] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.289681] nix-grpc-daemon[778]: ts=2026-09-20T09:32:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.502681] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.490531] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.508197] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.495726] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.709090] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.696749] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.714416] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.701736] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.917017] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.904326] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.921366] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.908411] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.117682] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.104821] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.122981] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.109838] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.323889] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.310748] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.329353] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.315994] nix-grpc-daemon[778]: ts=2026-09-20T09:32:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.530001] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.516768] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.533743] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.520355] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.734677] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.721538] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.739973] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.726870] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.942436] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.929565] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.946516] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.933411] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.143149] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.129853] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.148566] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.135235] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.349489] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.337197] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.354729] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.347326] nix-grpc-daemon[778]: ts=2026-09-20T09:32:30Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.538274] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.555701] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.543847] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.561240] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.744794] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.761907] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.750043] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.767246] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.969047] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.951878] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.957098] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.974277] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.157888] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.175319] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.163791] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.181720] nix-grpc-daemon[778]: ts=2026-09-20T09:32:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.365268] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.382739] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.371460] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.388765] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.572676] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.590543] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.578571] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.597028] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.780360] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.798214] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.786708] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.804130] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.989352] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.008675] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.994747] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.013139] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.208692] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.191519] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.197314] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.214429] nix-grpc-daemon[778]: ts=2026-09-20T09:32:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.398516] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.415528] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.421510] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.405656] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.622288] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.606889] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.628106] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.613499] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.829515] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.817656] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.835533] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.824122] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.019697] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.039758] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.024871] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.044508] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.240596] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.226990] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.246638] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.232754] nix-grpc-daemon[778]: ts=2026-09-20T09:32:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 28.336533] rustfs-bucket-start[997]: mb s3://farm lb # [ 28.344840] systemd[1]: Finished rustfs-bucket.service. lb # [ 28.353382] systemd[1]: Starting niks3 server... worker2 # [ 28.429624] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.448518] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.435640] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.455101] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 28.584895] postgres[1017]: [1017] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 28.586217] postgres[1017]: [1017] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 28.624567] niks3-server[1011]: 2026/09/20 09:32:34 OK 20241026095416_initial_model.sql (24.82ms) lb # [ 28.628314] niks3-server[1011]: 2026/09/20 09:32:34 OK 20251210153512_drop_unused_gin_index.sql (2.04ms) worker2 # [ 28.637188] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:50051 lb # [ 28.635166] niks3-server[1011]: 2026/09/20 09:32:34 OK 20251218171726_add_pins.sql (6.79ms) worker1 # [ 28.657193] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:50051 lb # [ 28.640454] niks3-server[1011]: 2026/09/20 09:32:34 OK 20260628120000_add_object_size_and_stats.sql (5.24ms) worker2 # [ 28.644466] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.662373] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 28.647530] niks3-server[1011]: 2026/09/20 09:32:34 OK 20260905000000_add_claims.sql (7.04ms) lb # [ 28.652552] niks3-server[1011]: 2026/09/20 09:32:34 OK 20260920000000_drop_claims.sql (4.83ms) lb # [ 28.653812] niks3-server[1011]: 2026/09/20 09:32:34 goose: successfully migrated database to version: 20260920000000 lb # [ 28.659177] niks3-server[1011]: 2026/09/20 09:32:34 OK 1_commit_pending_closure.sql (6.59ms) lb # [ 28.662456] niks3-server[1011]: 2026/09/20 09:32:34 OK 2_object_stats_trigger.sql (3.12ms) lb # [ 28.663760] niks3-server[1011]: 2026/09/20 09:32:34 goose: up to current file version: 2 lb # [ 28.668504] niks3-server[1011]: 2026/09/20 09:32:34 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 28.722138] niks3-server[1011]: 2026/09/20 09:32:34 INFO Read proxy enabled — serving cache objects from S3 lb # [ 28.724949] niks3-server[1011]: 2026/09/20 09:32:34 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 28.729428] niks3-server[1011]: 2026/09/20 09:32:34 INFO systemd watchdog enabled interval=15s lb # [ 28.730588] niks3-server[1011]: 2026/09/20 09:32:34 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 28.736293] systemd[1]: Started niks3 server. lb # [ 28.737147] niks3-server[1011]: 2026/09/20 09:32:34 INFO lead: acquired remote=192.168.1.4:35474 lb # [ 28.738297] systemd[1]: Reached target Multi-User System. worker2 # [ 28.742050] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_take_over lb # [ 28.739095] systemd[1]: Startup finished in 918ms (kernel) + 5.486s (initrd) + 22.324s (userspace) = 28.729s. worker2 # [ 28.844634] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.863975] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.864800] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 28.871582] nix-grpc-daemon[778]: ts=2026-09-20T09:32:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: waiting for unit niks3.service, in 14.96 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.07 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 29.643169] envoy[920]: conn peer=[::1]:37456 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy ??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 128 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.12 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.10 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.16 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 30.534753] nix-grpc-daemon[778]: ts=2026-09-20T09:32:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 30.553777] systemd[1]: Started Nix Daemon. worker2 # [ 30.907246] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 30.950527] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 1/5) worker2 # [ 30.968780] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 2/5) worker2 # [ 31.012297] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 298 ms (attempt 3/5) worker2 # [ 31.316788] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 351 ms (attempt 4/5) worker2 # [ 31.673720] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 31.705551] nix-grpc-daemon[778]: ts=2026-09-20T09:32:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 31.723592] nix-grpc-daemon[778]: ts=2026-09-20T09:32:37Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 31.738230] nix-grpc-daemon[778]: ts=2026-09-20T09:32:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 31.750743] nix-grpc-daemon[778]: ts=2026-09-20T09:32:37Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.13 seconds) client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds) worker2 # [ 32.742336] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 32.742808] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:60318 worker2 # [ 32.761730] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:60318 worker2 # [ 32.775780] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 32.791483] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:60318 worker2 # [ 32.799668] nix-grpc-daemon[778]: ts=2026-09-20T09:32:38Z level=debug event=path_info_miss path=hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test error="error: path '/nix/store/hm2ivcfpd1c4zm4pjvk30sbdr1spxhrj-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.06 seconds) worker2 # [ 35.165802] nix-grpc-daemon[778]: ts=2026-09-20T09:32:40Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 35.444639] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.34 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 35.766441] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 35.781422] systemd[1]: Started Nix Daemon. worker1 # [ 36.117352] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 36.131560] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 36.203863] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 36.210945] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 36.275549] nix-grpc-daemon[778]: ts=2026-09-20T09:32:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 36.331403] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5) worker1 # [ 36.356576] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 132 ms (attempt 2/5) worker1 # [ 36.496836] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 92 ms (attempt 3/5) worker1 # [ 36.596633] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 691 ms (attempt 4/5) worker1 # [ 37.298843] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 37.323112] nix-grpc-daemon[778]: ts=2026-09-20T09:32:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45680 client # copying 1 paths to 'lb:50051'... worker1 # [ 37.340113] nix-grpc-daemon[778]: ts=2026-09-20T09:32:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 37.372577] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 37.408701] nix-grpc-daemon[778]: ts=2026-09-20T09:32:43Z level=info event=niks3_push_started pid=846 worker1 # [ 37.876075] nix-daemon[837]: accepted connection from pid 859, user nix-grpc-daemon (trusted) worker1 # [ 37.896711] nix-daemon[837]: reaped child process 862, status = succeeded worker1 # [ 38.069008] nix-daemon[837]: accepted connection from pid 864, user nix-grpc-daemon (trusted) worker1 # [ 38.088240] nix-daemon[837]: reaped child process 867, status = succeeded lb # [ 38.079254] niks3-server[1011]: 2026/09/20 09:32:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 38.132095] nix-grpc-daemon[846]: time=2026-09-20T09:32:43.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 38.133731] nix-grpc-daemon[846]: time=2026-09-20T09:32:43.777Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 38.161799] niks3-server[1011]: 2026/09/20 09:32:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 38.168377] niks3-server[1011]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 38.184114] niks3-server[1011]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 38.202718] niks3-server[1011]: 2026/09/20 09:32:43 INFO Signed narinfos id=1 count=1 worker1 # [ 38.230292] nix-grpc-daemon[846]: time=2026-09-20T09:32:43.876Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.218750] niks3-server[1011]: 2026/09/20 09:32:43 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 38.226290] niks3-server[1011]: 2026/09/20 09:32:43 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo lb # [ 38.242482] niks3-server[1011]: 2026/09/20 09:32:43 INFO Completed upload id=1 worker1 # [ 38.264981] nix-grpc-daemon[846]: time=2026-09-20T09:32:43.912Z level=INFO msg="Upload complete. (571ms)" worker1 # [ 38.275686] nix-grpc-daemon[778]: ts=2026-09-20T09:32:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 38.292686] nix-grpc-daemon[778]: ts=2026-09-20T09:32:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 38.306742] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 38.314221] nix-daemon[837]: reaped child process 844, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... worker1 # [ 38.323224] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv client # farm-a> LOG-farm-a-t1 worker1 # [ 40.171302] nix-daemon[837]: reaped child process 871, status = succeeded worker1 # [ 40.358854] nix-daemon[837]: accepted connection from pid 887, user nix-grpc-daemon (trusted) worker1 # [ 40.377026] nix-daemon[837]: reaped child process 890, status = succeeded lb # [ 40.366985] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.402878] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.048Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 40.405036] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.048Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 40.415111] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 40.431794] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 40.442971] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign worker1 # [ 40.466085] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.112Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.446678] niks3-server[1011]: 2026/09/20 09:32:46 INFO Signed narinfos id=2 count=1 lb # [ 40.449565] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 40.457924] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 40.466247] niks3-server[1011]: 2026/09/20 09:32:46 INFO Completed upload id=2 worker1 # [ 40.487626] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.134Z level=INFO msg="Upload complete. (348ms)" lb # [ 40.468819] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 40.501377] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker1 # [ 40.517123] nix-daemon[837]: reaped child process 869, status = succeeded worker2 # [ 40.497423] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 40.498165] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 40.564145] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 40.579647] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 40.594795] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.242Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 40.603893] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 40.628199] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 40.839532] nix-daemon[837]: accepted connection from pid 894, user nix-grpc-daemon (trusted) worker1 # [ 40.857212] nix-daemon[837]: reaped child process 897, status = succeeded worker1 # [ 41.032810] nix-daemon[837]: accepted connection from pid 899, user nix-grpc-daemon (trusted) worker1 # [ 41.050445] nix-daemon[837]: reaped child process 902, status = succeeded lb # [ 41.040509] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 41.074447] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.721Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 41.076098] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.721Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 41.071331] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 41.084518] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker1 # [ 41.113105] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.760Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.098468] niks3-server[1011]: 2026/09/20 09:32:46 INFO Signed narinfos id=3 count=1 lb # [ 41.104453] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 41.111150] niks3-server[1011]: 2026/09/20 09:32:46 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 41.119371] niks3-server[1011]: 2026/09/20 09:32:46 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo lb # [ 41.126229] niks3-server[1011]: 2026/09/20 09:32:46 INFO Completed upload id=3 worker1 # [ 41.148485] nix-grpc-daemon[846]: time=2026-09-20T09:32:46.795Z level=INFO msg="Upload complete. (503ms)" worker1 # [ 41.159193] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 41.174921] nix-grpc-daemon[778]: ts=2026-09-20T09:32:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 41.181761] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 41.190775] nix-daemon[837]: reaped child process 892, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... worker1 # [ 41.200466] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 41.447380] envoy[920]: conn peer=[2001:db8:1::1]:37550 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=1286 lb # [ 41.452586] envoy[920]: conn peer=[2001:db8:1::1]:54194 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=101 lb # [ 41.457117] envoy[920]: conn peer=[2001:db8:1::1]:54196 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=18 lb # [ 41.462318] envoy[920]: conn peer=[2001:db8:1::1]:54210 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=15 client # farm-b> LOG-farm-b-t1 worker1 # [ 42.033601] nix-daemon[837]: reaped child process 906, status = succeeded worker1 # [ 42.198955] nix-daemon[837]: accepted connection from pid 921, user nix-grpc-daemon (trusted) worker1 # [ 42.223626] nix-daemon[837]: reaped child process 924, status = succeeded lb # [ 42.218970] niks3-server[1011]: 2026/09/20 09:32:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.252601] nix-grpc-daemon[846]: time=2026-09-20T09:32:47.898Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 42.254093] nix-grpc-daemon[846]: time=2026-09-20T09:32:47.898Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 42.257621] niks3-server[1011]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst worker1 # [ 42.295917] nix-grpc-daemon[846]: time=2026-09-20T09:32:47.942Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.273164] niks3-server[1011]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 42.284291] niks3-server[1011]: 2026/09/20 09:32:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 42.291299] niks3-server[1011]: 2026/09/20 09:32:47 INFO Signed narinfos id=4 count=1 lb # [ 42.298233] niks3-server[1011]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls worker1 # [ 42.326794] nix-grpc-daemon[846]: time=2026-09-20T09:32:47.974Z level=INFO msg="Upload complete. (314ms)" lb # [ 42.305381] niks3-server[1011]: 2026/09/20 09:32:47 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 42.311423] niks3-server[1011]: 2026/09/20 09:32:47 INFO Completed upload id=4 lb # [ 42.314722] niks3-server[1011]: 2026/09/20 09:32:47 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker1 # [ 42.332670] nix-grpc-daemon[778]: ts=2026-09-20T09:32:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker1 # [ 42.341894] nix-daemon[837]: reaped child process 904, status = succeeded worker2 # [ 42.330281] nix-grpc-daemon[778]: ts=2026-09-20T09:32:47Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 42.336349] nix-grpc-daemon[778]: ts=2026-09-20T09:32:47Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 42.389982] nix-grpc-daemon[778]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 42.408830] nix-grpc-daemon[778]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 42.422443] nix-grpc-daemon[846]: time=2026-09-20T09:32:48.069Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 42.432092] nix-grpc-daemon[778]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 42.454075] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 42.651184] nix-daemon[837]: accepted connection from pid 929, user nix-grpc-daemon (trusted) worker1 # [ 42.668829] nix-daemon[837]: reaped child process 932, status = succeeded worker1 # [ 42.841313] nix-daemon[837]: accepted connection from pid 934, user nix-grpc-daemon (trusted) worker1 # [ 42.859795] nix-daemon[837]: reaped child process 937, status = succeeded lb # [ 42.849007] niks3-server[1011]: 2026/09/20 09:32:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.882763] nix-grpc-daemon[846]: time=2026-09-20T09:32:48.529Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 42.884388] nix-grpc-daemon[846]: time=2026-09-20T09:32:48.529Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 42.883267] niks3-server[1011]: 2026/09/20 09:32:48 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 42.895540] niks3-server[1011]: 2026/09/20 09:32:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 42.924344] nix-grpc-daemon[846]: time=2026-09-20T09:32:48.571Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.906668] niks3-server[1011]: 2026/09/20 09:32:48 INFO Signed narinfos id=5 count=1 lb # [ 42.912295] niks3-server[1011]: 2026/09/20 09:32:48 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 42.919524] niks3-server[1011]: 2026/09/20 09:32:48 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 42.926187] niks3-server[1011]: 2026/09/20 09:32:48 INFO Completed upload id=5 worker1 # [ 42.948272] nix-grpc-daemon[846]: time=2026-09-20T09:32:48.595Z level=INFO msg="Upload complete. (477ms)" lb # [ 42.928654] niks3-server[1011]: 2026/09/20 09:32:48 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 42.956070] nix-grpc-daemon[778]: ts=2026-09-20T09:32:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 42.970423] nix-grpc-daemon[778]: ts=2026-09-20T09:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 42.976615] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 42.981435] nix-daemon[837]: reaped child process 927, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 42.995202] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1 worker1 # [ 44.442826] nix-daemon[837]: reaped child process 941, status = succeeded worker1 # [ 44.617546] nix-daemon[837]: accepted connection from pid 956, user nix-grpc-daemon (trusted) worker1 # [ 44.636313] nix-daemon[837]: reaped child process 959, status = succeeded lb # [ 44.626643] niks3-server[1011]: 2026/09/20 09:32:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 44.660425] nix-grpc-daemon[846]: time=2026-09-20T09:32:50.306Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 44.661905] nix-grpc-daemon[846]: time=2026-09-20T09:32:50.306Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 44.661460] niks3-server[1011]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 44.677731] niks3-server[1011]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 44.691986] niks3-server[1011]: 2026/09/20 09:32:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker1 # [ 44.718338] nix-grpc-daemon[846]: time=2026-09-20T09:32:50.365Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.700702] niks3-server[1011]: 2026/09/20 09:32:50 INFO Signed narinfos id=6 count=1 lb # [ 44.702972] niks3-server[1011]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 44.713106] niks3-server[1011]: 2026/09/20 09:32:50 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 44.720961] niks3-server[1011]: 2026/09/20 09:32:50 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 44.725954] niks3-server[1011]: 2026/09/20 09:32:50 INFO Completed upload id=6 worker1 # [ 44.748306] nix-grpc-daemon[846]: time=2026-09-20T09:32:50.395Z level=INFO msg="Upload complete. (341ms)" worker1 # [ 44.761177] nix-grpc-daemon[778]: ts=2026-09-20T09:32:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker1 # [ 44.778043] nix-daemon[837]: reaped child process 939, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 9.33 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 10.01 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 46.382750] nix-grpc-daemon[778]: ts=2026-09-20T09:32:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45680 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # [ 46.401723] nix-grpc-daemon[778]: ts=2026-09-20T09:32:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 46.414440] nix-grpc-daemon[846]: time=2026-09-20T09:32:52.059Z level=INFO msg="All 2 paths already cached" worker2 # [ 46.412726] nix-grpc-daemon[778]: ts=2026-09-20T09:32:52Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.35 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.08 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.54 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 47.480991] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45680 worker2 # [ 47.471215] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 47.502145] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 47.508395] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 47.566503] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 47.580805] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 47.597348] nix-grpc-daemon[846]: time=2026-09-20T09:32:53.243Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker1 # [ 47.608143] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 47.622976] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 47.829357] nix-daemon[837]: accepted connection from pid 977, user nix-grpc-daemon (trusted) worker1 # [ 47.850709] nix-daemon[837]: reaped child process 980, status = succeeded worker1 # [ 48.023516] nix-daemon[837]: accepted connection from pid 982, user nix-grpc-daemon (trusted) worker1 # [ 48.042935] nix-daemon[837]: reaped child process 985, status = succeeded lb # [ 48.034693] niks3-server[1011]: 2026/09/20 09:32:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.066902] nix-grpc-daemon[846]: time=2026-09-20T09:32:53.713Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 48.068497] nix-grpc-daemon[846]: time=2026-09-20T09:32:53.713Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 48.063060] niks3-server[1011]: 2026/09/20 09:32:53 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 48.080513] niks3-server[1011]: 2026/09/20 09:32:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker1 # [ 48.108109] nix-grpc-daemon[846]: time=2026-09-20T09:32:53.755Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.093042] niks3-server[1011]: 2026/09/20 09:32:53 INFO Signed narinfos id=7 count=1 lb # [ 48.099620] niks3-server[1011]: 2026/09/20 09:32:53 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 48.107347] niks3-server[1011]: 2026/09/20 09:32:53 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 48.114800] niks3-server[1011]: 2026/09/20 09:32:53 INFO Completed upload id=7 worker1 # [ 48.134615] nix-grpc-daemon[846]: time=2026-09-20T09:32:53.781Z level=INFO msg="Upload complete. (493ms)" lb # [ 48.118384] niks3-server[1011]: 2026/09/20 09:32:53 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker1 # [ 48.144551] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 48.155255] nix-grpc-daemon[778]: ts=2026-09-20T09:32:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 48.162145] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 48.166669] nix-daemon[837]: reaped child process 975, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 48.180106] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1b worker1 # [ 49.840306] nix-daemon[837]: reaped child process 989, status = succeeded worker1 # [ 50.018652] nix-daemon[837]: accepted connection from pid 1004, user nix-grpc-daemon (trusted) worker1 # [ 50.038018] nix-daemon[837]: reaped child process 1007, status = succeeded lb # [ 50.030224] niks3-server[1011]: 2026/09/20 09:32:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 50.065270] nix-grpc-daemon[846]: time=2026-09-20T09:32:55.710Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 50.070347] nix-grpc-daemon[846]: time=2026-09-20T09:32:55.710Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 50.071636] niks3-server[1011]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 50.087015] niks3-server[1011]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 50.097867] niks3-server[1011]: 2026/09/20 09:32:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker1 # [ 50.124421] nix-grpc-daemon[846]: time=2026-09-20T09:32:55.771Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.105945] niks3-server[1011]: 2026/09/20 09:32:55 INFO Signed narinfos id=8 count=1 lb # [ 50.110620] niks3-server[1011]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 50.118478] niks3-server[1011]: 2026/09/20 09:32:55 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 50.127570] niks3-server[1011]: 2026/09/20 09:32:55 INFO Completed upload id=8 lb # [ 50.130410] niks3-server[1011]: 2026/09/20 09:32:55 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker1 # [ 50.149279] nix-grpc-daemon[846]: time=2026-09-20T09:32:55.796Z level=INFO msg="Upload complete. (358ms)" worker1 # [ 50.161498] nix-grpc-daemon[778]: ts=2026-09-20T09:32:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=2 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker1 # [ 50.181260] nix-daemon[837]: reaped child process 987, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.97 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.62 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 50.729902] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 899eaf41316c457b84b6fe56ff4bb2a1 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.11 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 50.982151] nix[885]: don't know how to build these paths: client # [ 50.984064] nix[885]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 50.973430] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 50.987785] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 50.995619] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 51.033689] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 51.053389] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60318 client # [ 51.076206] nix[885]: copying 1 paths to 'lb:50051'... client # [ 51.078523] nix[885]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 51.068346] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 51.083091] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 51.115842] nix-grpc-daemon[778]: ts=2026-09-20T09:32:56Z level=info event=niks3_push_started pid=894 lb # [ 51.449175] envoy[920]: conn peer=[2001:db8:1::1]:54224 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9540 tx=3880 ms=9043 lb # [ 51.449484] envoy[920]: conn peer=[2001:db8:1::1]:38156 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=73 lb # [ 51.449591] envoy[920]: conn peer=[2001:db8:1::1]:38172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1727 ms=2695 worker2 # [ 51.564235] nix-daemon[840]: accepted connection from pid 907, user nix-grpc-daemon (trusted) worker2 # [ 51.584248] nix-daemon[840]: reaped child process 910, status = succeeded worker2 # [ 51.762590] nix-daemon[840]: accepted connection from pid 912, user nix-grpc-daemon (trusted) worker2 # [ 51.780301] nix-daemon[840]: reaped child process 915, status = succeeded lb # [ 51.789721] niks3-server[1011]: 2026/09/20 09:32:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 51.806174] nix-grpc-daemon[894]: time=2026-09-20T09:32:57.451Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 51.807966] nix-grpc-daemon[894]: time=2026-09-20T09:32:57.451Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 51.824183] niks3-server[1011]: 2026/09/20 09:32:57 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst lb # [ 51.836644] niks3-server[1011]: 2026/09/20 09:32:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker2 # [ 51.849281] nix-grpc-daemon[894]: time=2026-09-20T09:32:57.495Z level=INFO msg="Uploading 1 narinfos" client # [ 51.849369] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. lb # [ 51.847443] niks3-server[1011]: 2026/09/20 09:32:57 INFO Signed narinfos id=9 count=1 client # Running as unit: dedup2.service; invocation ID: 173c4c88bfe241ad91a1dc16592e4eb9 lb # [ 51.856726] niks3-server[1011]: 2026/09/20 09:32:57 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds) lb # [ 51.867851] niks3-server[1011]: 2026/09/20 09:32:57 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 51.877206] niks3-server[1011]: 2026/09/20 09:32:57 INFO Completed upload id=9 worker2 # [ 51.883782] nix-grpc-daemon[894]: time=2026-09-20T09:32:57.529Z level=INFO msg="Upload complete. (504ms)" lb # [ 51.881273] niks3-server[1011]: 2026/09/20 09:32:57 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 51.892305] nix-grpc-daemon[778]: ts=2026-09-20T09:32:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 51.900332] nix-grpc-daemon[778]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 51.913307] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 51.916701] nix-daemon[840]: reaped child process 892, status = succeeded client # [ 51.934180] nix[885]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 51.929612] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 52.182707] nix-grpc-daemon[778]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45680 client # [ 52.182425] nix[900]: don't know how to build these paths: client # [ 52.183494] nix[900]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 52.189138] nix-grpc-daemon[778]: ts=2026-09-20T09:32:57Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 client # [ 52.206726] nix[900]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 52.197715] nix-grpc-daemon[778]: ts=2026-09-20T09:32:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.07 seconds) ??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 client: waiting for success: ! systemctl is-active dedup1 dedup2 ??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 worker2 # [ 56.777428] nix-daemon[840]: reaped child process 919, status = succeeded worker2 # [ 56.967035] nix-daemon[840]: accepted connection from pid 954, user nix-grpc-daemon (trusted) worker2 # [ 56.987203] nix-daemon[840]: reaped child process 957, status = succeeded lb # [ 56.994989] niks3-server[1011]: 2026/09/20 09:33:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 57.012717] nix-grpc-daemon[894]: time=2026-09-20T09:33:02.657Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 57.015884] nix-grpc-daemon[894]: time=2026-09-20T09:33:02.657Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 57.043553] niks3-server[1011]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 57.056889] niks3-server[1011]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 57.072283] nix-grpc-daemon[894]: time=2026-09-20T09:33:02.718Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.069023] niks3-server[1011]: 2026/09/20 09:33:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 57.073382] niks3-server[1011]: 2026/09/20 09:33:02 INFO Signed narinfos id=10 count=1 lb # [ 57.075712] niks3-server[1011]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 57.089366] niks3-server[1011]: 2026/09/20 09:33:02 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 57.095395] niks3-server[1011]: 2026/09/20 09:33:02 INFO Completed upload id=10 worker2 # [ 57.099836] nix-grpc-daemon[894]: time=2026-09-20T09:33:02.747Z level=INFO msg="Upload complete. (353ms)" lb # [ 57.098401] niks3-server[1011]: 2026/09/20 09:33:02 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 57.117038] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 57.134115] nix-grpc-daemon[778]: ts=2026-09-20T09:33:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 57.141455] nix-daemon[840]: reaped child process 917, status = succeeded client # [ 57.182317] systemd[1]: dedup2.service: Deactivated successfully. client # [ 57.186728] systemd[1]: dedup2.service: Consumed 184ms CPU time over 5.337s wall clock time, 31M memory peak, 7.3K incoming IP traffic, 6.4K outgoing IP traffic. client # [ 57.198278] systemd[1]: dedup1.service: Deactivated successfully. client # [ 57.201129] systemd[1]: dedup1.service: Consumed 158ms CPU time over 6.465s wall clock time, 39.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.08 seconds) (finished: subtest: two clients wanting the same drv build it once, in 7.47 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 58.348623] systemd[1]: Started Nix Daemon. client # [ 58.535343] nix-daemon[941]: accepted connection from pid 938, user root (trusted) worker2 # [ 58.738690] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 58.746119] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 58.758815] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 58.769661] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 58.825204] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 58.842503] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 58.859138] nix-grpc-daemon[778]: ts=2026-09-20T09:33:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 58.874867] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 59.085538] nix-daemon[837]: accepted connection from pid 1038, user nix-grpc-daemon (trusted) worker1 # [ 59.103831] nix-daemon[837]: reaped child process 1041, status = succeeded worker1 # [ 59.279260] nix-daemon[837]: accepted connection from pid 1043, user nix-grpc-daemon (trusted) worker1 # [ 59.295752] nix-daemon[837]: reaped child process 1046, status = succeeded lb # [ 59.289824] niks3-server[1011]: 2026/09/20 09:33:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 59.323171] nix-grpc-daemon[846]: time=2026-09-20T09:33:04.969Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 59.324782] nix-grpc-daemon[846]: time=2026-09-20T09:33:04.969Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 59.322456] niks3-server[1011]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst worker1 # [ 59.359172] nix-grpc-daemon[846]: time=2026-09-20T09:33:05.006Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.339438] niks3-server[1011]: 2026/09/20 09:33:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 59.349915] niks3-server[1011]: 2026/09/20 09:33:04 INFO Signed narinfos id=11 count=1 lb # [ 59.358722] niks3-server[1011]: 2026/09/20 09:33:04 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls worker1 # [ 59.386717] nix-grpc-daemon[846]: time=2026-09-20T09:33:05.033Z level=INFO msg="Upload complete. (494ms)" lb # [ 59.365354] niks3-server[1011]: 2026/09/20 09:33:05 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 59.370178] niks3-server[1011]: 2026/09/20 09:33:05 INFO Completed upload id=11 lb # [ 59.373464] niks3-server[1011]: 2026/09/20 09:33:05 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker1 # [ 59.396138] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 59.407575] nix-grpc-daemon[778]: ts=2026-09-20T09:33:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 59.414240] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 59.418713] nix-daemon[837]: reaped child process 1036, status = succeeded worker1 # [ 59.429526] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 60.675419] nix-daemon[837]: reaped child process 1050, status = succeeded worker1 # [ 60.860928] nix-daemon[837]: accepted connection from pid 1065, user nix-grpc-daemon (trusted) worker1 # [ 60.879219] nix-daemon[837]: reaped child process 1068, status = succeeded lb # [ 60.869933] niks3-server[1011]: 2026/09/20 09:33:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 60.904612] nix-grpc-daemon[846]: time=2026-09-20T09:33:06.549Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 60.906465] nix-grpc-daemon[846]: time=2026-09-20T09:33:06.549Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 60.908726] niks3-server[1011]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 60.924510] niks3-server[1011]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 60.937324] niks3-server[1011]: 2026/09/20 09:33:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker1 # [ 60.959860] nix-grpc-daemon[846]: time=2026-09-20T09:33:06.606Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.942570] niks3-server[1011]: 2026/09/20 09:33:06 INFO Signed narinfos id=12 count=1 lb # [ 60.949020] niks3-server[1011]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 60.958498] niks3-server[1011]: 2026/09/20 09:33:06 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 60.965819] niks3-server[1011]: 2026/09/20 09:33:06 INFO Completed upload id=12 worker1 # [ 60.988000] nix-grpc-daemon[846]: time=2026-09-20T09:33:06.635Z level=INFO msg="Upload complete. (345ms)" lb # [ 60.968675] niks3-server[1011]: 2026/09/20 09:33:06 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker1 # [ 61.001248] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker2 # [ 60.987121] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60318 worker1 # [ 61.018627] nix-daemon[837]: reaped child process 1048, status = succeeded worker2 # [ 61.004146] nix-grpc-daemon[778]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 61.101383] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 61.109926] nix-grpc-daemon[778]: ts=2026-09-20T09:33:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 61.357160] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 61.365058] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 61.372812] nix-grpc-daemon[894]: time=2026-09-20T09:33:07.018Z level=INFO msg="All 1 paths already cached" worker2 # [ 61.385630] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker1 # [ 61.405912] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker2 # [ 61.391789] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 61.422116] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 61.437435] nix-grpc-daemon[846]: time=2026-09-20T09:33:07.084Z level=INFO msg="All 1 paths already cached" worker1 # [ 61.447640] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 61.461955] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) lb # [ 61.446639] envoy[920]: conn peer=[2001:db8:1::1]:58642 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1374 ms=6158 lb # [ 61.452266] envoy[920]: conn peer=[2001:db8:1::1]:58654 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=4971 lb # [ 61.457584] envoy[920]: conn peer=[2001:db8:1::1]:58668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3414 tx=1747 ms=2377 lb # [ 61.463185] envoy[920]: conn peer=[2001:db8:1::1]:49486 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=334 ms=35 worker1 # [ 61.691917] nix-daemon[837]: accepted connection from pid 1072, user nix-grpc-daemon (trusted) worker1 # [ 61.713208] nix-daemon[837]: reaped child process 1075, status = succeeded worker1 # [ 61.892218] nix-daemon[837]: accepted connection from pid 1077, user nix-grpc-daemon (trusted) worker1 # [ 61.910841] nix-daemon[837]: reaped child process 1080, status = succeeded lb # [ 61.903584] niks3-server[1011]: 2026/09/20 09:33:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 61.935297] nix-grpc-daemon[846]: time=2026-09-20T09:33:07.581Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 61.937012] nix-grpc-daemon[846]: time=2026-09-20T09:33:07.581Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 61.932894] niks3-server[1011]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker1 # [ 61.969040] nix-grpc-daemon[846]: time=2026-09-20T09:33:07.616Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.950142] niks3-server[1011]: 2026/09/20 09:33:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 61.960523] niks3-server[1011]: 2026/09/20 09:33:07 INFO Signed narinfos id=13 count=1 lb # [ 61.966029] niks3-server[1011]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 61.974833] niks3-server[1011]: 2026/09/20 09:33:07 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 61.980129] niks3-server[1011]: 2026/09/20 09:33:07 INFO Completed upload id=13 worker1 # [ 62.001560] nix-grpc-daemon[846]: time=2026-09-20T09:33:07.648Z level=INFO msg="Upload complete. (522ms)" lb # [ 61.982885] niks3-server[1011]: 2026/09/20 09:33:07 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker1 # [ 62.013196] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 62.024241] nix-grpc-daemon[778]: ts=2026-09-20T09:33:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 62.031024] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 62.035706] nix-daemon[837]: reaped child process 1070, status = succeeded worker1 # [ 62.049303] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 63.697317] nix-daemon[837]: reaped child process 1084, status = succeeded worker1 # [ 63.876545] nix-daemon[837]: accepted connection from pid 1099, user nix-grpc-daemon (trusted) worker1 # [ 63.896528] nix-daemon[837]: reaped child process 1102, status = succeeded lb # [ 63.886916] niks3-server[1011]: 2026/09/20 09:33:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 63.919664] nix-grpc-daemon[846]: time=2026-09-20T09:33:09.565Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 63.921411] nix-grpc-daemon[846]: time=2026-09-20T09:33:09.565Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 63.922541] niks3-server[1011]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 63.941395] niks3-server[1011]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker1 # [ 63.977101] nix-grpc-daemon[846]: time=2026-09-20T09:33:09.624Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.950482] niks3-server[1011]: 2026/09/20 09:33:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 63.959812] niks3-server[1011]: 2026/09/20 09:33:09 INFO Signed narinfos id=14 count=1 lb # [ 63.965110] niks3-server[1011]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 63.972253] niks3-server[1011]: 2026/09/20 09:33:09 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 63.977839] niks3-server[1011]: 2026/09/20 09:33:09 INFO Completed upload id=14 worker1 # [ 63.999895] nix-grpc-daemon[846]: time=2026-09-20T09:33:09.646Z level=INFO msg="Upload complete. (339ms)" lb # [ 63.980279] niks3-server[1011]: 2026/09/20 09:33:09 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker1 # [ 64.014828] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker1 # [ 64.028395] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 64.032884] nix-daemon[837]: reaped child process 1082, status = succeeded worker2 # [ 64.021895] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 64.035307] nix-grpc-daemon[778]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker2 # [ 64.054800] nix-grpc-daemon[778]: ts=2026-09-20T09:33:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 64.382733] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:45680 worker2 # [ 64.370081] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 64.381271] nix-grpc-daemon[894]: time=2026-09-20T09:33:10.027Z level=INFO msg="All 2 paths already cached" worker2 # [ 64.399810] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 64.406285] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 64.426317] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 64.442553] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 64.457403] nix-grpc-daemon[846]: time=2026-09-20T09:33:10.104Z level=INFO msg="All 2 paths already cached" worker1 # [ 64.467562] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 64.482263] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 64.693748] nix-daemon[837]: accepted connection from pid 1106, user nix-grpc-daemon (trusted) worker1 # [ 64.713565] nix-daemon[837]: reaped child process 1109, status = succeeded worker1 # [ 64.891123] nix-daemon[837]: accepted connection from pid 1111, user nix-grpc-daemon (trusted) worker1 # [ 64.909275] nix-daemon[837]: reaped child process 1114, status = succeeded lb # [ 64.901879] niks3-server[1011]: 2026/09/20 09:33:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 64.933873] nix-grpc-daemon[846]: time=2026-09-20T09:33:10.580Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 64.935360] nix-grpc-daemon[846]: time=2026-09-20T09:33:10.580Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 64.935784] niks3-server[1011]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker1 # [ 64.967925] nix-grpc-daemon[846]: time=2026-09-20T09:33:10.615Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.950689] niks3-server[1011]: 2026/09/20 09:33:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 64.961243] niks3-server[1011]: 2026/09/20 09:33:10 INFO Signed narinfos id=15 count=1 lb # [ 64.963762] niks3-server[1011]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 64.974621] niks3-server[1011]: 2026/09/20 09:33:10 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete worker1 # [ 65.000795] nix-grpc-daemon[846]: time=2026-09-20T09:33:10.648Z level=INFO msg="Upload complete. (500ms)" lb # [ 64.979407] niks3-server[1011]: 2026/09/20 09:33:10 INFO Completed upload id=15 lb # [ 64.982184] niks3-server[1011]: 2026/09/20 09:33:10 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker1 # [ 65.008214] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 65.023193] nix-grpc-daemon[778]: ts=2026-09-20T09:33:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 65.029827] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 65.034729] nix-daemon[837]: reaped child process 1104, status = succeeded worker1 # [ 65.046121] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 66.486071] nix-daemon[837]: reaped child process 1118, status = succeeded worker1 # [ 66.658490] nix-daemon[837]: accepted connection from pid 1133, user nix-grpc-daemon (trusted) worker1 # [ 66.679157] nix-daemon[837]: reaped child process 1136, status = succeeded lb # [ 66.671550] niks3-server[1011]: 2026/09/20 09:33:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 66.711409] nix-grpc-daemon[846]: time=2026-09-20T09:33:12.355Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 66.713149] nix-grpc-daemon[846]: time=2026-09-20T09:33:12.355Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 66.716351] niks3-server[1011]: 2026/09/20 09:33:12 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 66.723199] niks3-server[1011]: 2026/09/20 09:33:12 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst worker1 # [ 66.752774] nix-grpc-daemon[846]: time=2026-09-20T09:33:12.399Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.732526] niks3-server[1011]: 2026/09/20 09:33:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 66.734890] niks3-server[1011]: 2026/09/20 09:33:12 INFO Signed narinfos id=16 count=1 lb # [ 66.741445] niks3-server[1011]: 2026/09/20 09:33:12 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 66.747926] niks3-server[1011]: 2026/09/20 09:33:12 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete worker1 # [ 66.773960] nix-grpc-daemon[846]: time=2026-09-20T09:33:12.421Z level=INFO msg="Upload complete. (314ms)" lb # [ 66.753963] niks3-server[1011]: 2026/09/20 09:33:12 INFO Completed upload id=16 lb # [ 66.757390] niks3-server[1011]: 2026/09/20 09:33:12 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 66.784991] nix-grpc-daemon[778]: ts=2026-09-20T09:33:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker2 # [ 66.771531] nix-grpc-daemon[778]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60318 worker1 # [ 66.797974] nix-daemon[837]: reaped child process 1116, status = succeeded worker2 # [ 66.785095] nix-grpc-daemon[778]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker2 # [ 66.827904] nix-grpc-daemon[778]: ts=2026-09-20T09:33:12Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 66.833171] nix-grpc-daemon[778]: ts=2026-09-20T09:33:12Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=1 nar_bytes_out=232 client # [ 66.974164] nix-daemon[941]: reaped child process 943, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.87 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 9.00 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.45 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 68.279749] nix-daemon[941]: accepted connection from pid 1021, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker1 # [ 68.491050] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:45680 client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 68.499164] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 68.697733] nix-daemon[837]: accepted connection from pid 1143, user nix-grpc-daemon (trusted) worker1 # [ 68.715470] nix-daemon[837]: reaped child process 1146, status = succeeded lb # [ 68.705911] niks3-server[1011]: 2026/09/20 09:33:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 68.737840] nix-grpc-daemon[846]: time=2026-09-20T09:33:14.384Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 68.739343] nix-grpc-daemon[846]: time=2026-09-20T09:33:14.384Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 68.734855] niks3-server[1011]: 2026/09/20 09:33:14 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 68.750428] niks3-server[1011]: 2026/09/20 09:33:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 68.778635] nix-grpc-daemon[846]: time=2026-09-20T09:33:14.425Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.763626] niks3-server[1011]: 2026/09/20 09:33:14 INFO Signed narinfos id=17 count=1 lb # [ 68.769644] niks3-server[1011]: 2026/09/20 09:33:14 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 68.777682] niks3-server[1011]: 2026/09/20 09:33:14 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 68.783265] niks3-server[1011]: 2026/09/20 09:33:14 INFO Completed upload id=17 worker1 # [ 68.804502] nix-grpc-daemon[846]: time=2026-09-20T09:33:14.451Z level=INFO msg="Upload complete. (306ms)" lb # [ 68.785523] niks3-server[1011]: 2026/09/20 09:33:14 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker2 # [ 68.815987] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 68.816484] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 68.862679] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 68.879241] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60318 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 68.899288] nix-grpc-daemon[778]: ts=2026-09-20T09:33:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60318 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 68.915517] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 69.132180] nix-daemon[840]: accepted connection from pid 986, user nix-grpc-daemon (trusted) worker2 # [ 69.150935] nix-daemon[840]: reaped child process 989, status = succeeded worker2 # [ 69.322355] nix-daemon[840]: accepted connection from pid 991, user nix-grpc-daemon (trusted) worker2 # [ 69.340392] nix-daemon[840]: reaped child process 994, status = succeeded lb # [ 69.345899] niks3-server[1011]: 2026/09/20 09:33:14 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 69.356381] niks3-server[1011]: 2026/09/20 09:33:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 69.372062] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.018Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 69.373612] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.018Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" worker2 # [ 69.375344] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.018Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" lb # [ 69.399178] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 69.414078] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 69.422950] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls worker2 # [ 69.437282] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.083Z level=INFO msg="Uploading 3 narinfos" lb # [ 69.433593] niks3-server[1011]: 2026/09/20 09:33:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 69.440148] niks3-server[1011]: 2026/09/20 09:33:15 INFO Signed narinfos id=19 count=2 lb # [ 69.442081] niks3-server[1011]: 2026/09/20 09:33:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 69.450852] niks3-server[1011]: 2026/09/20 09:33:15 INFO Signed narinfos id=18 count=1 lb # [ 69.455184] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 69.462991] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 69.472362] niks3-server[1011]: 2026/09/20 09:33:15 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 69.480847] niks3-server[1011]: 2026/09/20 09:33:15 INFO Completed upload id=18 lb # [ 69.483350] niks3-server[1011]: 2026/09/20 09:33:15 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete worker2 # [ 69.497242] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.144Z level=INFO msg="Upload complete. (561ms)" lb # [ 69.491632] niks3-server[1011]: 2026/09/20 09:33:15 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 69.496318] niks3-server[1011]: 2026/09/20 09:33:15 INFO Completed upload id=19 worker2 # [ 69.508389] nix-grpc-daemon[778]: ts=2026-09-20T09:33:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=2 nar_bytes_in=984 worker2 # [ 69.524641] nix-grpc-daemon[894]: time=2026-09-20T09:33:15.153Z level=WARN msg="Failed to register uploaded object" key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 69.539890] nix-grpc-daemon[778]: ts=2026-09-20T09:33:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 69.548181] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 69.550188] nix-daemon[840]: reaped child process 984, status = succeeded worker2 # [ 69.558839] nix-grpc-daemon[778]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker2 # [ 69.576258] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 71.209621] nix-daemon[840]: reaped child process 999, status = succeeded worker2 # [ 71.379493] nix-daemon[840]: accepted connection from pid 1014, user nix-grpc-daemon (trusted) worker2 # [ 71.400331] nix-daemon[840]: reaped child process 1017, status = succeeded lb # [ 71.410411] niks3-server[1011]: 2026/09/20 09:33:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.435997] nix-grpc-daemon[894]: time=2026-09-20T09:33:17.082Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 71.446631] envoy[920]: conn peer=[2001:db8:1::1]:49490 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3900 tx=1876 ms=2757 lb # [ 71.459915] envoy[920]: conn peer=[2001:db8:1::1]:49498 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=98 worker2 # [ 71.479661] nix-grpc-daemon[894]: time=2026-09-20T09:33:17.126Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.477030] envoy[920]: conn peer=[2001:db8:1::1]:49506 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4352 tx=2223 ms=2522 lb # [ 71.484839] envoy[920]: conn peer=[2001:db8:1::1]:49508 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=65 lb # [ 71.494525] niks3-server[1011]: 2026/09/20 09:33:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 71.501515] niks3-server[1011]: 2026/09/20 09:33:17 INFO Signed narinfos id=20 count=1 lb # [ 71.507351] niks3-server[1011]: 2026/09/20 09:33:17 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 71.513157] niks3-server[1011]: 2026/09/20 09:33:17 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 71.517668] niks3-server[1011]: 2026/09/20 09:33:17 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 71.522235] niks3-server[1011]: 2026/09/20 09:33:17 INFO Completed upload id=20 worker2 # [ 71.517840] nix-grpc-daemon[894]: time=2026-09-20T09:33:17.164Z level=INFO msg="Upload complete. (325ms)" lb # [ 71.525148] niks3-server[1011]: 2026/09/20 09:33:17 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker2 # [ 71.532306] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=2 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker2 # [ 71.551060] nix-daemon[840]: reaped child process 996, status = succeeded client # copying 1 paths... worker2 # [ 71.580185] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60318 client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 71.632663] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 71.654410] nix-grpc-daemon[778]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... worker1 # [ 71.678199] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_out=120 client # [ 71.810028] nix-daemon[941]: reaped child process 1024, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.76 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 72.029138] nix-daemon[941]: accepted connection from pid 1041, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 72.230835] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:60318 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 72.239186] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 72.246488] nix-grpc-daemon[894]: time=2026-09-20T09:33:17.892Z level=INFO msg="All 1 paths already cached" worker2 # [ 72.259833] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker1 # [ 72.281322] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker2 # [ 72.266987] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 72.298004] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45680 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 72.322693] nix-grpc-daemon[778]: ts=2026-09-20T09:33:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 72.338762] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 72.364103] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 86 ms (attempt 1/5) worker1 # [ 72.457047] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 2/5) worker1 # [ 72.480361] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 244 ms (attempt 3/5) worker1 # [ 72.733051] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 4/5) worker1 # [ 72.787990] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 72.799112] nix-grpc-daemon[778]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 73.049356] nix-daemon[837]: accepted connection from pid 1155, user nix-grpc-daemon (trusted) worker1 # [ 73.068985] nix-daemon[837]: reaped child process 1158, status = succeeded worker1 # [ 73.256910] nix-daemon[837]: accepted connection from pid 1160, user nix-grpc-daemon (trusted) worker1 # [ 73.275806] nix-daemon[837]: reaped child process 1163, status = succeeded lb # [ 73.266580] niks3-server[1011]: 2026/09/20 09:33:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 73.300092] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.946Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 73.301677] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.946Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 73.297260] niks3-server[1011]: 2026/09/20 09:33:18 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst lb # [ 73.315426] niks3-server[1011]: 2026/09/20 09:33:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker1 # [ 73.343524] nix-grpc-daemon[846]: time=2026-09-20T09:33:18.990Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.329749] niks3-server[1011]: 2026/09/20 09:33:18 INFO Signed narinfos id=21 count=1 lb # [ 73.336729] niks3-server[1011]: 2026/09/20 09:33:18 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 73.350712] niks3-server[1011]: 2026/09/20 09:33:18 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 73.356677] niks3-server[1011]: 2026/09/20 09:33:19 INFO Completed upload id=21 worker1 # [ 73.378848] nix-grpc-daemon[846]: time=2026-09-20T09:33:19.026Z level=INFO msg="Upload complete. (544ms)" lb # [ 73.359661] niks3-server[1011]: 2026/09/20 09:33:19 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker1 # [ 73.388351] nix-grpc-daemon[778]: ts=2026-09-20T09:33:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 paths=1 nar_bytes_in=568 worker1 # [ 73.400373] nix-grpc-daemon[778]: ts=2026-09-20T09:33:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 73.419127] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker1 # [ 73.422920] nix-daemon[837]: reaped child process 1149, status = succeeded client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 73.437850] nix-daemon[837]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 74.874838] nix-daemon[837]: reaped child process 1167, status = succeeded worker1 # [ 75.054192] nix-daemon[837]: accepted connection from pid 1182, user nix-grpc-daemon (trusted) worker1 # [ 75.074334] nix-daemon[837]: reaped child process 1185, status = succeeded lb # [ 75.066614] niks3-server[1011]: 2026/09/20 09:33:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 75.097534] nix-grpc-daemon[846]: time=2026-09-20T09:33:20.743Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 75.095625] niks3-server[1011]: 2026/09/20 09:33:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker1 # [ 75.126510] nix-grpc-daemon[846]: time=2026-09-20T09:33:20.773Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.111816] niks3-server[1011]: 2026/09/20 09:33:20 INFO Signed narinfos id=22 count=1 lb # [ 75.119301] niks3-server[1011]: 2026/09/20 09:33:20 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 75.125601] niks3-server[1011]: 2026/09/20 09:33:20 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 75.133213] niks3-server[1011]: 2026/09/20 09:33:20 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete worker1 # [ 75.161123] nix-grpc-daemon[846]: time=2026-09-20T09:33:20.808Z level=INFO msg="Upload complete. (310ms)" lb # [ 75.139799] niks3-server[1011]: 2026/09/20 09:33:20 INFO Completed upload id=22 lb # [ 75.142163] niks3-server[1011]: 2026/09/20 09:33:20 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker1 # [ 75.168924] nix-grpc-daemon[778]: ts=2026-09-20T09:33:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker1 # [ 75.183709] nix-daemon[837]: reaped child process 1165, status = succeeded client # copying 1 paths... worker1 # [ 75.221235] nix-grpc-daemon[778]: ts=2026-09-20T09:33:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:45680 client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 75.247369] nix-grpc-daemon[778]: ts=2026-09-20T09:33:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 75.262278] nix-grpc-daemon[778]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... worker2 # [ 75.284231] nix-grpc-daemon[778]: ts=2026-09-20T09:33:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=1 nar_bytes_out=120 client # [ 75.433459] nix-daemon[941]: reaped child process 1044, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.62 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 75.654346] nix-daemon[941]: accepted connection from pid 1062, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 75.865488] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:45680 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 75.873662] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 75.881012] nix-grpc-daemon[846]: time=2026-09-20T09:33:21.526Z level=INFO msg="All 1 paths already cached" worker2 # [ 75.878638] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 75.886723] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 75.897819] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 75.910801] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 75.928713] nix-grpc-daemon[894]: time=2026-09-20T09:33:21.574Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 75.940639] nix-grpc-daemon[778]: ts=2026-09-20T09:33:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 75.959629] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 76.166920] nix-daemon[840]: accepted connection from pid 1026, user nix-grpc-daemon (trusted) worker2 # [ 76.189495] nix-daemon[840]: reaped child process 1029, status = succeeded worker2 # [ 76.369115] nix-daemon[840]: accepted connection from pid 1031, user nix-grpc-daemon (trusted) worker2 # [ 76.388310] nix-daemon[840]: reaped child process 1034, status = succeeded lb # [ 76.397574] niks3-server[1011]: 2026/09/20 09:33:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 76.413958] nix-grpc-daemon[894]: time=2026-09-20T09:33:22.060Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 76.415565] nix-grpc-daemon[894]: time=2026-09-20T09:33:22.060Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 76.432066] niks3-server[1011]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst worker2 # [ 76.452122] nix-grpc-daemon[894]: time=2026-09-20T09:33:22.099Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.448282] niks3-server[1011]: 2026/09/20 09:33:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 76.459417] niks3-server[1011]: 2026/09/20 09:33:22 INFO Signed narinfos id=23 count=1 lb # [ 76.464669] niks3-server[1011]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 76.476218] niks3-server[1011]: 2026/09/20 09:33:22 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 76.478952] niks3-server[1011]: 2026/09/20 09:33:22 INFO Completed upload id=23 lb # [ 76.482024] niks3-server[1011]: 2026/09/20 09:33:22 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker2 # [ 76.481467] nix-grpc-daemon[894]: time=2026-09-20T09:33:22.128Z level=INFO msg="Upload complete. (503ms)" worker2 # [ 76.494188] nix-grpc-daemon[778]: ts=2026-09-20T09:33:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=0 paths=1 nar_bytes_in=568 worker2 # [ 76.508295] nix-grpc-daemon[778]: ts=2026-09-20T09:33:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 worker2 # [ 76.514551] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 76.519831] nix-daemon[840]: reaped child process 1024, status = succeeded worker2 # [ 76.531508] nix-daemon[840]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 77.993260] nix-daemon[840]: reaped child process 1038, status = succeeded worker2 # [ 78.178827] nix-daemon[840]: accepted connection from pid 1053, user nix-grpc-daemon (trusted) worker2 # [ 78.197840] nix-daemon[840]: reaped child process 1056, status = succeeded lb # [ 78.206767] niks3-server[1011]: 2026/09/20 09:33:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 78.224255] nix-grpc-daemon[894]: time=2026-09-20T09:33:23.869Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 78.239621] niks3-server[1011]: 2026/09/20 09:33:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker2 # [ 78.257351] nix-grpc-daemon[894]: time=2026-09-20T09:33:23.904Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.257519] niks3-server[1011]: 2026/09/20 09:33:23 INFO Signed narinfos id=24 count=1 lb # [ 78.263104] niks3-server[1011]: 2026/09/20 09:33:23 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 78.270789] niks3-server[1011]: 2026/09/20 09:33:23 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 78.278587] niks3-server[1011]: 2026/09/20 09:33:23 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 78.283876] niks3-server[1011]: 2026/09/20 09:33:23 INFO Completed upload id=24 worker2 # [ 78.288580] nix-grpc-daemon[894]: time=2026-09-20T09:33:23.935Z level=INFO msg="Upload complete. (334ms)" lb # [ 78.286754] niks3-server[1011]: 2026/09/20 09:33:23 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker2 # [ 78.301187] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60318 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker2 # [ 78.316525] nix-daemon[840]: reaped child process 1036, status = succeeded client # copying 1 paths... worker2 # [ 78.347959] nix-grpc-daemon[778]: ts=2026-09-20T09:33:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60318 client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 78.402176] nix-grpc-daemon[778]: ts=2026-09-20T09:33:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 78.418162] nix-grpc-daemon[778]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... worker1 # [ 78.439517] nix-grpc-daemon[778]: ts=2026-09-20T09:33:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:45680 duration_s=0 paths=1 nar_bytes_out=120 client # [ 78.566060] nix-daemon[941]: reaped child process 1065, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.14 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 11.46 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.48 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.46 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds) worker2 # [ 80.044255] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 80.802707] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=signal_exit worker2 # [ 81.059772] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_yield lb # [ 81.059092] niks3-server[1011]: 2026/09/20 09:33:26 INFO lead: released remote=192.168.1.4:35474 worker2 # [ 81.065783] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 81.071295] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60304 worker2 # [ 81.076230] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 81.097103] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 81.082399] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60304 worker2 # [ 81.087166] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 81.266995] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.272666] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.296624] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.302050] nix-grpc-daemon[778]: ts=2026-09-20T09:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 81.445505] envoy[920]: conn peer=[2001:db8:1::1]:49522 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3862 tx=1787 ms=3251 lb # [ 81.450786] envoy[920]: conn peer=[2001:db8:1::1]:58716 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=118 lb # [ 81.455798] envoy[920]: conn peer=[2001:db8:1::1]:58724 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3722 tx=1804 ms=3115 lb # [ 81.460981] envoy[920]: conn peer=[2001:db8:1::1]:58734 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=106 lb # [ 81.465857] envoy[920]: conn peer=[2001:db8:1::1]:58760 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=103 worker2 # [ 81.473808] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:50051 lb # [ 81.472754] envoy[920]: conn peer=[2001:db8:1::1]:58746 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3723 tx=1805 ms=2636 worker2 # [ 81.479362] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.503416] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.509688] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.680344] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.685767] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.710267] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.716382] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.889290] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.893703] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.917852] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.924402] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.061735] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_restarting worker1 # [ 82.127689] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.132691] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.118706] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 82.131827] nix-daemon[840]: reaped child process 842, status = succeeded worker2 # [ 82.176701] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 82.178890] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 82.186396] systemd[1]: nix-grpc-daemon.service: Consumed 1.927s CPU time over 1min 715ms wall clock time, 54.9M memory peak, 52.1K incoming IP traffic, 94.9K outgoing IP traffic. worker2 # [ 82.193653] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 82.195252] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 82.200622] systemd[1]: nix-grpc-daemon.socket: Consumed 615us CPU time over 1min 11.484s wall clock time, 256K memory peak, 77K incoming IP traffic, 68.8K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 82.327970] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.333076] nix-grpc-daemon[778]: ts=2026-09-20T09:33:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.533729] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.538941] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.550174] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45680 worker1 # [ 82.558626] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:45680 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.28 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 82.691194] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 82.740381] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.752232] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.798282] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 82.826554] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=signal_exit worker1 # [ 82.949974] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.955143] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.981939] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 83.157866] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.162021] nix-grpc-daemon[778]: ts=2026-09-20T09:33:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.200173] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 83.202662] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 83.211329] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 83.222078] niks3-server[1011]: 2026/09/20 09:33:28 INFO lead: acquired remote=192.168.1.4:42708 worker2 # [ 83.234348] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 83.235569] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=scheduler_take_over worker2 # [ 83.257493] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.261117] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 83.358379] nix-grpc-daemon[778]: ts=2026-09-20T09:33:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.343395] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 84.077242] nix-grpc-daemon[778]: ts=2026-09-20T09:33:29Z level=info event=scheduler_restarting worker2 # [ 84.072228] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:29Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50148 worker2 # [ 84.072685] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:29Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 84.120534] nix-grpc-daemon[778]: ts=2026-09-20T09:33:29Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 84.139609] nix-daemon[837]: reaped child process 839, status = succeeded worker1 # [ 84.984096] nix-grpc-daemon[778]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 84.984384] nix-grpc-daemon[778]: E0000 00:00:1789896810.629743 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 84.984574] nix-grpc-daemon[778]: E0000 00:00:1789896810.630138 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 86.105992] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 86.109973] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 86.115379] systemd[1]: nix-grpc-daemon.service: Consumed 3.716s CPU time over 1min 4.630s wall clock time, 58.4M memory peak, 84.3K incoming IP traffic, 154.3K outgoing IP traffic. worker1 # [ 86.133397] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 86.135422] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 86.137275] systemd[1]: nix-grpc-daemon.socket: Consumed 592us CPU time over 1min 15.446s wall clock time, 256K memory peak, 77.3K incoming IP traffic, 63.8K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 86.461044] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:50162 worker2 # [ 86.476568] nix-daemon[840]: accepted connection from pid 1077, user nix-grpc-daemon (trusted) worker2 # [ 86.506167] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5) worker2 # [ 86.556073] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 2/5) worker2 # [ 86.599416] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 114 ms (attempt 3/5) worker2 # [ 86.721246] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 412 ms (attempt 4/5) worker2 # [ 87.134370] nix-grpc-daemon[1077]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 87.163357] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50162 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 87.177623] nix-daemon[840]: accepted connection from pid 1077, user nix-grpc-daemon (trusted) worker2 # [ 87.211144] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:32Z level=info event=niks3_push_started pid=1133 worker2 # [ 87.603622] nix-daemon[840]: accepted connection from pid 1146, user nix-grpc-daemon (trusted) worker2 # [ 87.621246] nix-daemon[840]: reaped child process 1149, status = succeeded lb # [ 87.630871] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 87.641031] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 87.656464] nix-grpc-daemon[1133]: time=2026-09-20T09:33:33.301Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 87.657973] nix-grpc-daemon[1133]: time=2026-09-20T09:33:33.301Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 87.659705] nix-grpc-daemon[1133]: time=2026-09-20T09:33:33.302Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 87.688936] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 87.703280] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst worker2 # [ 87.724130] nix-grpc-daemon[1133]: time=2026-09-20T09:33:33.370Z level=INFO msg="Uploading 3 narinfos" lb # [ 87.719774] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 87.723727] niks3-server[1011]: 2026/09/20 09:33:33 INFO Signed narinfos id=25 count=1 lb # [ 87.734795] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 87.740762] niks3-server[1011]: 2026/09/20 09:33:33 INFO Signed narinfos id=26 count=2 lb # [ 87.742561] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 87.751037] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 87.760727] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 87.774834] niks3-server[1011]: 2026/09/20 09:33:33 INFO Completed upload id=25 lb # [ 87.778268] niks3-server[1011]: 2026/09/20 09:33:33 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 87.784626] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 87.786692] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 87.790950] niks3-server[1011]: 2026/09/20 09:33:33 INFO Completed upload id=26 worker2 # [ 87.796480] nix-grpc-daemon[1133]: time=2026-09-20T09:33:33.443Z level=INFO msg="Upload complete. (365ms)" lb # [ 87.795987] niks3-server[1011]: 2026/09/20 09:33:33 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo worker2 # [ 87.809213] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50162 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 87.825806] nix-daemon[840]: reaped child process 1131, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.64 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds) worker1 # [ 87.982878] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 87.993260] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 88.196966] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:33Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 88.199743] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:33Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 88.208079] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:33Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 88.224207] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 88.262509] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.248404] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:33Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.74 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 88.582525] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 89.223082] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:34Z level=info event=signal_exit worker2 # [ 89.430726] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_yield worker1 # [ 89.453427] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 89.432249] niks3-server[1011]: 2026/09/20 09:33:35 INFO lead: released remote=192.168.1.4:42708 worker2 # [ 89.437601] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50148 worker2 # [ 89.444240] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 89.448308] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 89.452269] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:50148 worker2 # [ 89.456672] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 89.653073] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.638822] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.658954] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.644253] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.859508] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.845006] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.865111] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.850194] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.065946] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.051029] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.071345] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.056364] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.272406] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.259505] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.278351] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.265507] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.436271] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:36Z level=info event=scheduler_restarting worker1 # [ 90.480633] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.486690] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.485482] nix-daemon[840]: reaped child process 1126, status = succeeded worker2 # [ 90.488397] nix-grpc-daemon[1077]: ts=2026-09-20T09:33:36Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 90.686912] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.692658] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.893604] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.898905] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.099823] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.105433] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.256599] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 91.261162] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 91.263605] systemd[1]: nix-grpc-daemon.service: Consumed 491ms CPU time over 8.268s wall clock time, 33.5M memory peak, 17.5K incoming IP traffic, 22K outgoing IP traffic. worker2 # [ 91.280402] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 91.283058] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 91.305978] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.288754] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 8.601s wall clock time, 256K memory peak, 19.9K incoming IP traffic, 15.3K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 91.311340] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 91.447689] envoy[920]: conn peer=[2001:db8:1::4]:34642 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6094 tx=1799 ms=60272 lb # [ 91.452900] envoy[920]: conn peer=[2001:db8:1::1]:43882 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=28 lb # [ 91.457618] envoy[920]: conn peer=[2001:db8:1::3]:37996 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8140 tx=2373 ms=62262 lb # [ 91.462607] envoy[920]: conn peer=[2001:db8:1::1]:43898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=304 ms=1365 lb # [ 91.467326] envoy[920]: conn peer=[2001:db8:1::4]:39000 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1003 tx=349 ms=7217 worker1 # [ 91.514265] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.518601] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.715152] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.720677] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.921622] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.926864] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.127710] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.133086] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.333824] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.339059] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.541999] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.546358] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.743011] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.748688] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.949531] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.954925] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.155973] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.161597] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.225842] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:38Z level=info event=scheduler_take_over lb # [ 93.204784] niks3-server[1011]: 2026/09/20 09:33:38 INFO lead: acquired remote=192.168.1.3:58346 worker1 # [ 93.362354] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.371834] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 2.24 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker1 # [ 93.864847] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 93.878191] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 93.900480] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 93.916463] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 1/5) worker1 # [ 93.992340] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 154 ms (attempt 2/5) worker1 # [ 94.146795] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 93 ms (attempt 3/5) worker1 # [ 94.247493] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 272 ms (attempt 4/5) worker1 # [ 94.527785] nix-grpc-daemon[1209]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 94.562103] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 94.569853] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 94.611592] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 94.627905] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43676 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 94.643287] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 94.657876] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) worker1 # [ 94.684831] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:40Z level=info event=niks3_push_started pid=1290 worker1 # [ 95.070178] nix-daemon[837]: accepted connection from pid 1303, user nix-grpc-daemon (trusted) worker1 # [ 95.090858] nix-daemon[837]: reaped child process 1306, status = succeeded worker1 # [ 95.269032] nix-daemon[837]: accepted connection from pid 1308, user nix-grpc-daemon (trusted) worker1 # [ 95.288917] nix-daemon[837]: reaped child process 1311, status = succeeded lb # [ 95.279656] niks3-server[1011]: 2026/09/20 09:33:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 95.314577] nix-grpc-daemon[1290]: time=2026-09-20T09:33:40.959Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 95.316291] nix-grpc-daemon[1290]: time=2026-09-20T09:33:40.959Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 95.315362] niks3-server[1011]: 2026/09/20 09:33:40 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 95.328305] niks3-server[1011]: 2026/09/20 09:33:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker1 # [ 95.357441] nix-grpc-daemon[1290]: time=2026-09-20T09:33:41.004Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.340922] niks3-server[1011]: 2026/09/20 09:33:40 INFO Signed narinfos id=27 count=1 lb # [ 95.347895] niks3-server[1011]: 2026/09/20 09:33:40 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 95.358364] niks3-server[1011]: 2026/09/20 09:33:41 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 95.367333] niks3-server[1011]: 2026/09/20 09:33:41 INFO Completed upload id=27 worker1 # [ 95.389709] nix-grpc-daemon[1290]: time=2026-09-20T09:33:41.036Z level=INFO msg="Upload complete. (490ms)" lb # [ 95.370333] niks3-server[1011]: 2026/09/20 09:33:41 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker1 # [ 95.401404] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 95.413748] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 95.419706] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) worker1 # [ 95.424639] nix-daemon[837]: reaped child process 1288, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker1 # [ 95.437327] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-on-standby worker1 # [ 96.663476] nix-daemon[837]: reaped child process 1315, status = succeeded worker1 # [ 96.831387] nix-daemon[837]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 96.848705] nix-daemon[837]: reaped child process 1333, status = succeeded lb # [ 96.840942] niks3-server[1011]: 2026/09/20 09:33:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 96.880424] nix-grpc-daemon[1290]: time=2026-09-20T09:33:42.525Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 96.881905] nix-grpc-daemon[1290]: time=2026-09-20T09:33:42.526Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 96.901029] niks3-server[1011]: 2026/09/20 09:33:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker1 # [ 96.931874] nix-grpc-daemon[1290]: time=2026-09-20T09:33:42.577Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.909089] niks3-server[1011]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 96.921516] niks3-server[1011]: 2026/09/20 09:33:42 INFO Signed narinfos id=28 count=1 lb # [ 96.923728] niks3-server[1011]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker1 # [ 96.963979] nix-grpc-daemon[1290]: time=2026-09-20T09:33:42.611Z level=INFO msg="Upload complete. (316ms)" lb # [ 96.943499] niks3-server[1011]: 2026/09/20 09:33:42 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 96.949060] niks3-server[1011]: 2026/09/20 09:33:42 INFO Completed upload id=28 lb # [ 96.951779] niks3-server[1011]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo lb # [ 96.959030] niks3-server[1011]: 2026/09/20 09:33:42 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls worker1 # [ 96.986521] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 96.999962] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 97.003311] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 97.006903] nix-daemon[837]: reaped child process 1313, status = succeeded worker1 # [ 97.030821] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 97.045544] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 97.062591] nix-grpc-daemon[1290]: time=2026-09-20T09:33:42.709Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 97.073626] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 97.087703] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) worker1 # [ 97.296486] nix-daemon[837]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker1 # [ 97.314376] nix-daemon[837]: reaped child process 1342, status = succeeded worker1 # [ 97.492090] nix-daemon[837]: accepted connection from pid 1344, user nix-grpc-daemon (trusted) worker1 # [ 97.509314] nix-daemon[837]: reaped child process 1347, status = succeeded lb # [ 97.500662] niks3-server[1011]: 2026/09/20 09:33:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.537485] nix-grpc-daemon[1290]: time=2026-09-20T09:33:43.184Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 97.539020] nix-grpc-daemon[1290]: time=2026-09-20T09:33:43.184Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 97.536405] niks3-server[1011]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 97.549825] niks3-server[1011]: 2026/09/20 09:33:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign worker1 # [ 97.578080] nix-grpc-daemon[1290]: time=2026-09-20T09:33:43.225Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.561895] niks3-server[1011]: 2026/09/20 09:33:43 INFO Signed narinfos id=29 count=1 lb # [ 97.566857] niks3-server[1011]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 97.577027] niks3-server[1011]: 2026/09/20 09:33:43 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 97.581107] niks3-server[1011]: 2026/09/20 09:33:43 INFO Completed upload id=29 worker1 # [ 97.602661] nix-grpc-daemon[1290]: time=2026-09-20T09:33:43.249Z level=INFO msg="Upload complete. (498ms)" lb # [ 97.583484] niks3-server[1011]: 2026/09/20 09:33:43 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker1 # [ 97.612341] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 97.622721] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 97.629800] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) worker1 # [ 97.634857] nix-daemon[837]: reaped child process 1337, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... worker1 # [ 97.646155] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv client # farm-b> LOG-farm-b-on-standby worker1 # [ 98.477665] nix-daemon[837]: reaped child process 1351, status = succeeded worker1 # [ 98.641329] nix-daemon[837]: accepted connection from pid 1366, user nix-grpc-daemon (trusted) worker1 # [ 98.657938] nix-daemon[837]: reaped child process 1369, status = succeeded lb # [ 98.652725] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 98.687756] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.334Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 98.689504] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.334Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 98.695357] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 98.706338] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst worker1 # [ 98.741907] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.388Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.719625] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 98.724916] niks3-server[1011]: 2026/09/20 09:33:44 INFO Signed narinfos id=30 count=1 lb # [ 98.727062] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 98.736305] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 98.744046] niks3-server[1011]: 2026/09/20 09:33:44 INFO Completed upload id=30 worker1 # [ 98.765547] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.412Z level=INFO msg="Upload complete. (307ms)" lb # [ 98.746655] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker1 # [ 98.781567] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 98.796003] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 98.799830] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 98.803763] nix-daemon[837]: reaped child process 1349, status = succeeded worker1 # [ 98.827186] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 98.842679] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 98.859006] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.506Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 98.869494] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 98.882798] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) worker1 # [ 99.080817] nix-daemon[837]: accepted connection from pid 1375, user nix-grpc-daemon (trusted) worker1 # [ 99.098749] nix-daemon[837]: reaped child process 1378, status = succeeded worker1 # [ 99.273785] nix-daemon[837]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker1 # [ 99.291269] nix-daemon[837]: reaped child process 1383, status = succeeded lb # [ 99.280786] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 99.313719] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.960Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 99.315268] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.960Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 99.309773] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker1 # [ 99.345390] nix-grpc-daemon[1290]: time=2026-09-20T09:33:44.992Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.327057] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 99.337919] niks3-server[1011]: 2026/09/20 09:33:44 INFO Signed narinfos id=31 count=1 lb # [ 99.342884] niks3-server[1011]: 2026/09/20 09:33:44 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 99.350639] niks3-server[1011]: 2026/09/20 09:33:44 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 99.355643] niks3-server[1011]: 2026/09/20 09:33:45 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo lb # [ 99.359970] niks3-server[1011]: 2026/09/20 09:33:45 INFO Completed upload id=31 worker1 # [ 99.381743] nix-grpc-daemon[1290]: time=2026-09-20T09:33:45.028Z level=INFO msg="Upload complete. (483ms)" worker1 # [ 99.388357] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 99.400587] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 99.411327] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) worker1 # [ 99.413446] nix-daemon[837]: reaped child process 1373, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 99.426732] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-on-standby worker1 # [ 101.071662] nix-daemon[837]: reaped child process 1387, status = succeeded worker1 # [ 101.255256] nix-daemon[837]: accepted connection from pid 1402, user nix-grpc-daemon (trusted) worker1 # [ 101.274012] nix-daemon[837]: reaped child process 1405, status = succeeded lb # [ 101.264755] niks3-server[1011]: 2026/09/20 09:33:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 101.299673] nix-grpc-daemon[1290]: time=2026-09-20T09:33:46.945Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 101.301670] nix-grpc-daemon[1290]: time=2026-09-20T09:33:46.945Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 101.302274] niks3-server[1011]: 2026/09/20 09:33:46 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 101.318662] niks3-server[1011]: 2026/09/20 09:33:46 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 101.327953] niks3-server[1011]: 2026/09/20 09:33:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 101.334373] niks3-server[1011]: 2026/09/20 09:33:46 INFO Signed narinfos id=32 count=1 worker1 # [ 101.354923] nix-grpc-daemon[1290]: time=2026-09-20T09:33:47.001Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.339526] niks3-server[1011]: 2026/09/20 09:33:46 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 101.348480] niks3-server[1011]: 2026/09/20 09:33:46 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 101.355405] niks3-server[1011]: 2026/09/20 09:33:47 INFO Completed upload id=32 worker1 # [ 101.377630] nix-grpc-daemon[1290]: time=2026-09-20T09:33:47.024Z level=INFO msg="Upload complete. (338ms)" lb # [ 101.358397] niks3-server[1011]: 2026/09/20 09:33:47 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker1 # [ 101.393157] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 101.409673] nix-daemon[837]: reaped child process 1385, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.83 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath lb # [ 101.446804] envoy[920]: conn peer=[2001:db8:1::1]:36636 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=3854 ms=7549 client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds) worker2 # [ 101.752992] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 101.761687] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 101.964197] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 101.966896] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 101.974686] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 101.982626] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 102.017791] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.036502] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.08 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 102.476893] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 332d180493714d23aa39c106fce436b6 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds) client # [ 102.710508] nix[1163]: don't know how to build these paths: client # [ 102.711647] nix[1163]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 102.718647] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 102.734490] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 102.741965] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 102.782577] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 102.798627] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43676 client # [ 102.802850] nix[1163]: copying 1 paths to 'lb:50051'... client # [ 102.808368] nix[1163]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 102.816316] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 102.831909] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) worker1 # [ 103.039332] nix-daemon[837]: accepted connection from pid 1420, user nix-grpc-daemon (trusted) worker1 # [ 103.059383] nix-daemon[837]: reaped child process 1423, status = succeeded worker1 # [ 103.235877] nix-daemon[837]: accepted connection from pid 1425, user nix-grpc-daemon (trusted) worker1 # [ 103.252335] nix-daemon[837]: reaped child process 1428, status = succeeded lb # [ 103.245684] niks3-server[1011]: 2026/09/20 09:33:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 103.278398] nix-grpc-daemon[1290]: time=2026-09-20T09:33:48.925Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 103.279862] nix-grpc-daemon[1290]: time=2026-09-20T09:33:48.925Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 103.273150] niks3-server[1011]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 103.286736] niks3-server[1011]: 2026/09/20 09:33:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker1 # [ 103.314398] nix-grpc-daemon[1290]: time=2026-09-20T09:33:48.961Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.296827] niks3-server[1011]: 2026/09/20 09:33:48 INFO Signed narinfos id=33 count=1 lb # [ 103.299784] niks3-server[1011]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 103.312893] niks3-server[1011]: 2026/09/20 09:33:48 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete worker1 # [ 103.341148] nix-grpc-daemon[1290]: time=2026-09-20T09:33:48.988Z level=INFO msg="Upload complete. (492ms)" lb # [ 103.323952] niks3-server[1011]: 2026/09/20 09:33:48 INFO Completed upload id=33 lb # [ 103.327121] niks3-server[1011]: 2026/09/20 09:33:48 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker1 # [ 103.348488] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 103.361849] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 worker1 # [ 103.371803] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) worker1 # [ 103.374220] nix-daemon[837]: reaped child process 1418, status = succeeded client # [ 103.375372] nix[1163]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker1 # [ 103.387243] nix-daemon[837]: accepted connection from pid 1209, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 105.427163] systemd-journald[267]: Received client request to rotate journal, rotating. worker2 # [ 105.447841] systemd-journald[267]: Vacuuming done, freed 0B of archived journals from /var/log/journal/65e045999aab422fab181f45d379ab3f. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 105.523155] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds) ??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 573 client: must succeed: sleep 5.0 worker1 # [ 106.227623] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:51Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 111.037419] nix-daemon[837]: reaped child process 1432, status = succeeded worker1 # [ 111.220591] nix-daemon[837]: accepted connection from pid 1472, user nix-grpc-daemon (trusted) worker1 # [ 111.237927] nix-daemon[837]: reaped child process 1475, status = succeeded lb # [ 111.230071] niks3-server[1011]: 2026/09/20 09:33:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 111.264519] nix-grpc-daemon[1290]: time=2026-09-20T09:33:56.909Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 111.266416] nix-grpc-daemon[1290]: time=2026-09-20T09:33:56.909Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 111.274380] niks3-server[1011]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 111.287788] niks3-server[1011]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 111.296292] niks3-server[1011]: 2026/09/20 09:33:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker1 # [ 111.325273] nix-grpc-daemon[1290]: time=2026-09-20T09:33:56.972Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.302743] niks3-server[1011]: 2026/09/20 09:33:56 INFO Signed narinfos id=34 count=1 lb # [ 111.308456] niks3-server[1011]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 111.318711] niks3-server[1011]: 2026/09/20 09:33:56 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 111.331209] niks3-server[1011]: 2026/09/20 09:33:56 INFO Completed upload id=34 worker1 # [ 111.353509] nix-grpc-daemon[1290]: time=2026-09-20T09:33:57.000Z level=INFO msg="Upload complete. (349ms)" lb # [ 111.334607] niks3-server[1011]: 2026/09/20 09:33:56 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 111.369379] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43676 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 111.388808] nix-daemon[837]: reaped child process 1430, status = succeeded client # [ 111.401673] systemd[1]: rs.service: Deactivated successfully. client # [ 111.406092] systemd[1]: rs.service: Consumed 152ms CPU time over 8.928s wall clock time, 37M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic. lb # [ 111.446145] envoy[920]: conn peer=[2001:db8:1::1]:37368 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1324 ms=8665 worker1 # [ 112.233465] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:57Z level=info event=signal_exit worker1 # [ 112.446993] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_yield worker1 # [ 112.456267] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 112.433838] niks3-server[1011]: 2026/09/20 09:33:58 INFO lead: released remote=192.168.1.3:58346 worker2 # [ 112.441138] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 112.462927] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:43662 worker1 # [ 112.467655] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 112.471774] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:43662 worker1 # [ 112.476302] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 112.640738] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.657601] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.646087] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.663061] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.846848] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.863858] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.851824] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.869093] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.052805] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.069917] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.075298] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.062022] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.20 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 113.258779] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.276146] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.264275] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 113.281593] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1 # [ 113.456944] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:59Z level=info event=scheduler_restarting worker2 # [ 113.467023] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.471564] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 113.507272] nix-grpc-daemon[1209]: ts=2026-09-20T09:33:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 113.513179] nix-daemon[837]: reaped child process 1281, status = succeeded worker2 # [ 113.667423] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.670379] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.871413] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.876890] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.077718] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.082734] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.239026] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 114.242667] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 114.247839] systemd[1]: nix-grpc-daemon.service: Consumed 1.823s CPU time over 26.241s wall clock time, 37M memory peak, 47.4K incoming IP traffic, 87.4K outgoing IP traffic. worker1 # [ 114.262681] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 114.283567] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.288933] nix-grpc-daemon[1170]: ts=2026-09-20T09:33:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker1 # [ 114.470009] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 114.472756] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 114.481000] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 114.482832] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 114.499470] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_take_over lb # [ 114.479262] niks3-server[1011]: 2026/09/20 09:34:00 INFO lead: acquired remote=192.168.1.3:55182 worker2 # [ 114.491210] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.496993] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.528856] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.530798] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.697985] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.703687] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.732443] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.737975] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.904737] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.910373] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.939434] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.945084] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.111301] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.117055] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 115.146016] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.151651] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.317937] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.323526] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 115.353776] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.360551] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2 # [ 115.525765] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.549139] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 115.556701] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.562488] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.09 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 14.27 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 116.748886] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 170f5f461bd041ba80cdf56d0068caab client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds) worker1 # [ 117.003520] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52576 worker1 # [ 117.019467] nix-daemon[837]: accepted connection from pid 1482, user nix-grpc-daemon (trusted) client # [ 117.029511] nix[1198]: don't know how to build these paths: client # [ 117.030823] nix[1198]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 117.051290] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:02Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 117.058311] nix-grpc-daemon[1482]: ts=2026-09-20T09:34:02Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 117.107501] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34700 worker2 # [ 117.122837] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted) worker2 # [ 117.149437] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 1/5) worker2 # [ 117.165188] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 2/5) worker2 # [ 117.206284] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 3/5) worker2 # [ 117.255989] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 584 ms (attempt 4/5) worker2 # [ 117.848374] nix-grpc-daemon[1170]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 117.873880] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34700 client # [ 117.899762] nix[1198]: copying 1 paths to 'lb:50051'... worker2 # [ 117.891181] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34700 client # [ 117.900278] nix[1198]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 117.907004] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted) worker2 # [ 117.937567] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:03Z level=info event=niks3_push_started pid=1282 worker2 # [ 118.344596] nix-daemon[840]: accepted connection from pid 1299, user nix-grpc-daemon (trusted) worker2 # [ 118.361297] nix-daemon[840]: reaped child process 1302, status = succeeded worker2 # [ 118.538296] nix-daemon[840]: accepted connection from pid 1304, user nix-grpc-daemon (trusted) worker2 # [ 118.555615] nix-daemon[840]: reaped child process 1307, status = succeeded lb # [ 118.563081] niks3-server[1011]: 2026/09/20 09:34:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 118.580458] nix-grpc-daemon[1282]: time=2026-09-20T09:34:04.226Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 118.581945] nix-grpc-daemon[1282]: time=2026-09-20T09:34:04.226Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 118.600882] niks3-server[1011]: 2026/09/20 09:34:04 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 118.619273] nix-grpc-daemon[1282]: time=2026-09-20T09:34:04.265Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.613622] niks3-server[1011]: 2026/09/20 09:34:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 118.621856] niks3-server[1011]: 2026/09/20 09:34:04 INFO Signed narinfos id=35 count=1 lb # [ 118.632356] niks3-server[1011]: 2026/09/20 09:34:04 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 118.644071] niks3-server[1011]: 2026/09/20 09:34:04 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete worker2 # [ 118.654698] nix-grpc-daemon[1282]: time=2026-09-20T09:34:04.301Z level=INFO msg="Upload complete. (482ms)" lb # [ 118.651088] niks3-server[1011]: 2026/09/20 09:34:04 INFO Completed upload id=35 worker2 # [ 118.663870] nix-grpc-daemon[1282]: time=2026-09-20T09:34:04.305Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 118.677108] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34700 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 118.681736] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34700 worker2 # [ 118.688888] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted) worker2 # [ 118.691457] nix-daemon[840]: reaped child process 1280, status = succeeded worker2 # [ 118.701590] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted) client # [ 118.709962] nix[1198]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service lb # [ 120.783810] niks3-server[1011]: 2026/09/20 09:34:06 INFO lead: released remote=192.168.1.3:55182 worker1 # [ 120.799951] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1482 (nix-grpc-daemon) on client request. worker1 # [ 120.812902] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. worker2 # [ 120.803441] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))" client # [ 120.813186] nix[1198]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 120.853186] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 120.868425] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.14 seconds) worker1 # [ 120.870923] systemd[1]: nix-grpc-daemon.service: Consumed 213ms CPU time over 6.594s wall clock time, 13.8M memory peak, 7.9K incoming IP traffic, 9.6K outgoing IP traffic. client: must succeed: sleep 5.0 worker1 # [ 120.875287] nix-daemon[837]: reaped child process 1540, status = succeeded worker1 # [ 120.954882] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker1 # [ 120.968271] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 121.003579] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 121.180193] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 121.182440] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 121.190217] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 121.191944] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 121.182036] niks3-server[1011]: 2026/09/20 09:34:06 INFO lead: acquired remote=192.168.1.3:36448 worker1 # [ 121.208032] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=scheduler_take_over worker1 # [ 121.219488] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=1 worker1 # [ 121.233004] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 121.234902] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 121.445966] envoy[920]: conn peer=[2001:db8:1::3]:50104 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4430 tx=1348 ms=25234 lb # [ 121.451518] envoy[920]: conn peer=[2001:db8:1::3]:33840 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1107 tx=295 ms=6298 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 126.355383] nix-daemon[840]: reaped child process 1311, status = succeeded worker2 # [ 126.529296] nix-daemon[840]: accepted connection from pid 1347, user nix-grpc-daemon (trusted) worker2 # [ 126.547858] nix-daemon[840]: reaped child process 1350, status = succeeded lb # [ 126.556740] niks3-server[1011]: 2026/09/20 09:34:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 126.574675] nix-grpc-daemon[1282]: time=2026-09-20T09:34:12.219Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 126.576805] nix-grpc-daemon[1282]: time=2026-09-20T09:34:12.219Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 126.598087] niks3-server[1011]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 126.610775] niks3-server[1011]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 126.619520] niks3-server[1011]: 2026/09/20 09:34:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign worker2 # [ 126.632196] nix-grpc-daemon[1282]: time=2026-09-20T09:34:12.278Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.627917] niks3-server[1011]: 2026/09/20 09:34:12 INFO Signed narinfos id=36 count=1 lb # [ 126.649052] niks3-server[1011]: 2026/09/20 09:34:12 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete worker2 # [ 126.664140] nix-grpc-daemon[1282]: time=2026-09-20T09:34:12.311Z level=INFO msg="Upload complete. (344ms)" lb # [ 126.664437] niks3-server[1011]: 2026/09/20 09:34:12 INFO Completed upload id=36 worker2 # [ 126.677133] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34700 duration_s=8 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 lb # [ 126.683922] niks3-server[1011]: 2026/09/20 09:34:12 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls worker2 # [ 126.692815] nix-grpc-daemon[1282]: time=2026-09-20T09:34:12.339Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 126.700828] nix-daemon[840]: reaped child process 1309, status = succeeded client # [ 126.728798] systemd[1]: mid.service: Deactivated successfully. client # [ 126.733149] systemd[1]: mid.service: Consumed 164ms CPU time over 9.983s wall clock time, 34.9M memory peak, 8.8K incoming IP traffic, 9.2K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.73 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 127.444739] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 19f822cecb9f4dc2abc0045e59f563f3 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) worker1 # [ 127.678782] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 127.693758] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) client # [ 127.702220] nix[1233]: don't know how to build these paths: client # [ 127.703262] nix[1233]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker1 # [ 127.724870] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:13Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker1 # [ 127.731680] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:13Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 127.778247] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 127.795338] nix-grpc-daemon[1568]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 1/5) worker1 # [ 127.856159] nix-grpc-daemon[1568]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 186 ms (attempt 2/5) worker1 # [ 128.049766] nix-grpc-daemon[1568]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 342 ms (attempt 3/5) worker1 # [ 128.399552] nix-grpc-daemon[1568]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 470 ms (attempt 4/5) worker1 # [ 128.879175] nix-grpc-daemon[1568]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 128.900522] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 client # [ 128.906491] nix[1233]: copying 1 paths to 'lb:50051'... worker1 # [ 128.918471] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 client # [ 128.911837] nix[1233]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker1 # [ 128.936567] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 128.964347] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:14Z level=info event=niks3_push_started pid=1642 worker1 # [ 129.354919] nix-daemon[837]: accepted connection from pid 1655, user nix-grpc-daemon (trusted) worker1 # [ 129.372348] nix-daemon[837]: reaped child process 1658, status = succeeded worker1 # [ 129.549311] nix-daemon[837]: accepted connection from pid 1660, user nix-grpc-daemon (trusted) worker1 # [ 129.567464] nix-daemon[837]: reaped child process 1663, status = succeeded lb # [ 129.558026] niks3-server[1011]: 2026/09/20 09:34:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 129.596435] nix-grpc-daemon[1642]: time=2026-09-20T09:34:15.242Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 129.597930] nix-grpc-daemon[1642]: time=2026-09-20T09:34:15.242Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 129.609111] niks3-server[1011]: 2026/09/20 09:34:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign worker1 # [ 129.640374] nix-grpc-daemon[1642]: time=2026-09-20T09:34:15.287Z level=INFO msg="Uploading 1 narinfos" lb # [ 129.622302] niks3-server[1011]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 129.631337] niks3-server[1011]: 2026/09/20 09:34:15 INFO Signed narinfos id=37 count=1 lb # [ 129.638907] niks3-server[1011]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 129.648631] niks3-server[1011]: 2026/09/20 09:34:15 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 129.652201] niks3-server[1011]: 2026/09/20 09:34:15 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo lb # [ 129.656159] niks3-server[1011]: 2026/09/20 09:34:15 INFO Completed upload id=37 worker1 # [ 129.678655] nix-grpc-daemon[1642]: time=2026-09-20T09:34:15.325Z level=INFO msg="Upload complete. (500ms)" worker1 # [ 129.689249] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 129.708196] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 129.711879] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 129.720189] nix-daemon[837]: reaped child process 1640, status = succeeded client # [ 129.718233] nix[1233]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker1 # [ 129.730060] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 131.156579] systemd[1]: intr.service: Sent signal SIGINT to main process 1233 (nix) on client request. client # [ 131.162367] nix[1233]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 131.169648] nix[1233]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) client # [ 131.204159] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 131.208749] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 131.210782] systemd[1]: intr.service: Consumed 141ms CPU time over 3.762s wall clock time, 37.2M memory peak, 7.6K incoming IP traffic, 8.7K outgoing IP traffic. worker1 # [ 131.355828] nix-daemon[837]: reaped child process 1665, status = succeeded worker1 # [ 131.358945] nix-daemon[1667]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 131.367464] nix-daemon[837]: reaped child process 1667, status = failed with exit code 1 lb # [ 131.445841] envoy[920]: conn peer=[2001:db8:1::1]:60054 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3022 tx=1424 ms=9714 lb # [ 131.451074] envoy[920]: conn peer=[2001:db8:1::1]:47332 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=755 ms=3519 (finished: subtest: interrupting the client stops the build on the worker, in 5.08 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 132.549010] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: f96d2c16a95f4bd98b6da2a458736c0a client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.10 seconds) client # [ 132.800843] nix[1252]: don't know how to build these paths: client # [ 132.801823] nix[1252]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 132.791663] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34700 worker1 # [ 132.824776] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:18Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker1 # [ 132.825192] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:18Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 132.854077] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34700 worker2 # [ 132.870697] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34700 client # [ 132.895100] nix[1252]: copying 1 paths to 'lb:50051'... worker2 # [ 132.886936] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34700 client # [ 132.897776] nix[1252]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker2 # [ 132.901868] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted) worker2 # [ 133.109842] nix-daemon[840]: accepted connection from pid 1382, user nix-grpc-daemon (trusted) worker2 # [ 133.129574] nix-daemon[840]: reaped child process 1385, status = succeeded worker2 # [ 133.306439] nix-daemon[840]: accepted connection from pid 1387, user nix-grpc-daemon (trusted) worker2 # [ 133.323937] nix-daemon[840]: reaped child process 1390, status = succeeded lb # [ 133.330996] niks3-server[1011]: 2026/09/20 09:34:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 133.349940] nix-grpc-daemon[1282]: time=2026-09-20T09:34:18.996Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 133.351479] nix-grpc-daemon[1282]: time=2026-09-20T09:34:18.996Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 133.368093] niks3-server[1011]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker2 # [ 133.387839] nix-grpc-daemon[1282]: time=2026-09-20T09:34:19.034Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.385663] niks3-server[1011]: 2026/09/20 09:34:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 133.395404] niks3-server[1011]: 2026/09/20 09:34:19 INFO Signed narinfos id=38 count=1 lb # [ 133.400623] niks3-server[1011]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 133.410343] niks3-server[1011]: 2026/09/20 09:34:19 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 133.414933] niks3-server[1011]: 2026/09/20 09:34:19 INFO Completed upload id=38 worker2 # [ 133.420519] nix-grpc-daemon[1282]: time=2026-09-20T09:34:19.067Z level=INFO msg="Upload complete. (501ms)" lb # [ 133.417585] niks3-server[1011]: 2026/09/20 09:34:19 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker2 # [ 133.428272] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34700 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 133.443622] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34700 worker2 # [ 133.451838] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted) worker2 # [ 133.457452] nix-daemon[840]: reaped child process 1380, status = succeeded client # [ 133.476617] nix[1252]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker2 # [ 133.472574] nix-daemon[840]: accepted connection from pid 1170, user nix-grpc-daemon (trusted) worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done worker2 # [ 136.040379] nixos[1425]: switching to system configuration /nix/store/clfbplp7p27ip16wqar5gfyx0y1bpgkm-nixos-system-worker2-test worker2 # [ 136.042312] systemd[1]: Stopped target Local File Systems. worker2 # [ 136.043087] systemd[1]: Stopped target Remote File Systems. worker2 # activating the configuration... worker2 # setting up /etc... worker2 # [ 136.822175] systemd[1]: Reload requested from client PID 1425 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 136.824786] systemd[1]: Reloading... worker2 # [ 137.712436] systemd[1]: Reloading finished in 885 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 137.797707] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 137.958989] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 137.964948] systemd[1]: Reached target Reactivate sysinit units. worker2 # [ 137.966074] dbus-broker-launch[495]: Caught SIGHUP, trigger reload. worker2 # [ 137.967022] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 137.970735] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 137.991819] dbus-broker-launch[495]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 137.996100] dbus-broker-launch[495]: NSS returned no entry for 'systemd-timesync' worker2 # [ 138.000121] dbus-broker-launch[495]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 138.029737] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 138.054186] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 138.057045] systemd[1]: Reached target Local File Systems. worker2 # [ 138.057855] systemd[1]: Reached target Remote File Systems. worker2 # [ 138.068096] systemd[1]: Starting linger-users.service... worker2 # [ 138.074351] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 138.080384] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 138.087140] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 138.096786] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 138.097628] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 138.098830] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 138.108341] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 138.112574] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 138.116771] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 138.154148] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 138.156164] systemd[1]: Finished linger-users.service. worker2 # [ 138.593967] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 138.595026] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 138.847528] nixos[1425]: finished switching to system configuration /nix/store/clfbplp7p27ip16wqar5gfyx0y1bpgkm-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.65 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 worker2 # [ 138.994936] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:24Z level=info event=draining worker2 # [ 139.176770] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34700 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 139.202916] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 139.229294] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker1 # [ 139.236423] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 139.279255] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 139.294829] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 client # copying 1 paths to 'lb:50051'... worker1 # [ 139.311569] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker1 # [ 139.335988] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 139.547874] nix-daemon[837]: accepted connection from pid 1721, user nix-grpc-daemon (trusted) worker1 # [ 139.565248] nix-daemon[837]: reaped child process 1724, status = succeeded worker1 # [ 139.746078] nix-daemon[837]: accepted connection from pid 1726, user nix-grpc-daemon (trusted) worker1 # [ 139.763073] nix-daemon[837]: reaped child process 1729, status = succeeded lb # [ 139.753578] niks3-server[1011]: 2026/09/20 09:34:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 139.786593] nix-grpc-daemon[1642]: time=2026-09-20T09:34:25.433Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 139.788116] nix-grpc-daemon[1642]: time=2026-09-20T09:34:25.433Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 139.786444] niks3-server[1011]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst lb # [ 139.806846] niks3-server[1011]: 2026/09/20 09:34:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign worker1 # [ 139.833828] nix-grpc-daemon[1642]: time=2026-09-20T09:34:25.480Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.817227] niks3-server[1011]: 2026/09/20 09:34:25 INFO Signed narinfos id=39 count=1 lb # [ 139.819618] niks3-server[1011]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 139.827571] niks3-server[1011]: 2026/09/20 09:34:25 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 139.838064] niks3-server[1011]: 2026/09/20 09:34:25 INFO Completed upload id=39 worker1 # [ 139.860341] nix-grpc-daemon[1642]: time=2026-09-20T09:34:25.507Z level=INFO msg="Upload complete. (507ms)" lb # [ 139.840692] niks3-server[1011]: 2026/09/20 09:34:25 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker1 # [ 139.868286] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=528 worker1 # [ 139.884277] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 139.895649] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 139.898691] nix-daemon[837]: reaped child process 1719, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... worker1 # [ 139.912210] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv client # farm-a> LOG-farm-a-during-drain worker1 # [ 141.152788] nix-daemon[837]: reaped child process 1733, status = succeeded worker1 # [ 141.327173] nix-daemon[837]: accepted connection from pid 1748, user nix-grpc-daemon (trusted) worker1 # [ 141.346859] nix-daemon[837]: reaped child process 1751, status = succeeded lb # [ 141.337064] niks3-server[1011]: 2026/09/20 09:34:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 141.371894] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.016Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 141.374151] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.016Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 141.379742] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 141.395974] niks3-server[1011]: 2026/09/20 09:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 141.400449] niks3-server[1011]: 2026/09/20 09:34:27 INFO Signed narinfos id=40 count=1 worker1 # [ 141.423621] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.069Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.408991] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 141.422709] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 141.430050] niks3-server[1011]: 2026/09/20 09:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 141.438003] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo lb # [ 141.442276] niks3-server[1011]: 2026/09/20 09:34:27 INFO Completed upload id=40 worker1 # [ 141.464214] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.111Z level=INFO msg="Upload complete. (339ms)" worker1 # [ 141.481293] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=3 outputs=1 worker1 # [ 141.496322] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker1 # [ 141.502844] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 141.506978] nix-daemon[837]: reaped child process 1731, status = succeeded worker1 # [ 141.532143] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 141.547955] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 client # copying 1 paths to 'lb:50051'... worker1 # [ 141.562629] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.209Z level=INFO msg="All 1 paths already cached" worker1 # [ 141.569365] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker1 # [ 141.592195] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 141.800655] nix-daemon[837]: accepted connection from pid 1757, user nix-grpc-daemon (trusted) worker1 # [ 141.817865] nix-daemon[837]: reaped child process 1760, status = succeeded worker1 # [ 141.997460] nix-daemon[837]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 142.014491] nix-daemon[837]: reaped child process 1765, status = succeeded lb # [ 142.003299] niks3-server[1011]: 2026/09/20 09:34:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 142.034646] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.681Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 142.036249] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.681Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 142.029927] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst worker1 # [ 142.065468] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.712Z level=INFO msg="Uploading 1 narinfos" lb # [ 142.046581] niks3-server[1011]: 2026/09/20 09:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 142.056707] niks3-server[1011]: 2026/09/20 09:34:27 INFO Signed narinfos id=41 count=1 lb # [ 142.059467] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 142.067291] niks3-server[1011]: 2026/09/20 09:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 142.074195] niks3-server[1011]: 2026/09/20 09:34:27 INFO Completed upload id=41 worker1 # [ 142.095685] nix-grpc-daemon[1642]: time=2026-09-20T09:34:27.742Z level=INFO msg="Upload complete. (486ms)" lb # [ 142.076548] niks3-server[1011]: 2026/09/20 09:34:27 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker1 # [ 142.104306] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 142.115266] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 142.122260] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 142.126978] nix-daemon[837]: reaped child process 1755, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... worker1 # [ 142.140266] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv client # farm-b> LOG-farm-b-during-drain worker1 # [ 142.975521] nix-daemon[837]: reaped child process 1769, status = succeeded worker1 # [ 143.146989] nix-daemon[837]: accepted connection from pid 1784, user nix-grpc-daemon (trusted) worker1 # [ 143.167256] nix-daemon[837]: reaped child process 1787, status = succeeded lb # [ 143.157440] niks3-server[1011]: 2026/09/20 09:34:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 143.190376] nix-grpc-daemon[1642]: time=2026-09-20T09:34:28.836Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 143.192253] nix-grpc-daemon[1642]: time=2026-09-20T09:34:28.836Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 143.196380] niks3-server[1011]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst worker1 # [ 143.228824] nix-grpc-daemon[1642]: time=2026-09-20T09:34:28.875Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.210685] niks3-server[1011]: 2026/09/20 09:34:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 143.219586] niks3-server[1011]: 2026/09/20 09:34:28 INFO Signed narinfos id=42 count=1 lb # [ 143.224641] niks3-server[1011]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 143.231493] niks3-server[1011]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls worker1 # [ 143.257943] nix-grpc-daemon[1642]: time=2026-09-20T09:34:28.905Z level=INFO msg="Upload complete. (308ms)" lb # [ 143.236598] niks3-server[1011]: 2026/09/20 09:34:28 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 143.240597] niks3-server[1011]: 2026/09/20 09:34:28 INFO Completed upload id=42 lb # [ 143.243712] niks3-server[1011]: 2026/09/20 09:34:28 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker1 # [ 143.269195] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=4 outputs=1 worker1 # [ 143.292192] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:28Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker1 # [ 143.295990] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:28Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 143.300576] nix-daemon[837]: reaped child process 1767, status = succeeded worker1 # [ 143.335593] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 143.351249] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 143.365501] nix-grpc-daemon[1642]: time=2026-09-20T09:34:29.012Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 143.376114] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker1 # [ 143.394299] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 143.607339] nix-daemon[837]: accepted connection from pid 1793, user nix-grpc-daemon (trusted) worker1 # [ 143.627893] nix-daemon[837]: reaped child process 1796, status = succeeded worker1 # [ 143.802309] nix-daemon[837]: accepted connection from pid 1798, user nix-grpc-daemon (trusted) worker1 # [ 143.821140] nix-daemon[837]: reaped child process 1801, status = succeeded lb # [ 143.810571] niks3-server[1011]: 2026/09/20 09:34:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 143.842177] nix-grpc-daemon[1642]: time=2026-09-20T09:34:29.489Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 143.843732] nix-grpc-daemon[1642]: time=2026-09-20T09:34:29.489Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 143.837493] niks3-server[1011]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst worker1 # [ 143.872838] nix-grpc-daemon[1642]: time=2026-09-20T09:34:29.519Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.853971] niks3-server[1011]: 2026/09/20 09:34:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 143.864399] niks3-server[1011]: 2026/09/20 09:34:29 INFO Signed narinfos id=43 count=1 lb # [ 143.870158] niks3-server[1011]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 143.878534] niks3-server[1011]: 2026/09/20 09:34:29 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 143.884117] niks3-server[1011]: 2026/09/20 09:34:29 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo lb # [ 143.888748] niks3-server[1011]: 2026/09/20 09:34:29 INFO Completed upload id=43 worker1 # [ 143.910762] nix-grpc-daemon[1642]: time=2026-09-20T09:34:29.558Z level=INFO msg="Upload complete. (498ms)" worker1 # [ 143.918880] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 143.935442] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 143.938997] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 143.944730] nix-daemon[837]: reaped child process 1791, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker1 # [ 143.955755] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> LOG-farm-top-during-drain worker1 # [ 145.001312] nix-daemon[837]: reaped child process 1805, status = succeeded worker1 # [ 145.188648] nix-daemon[837]: accepted connection from pid 1820, user nix-grpc-daemon (trusted) worker1 # [ 145.206465] nix-daemon[837]: reaped child process 1823, status = succeeded lb # [ 145.198305] niks3-server[1011]: 2026/09/20 09:34:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 145.232155] nix-grpc-daemon[1642]: time=2026-09-20T09:34:30.877Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 145.233866] nix-grpc-daemon[1642]: time=2026-09-20T09:34:30.877Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 145.238196] niks3-server[1011]: 2026/09/20 09:34:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker1 # [ 145.270402] nix-grpc-daemon[1642]: time=2026-09-20T09:34:30.917Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.255332] niks3-server[1011]: 2026/09/20 09:34:30 INFO Signed narinfos id=44 count=1 lb # [ 145.264489] niks3-server[1011]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 145.272519] niks3-server[1011]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 145.281438] niks3-server[1011]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 145.285283] niks3-server[1011]: 2026/09/20 09:34:30 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 145.290188] niks3-server[1011]: 2026/09/20 09:34:30 INFO Completed upload id=44 worker1 # [ 145.312207] nix-grpc-daemon[1642]: time=2026-09-20T09:34:30.959Z level=INFO msg="Upload complete. (339ms)" lb # [ 145.293723] niks3-server[1011]: 2026/09/20 09:34:30 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker1 # [ 145.323870] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=5 outputs=1 worker1 # [ 145.341980] nix-daemon[837]: reaped child process 1803, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.44 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 145.710034] nix-daemon[840]: reaped child process 1394, status = succeeded worker2 # [ 145.877603] nix-daemon[840]: accepted connection from pid 1566, user nix-grpc-daemon (trusted) worker2 # [ 145.896754] nix-daemon[840]: reaped child process 1569, status = succeeded lb # [ 145.903644] niks3-server[1011]: 2026/09/20 09:34:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 145.918831] nix-grpc-daemon[1282]: time=2026-09-20T09:34:31.565Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 145.920459] nix-grpc-daemon[1282]: time=2026-09-20T09:34:31.565Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 145.938813] niks3-server[1011]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst worker2 # [ 145.957793] nix-grpc-daemon[1282]: time=2026-09-20T09:34:31.604Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.954819] niks3-server[1011]: 2026/09/20 09:34:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 145.964332] niks3-server[1011]: 2026/09/20 09:34:31 INFO Signed narinfos id=45 count=1 lb # [ 145.969502] niks3-server[1011]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 145.973891] niks3-server[1011]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls worker2 # [ 145.988968] nix-grpc-daemon[1282]: time=2026-09-20T09:34:31.636Z level=INFO msg="Upload complete. (291ms)" lb # [ 145.983405] niks3-server[1011]: 2026/09/20 09:34:31 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 145.989196] niks3-server[1011]: 2026/09/20 09:34:31 INFO Completed upload id=45 lb # [ 145.991809] niks3-server[1011]: 2026/09/20 09:34:31 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker2 # [ 146.000871] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34700 duration_s=12 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=2 outputs=1 worker2 # [ 146.012387] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:31Z level=info event=signal_exit worker2 # [ 146.016666] nix-daemon[840]: reaped child process 1392, status = succeeded client # [ 146.053465] systemd[1]: sw.service: Deactivated successfully. client # [ 146.056594] systemd[1]: sw.service: Consumed 163ms CPU time over 13.504s wall clock time, 37M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker1 # [ 147.258288] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47544 worker1 # [ 147.258674] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:32Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 147.251909] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:32Z level=info event=scheduler_restarting worker2 # [ 147.267146] nix-grpc-daemon[1170]: ts=2026-09-20T09:34:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 147.294524] nix-daemon[840]: reaped child process 1275, status = succeeded worker2 # [ 147.406197] nix-grpc-daemon[1170]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 147.410945] nix-grpc-daemon[1170]: E0000 00:00:1789896873.053231 1213 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker2 # [ 147.417500] nix-grpc-daemon[1170]: E0000 00:00:1789896873.057927 1213 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 148.489753] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 148.495642] systemd[1]: nix-grpc-daemon.service: Consumed 1.159s CPU time over 46.727s wall clock time, 33.6M memory peak, 28.1K incoming IP traffic, 40.6K outgoing IP traffic. worker2 # [ 148.517890] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 148.724333] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 148.727574] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 148.735859] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 148.745379] systemd[1]: Started Nix worker-protocol over gRPC. worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.93 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 148.783569] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 148.806693] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.61 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 150.337197] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 150.352877] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) worker1 # [ 150.391510] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 150.439551] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker1 # [ 150.446630] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 150.452649] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker1 # [ 150.458190] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 150.486700] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 150.502961] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 150.518548] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 150.533389] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 150.739488] nix-daemon[837]: accepted connection from pid 1834, user nix-grpc-daemon (trusted) worker1 # [ 150.760657] nix-daemon[837]: reaped child process 1837, status = succeeded worker1 # [ 150.934885] nix-daemon[837]: accepted connection from pid 1839, user nix-grpc-daemon (trusted) worker1 # [ 150.952809] nix-daemon[837]: reaped child process 1842, status = succeeded lb # [ 150.942887] niks3-server[1011]: 2026/09/20 09:34:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.976125] nix-grpc-daemon[1642]: time=2026-09-20T09:34:36.622Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.977675] nix-grpc-daemon[1642]: time=2026-09-20T09:34:36.622Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 150.971735] niks3-server[1011]: 2026/09/20 09:34:36 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 151.008123] nix-grpc-daemon[1642]: time=2026-09-20T09:34:36.655Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.985913] niks3-server[1011]: 2026/09/20 09:34:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 150.997741] niks3-server[1011]: 2026/09/20 09:34:36 INFO Signed narinfos id=46 count=1 lb # [ 151.005182] niks3-server[1011]: 2026/09/20 09:34:36 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 151.012952] niks3-server[1011]: 2026/09/20 09:34:36 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete worker1 # [ 151.042618] nix-grpc-daemon[1642]: time=2026-09-20T09:34:36.689Z level=INFO msg="Upload complete. (492ms)" lb # [ 151.021381] niks3-server[1011]: 2026/09/20 09:34:36 INFO Completed upload id=46 lb # [ 151.025237] niks3-server[1011]: 2026/09/20 09:34:36 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 151.052417] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 151.063940] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 151.070899] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 151.075658] nix-daemon[837]: reaped child process 1832, status = succeeded worker1 # [ 151.090047] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) lb # [ 151.446168] envoy[920]: conn peer=[2001:db8:1::1]:33102 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9582 tx=3872 ms=6143 lb # [ 151.451473] envoy[920]: conn peer=[2001:db8:1::1]:33100 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2935 tx=1311 ms=13225 lb # [ 151.456438] envoy[920]: conn peer=[2001:db8:1::4]:45680 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3035 tx=929 ms=45237 worker1 # [ 152.339713] nix-daemon[837]: reaped child process 1846, status = succeeded worker1 # [ 152.523876] nix-daemon[837]: accepted connection from pid 1861, user nix-grpc-daemon (trusted) worker1 # [ 152.543072] nix-daemon[837]: reaped child process 1864, status = succeeded lb # [ 152.533646] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.568471] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.212Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.570096] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.213Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 152.579431] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 152.591575] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 152.602011] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 152.629241] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.276Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.610043] niks3-server[1011]: 2026/09/20 09:34:38 INFO Signed narinfos id=47 count=1 lb # [ 152.614945] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 152.623258] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 152.629793] niks3-server[1011]: 2026/09/20 09:34:38 INFO Completed upload id=47 worker1 # [ 152.651538] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.298Z level=INFO msg="Upload complete. (350ms)" lb # [ 152.632536] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 152.670495] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=6 outputs=1 worker1 # [ 152.688294] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 152.696975] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 152.699864] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 152.704419] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 152.708501] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 152.717293] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 152.719830] nix-daemon[837]: reaped child process 1844, status = succeeded worker1 # [ 152.903809] nix-daemon[837]: accepted connection from pid 1870, user nix-grpc-daemon (trusted) worker1 # [ 152.923604] nix-daemon[837]: reaped child process 1873, status = succeeded worker1 # [ 153.101464] nix-daemon[837]: accepted connection from pid 1875, user nix-grpc-daemon (trusted) worker1 # [ 153.118465] nix-daemon[837]: reaped child process 1878, status = succeeded lb # [ 153.108699] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.139123] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.786Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 153.140688] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.786Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 153.132970] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst lb # [ 153.148214] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker1 # [ 153.177184] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.824Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.160976] niks3-server[1011]: 2026/09/20 09:34:38 INFO Signed narinfos id=48 count=1 lb # [ 153.167905] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 153.177580] niks3-server[1011]: 2026/09/20 09:34:38 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete worker1 # [ 153.204482] nix-grpc-daemon[1642]: time=2026-09-20T09:34:38.851Z level=INFO msg="Upload complete. (474ms)" lb # [ 153.182699] niks3-server[1011]: 2026/09/20 09:34:38 INFO Completed upload id=48 lb # [ 153.186582] niks3-server[1011]: 2026/09/20 09:34:38 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 153.211972] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 153.223851] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 153.233471] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 153.235551] nix-daemon[837]: reaped child process 1868, status = succeeded worker1 # [ 153.245571] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 154.491727] nix-daemon[837]: reaped child process 1882, status = succeeded worker1 # [ 154.667466] nix-daemon[837]: accepted connection from pid 1897, user nix-grpc-daemon (trusted) worker1 # [ 154.685082] nix-daemon[837]: reaped child process 1900, status = succeeded lb # [ 154.675515] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.708403] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.354Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 154.709892] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.354Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 154.710990] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 154.725572] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 154.742492] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 154.770648] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.417Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.754809] niks3-server[1011]: 2026/09/20 09:34:40 INFO Signed narinfos id=49 count=1 lb # [ 154.761256] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 154.771312] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 154.775919] niks3-server[1011]: 2026/09/20 09:34:40 INFO Completed upload id=49 worker1 # [ 154.797787] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.444Z level=INFO msg="Upload complete. (339ms)" lb # [ 154.778734] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker1 # [ 154.817074] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=7 outputs=1 worker1 # [ 154.836694] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 154.840889] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 154.844002] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 154.850449] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 154.854839] nix-daemon[837]: reaped child process 1880, status = succeeded worker1 # [ 154.856712] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 154.866986] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 155.054431] nix-daemon[837]: accepted connection from pid 1906, user nix-grpc-daemon (trusted) worker1 # [ 155.073542] nix-daemon[837]: reaped child process 1909, status = succeeded worker1 # [ 155.250281] nix-daemon[837]: accepted connection from pid 1911, user nix-grpc-daemon (trusted) worker1 # [ 155.267241] nix-daemon[837]: reaped child process 1914, status = succeeded lb # [ 155.256275] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.286850] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.933Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 155.288451] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.933Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 155.283980] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 155.294861] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker1 # [ 155.323782] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.970Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.307959] niks3-server[1011]: 2026/09/20 09:34:40 INFO Signed narinfos id=50 count=1 lb # [ 155.310735] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 155.320917] niks3-server[1011]: 2026/09/20 09:34:40 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 155.327516] niks3-server[1011]: 2026/09/20 09:34:40 INFO Completed upload id=50 lb # [ 155.330201] niks3-server[1011]: 2026/09/20 09:34:40 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 155.349733] nix-grpc-daemon[1642]: time=2026-09-20T09:34:40.996Z level=INFO msg="Upload complete. (472ms)" worker1 # [ 155.359446] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 155.371524] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 155.377297] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 155.381893] nix-daemon[837]: reaped child process 1904, status = succeeded worker1 # [ 155.394783] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 157.045735] nix-daemon[837]: reaped child process 1918, status = succeeded worker1 # [ 157.228774] nix-daemon[837]: accepted connection from pid 1933, user nix-grpc-daemon (trusted) worker1 # [ 157.247349] nix-daemon[837]: reaped child process 1936, status = succeeded lb # [ 157.237591] niks3-server[1011]: 2026/09/20 09:34:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.272827] nix-grpc-daemon[1642]: time=2026-09-20T09:34:42.919Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 157.275616] nix-grpc-daemon[1642]: time=2026-09-20T09:34:42.921Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 157.301737] niks3-server[1011]: 2026/09/20 09:34:42 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 157.307594] niks3-server[1011]: 2026/09/20 09:34:42 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 157.314867] niks3-server[1011]: 2026/09/20 09:34:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 157.320918] niks3-server[1011]: 2026/09/20 09:34:42 INFO Signed narinfos id=51 count=1 worker1 # [ 157.341979] nix-grpc-daemon[1642]: time=2026-09-20T09:34:42.988Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.324767] niks3-server[1011]: 2026/09/20 09:34:42 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 157.332623] niks3-server[1011]: 2026/09/20 09:34:42 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 157.338134] niks3-server[1011]: 2026/09/20 09:34:42 INFO Completed upload id=51 worker1 # [ 157.360387] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.007Z level=INFO msg="Upload complete. (354ms)" lb # [ 157.340180] niks3-server[1011]: 2026/09/20 09:34:42 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker1 # [ 157.378356] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=2 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=8 outputs=1 worker1 # [ 157.396953] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 157.406609] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 157.411167] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 157.416736] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 157.421492] nix-daemon[837]: reaped child process 1916, status = succeeded worker1 # [ 157.423454] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.067Z level=INFO msg="All 1 paths already cached" worker1 # [ 157.427271] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 157.439459] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 157.629169] nix-daemon[837]: accepted connection from pid 1942, user nix-grpc-daemon (trusted) worker1 # [ 157.646925] nix-daemon[837]: reaped child process 1945, status = succeeded worker1 # [ 157.821203] nix-daemon[837]: accepted connection from pid 1947, user nix-grpc-daemon (trusted) worker1 # [ 157.837693] nix-daemon[837]: reaped child process 1950, status = succeeded lb # [ 157.826735] niks3-server[1011]: 2026/09/20 09:34:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.858471] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.505Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 157.859977] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.505Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 157.853140] niks3-server[1011]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 157.891126] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.538Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.868827] niks3-server[1011]: 2026/09/20 09:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 157.879212] niks3-server[1011]: 2026/09/20 09:34:43 INFO Signed narinfos id=52 count=1 lb # [ 157.886261] niks3-server[1011]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 157.895314] niks3-server[1011]: 2026/09/20 09:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 157.903925] niks3-server[1011]: 2026/09/20 09:34:43 INFO Completed upload id=52 worker1 # [ 157.925522] nix-grpc-daemon[1642]: time=2026-09-20T09:34:43.572Z level=INFO msg="Upload complete. (473ms)" lb # [ 157.908346] niks3-server[1011]: 2026/09/20 09:34:43 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 157.936392] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 157.939882] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 157.950355] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 157.955165] nix-daemon[837]: reaped child process 1940, status = succeeded worker1 # [ 157.967675] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 158.787855] nix-daemon[837]: reaped child process 1954, status = succeeded worker1 # [ 158.944981] nix-daemon[837]: accepted connection from pid 1969, user nix-grpc-daemon (trusted) worker1 # [ 158.964859] nix-daemon[837]: reaped child process 1972, status = succeeded lb # [ 158.955080] niks3-server[1011]: 2026/09/20 09:34:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.988413] nix-grpc-daemon[1642]: time=2026-09-20T09:34:44.635Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.989889] nix-grpc-daemon[1642]: time=2026-09-20T09:34:44.635Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 158.997893] niks3-server[1011]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 159.009924] niks3-server[1011]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 159.018413] niks3-server[1011]: 2026/09/20 09:34:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker1 # [ 159.045404] nix-grpc-daemon[1642]: time=2026-09-20T09:34:44.692Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.026136] niks3-server[1011]: 2026/09/20 09:34:44 INFO Signed narinfos id=53 count=1 lb # [ 159.030622] niks3-server[1011]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 159.037419] niks3-server[1011]: 2026/09/20 09:34:44 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 159.041396] niks3-server[1011]: 2026/09/20 09:34:44 INFO Completed upload id=53 worker1 # [ 159.063280] nix-grpc-daemon[1642]: time=2026-09-20T09:34:44.710Z level=INFO msg="Upload complete. (286ms)" lb # [ 159.043684] niks3-server[1011]: 2026/09/20 09:34:44 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker1 # [ 159.076994] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=9 outputs=1 worker1 # [ 159.088056] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.091817] nix-daemon[837]: reaped child process 1952, status = succeeded worker1 # [ 159.116123] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 159.126475] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 159.137564] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 159.150983] nix-grpc-daemon[1642]: time=2026-09-20T09:34:44.798Z level=INFO msg="All 1 paths already cached" worker1 # [ 159.159700] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 159.172979] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 159.374495] nix-daemon[837]: accepted connection from pid 1978, user nix-grpc-daemon (trusted) worker1 # [ 159.393683] nix-daemon[837]: reaped child process 1981, status = succeeded worker1 # [ 159.566785] nix-daemon[837]: accepted connection from pid 1983, user nix-grpc-daemon (trusted) worker1 # [ 159.583620] nix-daemon[837]: reaped child process 1986, status = succeeded lb # [ 159.572870] niks3-server[1011]: 2026/09/20 09:34:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.603504] nix-grpc-daemon[1642]: time=2026-09-20T09:34:45.250Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 159.605134] nix-grpc-daemon[1642]: time=2026-09-20T09:34:45.250Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 159.599296] niks3-server[1011]: 2026/09/20 09:34:45 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 159.612765] niks3-server[1011]: 2026/09/20 09:34:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 159.640739] nix-grpc-daemon[1642]: time=2026-09-20T09:34:45.287Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.625221] niks3-server[1011]: 2026/09/20 09:34:45 INFO Signed narinfos id=54 count=1 lb # [ 159.632076] niks3-server[1011]: 2026/09/20 09:34:45 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls worker1 # [ 159.662713] nix-grpc-daemon[1642]: time=2026-09-20T09:34:45.309Z level=INFO msg="Upload complete. (475ms)" lb # [ 159.640860] niks3-server[1011]: 2026/09/20 09:34:45 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 159.645867] niks3-server[1011]: 2026/09/20 09:34:45 INFO Completed upload id=54 lb # [ 159.649191] niks3-server[1011]: 2026/09/20 09:34:45 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 159.671829] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 159.682179] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 159.687726] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 159.691954] nix-daemon[837]: reaped child process 1976, status = succeeded worker1 # [ 159.704245] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 161.129629] nix-daemon[837]: reaped child process 1990, status = succeeded worker1 # [ 161.292149] nix-daemon[837]: accepted connection from pid 2005, user nix-grpc-daemon (trusted) worker1 # [ 161.311076] nix-daemon[837]: reaped child process 2008, status = succeeded lb # [ 161.301282] niks3-server[1011]: 2026/09/20 09:34:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.334282] nix-grpc-daemon[1642]: time=2026-09-20T09:34:46.980Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 161.335901] nix-grpc-daemon[1642]: time=2026-09-20T09:34:46.980Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 161.331996] niks3-server[1011]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 161.344589] niks3-server[1011]: 2026/09/20 09:34:46 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 161.358280] niks3-server[1011]: 2026/09/20 09:34:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 161.385065] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.032Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.368256] niks3-server[1011]: 2026/09/20 09:34:47 INFO Signed narinfos id=55 count=1 lb # [ 161.370904] niks3-server[1011]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 161.381138] niks3-server[1011]: 2026/09/20 09:34:47 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 161.388892] niks3-server[1011]: 2026/09/20 09:34:47 INFO Completed upload id=55 worker1 # [ 161.411077] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.058Z level=INFO msg="Upload complete. (297ms)" lb # [ 161.392302] niks3-server[1011]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 161.426226] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=10 outputs=1 worker1 # [ 161.441043] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 161.451513] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 161.456864] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 161.461986] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 161.466804] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.113Z level=INFO msg="All 1 paths already cached" worker1 # [ 161.469660] nix-daemon[837]: reaped child process 1988, status = succeeded worker1 # [ 161.472617] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 161.483129] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 161.665809] nix-daemon[837]: accepted connection from pid 2014, user nix-grpc-daemon (trusted) worker1 # [ 161.685044] nix-daemon[837]: reaped child process 2017, status = succeeded worker1 # [ 161.864539] nix-daemon[837]: accepted connection from pid 2019, user nix-grpc-daemon (trusted) worker1 # [ 161.881121] nix-daemon[837]: reaped child process 2022, status = succeeded lb # [ 161.874146] niks3-server[1011]: 2026/09/20 09:34:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.904905] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.551Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 161.906391] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.551Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 161.900137] niks3-server[1011]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst worker1 # [ 161.934981] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.582Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.917091] niks3-server[1011]: 2026/09/20 09:34:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 161.927270] niks3-server[1011]: 2026/09/20 09:34:47 INFO Signed narinfos id=56 count=1 lb # [ 161.932419] niks3-server[1011]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 161.940424] niks3-server[1011]: 2026/09/20 09:34:47 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete worker1 # [ 161.966788] nix-grpc-daemon[1642]: time=2026-09-20T09:34:47.614Z level=INFO msg="Upload complete. (472ms)" lb # [ 161.945238] niks3-server[1011]: 2026/09/20 09:34:47 INFO Completed upload id=56 lb # [ 161.948207] niks3-server[1011]: 2026/09/20 09:34:47 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 161.976241] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 161.988003] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 161.993824] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 161.998783] nix-daemon[837]: reaped child process 2012, status = succeeded worker1 # [ 162.009641] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 162.639649] nix-daemon[837]: reaped child process 2026, status = succeeded worker1 # [ 162.812962] nix-daemon[837]: accepted connection from pid 2041, user nix-grpc-daemon (trusted) worker1 # [ 162.829514] nix-daemon[837]: reaped child process 2044, status = succeeded lb # [ 162.822017] niks3-server[1011]: 2026/09/20 09:34:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.856450] nix-grpc-daemon[1642]: time=2026-09-20T09:34:48.500Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 162.857957] nix-grpc-daemon[1642]: time=2026-09-20T09:34:48.500Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 162.858320] niks3-server[1011]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 162.873054] niks3-server[1011]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 162.885389] niks3-server[1011]: 2026/09/20 09:34:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 162.912713] nix-grpc-daemon[1642]: time=2026-09-20T09:34:48.559Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.894891] niks3-server[1011]: 2026/09/20 09:34:48 INFO Signed narinfos id=57 count=1 lb # [ 162.899586] niks3-server[1011]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls worker1 # [ 162.927748] nix-grpc-daemon[1642]: time=2026-09-20T09:34:48.574Z level=INFO msg="Upload complete. (307ms)" lb # [ 162.906801] niks3-server[1011]: 2026/09/20 09:34:48 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 162.911166] niks3-server[1011]: 2026/09/20 09:34:48 INFO Completed upload id=57 lb # [ 162.913928] niks3-server[1011]: 2026/09/20 09:34:48 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker1 # [ 162.943967] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=11 outputs=1 worker1 # [ 162.959755] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 162.965124] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 162.969742] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 162.974643] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 162.979196] nix-daemon[837]: reaped child process 2024, status = succeeded worker1 # [ 162.982383] nix-grpc-daemon[1642]: time=2026-09-20T09:34:48.629Z level=INFO msg="All 2 paths already cached" worker1 # [ 162.989464] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 162.998672] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 163.186315] nix-daemon[837]: accepted connection from pid 2050, user nix-grpc-daemon (trusted) worker1 # [ 163.204920] nix-daemon[837]: reaped child process 2053, status = succeeded worker1 # [ 163.382368] nix-daemon[837]: accepted connection from pid 2055, user nix-grpc-daemon (trusted) worker1 # [ 163.400337] nix-daemon[837]: reaped child process 2058, status = succeeded lb # [ 163.389570] niks3-server[1011]: 2026/09/20 09:34:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.420110] nix-grpc-daemon[1642]: time=2026-09-20T09:34:49.067Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.422128] nix-grpc-daemon[1642]: time=2026-09-20T09:34:49.067Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 163.416444] niks3-server[1011]: 2026/09/20 09:34:49 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 163.430493] niks3-server[1011]: 2026/09/20 09:34:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign worker1 # [ 163.458459] nix-grpc-daemon[1642]: time=2026-09-20T09:34:49.105Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.443033] niks3-server[1011]: 2026/09/20 09:34:49 INFO Signed narinfos id=58 count=1 lb # [ 163.449687] niks3-server[1011]: 2026/09/20 09:34:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 163.457814] niks3-server[1011]: 2026/09/20 09:34:49 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete worker1 # [ 163.484158] nix-grpc-daemon[1642]: time=2026-09-20T09:34:49.131Z level=INFO msg="Upload complete. (474ms)" lb # [ 163.462704] niks3-server[1011]: 2026/09/20 09:34:49 INFO Completed upload id=58 lb # [ 163.466555] niks3-server[1011]: 2026/09/20 09:34:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 163.492149] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 163.502112] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 163.508580] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 163.513257] nix-daemon[837]: reaped child process 2048, status = succeeded worker1 # [ 163.526108] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 164.949582] nix-daemon[837]: reaped child process 2062, status = succeeded worker1 # [ 165.114077] nix-daemon[837]: accepted connection from pid 2077, user nix-grpc-daemon (trusted) worker1 # [ 165.131483] nix-daemon[837]: reaped child process 2080, status = succeeded lb # [ 165.122010] niks3-server[1011]: 2026/09/20 09:34:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.155372] nix-grpc-daemon[1642]: time=2026-09-20T09:34:50.801Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.157250] nix-grpc-daemon[1642]: time=2026-09-20T09:34:50.801Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 165.159457] niks3-server[1011]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 165.175383] niks3-server[1011]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker1 # [ 165.206417] nix-grpc-daemon[1642]: time=2026-09-20T09:34:50.853Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.188181] niks3-server[1011]: 2026/09/20 09:34:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 165.196246] niks3-server[1011]: 2026/09/20 09:34:50 INFO Signed narinfos id=59 count=1 lb # [ 165.202035] niks3-server[1011]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls worker1 # [ 165.233046] nix-grpc-daemon[1642]: time=2026-09-20T09:34:50.880Z level=INFO msg="Upload complete. (296ms)" lb # [ 165.210247] niks3-server[1011]: 2026/09/20 09:34:50 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 165.217211] niks3-server[1011]: 2026/09/20 09:34:50 INFO Completed upload id=59 lb # [ 165.220843] niks3-server[1011]: 2026/09/20 09:34:50 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker1 # [ 165.245077] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=12 outputs=1 worker1 # [ 165.261931] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:50Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 165.266848] nix-daemon[837]: reaped child process 2060, status = succeeded worker1 # [ 165.287451] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 165.303307] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 165.318426] nix-grpc-daemon[1642]: time=2026-09-20T09:34:50.965Z level=INFO msg="All 2 paths already cached" worker1 # [ 165.327554] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 165.341802] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 165.539022] nix-daemon[837]: accepted connection from pid 2084, user nix-grpc-daemon (trusted) worker1 # [ 165.557557] nix-daemon[837]: reaped child process 2087, status = succeeded worker1 # [ 165.738836] nix-daemon[837]: accepted connection from pid 2089, user nix-grpc-daemon (trusted) worker1 # [ 165.756516] nix-daemon[837]: reaped child process 2092, status = succeeded lb # [ 165.745807] niks3-server[1011]: 2026/09/20 09:34:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.778348] nix-grpc-daemon[1642]: time=2026-09-20T09:34:51.425Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.779865] nix-grpc-daemon[1642]: time=2026-09-20T09:34:51.425Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 165.776484] niks3-server[1011]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 165.810315] nix-grpc-daemon[1642]: time=2026-09-20T09:34:51.457Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.791357] niks3-server[1011]: 2026/09/20 09:34:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 165.801336] niks3-server[1011]: 2026/09/20 09:34:51 INFO Signed narinfos id=60 count=1 worker1 # [ 165.831051] nix-grpc-daemon[1642]: time=2026-09-20T09:34:51.478Z level=INFO msg="Upload complete. (473ms)" lb # [ 165.810588] niks3-server[1011]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 165.815508] niks3-server[1011]: 2026/09/20 09:34:51 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 165.819809] niks3-server[1011]: 2026/09/20 09:34:51 INFO Completed upload id=60 lb # [ 165.821965] niks3-server[1011]: 2026/09/20 09:34:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 165.836453] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 165.850769] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 165.856353] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 165.860975] nix-daemon[837]: reaped child process 2082, status = succeeded worker1 # [ 165.873053] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 167.501501] nix-daemon[837]: reaped child process 2096, status = succeeded worker1 # [ 167.670413] nix-daemon[837]: accepted connection from pid 2111, user nix-grpc-daemon (trusted) worker1 # [ 167.688983] nix-daemon[837]: reaped child process 2114, status = succeeded lb # [ 167.679345] niks3-server[1011]: 2026/09/20 09:34:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.712413] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.357Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 167.713933] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.357Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 167.718320] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 167.730548] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst worker1 # [ 167.764501] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.411Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.745660] niks3-server[1011]: 2026/09/20 09:34:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 167.752923] niks3-server[1011]: 2026/09/20 09:34:53 INFO Signed narinfos id=61 count=1 lb # [ 167.755034] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 167.762672] niks3-server[1011]: 2026/09/20 09:34:53 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 167.768355] niks3-server[1011]: 2026/09/20 09:34:53 INFO Completed upload id=61 worker1 # [ 167.790525] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.437Z level=INFO msg="Upload complete. (307ms)" lb # [ 167.770667] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker1 # [ 167.801131] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=13 outputs=1 worker1 # [ 167.817780] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:53Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 167.822056] nix-daemon[837]: reaped child process 2094, status = succeeded worker1 # [ 167.843068] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 167.858823] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 167.874431] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.520Z level=INFO msg="All 2 paths already cached" worker1 # [ 167.879940] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 167.893829] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 168.090055] nix-daemon[837]: accepted connection from pid 2118, user nix-grpc-daemon (trusted) worker1 # [ 168.109557] nix-daemon[837]: reaped child process 2121, status = succeeded worker1 # [ 168.283406] nix-daemon[837]: accepted connection from pid 2123, user nix-grpc-daemon (trusted) worker1 # [ 168.300796] nix-daemon[837]: reaped child process 2126, status = succeeded lb # [ 168.289896] niks3-server[1011]: 2026/09/20 09:34:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.321406] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.968Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 168.323029] nix-grpc-daemon[1642]: time=2026-09-20T09:34:53.968Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 168.316660] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst lb # [ 168.333055] niks3-server[1011]: 2026/09/20 09:34:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 168.360603] nix-grpc-daemon[1642]: time=2026-09-20T09:34:54.007Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.345477] niks3-server[1011]: 2026/09/20 09:34:53 INFO Signed narinfos id=62 count=1 lb # [ 168.352610] niks3-server[1011]: 2026/09/20 09:34:53 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 168.362846] niks3-server[1011]: 2026/09/20 09:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 168.367890] niks3-server[1011]: 2026/09/20 09:34:54 INFO Completed upload id=62 worker1 # [ 168.389717] nix-grpc-daemon[1642]: time=2026-09-20T09:34:54.036Z level=INFO msg="Upload complete. (480ms)" lb # [ 168.370771] niks3-server[1011]: 2026/09/20 09:34:54 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 168.400378] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 168.411919] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 168.421607] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 168.426108] nix-daemon[837]: reaped child process 2116, status = succeeded worker1 # [ 168.438953] nix-daemon[837]: accepted connection from pid 1568, user nix-grpc-daemon (trusted) worker1 # [ 169.884264] nix-daemon[837]: reaped child process 2130, status = succeeded worker1 # [ 170.062016] nix-daemon[837]: accepted connection from pid 2145, user nix-grpc-daemon (trusted) worker1 # [ 170.081962] nix-daemon[837]: reaped child process 2148, status = succeeded lb # [ 170.074104] niks3-server[1011]: 2026/09/20 09:34:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.105426] nix-grpc-daemon[1642]: time=2026-09-20T09:34:55.752Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 170.108150] nix-grpc-daemon[1642]: time=2026-09-20T09:34:55.754Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 170.111861] niks3-server[1011]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 170.123353] niks3-server[1011]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 170.135241] niks3-server[1011]: 2026/09/20 09:34:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign worker1 # [ 170.162526] nix-grpc-daemon[1642]: time=2026-09-20T09:34:55.809Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.141797] niks3-server[1011]: 2026/09/20 09:34:55 INFO Signed narinfos id=63 count=1 lb # [ 170.147075] niks3-server[1011]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 170.156412] niks3-server[1011]: 2026/09/20 09:34:55 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 170.163726] niks3-server[1011]: 2026/09/20 09:34:55 INFO Completed upload id=63 worker1 # [ 170.185356] nix-grpc-daemon[1642]: time=2026-09-20T09:34:55.832Z level=INFO msg="Upload complete. (335ms)" lb # [ 170.166610] niks3-server[1011]: 2026/09/20 09:34:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 170.201277] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47578 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=14 outputs=1 worker1 # [ 170.215284] nix-daemon[837]: reaped child process 2128, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.17 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1' worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.08 seconds) client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1 worker1 # [ 170.602679] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 170.612269] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 170.637264] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:56Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.32 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 20.58 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill lb # [ 171.446199] envoy[920]: conn peer=[2001:db8:1::1]:48438 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27161 tx=10712 ms=19866 lb # [ 171.446998] envoy[920]: conn peer=[2001:db8:1::1]:50094 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=880 tx=482 ms=55 worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.11 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 172.233817] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:57Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 worker2 # [ 173.149018] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:47418 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 173.176937] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47578 worker1 # [ 173.203103] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:58Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker1 # [ 173.209203] nix-grpc-daemon[1568]: ts=2026-09-20T09:34:58Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 173.234107] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 173.251488] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5) worker2 # [ 173.344367] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 163 ms (attempt 2/5) worker2 # [ 173.507941] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 3/5) worker2 # [ 173.531006] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 787 ms (attempt 4/5) worker2 # [ 174.327458] nix-grpc-daemon[1583]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 174.349092] nix-grpc-daemon[1583]: ts=2026-09-20T09:34:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47418 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 174.367566] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 174.383209] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) worker2 # [ 174.415485] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:00Z level=info event=niks3_push_started pid=1639 worker2 # [ 174.803702] nix-daemon[840]: accepted connection from pid 1652, user nix-grpc-daemon (trusted) worker2 # [ 174.822707] nix-daemon[840]: reaped child process 1655, status = succeeded worker2 # [ 175.003275] nix-daemon[840]: accepted connection from pid 1657, user nix-grpc-daemon (trusted) worker2 # [ 175.020105] nix-daemon[840]: reaped child process 1660, status = succeeded lb # [ 175.031531] niks3-server[1011]: 2026/09/20 09:35:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 175.048413] nix-grpc-daemon[1639]: time=2026-09-20T09:35:00.693Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 175.050127] nix-grpc-daemon[1639]: time=2026-09-20T09:35:00.693Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 175.072138] niks3-server[1011]: 2026/09/20 09:35:00 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst worker2 # [ 175.089474] nix-grpc-daemon[1639]: time=2026-09-20T09:35:00.736Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.084438] niks3-server[1011]: 2026/09/20 09:35:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 175.092152] niks3-server[1011]: 2026/09/20 09:35:00 INFO Signed narinfos id=64 count=1 lb # [ 175.101570] niks3-server[1011]: 2026/09/20 09:35:00 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls worker2 # [ 175.120351] nix-grpc-daemon[1639]: time=2026-09-20T09:35:00.767Z level=INFO msg="Upload complete. (490ms)" lb # [ 175.114830] niks3-server[1011]: 2026/09/20 09:35:00 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 175.120966] niks3-server[1011]: 2026/09/20 09:35:00 INFO Completed upload id=64 worker2 # [ 175.127662] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 175.125069] niks3-server[1011]: 2026/09/20 09:35:00 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 175.143484] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 175.150168] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) worker2 # [ 175.154823] nix-daemon[840]: reaped child process 1637, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 175.168285] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-drain worker2 # [ 176.208292] nix-daemon[840]: reaped child process 1664, status = succeeded worker2 # [ 176.388192] nix-daemon[840]: accepted connection from pid 1679, user nix-grpc-daemon (trusted) worker2 # [ 176.408678] nix-daemon[840]: reaped child process 1682, status = succeeded lb # [ 176.415025] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 176.432428] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.078Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 176.433958] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.078Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 176.466540] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 176.477254] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 176.496197] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.142Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.489754] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 176.497816] niks3-server[1011]: 2026/09/20 09:35:02 INFO Signed narinfos id=65 count=1 lb # [ 176.503714] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 176.513724] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete worker2 # [ 176.524697] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.171Z level=INFO msg="Upload complete. (346ms)" lb # [ 176.521777] niks3-server[1011]: 2026/09/20 09:35:02 INFO Completed upload id=65 lb # [ 176.523862] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 176.537255] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=15 outputs=1 worker1 # [ 176.562369] nix-grpc-daemon[1568]: ts=2026-09-20T09:35:02Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker1 # [ 176.568414] nix-grpc-daemon[1568]: ts=2026-09-20T09:35:02Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 176.556530] nix-daemon[840]: reaped child process 1662, status = succeeded worker2 # [ 176.590452] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 176.605375] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 176.619418] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.266Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 176.629802] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 176.643942] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) worker2 # [ 176.848755] nix-daemon[840]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker2 # [ 176.867734] nix-daemon[840]: reaped child process 1689, status = succeeded worker2 # [ 177.042284] nix-daemon[840]: accepted connection from pid 1691, user nix-grpc-daemon (trusted) worker2 # [ 177.059414] nix-daemon[840]: reaped child process 1694, status = succeeded lb # [ 177.069256] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 177.084165] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.731Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 177.085686] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.731Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 177.106363] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 177.123455] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.770Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.122593] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 177.132141] niks3-server[1011]: 2026/09/20 09:35:02 INFO Signed narinfos id=66 count=1 lb # [ 177.139403] niks3-server[1011]: 2026/09/20 09:35:02 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 177.146157] niks3-server[1011]: 2026/09/20 09:35:02 INFO Completed upload id=66 worker2 # [ 177.151246] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.798Z level=INFO msg="Upload complete. (490ms)" lb # [ 177.152577] niks3-server[1011]: 2026/09/20 09:35:02 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls worker2 # [ 177.158454] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 177.171460] nix-grpc-daemon[1639]: time=2026-09-20T09:35:02.804Z level=WARN msg="Failed to register uploaded object" key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 177.176068] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 177.183631] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) worker2 # [ 177.186536] nix-daemon[840]: reaped child process 1684, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... worker2 # [ 177.197391] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv client # farm-b> LOG-farm-b-drain worker2 # [ 178.440452] nix-daemon[840]: reaped child process 1698, status = succeeded worker2 # [ 178.610441] nix-daemon[840]: accepted connection from pid 1713, user nix-grpc-daemon (trusted) worker2 # [ 178.628663] nix-daemon[840]: reaped child process 1716, status = succeeded lb # [ 178.635703] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 178.653835] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.299Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 178.655778] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.300Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 178.672257] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 178.689417] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 178.698185] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 178.709033] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.355Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.707740] niks3-server[1011]: 2026/09/20 09:35:04 INFO Signed narinfos id=67 count=1 lb # [ 178.714430] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 178.723698] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete worker2 # [ 178.735101] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.382Z level=INFO msg="Upload complete. (328ms)" lb # [ 178.731838] niks3-server[1011]: 2026/09/20 09:35:04 INFO Completed upload id=67 lb # [ 178.734607] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker1 # [ 178.771400] nix-grpc-daemon[1568]: ts=2026-09-20T09:35:04Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker1 # [ 178.777581] nix-grpc-daemon[1568]: ts=2026-09-20T09:35:04Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 178.746482] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=16 outputs=1 worker2 # [ 178.768941] nix-daemon[840]: reaped child process 1696, status = succeeded worker2 # [ 178.802243] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 178.818783] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 178.833308] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.480Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 178.843947] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 178.857849] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) worker2 # [ 179.059955] nix-daemon[840]: accepted connection from pid 1720, user nix-grpc-daemon (trusted) worker2 # [ 179.078999] nix-daemon[840]: reaped child process 1723, status = succeeded worker2 # [ 179.255193] nix-daemon[840]: accepted connection from pid 1725, user nix-grpc-daemon (trusted) worker2 # [ 179.271439] nix-daemon[840]: reaped child process 1728, status = succeeded lb # [ 179.281405] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 179.296147] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.943Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 179.297658] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.943Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 179.310665] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 179.335919] nix-grpc-daemon[1639]: time=2026-09-20T09:35:04.982Z level=INFO msg="Uploading 1 narinfos" lb # [ 179.324403] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 179.336955] niks3-server[1011]: 2026/09/20 09:35:04 INFO Signed narinfos id=68 count=1 lb # [ 179.339739] niks3-server[1011]: 2026/09/20 09:35:04 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 179.351476] niks3-server[1011]: 2026/09/20 09:35:04 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 179.356499] niks3-server[1011]: 2026/09/20 09:35:05 INFO Completed upload id=68 worker2 # [ 179.361994] nix-grpc-daemon[1639]: time=2026-09-20T09:35:05.009Z level=INFO msg="Upload complete. (487ms)" lb # [ 179.359290] niks3-server[1011]: 2026/09/20 09:35:05 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 179.372697] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 179.380359] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 worker2 # [ 179.391300] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) worker2 # [ 179.393423] nix-daemon[840]: reaped child process 1718, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... worker2 # [ 179.405156] nix-daemon[840]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv client # farm-top> LOG-farm-top-drain worker2 # [ 180.435161] nix-daemon[840]: reaped child process 1732, status = succeeded worker2 # [ 180.596384] nix-daemon[840]: accepted connection from pid 1747, user nix-grpc-daemon (trusted) worker2 # [ 180.616240] nix-daemon[840]: reaped child process 1750, status = succeeded lb # [ 180.623893] niks3-server[1011]: 2026/09/20 09:35:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 180.640674] nix-grpc-daemon[1639]: time=2026-09-20T09:35:06.287Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 180.642162] nix-grpc-daemon[1639]: time=2026-09-20T09:35:06.287Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 180.669865] niks3-server[1011]: 2026/09/20 09:35:06 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 180.681978] niks3-server[1011]: 2026/09/20 09:35:06 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst worker2 # [ 180.695613] nix-grpc-daemon[1639]: time=2026-09-20T09:35:06.342Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.695430] niks3-server[1011]: 2026/09/20 09:35:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 180.705017] niks3-server[1011]: 2026/09/20 09:35:06 INFO Signed narinfos id=69 count=1 worker2 # [ 180.716101] nix-grpc-daemon[1639]: time=2026-09-20T09:35:06.363Z level=INFO msg="Upload complete. (299ms)" lb # [ 180.711533] niks3-server[1011]: 2026/09/20 09:35:06 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 180.718754] niks3-server[1011]: 2026/09/20 09:35:06 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete worker2 # [ 180.725034] nix-grpc-daemon[1583]: ts=2026-09-20T09:35:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:47418 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=17 outputs=1 lb # [ 180.724431] niks3-server[1011]: 2026/09/20 09:35:06 INFO Completed upload id=69 lb # [ 180.727852] niks3-server[1011]: 2026/09/20 09:35:06 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 180.740743] nix-daemon[840]: reaped child process 1730, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.89 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' lb # [ 181.449277] envoy[920]: conn peer=[2001:db8:1::1]:50084 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9510 tx=3874 ms=7601 worker1 # [ 182.247429] nix-grpc-daemon[1568]: ts=2026-09-20T09:35:07Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 11.74 seconds) (finished: run the VM test script, in 183.30 seconds) test script finished in 183.60s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.07 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh