tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm lb # Disk image does not exist, creating the virtualisation disk image... client # Disk image does not exist, creating the virtualisation disk image... worker1 # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 52) client: QEMU running (pid 49) worker1: QEMU running (pid 50) lb # Formatting '/build/vm-state-lb/tmp.rZtADGEtun', fmt=raw size=1073741824 worker2 # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 51) worker1 # Formatting '/build/vm-state-worker1/tmp.PT10xAj6KX', fmt=raw size=1073741824 client # Formatting '/build/vm-state-client/tmp.g53kosCfSb', fmt=raw size=1073741824 lb # mke2fs 1.47.4 (6-Mar-2025) worker2 # Formatting '/build/vm-state-worker2/tmp.eAIliEpUSf', fmt=raw size=1073741824 worker1 # mke2fs 1.47.4 (6-Mar-2025) client # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done worker2 # mke2fs 1.47.4 (6-Mar-2025) client # Discarding device blocks: 0/262144 done lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Discarding device blocks: 0/262144 done client # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Filesystem UUID: ab64aab8-b7c7-45b5-abe6-597f10a9e302 worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Filesystem UUID: 642954f7-dc87-4274-be56-a7c3f1eab4ed lb # Superblock backups stored on blocks: worker2 # Filesystem UUID: c31490af-0e50-4270-967b-5d642ca2e85f client # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 worker2 # Superblock backups stored on blocks: (finished: start all VMs, in 0.51 seconds) worker1 # Discarding device blocks: 0/262144 done client # 32768, 98304, 163840, 229376 lb # worker2 # 32768, 98304, 163840, 229376 client # lb # Allocating group tables: 0/8 done worker2 # client # Allocating group tables: 0/8 done lb # Writing inode tables: 0/8 done worker2 # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done worker2 # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Creating journal (8192 blocks): done client # Writing superblocks and filesystem accounting information: 0/8 done lb # worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # lb # Virtualisation disk image created. worker2 # client # Virtualisation disk image created. client: waiting for unit network-addresses-eth1.service worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes client: waiting for the VM to finish booting worker2 # Virtualisation disk image created. worker1 # Filesystem UUID: 4c31c1f6-49ba-42a0-b96f-6dcdb6ecf34c worker1 # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 worker1 # worker1 # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # worker1 # Virtualisation disk image created. client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] KASLR enabled client # [ 0.000000] random: crng init done client # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] KASLR enabled lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] random: crng init done client # [ 0.000000] Zone ranges: worker2 # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] efi: UEFI not found. client # [ 0.000000] DMA32 empty worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] Normal empty lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] Device empty worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Movable zone start for each node lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] Zone ranges: lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Zone ranges: worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] DMA32 empty client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Normal empty lb # [ 0.000000] DMA32 empty client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] Device empty lb # [ 0.000000] Normal empty lb # [ 0.000000] Device empty worker2 # [ 0.000000] Movable zone start for each node client # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] Early memory node ranges lb # [ 0.000000] Movable zone start for each node client # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] Early memory node ranges client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled client # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] random: crng init done lb # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] DMA32 empty lb # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] Normal empty lb # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] Device empty worker2 # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] Movable zone start for each node lb # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] Early memory node ranges lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9f6bv5lb34q1i2zz9zicg65xmqpax058-nixos-system-client-test/init regInfo=/nix/store/z2fzvvs14svami61n7xiwi3b7917b6jq-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/z2fzvvs14svami61n7xiwi3b7917b6jq-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/llalsjd4r22yln9sv6722yaj82c9dmk5-nixos-system-worker2-test/init regInfo=/nix/store/ylnayjgjjxgxnr3n328xnxdd7yr7m6db-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test/init regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/ylnayjgjjxgxnr3n328xnxdd7yr7m6db-closure-info/registration", will be passed to user space. client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qdg5w64gnxykmz82pw25fgmx46q7lp99-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Policy zone: DMA client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] Policy zone: DMA client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/wqisxk59apba7r6f4zihd6l6v5f3l1ba-nixos-system-worker1-test/init regInfo=/nix/store/gm4b0ass7ji18qksy3kv07zfazi27k3j-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/gm4b0ass7ji18qksy3kv07zfazi27k3j-closure-info/registration", will be passed to user space. client # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000032] arm-pv: using stolen time PV worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.000444] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000642] Console: colour dummy device 80x25 worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000651] printk: legacy console [tty0] enabled worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000032] arm-pv: using stolen time PV lb # [ 0.000032] arm-pv: using stolen time PV worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000875] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000457] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000882] pid_max: default: 32768 minimum: 301 lb # [ 0.000468] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000634] Console: colour dummy device 80x25 worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000637] Console: colour dummy device 80x25 client # [ 0.000958] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000642] printk: legacy console [tty0] enabled client # [ 0.001365] landlock: Up and running. lb # [ 0.000645] printk: legacy console [tty0] enabled client # [ 0.001368] Yama: becoming mindful. client # [ 0.001866] LSM support for eBPF active worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000832] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000863] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.000839] pid_max: default: 32768 minimum: 301 client # [ 0.002015] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000871] pid_max: default: 32768 minimum: 301 worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000910] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000943] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.002047] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.001067] landlock: Up and running. worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.001082] landlock: Up and running. worker2 # [ 0.001070] Yama: becoming mindful. lb # [ 0.001085] Yama: becoming mindful. client # [ 0.003212] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.001588] LSM support for eBPF active lb # [ 0.001610] LSM support for eBPF active client # [ 0.003972] rcu: Hierarchical SRCU implementation. worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.001744] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.003976] rcu: Max phase no-delay instances is 1000. lb # [ 0.001795] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.005265] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.001787] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.001830] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.005357] EFI services will not be available. worker2 # [ 0.003067] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.005435] smp: Bringing up secondary CPUs ... lb # [ 0.003060] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.005443] smp: Brought up 1 node, 1 CPU lb # [ 0.003848] rcu: Hierarchical SRCU implementation. worker2 # [ 0.003879] rcu: Hierarchical SRCU implementation. client # [ 0.005447] SMP: Total of 1 processors activated. worker2 # [ 0.003883] rcu: Max phase no-delay instances is 1000. lb # [ 0.003852] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.005452] CPU: All CPU(s) started at EL1 worker2 # [ 0.005130] fsl-mc MSI: its@8080000 domain created lb # [ 0.005092] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.005223] EFI services will not be available. client # [ 0.005464] CPU features: detected: Branch Target Identification worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.005193] EFI services will not be available. worker1 # [ 0.000031] arm-pv: using stolen time PV worker2 # [ 0.005300] smp: Bringing up secondary CPUs ... client # [ 0.005470] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.005272] smp: Bringing up secondary CPUs ... worker2 # [ 0.005308] smp: Brought up 1 node, 1 CPU lb # [ 0.005281] smp: Brought up 1 node, 1 CPU worker2 # [ 0.005312] SMP: Total of 1 processors activated. worker1 # [ 0.000415] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.005473] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.005285] SMP: Total of 1 processors activated. worker2 # [ 0.005318] CPU: All CPU(s) started at EL1 worker1 # [ 0.000595] Console: colour dummy device 80x25 lb # [ 0.005325] CPU: All CPU(s) started at EL1 worker2 # [ 0.005329] CPU features: detected: Branch Target Identification lb # [ 0.005336] CPU features: detected: Branch Target Identification client # [ 0.005476] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.000604] printk: legacy console [tty0] enabled worker2 # [ 0.005334] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.005480] CPU features: detected: Common not Private translations lb # [ 0.005341] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.000822] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.005483] CPU features: detected: CRC32 instructions worker1 # [ 0.000830] pid_max: default: 32768 minimum: 301 worker2 # [ 0.005337] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.005345] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.005486] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.000910] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.005341] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.005348] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.005490] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.001047] landlock: Up and running. worker1 # [ 0.001050] Yama: becoming mindful. worker2 # [ 0.005344] CPU features: detected: Common not Private translations lb # [ 0.005352] CPU features: detected: Common not Private translations worker1 # [ 0.001517] LSM support for eBPF active client # [ 0.005493] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.005347] CPU features: detected: CRC32 instructions lb # [ 0.005355] CPU features: detected: CRC32 instructions client # [ 0.005496] CPU features: detected: E0PD worker1 # [ 0.001684] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.005499] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.005350] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.005357] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.001719] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.005502] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.005354] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.005361] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.002881] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.005506] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.005357] CPU features: detected: Data independent timing control (DIT) lb # [ 0.005364] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.003647] rcu: Hierarchical SRCU implementation. client # [ 0.005508] CPU features: detected: Fine Grained Traps worker2 # [ 0.005360] CPU features: detected: E0PD lb # [ 0.005367] CPU features: detected: E0PD worker1 # [ 0.003651] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.005363] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.004863] fsl-mc MSI: its@8080000 domain created client # [ 0.005512] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.005369] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.004953] EFI services will not be available. worker2 # [ 0.005366] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.005517] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.005372] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.005032] smp: Bringing up secondary CPUs ... client # [ 0.005520] CPU features: detected: LSE atomic instructions worker2 # [ 0.005369] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.005376] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.005040] smp: Brought up 1 node, 1 CPU client # [ 0.005523] CPU features: detected: Privileged Access Never lb # [ 0.005379] CPU features: detected: Fine Grained Traps worker1 # [ 0.005043] SMP: Total of 1 processors activated. worker2 # [ 0.005372] CPU features: detected: Fine Grained Traps client # [ 0.005525] CPU features: detected: PMUv3 worker1 # [ 0.005049] CPU: All CPU(s) started at EL1 worker2 # [ 0.005375] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.005382] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.005528] CPU features: detected: RAS Extension Support worker1 # [ 0.005060] CPU features: detected: Branch Target Identification worker2 # [ 0.005380] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.005386] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.005531] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.005065] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.005383] CPU features: detected: LSE atomic instructions lb # [ 0.005389] CPU features: detected: LSE atomic instructions client # [ 0.005533] CPU features: detected: Random Number Generator lb # [ 0.005392] CPU features: detected: Privileged Access Never worker2 # [ 0.005386] CPU features: detected: Privileged Access Never worker1 # [ 0.005068] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.005536] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.005389] CPU features: detected: PMUv3 lb # [ 0.005395] CPU features: detected: PMUv3 client # [ 0.005539] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.005391] CPU features: detected: RAS Extension Support lb # [ 0.005398] CPU features: detected: RAS Extension Support worker1 # [ 0.005072] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.005542] CPU features: detected: TLB range maintenance instructions lb # [ 0.005400] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.005394] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.005075] CPU features: detected: Common not Private translations worker2 # [ 0.005397] CPU features: detected: Random Number Generator lb # [ 0.005403] CPU features: detected: Random Number Generator client # [ 0.005547] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.005079] CPU features: detected: CRC32 instructions lb # [ 0.005405] CPU features: detected: Speculation barrier (SB) client # [ 0.005585] alternatives: applying system-wide alternatives worker1 # [ 0.005082] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.005408] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.005399] CPU features: detected: Speculation barrier (SB) client # [ 0.008682] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.005085] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.005402] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.005411] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.005089] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.005405] CPU features: detected: TLB range maintenance instructions lb # [ 0.005416] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.005092] CPU features: detected: E0PD client # [ 0.008940] Memory: 1406540K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) lb # [ 0.005452] alternatives: applying system-wide alternatives client # [ 0.009327] devtmpfs: initialized worker2 # [ 0.005410] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.005094] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.008510] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.005449] alternatives: applying system-wide alternatives client # [ 0.011140] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.005097] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.008586] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.005101] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.005104] CPU features: detected: Fine Grained Traps lb # [ 0.008663] Memory: 1406604K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) lb # [ 0.009054] devtmpfs: initialized worker2 # [ 0.008770] Memory: 1406548K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.005107] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.009145] devtmpfs: initialized lb # [ 0.010926] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.005112] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.011056] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.005115] CPU features: detected: LSE atomic instructions lb # [ 0.010949] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.005119] CPU features: detected: Privileged Access Never lb # [ 0.011137] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.011080] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.005121] CPU features: detected: PMUv3 worker2 # [ 0.011282] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.005124] CPU features: detected: RAS Extension Support lb # [ 0.011142] 0 pages in range for non-PLT usage worker2 # [ 0.011287] 0 pages in range for non-PLT usage worker1 # [ 0.005127] CPU features: detected: RASv1p1 Extension Support lb # [ 0.011143] 508288 pages in range for PLT usage worker2 # [ 0.011288] 508288 pages in range for PLT usage worker1 # [ 0.005129] CPU features: detected: Random Number Generator lb # [ 0.011257] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.011409] pinctrl core: initialized pinctrl subsystem lb # [ 0.012089] DMI not present or invalid. worker2 # [ 0.012149] DMI not present or invalid. worker1 # [ 0.005132] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.015547] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.015490] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.005135] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.018127] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.005138] CPU features: detected: TLB range maintenance instructions lb # [ 0.017763] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.011163] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.011359] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.005143] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.018329] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.017944] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.011363] 0 pages in range for non-PLT usage worker1 # [ 0.005179] alternatives: applying system-wide alternatives worker2 # [ 0.018533] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.018148] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.011364] 508288 pages in range for PLT usage worker1 # [ 0.008209] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.018172] audit: initializing netlink subsys (disabled) worker2 # [ 0.018561] audit: initializing netlink subsys (disabled) client # [ 0.011483] pinctrl core: initialized pinctrl subsystem client # [ 0.012255] DMI not present or invalid. lb # [ 0.018759] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.019162] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.015448] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.018761] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.019164] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.008373] Memory: 1406516K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.008763] devtmpfs: initialized client # [ 0.017859] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.018765] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.019167] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.010678] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.018770] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.019173] thermal_sys: Registered thermal governor 'user_space' client # [ 0.018035] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.018773] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.019175] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.010701] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.018242] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.018804] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.010891] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.018264] audit: initializing netlink subsys (disabled) worker2 # [ 0.019200] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.018812] cpuidle: using governor ladder worker2 # [ 0.019208] cpuidle: using governor ladder client # [ 0.018819] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.018818] cpuidle: using governor menu worker2 # [ 0.019214] cpuidle: using governor menu client # [ 0.018821] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.019003] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.019406] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.018825] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.019019] ASID allocator initialised with 65536 entries worker2 # [ 0.019421] ASID allocator initialised with 65536 entries lb # [ 0.020213] Serial: AMBA PL011 UART driver client # [ 0.018830] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.020576] Serial: AMBA PL011 UART driver client # [ 0.018833] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.025474] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.025858] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.025651] printk: console [ttyAMA0] enabled worker2 # [ 0.026006] printk: console [ttyAMA0] enabled client # [ 0.018864] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.018873] cpuidle: using governor ladder client # [ 0.018879] cpuidle: using governor menu client # [ 0.019069] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.019084] ASID allocator initialised with 65536 entries client # [ 0.020261] Serial: AMBA PL011 UART driver client # [ 0.025481] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.010895] 0 pages in range for non-PLT usage client # [ 0.025606] printk: console [ttyAMA0] enabled worker1 # [ 0.010896] 508288 pages in range for PLT usage worker1 # [ 0.010997] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.011759] DMI not present or invalid. client # [ 0.145217] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.014902] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.142391] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.143189] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.145241] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.017417] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.142409] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.143206] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.145247] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.142415] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.143212] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.017617] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.145251] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.142420] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.143216] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.145256] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.017816] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.142424] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.017843] audit: initializing netlink subsys (disabled) client # [ 0.145260] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.143221] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.142428] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.018419] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.143225] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.145265] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.018420] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.142433] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.145269] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.143229] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.018424] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.142437] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.143234] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.018429] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.018432] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.152512] fbcon: Taking over console lb # [ 0.149638] fbcon: Taking over console worker1 # [ 0.018457] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.150484] fbcon: Taking over console client # [ 0.152528] ACPI: Interpreter disabled. worker1 # [ 0.018465] cpuidle: using governor ladder lb # [ 0.149656] ACPI: Interpreter disabled. worker2 # [ 0.150502] ACPI: Interpreter disabled. worker1 # [ 0.018471] cpuidle: using governor menu worker1 # [ 0.018655] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.018670] ASID allocator initialised with 65536 entries worker1 # [ 0.019911] Serial: AMBA PL011 UART driver worker1 # [ 0.025125] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.025249] printk: console [ttyAMA0] enabled client # [ 0.158814] iommu: Default domain type: Translated worker1 # [ 0.144631] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.158823] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.144651] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.160513] SCSI subsystem initialized worker1 # [ 0.144657] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.161243] usbcore: registered new interface driver usbfs worker1 # [ 0.144661] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.161282] usbcore: registered new interface driver hub lb # [ 0.158704] iommu: Default domain type: Translated worker2 # [ 0.159501] iommu: Default domain type: Translated worker1 # [ 0.144665] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.161300] usbcore: registered new device driver usb lb # [ 0.158716] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.159512] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.144670] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.161592] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.159057] SCSI subsystem initialized worker2 # [ 0.159875] SCSI subsystem initialized worker1 # [ 0.144674] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.161598] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.144678] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.160966] usbcore: registered new interface driver usbfs client # [ 0.161609] PTP clock support registered worker2 # [ 0.161793] usbcore: registered new interface driver usbfs client # [ 0.161663] EDAC MC: Ver: 3.0.0 lb # [ 0.161006] usbcore: registered new interface driver hub worker2 # [ 0.161826] usbcore: registered new interface driver hub lb # [ 0.161024] usbcore: registered new device driver usb worker2 # [ 0.161843] usbcore: registered new device driver usb client # [ 0.166196] scmi_core: SCMI protocol bus registered lb # [ 0.161344] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.162128] pps_core: LinuxPPS API ver. 1 registered client # [ 0.167190] FPGA manager framework worker1 # [ 0.152127] fbcon: Taking over console client # [ 0.168111] vgaarb: loaded lb # [ 0.161350] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.162135] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.152143] ACPI: Interpreter disabled. lb # [ 0.161369] PTP clock support registered worker2 # [ 0.162145] PTP clock support registered lb # [ 0.161425] EDAC MC: Ver: 3.0.0 worker2 # [ 0.162198] EDAC MC: Ver: 3.0.0 client # [ 0.168783] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.166019] scmi_core: SCMI protocol bus registered worker2 # [ 0.166805] scmi_core: SCMI protocol bus registered lb # [ 0.167026] FPGA manager framework worker2 # [ 0.167774] FPGA manager framework lb # [ 0.168022] vgaarb: loaded worker2 # [ 0.168722] vgaarb: loaded worker2 # [ 0.169374] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.168660] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.159080] iommu: Default domain type: Translated worker1 # [ 0.159090] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.174940] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.160800] SCSI subsystem initialized client # [ 0.174983] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.176626] netfs: FS-Cache loaded worker1 # [ 0.161514] usbcore: registered new interface driver usbfs client # [ 0.176732] pnp: PnP ACPI: disabled worker1 # [ 0.161546] usbcore: registered new interface driver hub worker1 # [ 0.161565] usbcore: registered new device driver usb worker2 # [ 0.175493] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.161854] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.175011] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.175541] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.175061] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.161860] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.177193] netfs: FS-Cache loaded worker1 # [ 0.161871] PTP clock support registered lb # [ 0.176714] netfs: FS-Cache loaded worker1 # [ 0.161920] EDAC MC: Ver: 3.0.0 worker2 # [ 0.177316] pnp: PnP ACPI: disabled lb # [ 0.176846] pnp: PnP ACPI: disabled client # [ 0.180608] NET: Registered PF_INET protocol family worker1 # [ 0.166582] scmi_core: SCMI protocol bus registered worker1 # [ 0.167563] FPGA manager framework worker1 # [ 0.168495] vgaarb: loaded worker1 # [ 0.169141] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.181092] NET: Registered PF_INET protocol family worker2 # [ 0.181361] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.181518] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.172538] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.172569] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.180725] NET: Registered PF_INET protocol family lb # [ 0.180997] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.176305] netfs: FS-Cache loaded worker1 # [ 0.176426] pnp: PnP ACPI: disabled worker1 # [ 0.180417] NET: Registered PF_INET protocol family worker1 # [ 0.180692] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.210396] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.210450] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.210478] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.210565] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.210763] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.211291] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.210712] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.210820] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.211347] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.210802] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.210852] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.211379] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.210839] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.210876] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.210939] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.211463] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.210967] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.211082] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.211607] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.211007] NET: Registered PF_XDP protocol family lb # [ 0.211172] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.211027] PCI: CLS 0 bytes, default 64 worker2 # [ 0.211699] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.211279] Trying to unpack rootfs image as initramfs... lb # [ 0.211210] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.211751] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211247] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.211789] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211394] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.211878] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.211419] NET: Registered PF_XDP protocol family worker2 # [ 0.211910] NET: Registered PF_XDP protocol family lb # [ 0.211438] PCI: CLS 0 bytes, default 64 worker2 # [ 0.211929] PCI: CLS 0 bytes, default 64 lb # [ 0.211694] Trying to unpack rootfs image as initramfs... worker2 # [ 0.212197] Trying to unpack rootfs image as initramfs... worker2 # [ 0.226908] kvm [1]: HYP mode not available worker1 # [ 0.210010] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.226245] kvm [1]: HYP mode not available worker1 # [ 0.210065] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.210099] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.210184] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.210350] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.210435] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.210473] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.210509] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.210595] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.210667] NET: Registered PF_XDP protocol family worker1 # [ 0.210687] PCI: CLS 0 bytes, default 64 worker1 # [ 0.210930] Trying to unpack rootfs image as initramfs... worker1 # [ 0.227042] kvm [1]: HYP mode not available lb # [ 0.232727] kvm [1]: HYP mode not available client # [ 0.325363] Initialise system trusted keyrings client # [ 0.332871] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.330806] Initialise system trusted keyrings client # [ 0.334335] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.331570] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.332853] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.335113] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.334839] Initialise system trusted keyrings worker2 # [ 0.335607] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.336825] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.333649] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.325763] Initialise system trusted keyrings worker1 # [ 0.326526] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.327771] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.328525] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.337637] 9p: Installing v9fs 9p2000 file system support client # [ 0.355760] Key type asymmetric registered client # [ 0.355786] Asymmetric key parser 'x509' registered client # [ 0.355858] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.358018] io scheduler mq-deadline registered client # [ 0.358029] io scheduler kyber registered worker2 # [ 0.357605] Key type asymmetric registered worker2 # [ 0.357630] Asymmetric key parser 'x509' registered lb # [ 0.357639] Key type asymmetric registered lb # [ 0.357666] Asymmetric key parser 'x509' registered worker2 # [ 0.357718] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.357746] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.359873] io scheduler mq-deadline registered lb # [ 0.359884] io scheduler kyber registered worker2 # [ 0.365436] io scheduler mq-deadline registered worker2 # [ 0.365455] io scheduler kyber registered client # [ 0.368960] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.357203] Key type asymmetric registered worker1 # [ 0.357231] Asymmetric key parser 'x509' registered client # [ 0.370337] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.357301] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.370726] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.359444] io scheduler mq-deadline registered worker1 # [ 0.359456] io scheduler kyber registered client # [ 0.370743] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.370755] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.370763] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.373532] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.373086] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.370784] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.370809] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.370905] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.374895] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.370915] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.375272] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.370921] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.370926] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.375290] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.370931] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.375303] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.371021] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.374489] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.375311] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.369311] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.374899] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.371459] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.375339] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.371641] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.374917] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.371657] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.375364] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.374937] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.371686] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.375446] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.370773] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.371702] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.375457] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.374947] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.371185] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.375463] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.372155] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.374968] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.372337] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.375468] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.371204] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.374990] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.372352] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.375473] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.371217] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.372382] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.375087] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.375568] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.375098] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.371226] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.376004] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.375104] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.371250] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.376189] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.375110] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.376205] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.371290] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.375115] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.376235] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.371378] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.375175] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.376251] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.371388] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.371395] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.375610] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.376704] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.375795] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.371401] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.376886] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.375812] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.376902] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.371406] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.375842] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.376931] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.371464] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.375859] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.371908] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.376316] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.372092] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.376499] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.372109] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.376515] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.372138] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.376545] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.372154] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.377020] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.372606] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.377203] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.372789] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.377219] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.372804] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.396930] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.377249] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.372834] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.397139] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.377724] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.397156] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.377907] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.397186] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.377923] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.391972] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.397699] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.377957] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.392160] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.397883] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.378411] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.392176] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.397898] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.378594] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.392205] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.397931] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.378611] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.392664] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.398404] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.378640] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.392847] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.398585] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.379110] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.392863] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.401447] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.398601] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.379306] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.401650] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.392896] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.398631] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.379324] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.401667] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.399084] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.379356] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.401697] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.399266] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.379838] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.402211] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.399282] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.380022] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.402393] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.399311] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.380038] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.402408] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.399767] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.380069] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.402440] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.399950] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.380085] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.402904] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.399966] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.380535] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.403088] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.399996] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.403104] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.400013] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.403133] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.400500] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.403578] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.400687] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.403760] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.400716] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.403776] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.401204] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.403806] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.401391] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.404254] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.401421] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.404436] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.401831] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.404451] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.402011] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.404480] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.404497] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.402261] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.420775] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.405470] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.402532] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.404991] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.420817] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.405681] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.402549] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.405181] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.405700] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.421322] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.402578] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.405211] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.405730] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.421515] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.403048] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.405681] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.406192] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.421545] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.403230] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.406392] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.405866] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.403245] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.421940] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.406408] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.405895] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.422121] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.403274] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.406437] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.406290] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.403855] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.422366] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.406884] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.406478] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.422648] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.403867] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.407066] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.422666] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.406730] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.403872] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.407082] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.407005] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.422696] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.407111] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.403917] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.407022] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.423161] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.407127] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.403964] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.407051] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.423344] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.407585] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.423360] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.404013] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.407520] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.407771] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.407704] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.423390] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.404060] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.407800] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.407720] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.423964] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.404107] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.407749] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.408254] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.423977] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.404153] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.408439] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.408315] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.423982] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.408468] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.404199] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.408326] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.424028] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.408851] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.404245] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.408332] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.424074] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.409031] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.404292] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.408375] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.424123] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.409292] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.404363] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.408424] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.409581] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.424170] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.404409] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.409599] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.408471] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.424217] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.404431] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.409629] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.408517] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.404452] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.424265] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.410098] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.408562] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.404474] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.410302] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.424314] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.408610] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.404498] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.410318] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.424360] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.404520] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.410348] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.408656] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.424407] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.410923] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.404541] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.408703] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.424480] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.404563] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.410935] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.408749] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.424525] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.404584] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.410941] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.408825] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.424548] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.404606] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.410986] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.408871] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.424570] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.404629] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.408893] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.411033] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.424593] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.404651] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.408914] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.424619] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.411079] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.404672] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.408936] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.424642] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.404693] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.411125] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.404715] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.408960] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.411171] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.404736] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.408982] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.404771] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.411217] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.409003] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.409025] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.411263] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.409047] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.411309] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.409069] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.411355] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.409091] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.411455] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.409113] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.411502] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.409134] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.411523] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.409155] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.411544] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.409178] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.411566] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.409200] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.411591] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.409221] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.409244] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.411612] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.409265] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.411633] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.460697] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.409287] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.411655] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.460749] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.409309] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.411677] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.460774] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.409336] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.411699] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.460798] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.409345] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.411721] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.460822] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.409350] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.411743] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.460847] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.468838] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.411765] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.460870] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.468877] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.411786] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.460894] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.468900] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.411807] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.460917] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.468923] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.411828] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.460939] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.468955] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.411851] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.460963] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.468964] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.411872] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.460986] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.468969] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.411893] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.461010] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.470141] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.411915] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.461035] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.411937] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.461057] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.411963] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.461090] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.474588] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.411972] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.461100] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.411977] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.461105] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.413128] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.462317] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.473262] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58728 usecs client # [ 0.495781] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.499783] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.496845] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.499051] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.506304] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.494046] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.496278] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.506034] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.508137] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.509311] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.510562] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.511594] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.512546] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.514589] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.507660] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.518764] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.520859] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.522711] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.524969] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.527135] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.514146] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.516233] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.532418] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.528836] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.531047] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.535669] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.537375] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.540399] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.526673] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.528964] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.542078] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.544450] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.545614] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.551522] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.548005] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.539189] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.551599] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.554910] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) lb # [ 0.555740] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.559040] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.558020] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.567623] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.549410] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.553223] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.570275] msm_serial: driver initialized client # [ 0.570425] SuperH (H)SCI(F) driver initialized worker1 # [ 0.555780] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.570477] STM32 USART driver initialized worker2 # [ 0.572300] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.572005] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.574677] msm_serial: driver initialized worker2 # [ 0.574961] msm_serial: driver initialized lb # [ 0.574827] SuperH (H)SCI(F) driver initialized worker2 # [ 0.575103] SuperH (H)SCI(F) driver initialized lb # [ 0.574883] STM32 USART driver initialized worker2 # [ 0.575157] STM32 USART driver initialized worker1 # [ 0.574440] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.577240] msm_serial: driver initialized worker1 # [ 0.577405] SuperH (H)SCI(F) driver initialized worker1 # [ 0.577459] STM32 USART driver initialized client # [ 0.606469] loop: module loaded client # [ 0.606673] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.607486] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.611639] loop: module loaded worker2 # [ 0.611869] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.613537] megasas: 07.734.00.00-rc1 worker2 # [ 0.612631] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.613311] loop: module loaded client # [ 0.614261] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.613508] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.616531] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.614262] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.616556] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.618111] megasas: 07.734.00.00-rc1 worker2 # [ 0.618844] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.620689] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.620710] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.611421] loop: module loaded worker1 # [ 0.611620] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.625859] Using buffer write method worker1 # [ 0.612347] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.625939] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.621459] megasas: 07.734.00.00-rc1 lb # [ 0.622233] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.624249] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.624289] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.626073] Using buffer write method worker1 # [ 0.617850] megasas: 07.734.00.00-rc1 worker2 # [ 0.630645] Using buffer write method worker1 # [ 0.618667] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.630730] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.626158] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.620931] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.632340] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.628000] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.620957] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.632373] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.628047] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.636833] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.636867] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.638447] Using buffer write method client # [ 0.638477] Concatenating MTD devices: client # [ 0.638481] (0): "0.flash" client # [ 0.638485] (1): "0.flash" client # [ 0.638489] into device "0.flash" worker1 # [ 0.630269] Using buffer write method worker2 # [ 0.646100] Using buffer write method worker1 # [ 0.630350] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.646140] Concatenating MTD devices: worker2 # [ 0.646144] (0): "0.flash" worker2 # [ 0.646148] (1): "0.flash" worker2 # [ 0.646152] into device "0.flash" lb # [ 0.648767] Using buffer write method lb # [ 0.648809] Concatenating MTD devices: lb # [ 0.648813] (0): "0.flash" lb # [ 0.648818] (1): "0.flash" lb # [ 0.648822] into device "0.flash" worker1 # [ 0.641190] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.641217] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.642747] Using buffer write method worker1 # [ 0.642777] Concatenating MTD devices: worker1 # [ 0.642781] (0): "0.flash" worker1 # [ 0.642785] (1): "0.flash" worker1 # [ 0.642789] into device "0.flash" client # [ 0.911907] Freeing initrd memory: 26160K worker2 # [ 0.908579] Freeing initrd memory: 26148K worker2 # [ 0.914784] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.918063] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.918688] thunder_xcv, ver 1.0 worker2 # [ 0.918730] thunder_bgx, ver 1.0 client # [ 0.921977] thunder_xcv, ver 1.0 worker2 # [ 0.918752] nicpf, ver 1.0 client # [ 0.922030] thunder_bgx, ver 1.0 worker2 # [ 0.919298] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.922056] nicpf, ver 1.0 client # [ 0.922594] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.919305] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.913135] Freeing initrd memory: 26148K client # [ 0.922602] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.919330] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.922627] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.919338] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.922635] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.919368] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.922668] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.919373] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.922673] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.919396] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.922697] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.919402] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.926372] Freeing initrd memory: 26140K worker2 # [ 0.919533] sky2: driver version 1.30 client # [ 0.922703] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.922834] sky2: driver version 1.30 worker2 # [ 0.921072] usbcore: registered new interface driver usb-storage client # [ 0.924414] usbcore: registered new interface driver usb-storage worker2 # [ 0.921186] usbcore: registered new interface driver usbserial_generic client # [ 0.924515] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.921201] usbserial: USB Serial support registered for generic worker1 # [ 0.919399] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.922195] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.924530] usbserial: USB Serial support registered for generic client # [ 0.925589] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.922224] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.925619] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 0.932629] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.925915] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.922510] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.933429] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.933789] hub 1-0:1.0: USB hub found client # [ 0.937563] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.933804] hub 1-0:1.0: 6 ports detected client # [ 0.937951] hub 1-0:1.0: USB hub found client # [ 0.937971] hub 1-0:1.0: 6 ports detected worker1 # [ 0.923208] thunder_xcv, ver 1.0 worker1 # [ 0.923256] thunder_bgx, ver 1.0 worker2 # [ 0.937101] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.923279] nicpf, ver 1.0 client # [ 0.940531] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.923835] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.923842] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.923871] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.938703] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.923881] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.942128] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.923910] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.938738] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:46 UTC (1789911226) worker2 # [ 0.939046] i2c_dev: i2c /dev entries driver worker1 # [ 0.923915] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.942156] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:46 UTC (1789911226) client # [ 0.942457] i2c_dev: i2c /dev entries driver worker1 # [ 0.923938] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.936857] thunder_xcv, ver 1.0 lb # [ 0.936902] thunder_bgx, ver 1.0 worker1 # [ 0.923944] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.936926] nicpf, ver 1.0 worker1 # [ 0.924080] sky2: driver version 1.30 lb # [ 0.937519] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.937527] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.937557] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.943883] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.937566] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.943894] sdhci: Copyright(c) Pierre Ossman client # [ 0.947336] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.932809] usbcore: registered new interface driver usb-storage lb # [ 0.937594] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.947351] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.944155] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.932895] usbcore: registered new interface driver usbserial_generic lb # [ 0.937600] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.947615] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.944518] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.932910] usbserial: USB Serial support registered for generic lb # [ 0.937628] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.947980] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.933951] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.937634] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.937772] sky2: driver version 1.30 worker1 # [ 0.933977] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.948860] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.939426] usbcore: registered new interface driver usb-storage worker1 # [ 0.934179] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.952275] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.949091] usbcore: registered new interface driver usbhid lb # [ 0.939539] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.949098] usbhid: USB HID core driver client # [ 0.952527] usbcore: registered new interface driver usbhid lb # [ 0.939554] usbserial: USB Serial support registered for generic client # [ 0.952535] usbhid: USB HID core driver worker1 # [ 0.939122] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.940155] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.941554] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 0.940743] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.941588] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.951933] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.941811] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.940778] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:46 UTC (1789911226) worker1 # [ 0.941080] i2c_dev: i2c /dev entries driver client # [ 0.955418] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.954539] drop_monitor: Initializing network drop monitor service lb # [ 0.953930] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.954723] NET: Registered PF_INET6 protocol family client # [ 0.956947] drop_monitor: Initializing network drop monitor service lb # [ 0.954308] hub 1-0:1.0: USB hub found client # [ 0.957159] NET: Registered PF_INET6 protocol family lb # [ 0.954346] hub 1-0:1.0: 6 ports detected worker2 # [ 0.956706] Segment Routing with IPv6 worker2 # [ 0.956725] In-situ OAM (IOAM) with IPv6 client # [ 0.960161] Segment Routing with IPv6 worker2 # [ 0.956768] NET: Registered PF_PACKET protocol family client # [ 0.960186] In-situ OAM (IOAM) with IPv6 client # [ 0.960219] NET: Registered PF_PACKET protocol family lb # [ 0.956788] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.956818] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T13:33:46 UTC (1789911226) lb # [ 0.957239] i2c_dev: i2c /dev entries driver worker1 # [ 0.946080] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.958660] 9pnet: Installing 9P2000 support worker1 # [ 0.946091] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.960976] Key type dns_resolver registered client # [ 0.962190] 9pnet: Installing 9P2000 support worker1 # [ 0.946389] Synopsys Designware Multimedia Card Interface Driver client # [ 0.964541] Key type dns_resolver registered worker1 # [ 0.946765] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.948516] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.948783] usbcore: registered new interface driver usbhid worker1 # [ 0.948790] usbhid: USB HID core driver lb # [ 0.962437] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.962450] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.953721] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.954038] hub 1-0:1.0: USB hub found lb # [ 0.962725] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.954059] hub 1-0:1.0: 6 ports detected lb # [ 0.963112] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.967901] registered taskstats version 1 lb # [ 0.967697] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.956861] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.968066] Loading compiled-in X.509 certificates client # [ 0.971616] registered taskstats version 1 lb # [ 0.967954] usbcore: registered new interface driver usbhid client # [ 0.971783] Loading compiled-in X.509 certificates lb # [ 0.967962] usbhid: USB HID core driver worker1 # [ 0.959557] drop_monitor: Initializing network drop monitor service worker1 # [ 0.959756] NET: Registered PF_INET6 protocol family worker1 # [ 0.961777] Segment Routing with IPv6 lb # [ 0.970927] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.961800] In-situ OAM (IOAM) with IPv6 lb # [ 0.972473] drop_monitor: Initializing network drop monitor service worker1 # [ 0.961854] NET: Registered PF_PACKET protocol family lb # [ 0.972619] NET: Registered PF_INET6 protocol family lb # [ 0.975789] Segment Routing with IPv6 worker1 # [ 0.963564] 9pnet: Installing 9P2000 support lb # [ 0.975825] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.976930] Demotion targets for Node 0: null lb # [ 0.975856] NET: Registered PF_PACKET protocol family worker2 # [ 0.977046] Key type .fscrypt registered client # [ 0.980268] Demotion targets for Node 0: null worker2 # [ 0.977054] Key type fscrypt-provisioning registered client # [ 0.980378] Key type .fscrypt registered worker2 # [ 0.977149] ima: No TPM chip found, activating TPM-bypass! client # [ 0.980385] Key type fscrypt-provisioning registered worker2 # [ 0.977169] ima: Allocated hash algorithm: sha1 client # [ 0.980485] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.977192] ima: No architecture policies found client # [ 0.980510] ima: Allocated hash algorithm: sha1 worker1 # [ 0.966511] Key type dns_resolver registered client # [ 0.980532] ima: No architecture policies found lb # [ 0.977802] 9pnet: Installing 9P2000 support worker2 # [ 0.981494] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.980148] Key type dns_resolver registered client # [ 0.984909] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.972995] registered taskstats version 1 lb # [ 0.987478] registered taskstats version 1 worker1 # [ 0.973736] Loading compiled-in X.509 certificates lb # [ 0.987631] Loading compiled-in X.509 certificates worker1 # [ 0.982338] Demotion targets for Node 0: null worker1 # [ 0.982468] Key type .fscrypt registered worker1 # [ 0.982474] Key type fscrypt-provisioning registered worker1 # [ 0.982574] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.982594] ima: Allocated hash algorithm: sha1 worker1 # [ 0.982618] ima: No architecture policies found lb # [ 0.996238] Demotion targets for Node 0: null lb # [ 0.996368] Key type .fscrypt registered lb # [ 0.996374] Key type fscrypt-provisioning registered worker1 # [ 0.986650] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.996477] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.996498] ima: Allocated hash algorithm: sha1 lb # [ 0.996520] ima: No architecture policies found worker2 # [ 1.000105] clk: Disabling unused clocks lb # [ 1.000782] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 1.000143] PM: genpd: Disabling unused power domains client # [ 1.003426] clk: Disabling unused clocks client # [ 1.003466] PM: genpd: Disabling unused power domains worker2 # [ 1.004422] Freeing unused kernel memory: 4736K worker2 # [ 1.004629] Run /init as init process client # [ 1.007717] Freeing unused kernel memory: 4736K client # [ 1.007902] Run /init as init process worker1 # [ 1.005248] clk: Disabling unused clocks worker1 # [ 1.005279] PM: genpd: Disabling unused power domains worker2 # [ 1.019745] systemd[1]: Successfully made /usr/ read-only. client # [ 1.023181] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.019409] clk: Disabling unused clocks worker1 # [ 1.009603] Freeing unused kernel memory: 4736K lb # [ 1.019450] PM: genpd: Disabling unused power domains worker1 # [ 1.009796] Run /init as init process lb # [ 1.023845] Freeing unused kernel memory: 4736K lb # [ 1.024036] Run /init as init process worker1 # [ 1.027578] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.039186] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.181469] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.184878] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.200735] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.201255] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.331625] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.337357] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.355236] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.354629] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.358153] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.366908] systemd[1]: Detected virtualization qemu. client # [ 1.370495] systemd[1]: Detected virtualization qemu. worker2 # [ 1.368927] systemd[1]: Detected architecture arm64. client # [ 1.372513] systemd[1]: Detected architecture arm64. worker2 # [ 1.370935] systemd[1]: Running in initrd. client # [ 1.374537] systemd[1]: Running in initrd. worker2 # [ 1.373581] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.359559] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.377344] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.376408] systemd[1]: Hostname set to . client # [ 1.380226] systemd[1]: Hostname set to . lb # [ 1.374105] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.386138] systemd[1]: Detected virtualization qemu. worker1 # [ 1.365742] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.388135] systemd[1]: Detected architecture arm64. worker1 # [ 1.365807] systemd[1]: Detected virtualization qemu. lb # [ 1.390136] systemd[1]: Running in initrd. worker1 # [ 1.365881] systemd[1]: Detected architecture arm64. lb # [ 1.392843] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.365905] systemd[1]: Running in initrd. lb # [ 1.395769] systemd[1]: Hostname set to . worker1 # [ 1.383000] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.383264] systemd[1]: Hostname set to . worker2 # [ 1.421710] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.425149] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.441035] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.445419] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.545476] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.548882] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.564770] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.565241] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.665608] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.689443] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.688009] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.702603] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.701485] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.704702] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.709476] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.714609] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.723324] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.732624] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.728803] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.739431] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.740405] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.726950] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.741508] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.741541] systemd[1]: Reached target Path Units. worker2 # [ 1.741559] systemd[1]: Reached target Slice Units. worker2 # [ 1.741576] systemd[1]: Reached target Swaps. worker2 # [ 1.741592] systemd[1]: Reached target Timer Units. worker1 # [ 1.731449] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.741755] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.741878] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.742014] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.742130] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.742224] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.742242] systemd[1]: Reached target Socket Units. worker2 # [ 1.750963] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.760465] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.761568] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.774796] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.793733] systemd[1]: Starting Journal Service... worker2 # [ 1.796051] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.796859] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.801819] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.811434] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.810508] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.812860] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.810646] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.814366] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.815582] systemd[1]: Reached target Path Units. client # [ 1.816554] systemd[1]: Reached target Slice Units. worker1 # [ 1.802434] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.817577] systemd[1]: Reached target Swaps. client # [ 1.818440] systemd[1]: Reached target Timer Units. client # [ 1.819594] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.821064] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.822382] systemd[1]: Listening on Journal Sockets. lb # [ 1.818995] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.823520] systemd[1]: Listening on udev Control Socket. lb # [ 1.820178] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.824700] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.821561] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.825809] systemd[1]: Reached target Socket Units. lb # [ 1.822604] systemd[1]: Reached target Path Units. worker1 # [ 1.811654] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.823392] systemd[1]: Reached target Slice Units. lb # [ 1.824198] systemd[1]: Reached target Swaps. worker1 # [ 1.813003] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.824975] systemd[1]: Reached target Timer Units. client # [ 1.828608] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.813054] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.826017] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.813084] systemd[1]: Reached target Path Units. lb # [ 1.827355] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.813104] systemd[1]: Reached target Slice Units. worker1 # [ 1.813124] systemd[1]: Reached target Swaps. lb # [ 1.828456] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.813190] systemd[1]: Reached target Timer Units. worker1 # [ 1.819183] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.829515] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.829621] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.829639] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.820627] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.829664] systemd[1]: Reached target Socket Units. worker2 # [ 1.830554] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.830864] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.833833] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.831103] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.821915] systemd[1]: Listening on Journal Sockets. client # [ 1.837023] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.822063] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.822190] systemd[1]: Listening on udev Kernel Socket. client # [ 1.837130] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.822232] systemd[1]: Reached target Socket Units. worker1 # [ 1.827711] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.844202] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.848981] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.845550] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.837415] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.837540] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.845956] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.845482] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.858343] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.865061] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.875420] systemd[1]: Starting Journal Service... worker1 # [ 1.865597] systemd[1]: Starting Journal Service... client # [ 1.882092] systemd[1]: Starting Load Kernel Modules... client # [ 1.883006] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.880986] systemd[1]: Starting Journal Service... worker2 # [ 1.879499] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.884828] systemd[1]: Starting Load Kernel Modules... lb # [ 1.885792] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.893093] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.897475] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.897971] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.906520] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.893431] systemd[1]: Starting Load Kernel Modules... client # [ 1.909239] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.893562] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.911606] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker2 # [ 1.911872] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.911886] [drm] features: -context_init worker2 # [ 1.912619] [drm] number of scanouts: 1 worker2 # [ 1.912641] [drm] number of cap sets: 0 worker1 # [ 1.905327] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.918055] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.916776] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.918639] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.918485] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.921833] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.919445] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.919749] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.912007] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.926396] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 1.916174] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.926035] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 1.926069] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 1.929326] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.926531] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.927909] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.928175] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.943302] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.933773] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.937508] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.960614] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 1.945336] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.945588] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.945599] [drm] features: -context_init worker1 # [ 1.946372] [drm] number of scanouts: 1 worker1 # [ 1.946393] [drm] number of cap sets: 0 lb # [ 1.961092] systemd[1]: Mounted Kernel Configuration File System. client # [ 1.966479] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.962104] Console: switching to colour frame buffer device 160x50 worker2 # [ 1.969227] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 1.961570] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.961601] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 1.981509] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.983758] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.981505] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.986157] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.986134] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.986543] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.986580] systemd[1]: Reached target Local File Systems. worker1 # [ 1.979568] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.991756] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.996913] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.997160] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.997170] [drm] features: -context_init client # [ 1.997928] [drm] number of scanouts: 1 client # [ 1.997947] [drm] number of cap sets: 0 lb # [ 1.997343] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.999593] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 2.002123] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.993965] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.997533] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 2.008666] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 2.008941] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 2.008952] [drm] features: -context_init lb # [ 2.009683] [drm] number of scanouts: 1 lb # [ 2.009702] [drm] number of cap sets: 0 client # [ 2.013228] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 2.013255] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 2.021686] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.005613] Console: switching to colour frame buffer device 160x50 worker1 # [ 2.012499] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 2.025208] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.025033] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 2.025053] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 2.037731] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.041302] systemd[1]: Starting Apply Kernel Variables... client # [ 2.049105] Console: switching to colour frame buffer device 160x50 client # [ 2.055903] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 2.060354] systemd[1]: Started Journal Service. client # [ 2.068954] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 2.060974] Console: switching to colour frame buffer device 160x50 client # [ 2.069201] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 2.056304] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.069241] systemd[1]: Reached target Local File Systems. worker2 # [ 2.057615] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.069735] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 2.069943] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 2.059887] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 2.069967] systemd[1]: Reached target Local File Systems. client # [ 2.075137] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.073957] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.064399] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.065488] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 2.067623] systemd[1]: Reached target Local File Systems. worker2 # [ 2.069234] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker2 # [ 2.076409] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.080318] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.077617] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.097051] systemd[1]: Finished Load Kernel Modules. lb # [ 2.093544] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 2.083075] systemd[1]: Finished Apply Kernel Variables. lb # [ 2.106169] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.097624] systemd-udevd[79]: Using default interface naming scheme 'v261'. client # [ 2.110262] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.117527] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.120923] systemd[1]: Started Journal Service. worker1 # [ 2.113507] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.117282] systemd[1]: Finished Create System Files and Directories. lb # [ 2.099930] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.125063] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.126212] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.127274] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.132343] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.146254] systemd[1]: Started Journal Service. lb # [ 2.132436] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.136820] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker2 # [ 2.135123] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.144139] systemd[1]: Starting Create System Files and Directories... client # [ 2.150569] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.152538] systemd[1]: Started Journal Service. client # [ 2.156379] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.160397] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.164334] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.151765] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.153162] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.154262] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.166293] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker1 # [ 2.155349] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.173391] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker1 # [ 2.168377] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.184162] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.169430] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.170778] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 2.184112] systemd[1]: Finished Apply Kernel Variables. client # [ 2.202049] systemd[1]: Finished Create System Files and Directories. lb # [ 2.199850] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.200320] systemd[1]: Starting Virtual Console Setup... lb # [ 2.213984] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.219499] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.209988] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.216776] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.248559] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.252241] systemd[1]: Finished Virtual Console Setup. lb # [ 2.272121] systemd[1]: Starting Virtual Console Setup... client # [ 2.284369] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.272629] systemd[1]: Starting Virtual Console Setup... client # [ 2.328517] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.332220] systemd[1]: Finished Virtual Console Setup. lb # [ 2.328593] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.332382] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.328566] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.332276] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.856368] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.857364] systemd[1]: Reached target System Initialization. worker2 # [ 2.860112] systemd[1]: Reached target Basic System. client # [ 2.929572] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.926294] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.930544] systemd[1]: Reached target System Initialization. lb # [ 2.927274] systemd[1]: Reached target System Initialization. client # [ 2.931370] systemd[1]: Reached target Basic System. lb # [ 2.928135] systemd[1]: Reached target Basic System. worker1 # [ 2.935471] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.936544] systemd[1]: Reached target System Initialization. worker1 # [ 2.937362] systemd[1]: Reached target Basic System. worker2 # [ 3.007850] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.039579] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.044488] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.090513] (udev-worker)[105]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.094995] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.088284] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.108357] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.108322] (udev-worker)[105]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.108948] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.115204] systemd[1]: Reached target Initrd Root Device. lb # [ 3.117917] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.122594] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.120212] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.125687] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.130475] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.180935] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.190492] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.192752] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.196204] systemd[1]: Reached target Initrd Root Device. client # [ 3.201500] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.202095] systemd[1]: Reached target Initrd Root Device. lb # [ 3.205500] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.194416] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.200156] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.204520] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.249234] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.253181] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.252356] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.291221] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.293358] systemd[1]: Mounting /sysroot... client # [ 3.297945] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.295327] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.284125] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.285250] systemd[1]: Mounting /sysroot... worker2 # [ 3.300750] systemd[1]: Mounting /sysroot... client # [ 3.304166] systemd[1]: Mounting /sysroot... worker1 # [ 3.334644] EXT4-fs (vda): mounted filesystem 4c31c1f6-49ba-42a0-b96f-6dcdb6ecf34c r/w with ordered data mode. Quota mode: none. lb # [ 3.346218] EXT4-fs (vda): mounted filesystem ab64aab8-b7c7-45b5-abe6-597f10a9e302 r/w with ordered data mode. Quota mode: none. client # [ 3.351649] EXT4-fs (vda): mounted filesystem 642954f7-dc87-4274-be56-a7c3f1eab4ed r/w with ordered data mode. Quota mode: none. lb # [ 3.338685] systemd[1]: Mounted /sysroot. worker1 # [ 3.327924] systemd[1]: Mounted /sysroot. worker2 # [ 3.351581] EXT4-fs (vda): mounted filesystem c31490af-0e50-4270-967b-5d642ca2e85f r/w with ordered data mode. Quota mode: none. lb # [ 3.341405] systemd[1]: Reached target Initrd Root File System. client # [ 3.346654] systemd[1]: Mounted /sysroot. worker1 # [ 3.332119] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.334055] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.346267] systemd[1]: Mounted /sysroot. client # [ 3.349575] systemd[1]: Reached target Initrd Root File System. lb # [ 3.346631] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.348445] systemd[1]: Reached target Initrd Root File System. client # [ 3.352894] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.352527] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.359797] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.371807] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.366250] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.378486] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.382274] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.381337] systemd[1]: Reloading... worker1 # [ 3.370927] systemd[1]: Reloading... client # [ 3.385670] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.384217] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.391193] systemd[1]: Reloading... worker2 # [ 3.389924] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.394798] systemd[1]: Reloading... lb # [ 3.588140] systemd[1]: Reloading finished in 210 ms. worker1 # [ 3.578903] systemd[1]: Reloading finished in 209 ms. client # [ 3.604102] systemd[1]: Reloading finished in 216 ms. worker2 # [ 3.609098] systemd[1]: Reloading finished in 215 ms. worker1 # [ 3.610071] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... lb # [ 3.622288] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.613978] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.627270] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... client # [ 3.635494] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.619991] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.633134] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.636206] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.624891] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.640777] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.628797] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.644376] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.641351] systemd-sysroot-fstab-check[121]: Requesting initrd-fs.target/start/replace... lb # [ 3.643598] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.633444] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.645515] systemd-sysroot-fstab-check[121]: Requesting swap.target/start/replace... lb # [ 3.647075] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.653607] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.651483] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.656461] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.656258] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.660153] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.659131] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.662152] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.655572] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.657293] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.668803] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.671823] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.681566] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 3.680237] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.684201] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.683656] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.816747] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.835513] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.839884] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.851798] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.882754] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.892009] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.899079] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.902245] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.915657] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.916364] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.906100] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.921670] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.919002] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.935783] systemd[1]: Mounting /sysroot/run... lb # [ 3.939157] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.931038] systemd[1]: Mounting /sysroot/run... client # [ 3.947554] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.946400] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.951014] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.953141] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.943944] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.959366] systemd[1]: Mounted /sysroot/run. client # [ 3.965732] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.968915] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.968227] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.971535] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.977599] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.980153] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.989125] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.994297] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.986393] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 4.001381] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.011214] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 4.016377] systemd[1]: Mounted /sysroot/run. worker1 # [ 4.014940] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 4.029220] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.032708] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 4.024457] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 4.039905] systemd[1]: Mounted /sysroot/run. worker1 # [ 4.027595] systemd[1]: Mounted /sysroot/run. worker1 # [ 4.031237] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 4.047245] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 4.054078] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 4.057488] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 4.061230] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.064673] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.064889] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.053521] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.066316] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.059258] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 4.079863] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.081488] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.387555] (udev-worker)[101]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker2 # [ 4.396344] (udev-worker)[101]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.428366] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.429550] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.432186] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 4.433494] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.444766] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.446251] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.448523] systemd[1]: Starting Virtual Console Setup... client # [ 4.463331] (udev-worker)[106]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.469675] (udev-worker)[106]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.469758] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 4.473182] systemd[1]: Finished Virtual Console Setup. worker1 # [ 4.478391] (udev-worker)[93]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.496947] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.498587] systemd[1]: Stopped Virtual Console Setup. client # [ 4.500384] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.483919] (udev-worker)[93]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.502434] systemd[1]: Starting Virtual Console Setup... client # [ 4.519893] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.521719] systemd[1]: Stopped Virtual Console Setup. client # [ 4.526397] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.514412] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.516146] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.521920] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.522789] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.536798] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.538341] systemd[1]: Stopped Virtual Console Setup. client # [ 4.554519] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.540645] systemd[1]: Starting Virtual Console Setup... client # [ 4.558068] systemd[1]: Finished Virtual Console Setup. lb # [ 4.558333] (udev-worker)[98]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.563276] (udev-worker)[98]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.562493] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.565942] systemd[1]: Finished Virtual Console Setup. lb # [ 4.588675] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.592166] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.594159] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.596220] systemd[1]: Starting Virtual Console Setup... lb # [ 4.612836] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.615368] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.616712] systemd[1]: Starting Virtual Console Setup... lb # [ 4.638404] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.641824] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.819494] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.886289] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.889594] systemd[1]: Reached target Initrd File Systems. lb # [ 4.890625] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.895360] systemd[1]: Starting Find NixOS closure... client # [ 4.902791] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.909100] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.908705] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.951344] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.953072] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.956566] systemd[1]: Reached target Initrd File Systems. client # [ 4.962167] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.957950] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 4.962039] systemd[1]: Starting Find NixOS closure... client # [ 4.965565] systemd[1]: Reached target Initrd File Systems. client # [ 4.971153] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.971810] systemd[1]: Finished Find NixOS closure. lb # [ 4.973035] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.975715] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.980930] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.984497] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.971938] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.975330] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.981131] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.989859] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 5.011185] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.015384] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 5.016687] systemd[1]: Stopped target Basic System. worker2 # [ 5.017770] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.018813] systemd[1]: Stopped target Path Units. worker2 # [ 5.019740] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 5.019748] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 5.024293] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.029219] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 5.028203] systemd[1]: Stopped target Slice Units. worker2 # [ 5.029208] systemd[1]: Stopped target Socket Units. worker2 # [ 5.030874] systemd[1]: Stopped target System Initialization. lb # [ 5.034311] systemd[1]: Finished Find NixOS closure. client # [ 5.037399] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 5.036201] systemd[1]: Stopped target Swaps. worker2 # [ 5.037268] systemd[1]: Stopped target Timer Units. lb # [ 5.037481] systemd[1]: Reached target Initrd Default Target. worker2 # [ 5.038068] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 5.038984] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.039181] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 5.041017] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.047321] systemd[1]: Finished Find NixOS closure. worker2 # [ 5.046758] systemd[1]: Stopped Find NixOS closure. client # [ 5.050984] systemd[1]: Reached target Initrd Default Target. worker2 # [ 5.048763] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 5.050984] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.056587] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 5.042044] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.046042] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 5.061174] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.063754] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.068433] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 5.070800] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.072779] systemd[1]: Stopped target Basic System. worker1 # [ 5.061358] systemd[1]: Finished Find NixOS closure. worker2 # [ 5.074719] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.063553] systemd[1]: Reached target Initrd Default Target. lb # [ 5.076515] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.077669] systemd[1]: Stopped target Path Units. worker2 # [ 5.077379] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.067400] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 5.080159] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 5.081059] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 5.082396] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 5.082750] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.083446] systemd[1]: Stopped Create System Files and Directories. client # [ 5.087688] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.086105] systemd[1]: Stopped target Slice Units. lb # [ 5.088325] systemd[1]: Stopped target Socket Units. client # [ 5.092601] systemd[1]: Stopped target Basic System. client # [ 5.093656] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.090481] systemd[1]: Stopped target System Initialization. client # [ 5.094756] systemd[1]: Stopped target Path Units. worker2 # [ 5.092244] systemd[1]: Stopped target Local File Systems. client # [ 5.095725] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 5.092000] systemd[1]: Stopped target Swaps. worker2 # [ 5.095616] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 5.096314] systemd[1]: Stopped target Timer Units. worker2 # [ 5.097008] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.097156] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 5.098072] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.101626] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 5.098973] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 5.099782] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.104169] systemd[1]: Stopped target Slice Units. lb # [ 5.102789] systemd[1]: Stopped Find NixOS closure. worker2 # [ 5.103480] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.108176] systemd[1]: Stopped target Socket Units. worker2 # [ 5.104849] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.105860] systemd[1]: Stopped Virtual Console Setup. client # [ 5.109156] systemd[1]: Stopped target System Initialization. worker2 # [ 5.106608] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.110160] systemd[1]: Stopped target Swaps. worker2 # [ 5.107523] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.112133] systemd[1]: Stopped target Timer Units. lb # [ 5.110596] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 5.112308] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.112533] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.116181] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.101461] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.117289] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 5.114168] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.118265] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.103381] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 5.116194] systemd[1]: systemd-udevd.service: Consumed 1.405s CPU time over 3.110s wall clock time, 22.3M memory peak. client # [ 5.120828] systemd[1]: Stopped Find NixOS closure. worker2 # [ 5.117817] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 5.118930] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.107554] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 5.119799] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.108793] systemd[1]: Stopped target Basic System. lb # [ 5.120436] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.120961] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.124135] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 5.110177] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.121751] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.122313] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.122742] systemd[1]: Closed udev Control Socket. worker2 # [ 5.123444] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.112311] systemd[1]: Stopped target Path Units. client # [ 5.128536] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.126560] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.114968] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.130882] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.128316] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 5.129472] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.118150] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 5.130957] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.119461] systemd[1]: Stopped target Slice Units. client # [ 5.135250] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.132304] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.133894] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.137853] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 5.135128] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.124251] systemd[1]: Stopped target Socket Units. worker2 # [ 5.136274] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.125114] systemd[1]: Stopped target System Initialization. worker1 # [ 5.125985] systemd[1]: Stopped target Swaps. worker2 # [ 5.137405] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.126695] systemd[1]: Stopped target Timer Units. worker2 # [ 5.138365] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.127457] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.143916] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.132276] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.144741] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.133441] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.145868] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.134532] systemd[1]: Stopped Find NixOS closure. lb # [ 5.146874] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.135271] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.147652] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.153467] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.154657] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.155901] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.141866] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.142787] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 5.154445] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.143760] systemd[1]: Stopped Apply Kernel Variables. lb # [ 5.156191] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.147259] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 5.159147] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 5.160551] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.151500] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.164493] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.165366] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.169228] systemd[1]: Stopped Create System Files and Directories. client # [ 5.171149] systemd[1]: Stopped target Local File Systems. lb # [ 5.168332] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 5.169321] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.172978] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 5.170007] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.171044] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.174983] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.160364] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 5.172246] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 5.172623] systemd[1]: Finished Cleanup udev Database. lb # [ 5.173211] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.161618] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 5.174438] systemd[1]: Reached target Switch Root. lb # [ 5.174207] systemd[1]: systemd-udevd.service: Consumed 1.503s CPU time over 3.091s wall clock time, 22.5M memory peak. client # [ 5.179135] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.175628] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 5.176311] systemd[1]: Starting NixOS Activation... worker1 # [ 5.164777] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.180651] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.184175] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 5.181173] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.185261] systemd[1]: Stopped Virtual Console Setup. client # [ 5.186931] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.172414] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.184204] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.185474] systemd[1]: Closed udev Control Socket. worker1 # [ 5.174572] systemd[1]: Stopped target Local File Systems. client # [ 5.190208] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.191276] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.188283] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.176928] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.192448] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 5.189139] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.193279] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.178658] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 5.194192] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.180658] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.192172] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.195167] systemd[1]: systemd-udevd.service: Consumed 1.409s CPU time over 3.108s wall clock time, 22.3M memory peak. lb # [ 5.193081] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.183348] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 5.196173] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.185199] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.200284] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.197193] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.202056] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.188353] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.200252] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.189188] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.204291] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.192196] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.208472] systemd[1]: Closed udev Control Socket. worker1 # [ 5.193271] systemd[1]: systemd-udevd.service: Consumed 1.430s CPU time over 3.109s wall clock time, 25.4M memory peak. client # [ 5.209248] systemd[1]: Starting Cleanup udev Database... client # [ 5.210002] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.195838] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.212162] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.197187] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.198220] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.213046] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.199202] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.200001] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.201076] systemd[1]: Closed udev Control Socket. client # [ 5.216121] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.201781] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.202533] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.203557] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.220199] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.221243] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.208266] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.212184] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.224797] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.213644] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.214636] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.227737] systemd[1]: Finished Cleanup udev Database. lb # [ 5.229111] systemd[1]: Reached target Switch Root. lb # [ 5.232617] systemd[1]: Starting NixOS Activation... client # [ 5.245695] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.248533] systemd[1]: Finished Cleanup udev Database. client # [ 5.249340] systemd[1]: Reached target Switch Root. client # [ 5.251048] systemd[1]: Starting NixOS Activation... worker1 # [ 5.246896] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.250016] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.250843] systemd[1]: Reached target Switch Root. worker1 # [ 5.251908] systemd[1]: Starting NixOS Activation... worker2 # [ 5.357703] initrd-nixos-activation-start[181]: booting system configuration /nix/store/llalsjd4r22yln9sv6722yaj82c9dmk5-nixos-system-worker2-test lb # [ 5.401518] initrd-nixos-activation-start[180]: booting system configuration /nix/store/lai4n7chb0cnvnygfis27sipihspygia-nixos-system-lb-test client # [ 5.429993] initrd-nixos-activation-start[181]: booting system configuration /nix/store/9f6bv5lb34q1i2zz9zicg65xmqpax058-nixos-system-client-test worker2 # [ 5.432928] initrd-nixos-activation-start[181]: running activation script... worker1 # [ 5.427201] initrd-nixos-activation-start[180]: booting system configuration /nix/store/wqisxk59apba7r6f4zihd6l6v5f3l1ba-nixos-system-worker1-test lb # [ 5.467069] initrd-nixos-activation-start[180]: running activation script... client # [ 5.498183] initrd-nixos-activation-start[181]: running activation script... worker1 # [ 5.500139] initrd-nixos-activation-start[180]: running activation script... lb # [ 5.869059] initrd-nixos-activation-start[203]: setting up /etc... worker2 # [ 5.876777] initrd-nixos-activation-start[204]: setting up /etc... worker1 # [ 5.898775] initrd-nixos-activation-start[203]: setting up /etc... client # [ 5.933816] initrd-nixos-activation-start[204]: setting up /etc... lb # [ 6.130876] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 6.133673] systemd[1]: Finished NixOS Activation. worker2 # [ 6.133907] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 6.134879] systemd[1]: Starting Switch Root... worker2 # [ 6.136784] systemd[1]: Finished NixOS Activation. worker2 # [ 6.140225] systemd[1]: Starting Switch Root... lb # [ 6.155889] systemd[1]: Switching root. worker2 # [ 6.160476] systemd[1]: Switching root. worker1 # [ 6.165366] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.168184] systemd[1]: Finished NixOS Activation. worker1 # [ 6.169453] systemd[1]: Starting Switch Root... worker1 # [ 6.187890] systemd[1]: Switching root. client # [ 6.204366] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.207294] systemd[1]: Finished NixOS Activation. client # [ 6.208919] systemd[1]: Starting Switch Root... client # [ 6.233326] systemd[1]: Switching root. lb # [ 6.344129] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.349287] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.368627] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 6.420211] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.954264] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.958659] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.968311] systemd[1]: Detected virtualization qemu. lb # [ 6.968431] systemd[1]: Detected architecture arm64. worker2 # [ 6.971289] systemd[1]: Detected virtualization qemu. lb # [ 6.968640] systemd[1]: Detected first boot. worker2 # [ 6.974560] systemd[1]: Detected architecture arm64. worker2 # [ 6.978603] systemd[1]: Detected first boot. lb # [ 6.980258] systemd[1]: Initializing machine ID from random generator. worker2 # [ 6.986507] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.983788] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.996554] systemd[1]: Detected virtualization qemu. worker1 # [ 6.999841] systemd[1]: Detected architecture arm64. worker1 # [ 7.003932] systemd[1]: Detected first boot. worker1 # [ 7.010956] systemd[1]: Initializing machine ID from random generator. client # [ 7.029626] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 7.042629] systemd[1]: Detected virtualization qemu. client # [ 7.046594] systemd[1]: Detected architecture arm64. client # [ 7.049742] systemd[1]: Detected first boot. client # [ 7.057200] systemd[1]: Initializing machine ID from random generator. lb # [ 7.310621] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 7.323223] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 7.339937] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.375182] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 7.505877] systemd[1]: Applying preset policy. worker2 # [ 7.517699] systemd[1]: Applying preset policy. worker1 # [ 7.539039] systemd[1]: Applying preset policy. client # [ 7.575342] systemd[1]: Applying preset policy. lb # [ 7.962097] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.996842] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 8.039075] systemd[1]: Populated /etc with preset unit settings. client # [ 8.070676] systemd[1]: Populated /etc with preset unit settings. lb # [ 8.446645] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 8.447992] systemd[1]: Stopped initrd-switch-root.service. lb # [ 8.451807] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 8.455950] systemd[1]: Created slice Slice /system/getty. lb # [ 8.458358] systemd[1]: Created slice User and Session Slice. lb # [ 8.459646] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 8.461479] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 8.463012] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.464250] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 8.465641] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.467512] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.468566] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.470372] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 8.472015] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.473861] systemd[1]: Reached target Path Units. lb # [ 8.476220] systemd[1]: Reached target Remote File Systems. lb # [ 8.477418] systemd[1]: Reached target Slice Units. lb # [ 8.479692] systemd[1]: Reached target Swaps. lb # [ 8.483877] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 8.489091] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 8.493001] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 8.493324] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.494727] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.496255] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 8.497480] systemd[1]: Listening on Factory Reset Management. lb # [ 8.498689] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 8.501174] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.503125] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.504407] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 8.505309] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.506896] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 8.506296] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 8.508665] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.509810] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 8.510384] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 8.511044] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 8.512387] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.511893] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 8.513694] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.513360] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.515544] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.516673] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.516026] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 8.507367] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 8.518245] systemd[1]: Reached target Path Units. worker2 # [ 8.520390] systemd[1]: Reached target Remote File Systems. worker1 # [ 8.508660] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.521487] systemd[1]: Reached target Slice Units. worker2 # [ 8.522962] systemd[1]: Reached target Swaps. worker1 # [ 8.512135] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 8.525642] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 8.527902] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.516415] systemd[1]: Created slice Slice /system/getty. lb # [ 8.527731] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.518650] systemd[1]: Created slice User and Session Slice. lb # [ 8.529653] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.519906] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.533022] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.521636] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.523109] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.534118] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.524560] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 8.537148] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 8.526225] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.538682] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 8.528664] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 8.541209] systemd[1]: Listening on Factory Reset Management. worker2 # [ 8.542466] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.529987] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.532427] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 8.533616] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.536384] systemd[1]: Reached target Path Units. worker2 # [ 8.548750] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.549250] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 8.538174] systemd[1]: Reached target Remote File Systems. worker2 # [ 8.551006] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.540181] systemd[1]: Reached target Slice Units. worker1 # [ 8.541938] systemd[1]: Reached target Swaps. worker2 # [ 8.554705] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 8.556213] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.546106] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.557654] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.559762] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.559655] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.550847] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.568041] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 8.554630] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.569679] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.570023] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.558576] systemd[1]: Listening on Factory Reset Management. client # [ 8.572942] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 8.569718] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 8.571412] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.559769] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 8.573025] systemd[1]: Listening on udev Varlink Socket. client # [ 8.576667] systemd[1]: Created slice Slice /system/getty. client # [ 8.578553] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.565811] systemd[1]: Starting Journal Log Access Socket... client # [ 8.579834] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.577943] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.567931] systemd[1]: Listening on Journal Audit Socket. client # [ 8.581968] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.584375] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.581626] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.585508] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.572328] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.587048] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.583706] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.583631] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.588652] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 8.573920] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.590212] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.576915] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.591786] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 8.578597] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.590504] systemd[1]: Mounting Kernel Debug File System... client # [ 8.593539] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.596027] systemd[1]: Reached target Path Units. client # [ 8.597951] systemd[1]: Reached target Remote File Systems. client # [ 8.599850] systemd[1]: Reached target Slice Units. client # [ 8.601818] systemd[1]: Reached target Swaps. lb # [ 8.599484] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 8.601596] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.602440] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.606036] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.591218] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.591682] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.592041] systemd[1]: Listening on udev Varlink Socket. client # [ 8.611012] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.597987] systemd[1]: Mounting Huge Pages File System... lb # [ 8.609755] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 8.615142] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.612171] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 8.602121] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.619183] systemd[1]: Listening on Factory Reset Management. client # [ 8.620407] systemd[1]: Listening on Hostname Service Socket. client # [ 8.626416] systemd[1]: Starting Journal Log Access Socket... client # [ 8.628486] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.609753] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.626423] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.633802] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.635334] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 8.631273] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.622901] systemd[1]: Mounting Kernel Trace File System... client # [ 8.637056] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.634979] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.640076] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.639717] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.650489] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.635492] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.651844] systemd[1]: Listening on udev Control Socket. worker2 # [ 8.649284] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.653573] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 8.652793] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.658170] systemd[1]: Mounting Huge Pages File System... client # [ 8.662473] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 8.657698] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.651427] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 8.654299] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.673334] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 8.662999] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 8.663364] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.663627] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.678238] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.684970] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 8.678714] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.693557] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 8.682363] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.682793] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.709378] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.711099] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.726568] systemd[1]: Starting Journal Service... client # [ 8.732112] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.733971] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.736087] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 8.747124] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.748344] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.760759] systemd[1]: Starting Journal Service... lb # [ 8.768906] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.774536] systemd[1]: Starting Load Kernel Modules... worker1 # [ 8.774394] systemd[1]: Starting Journal Service... worker2 # [ 8.799760] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 8.793682] systemd[1]: Starting Load Kernel Modules... client # [ 8.811123] systemd[1]: Starting Journal Service... lb # [ 8.815188] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.824282] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 8.826878] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.818241] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.839553] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 8.831270] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 8.844663] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 8.834067] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.853125] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.849709] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.853784] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 8.856025] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.858223] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.857347] systemd-journald[274]: Collecting audit messages is enabled. worker2 # [ 8.861086] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 8.853817] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.870008] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.859856] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.861481] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.877812] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 8.864181] systemd[1]: Mounted Huge Pages File System. worker1 # [ 8.869573] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 8.871213] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 8.870090] systemd[1]: Mounted Kernel Debug File System. lb # [ 8.881939] fuse: init (API version 7.45) worker1 # [ 8.870556] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.882828] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.870981] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 8.884583] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.875809] systemd-modules-load[275]: Module 'atkbd' is built in lb # [ 8.878477] systemd-modules-load[275]: Module 'loop' is built in worker2 # [ 8.893727] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.908455] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 8.899988] systemd[1]: Finished Create List of Static Device Nodes. client # [ 8.918675] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.907605] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.931103] systemd[1]: Started Journal Service. client # [ 8.933653] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.929170] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.934714] systemd[1]: Mounted Huge Pages File System. client # [ 8.953622] fuse: init (API version 7.45) lb # [ 8.943585] systemd[1]: Mounted POSIX Message Queue File System. client # [ 8.965309] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.952253] systemd[1]: Mounted Kernel Debug File System. lb # [ 8.955108] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 8.970684] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 8.973536] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 8.960723] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.966166] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 8.987473] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.972505] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.993285] systemd-journald[275]: Collecting audit messages is enabled. worker2 # [ 8.993746] EXT4-fs (vda): re-mounted c31490af-0e50-4270-967b-5d642ca2e85f. client # [ 8.996359] systemd[1]: Mounted Huge Pages File System. lb # [ 8.979303] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.999955] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 9.002986] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 9.005908] systemd[1]: Mounted Kernel Debug File System. lb # [ 8.985169] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 9.005570] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 8.994066] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.994942] systemd[1]: Finished Load Kernel Modules. client # [ 9.009365] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 9.007718] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 9.012729] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 9.009550] EXT4-fs (vda): re-mounted ab64aab8-b7c7-45b5-abe6-597f10a9e302. worker1 # [ 9.001671] EXT4-fs (vda): re-mounted 4c31c1f6-49ba-42a0-b96f-6dcdb6ecf34c. client # [ 9.019392] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 9.021629] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 9.010912] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 9.025650] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 9.024170] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.013714] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 9.028294] systemd[1]: Started Journal Service. lb # [ 9.014293] systemd[1]: Mounting FUSE Control File System... client # [ 9.017691] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 9.027253] systemd-journald[275]: Collecting audit messages is enabled. lb # [ 9.018079] systemd[1]: Starting Firewall... client # [ 9.021893] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 9.017888] systemd[1]: Finished Load Kernel Modules. worker1 # [ 9.024505] systemd[1]: Starting Firewall... client # [ 9.029048] systemd-modules-load[276]: Module 'atkbd' is built in worker2 # [ 9.038239] systemd[1]: Finished Load Kernel Modules. worker1 # [ 9.031552] systemd[1]: Starting Apply Kernel Variables... lb # [ 9.032141] systemd[1]: Starting Apply Kernel Variables... client # [ 9.037361] systemd-modules-load[276]: Module 'loop' is built in worker1 # [ 9.035334] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 9.042346] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 9.041559] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 9.054151] fuse: init (API version 7.45) worker1 # [ 9.042908] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 9.058323] systemd[1]: Starting Firewall... lb # [ 9.048934] systemd-oomd[277]: No swap; memory pressure usage will be degraded worker1 # [ 9.050935] systemd-journald[274]: Collecting audit messages is enabled. client # [ 9.046923] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 9.055775] systemd[1]: Finished Load Kernel Module fuse. client # [ 9.060519] systemd[1]: Finished Load Kernel Modules. worker2 # [ 9.074050] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 9.065888] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 9.078360] systemd[1]: Started Journal Service. worker1 # [ 9.069301] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 9.068992] systemd[1]: Queued start job for default target Multi-User System. lb # [ 9.069372] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 9.072470] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 9.077114] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 9.080908] systemd-modules-load[276]: Module 'atkbd' is built in lb # [ 9.084160] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 9.098903] EXT4-fs (vda): re-mounted 642954f7-dc87-4274-be56-a7c3f1eab4ed. client # [ 9.091460] systemd[1]: Mounting FUSE Control File System... worker1 # [ 9.096641] fuse: init (API version 7.45) worker2 # [ 9.097503] systemd-modules-load[276]: Module 'loop' is built in client # [ 9.102804] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 9.101500] systemd[1]: Started Journal Service. worker1 # [ 9.092598] systemd[1]: Queued start job for default target Multi-User System. lb # [ 9.108507] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 9.098952] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 9.114593] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 9.107728] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 9.119479] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 9.125916] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 9.112881] systemd-modules-load[275]: Module 'atkbd' is built in worker2 # [ 9.128577] systemd[1]: Finished Load Kernel Module fuse. lb # [ 9.129433] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 9.122075] systemd-modules-load[275]: Module 'loop' is built in lb # [ 9.138130] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 9.142776] systemd-oomd[277]: No swap; memory pressure usage will be degraded client # [ 9.148127] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 9.137395] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 9.150773] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 9.145031] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 9.162372] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 9.159532] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 9.165231] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 9.164696] systemd-oomd[277]: No swap; memory pressure usage will be degraded worker1 # [ 9.160340] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 9.179847] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 9.167538] systemd-oomd[276]: No swap; memory pressure usage will be degraded client # [ 9.189875] systemd[1]: Starting Load/Save OS Random Seed... client # [ 9.190877] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 9.189378] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 9.180406] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 9.196487] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 9.193501] systemd[1]: Reached target First Boot Complete. worker2 # [ 9.211984] systemd-journald[275]: Received client request to flush runtime journal. lb # [ 9.205466] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.205838] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 9.209560] systemd[1]: Reached target First Boot Complete. worker1 # [ 9.234146] systemd-journald[274]: Received client request to flush runtime journal. lb # [ 9.241912] systemd[1]: Mounted FUSE Control File System. client # [ 9.261648] systemd[1]: Mounted FUSE Control File System. lb # [ 9.276629] systemd-journald[274]: Received client request to flush runtime journal. worker2 # [ 9.279098] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 9.298009] systemd-journald[275]: Received client request to flush runtime journal. worker2 # [ 9.286127] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 9.291425] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 9.294944] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 9.308937] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.313722] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.331648] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 9.321075] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.325886] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 9.340166] systemd[1]: Reached target First Boot Complete. client # [ 9.344077] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.344631] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 9.348359] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.350876] systemd[1]: Reached target First Boot Complete. lb # [ 9.348406] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 9.351857] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.352179] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 9.356676] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 9.358457] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 9.375739] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 9.379512] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 9.383982] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 9.407260] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.409296] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 9.412875] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.430472] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.431523] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.436143] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.446747] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 9.447990] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 9.453182] systemd[1]: Mounting /run/wrappers... lb # [ 9.470265] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 9.486613] systemd[1]: Mounting /run/wrappers... worker2 # [ 9.489258] systemd[1]: Mounting FUSE Control File System... worker1 # [ 9.500163] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.504324] systemd[1]: Mounting FUSE Control File System... lb # [ 9.532873] systemd[1]: Mounted /run/wrappers. worker2 # [ 9.533634] systemd[1]: Mounted FUSE Control File System. lb # [ 9.534188] systemd[1]: Reached target Local File Systems. lb # [ 9.537962] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 9.537233] systemd-udevd[312]: Using default interface naming scheme 'v261'. client # [ 9.546568] systemd-udevd[307]: Using default interface naming scheme 'v261'. lb # [ 9.554969] systemd[1]: Starting register-nix-paths.service... client # [ 9.558767] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.545840] systemd[1]: Mounted FUSE Control File System. lb # [ 9.560144] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 9.570882] systemd[1]: Mounted /run/wrappers. lb # [ 9.563413] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 9.576468] systemd[1]: Reached target Local File Systems. worker1 # [ 9.573923] systemd-udevd[313]: Using default interface naming scheme 'v261'. worker1 # [ 9.575909] systemd[1]: Mounted /run/wrappers. lb # [ 9.589759] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 9.583096] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 9.581108] systemd[1]: Reached target Local File Systems. worker2 # [ 9.593250] systemd[1]: Starting register-nix-paths.service... worker2 # [ 9.602946] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 9.604645] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.613249] systemd[1]: Mounted /run/wrappers. client # [ 9.614240] systemd[1]: Reached target Local File Systems. client # [ 9.617917] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 9.587724] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 9.621611] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.607289] systemd[1]: Starting register-nix-paths.service... client # [ 9.626567] systemd[1]: Starting register-nix-paths.service... worker1 # [ 9.612684] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 9.624850] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.614306] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 9.629002] systemd[1]: Starting Create System Files and Directories... client # [ 9.641219] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.644855] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.627809] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.634830] systemd[1]: Starting Create System Files and Directories... client # [ 9.657466] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 9.669276] systemd-udevd[319]: Using default interface naming scheme 'v261'. client # [ 9.677709] systemd[1]: Starting Create System Files and Directories... worker2 # [ 9.705258] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 9.701772] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 9.715712] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.709187] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.732682] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.741746] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 9.746294] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 9.761400] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 9.823965] systemd[1]: Finished Create System Files and Directories. client # [ 9.834628] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 9.831920] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 9.843986] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.834104] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.838873] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 9.856859] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.852877] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.870340] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.873718] systemd[1]: Finished Create System Files and Directories. lb # [ 9.877167] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 9.889354] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.910644] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 9.895593] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 9.956954] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.954304] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 9.961744] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.999486] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 10.003005] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 10.062356] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 10.060426] systemd[1]: Finished Rebuild Journal Catalog. client # [ 10.065274] systemd[1]: Starting Update is Completed... worker2 # [ 10.064106] systemd[1]: Starting Update is Completed... lb # [ 10.077075] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 10.072381] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 10.075533] systemd[1]: Starting Update is Completed... lb # [ 10.114769] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 10.131096] systemd[1]: Starting Update is Completed... client # [ 10.138736] systemd[1]: Finished Update is Completed. worker2 # [ 10.150323] systemd[1]: Finished Update is Completed. worker1 # [ 10.161962] systemd[1]: Finished Update is Completed. lb # [ 10.237784] systemd[1]: Finished Update is Completed. client # [ 10.568139] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.573031] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.595483] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 10.598302] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 10.620171] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 10.622303] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 10.610644] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 10.612757] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.793588] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.846138] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 11.036512] systemd[1]: Finished register-nix-paths.service. client # [ 11.049726] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 11.102286] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 11.112405] systemd[1]: Finished Firewall. worker2 # [ 11.164371] systemd[1]: Finished Firewall. lb # [ 11.196139] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.197201] systemd[1]: Reached target System Initialization. lb # [ 11.200673] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 11.201828] systemd[1]: Started niks3 garbage collection timer. lb # [ 11.205388] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 11.209214] systemd[1]: Reached target Timer Units. lb # [ 11.215193] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 11.220279] systemd[1]: Listening on niks3 server socket. lb # [ 11.221291] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.222217] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 11.228274] systemd[1]: Reached target Socket Units. lb # [ 11.229366] systemd[1]: Reached target Basic System. lb # [ 11.233469] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.238161] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.261974] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.270663] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.292716] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.297648] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.307963] systemd[1]: Starting resolvconf update... worker2 # [ 11.332402] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 11.339389] systemd[1]: Finished register-nix-paths.service. client # [ 11.343966] systemd[1]: Reached target System Initialization. lb # [ 11.342104] systemd[1]: Started rustfs.service. client # [ 11.346145] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.348780] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.353890] systemd[1]: Reached target Timer Units. client # [ 11.358802] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.362016] systemd[1]: Listening on Nix Daemon Socket. client # [ 11.363522] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.368955] systemd[1]: Reached target Socket Units. client # [ 11.372796] systemd[1]: Reached target Basic System. client # [ 11.374253] systemd[1]: Started backdoor.service. client # [ 11.375585] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.382272] systemd[1]: Starting nftables firewall... lb # [ 11.378934] nsncd[484]: Sep 20 13:33:56.934 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.374346] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 11.389376] systemd[1]: Starting rustfs-bucket.service... client # [ 11.395604] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.392769] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.418292] systemd[1]: Starting Post-Boot Actions... client # [ 11.434691] (udev-worker)[378]: Network interface NamePolicy= disabled on kernel command line. lb # [ 11.438640] systemd[1]: Finished Post-Boot Actions. client # [ 11.457013] systemd[1]: Started Reset console on configuration changes. client # [ 11.497315] systemd[1]: Starting resolvconf update... lb # [ 11.500614] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.504843] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.517487] systemd[1]: Starting D-Bus System Message Bus... client # [ 11.529640] (udev-worker)[326]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 11.521401] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 11.543644] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 11.553424] nsncd[398]: Sep 20 13:33:57.123 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 11.557868] systemd[1]: Starting User Login Management... client # [ 11.565835] (udev-worker)[326]: Network interface NamePolicy= disabled on kernel command line. client # connecting to host... client # [ 11.572791] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.583901] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.591220] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.590643] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 11.585416] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 11.621414] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.626216] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.611287] systemd[1]: Finished register-nix-paths.service. client # [ 11.646757] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 11.614902] systemd[1]: Reached target System Initialization. client # [ 11.676676] systemd[1]: Starting User Login Management... worker2 # [ 11.652278] systemd[1]: Finished register-nix-paths.service. lb # [ 11.688288] systemd[1]: Finished Firewall. worker1 # [ 11.617321] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.705080] systemd[1]: Finished Import lastlog data into lastlog2 database. client: connected to guest root shell worker2 # [ 11.655334] systemd[1]: Reached target System Initialization. worker1 # [ 11.619063] systemd[1]: Started Daily Cleanup of Temporary Directories. client: (connecting took 12.18 seconds) worker2 # [ 11.657386] systemd[1]: Started Discard unused filesystem blocks once a week. client: (finished: waiting for the VM to finish booting, in 12.18 seconds) worker2 # [ 11.659779] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 11.621842] systemd[1]: Reached target Timer Units. worker2 # [ 11.662942] systemd[1]: Reached target Timer Units. worker1 # [ 11.626617] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 11.666723] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 11.627648] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.669152] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 11.630349] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 11.673361] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 11.634998] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 11.675816] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.644314] systemd[1]: Reached target Socket Units. worker2 # [ 11.683734] systemd[1]: Reached target Socket Units. worker1 # [ 11.652506] systemd[1]: Reached target Basic System. worker2 # [ 11.694916] systemd[1]: Reached target Basic System. worker1 # [ 11.661583] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 11.700611] systemd[1]: Started backdoor.service. worker1 # [ 11.669673] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.708896] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 11.680595] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.711653] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.688655] systemd[1]: Started Reset console on configuration changes. worker2 # [ 11.715183] systemd[1]: Starting Post-Boot Actions... worker1 # [ 11.697422] systemd[1]: Starting resolvconf update... worker2 # [ 11.732388] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.708169] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 11.741541] systemd[1]: Starting resolvconf update... worker1 # [ 11.720286] systemd[1]: Started backdoor.service. worker1 # [ 11.728372] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 11.747793] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.806106] dbus-broker-launch[519]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 11.798780] systemd[1]: Finished Post-Boot Actions. lb # [ 11.815602] dbus-broker-launch[519]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.833879] systemd[1]: Finished Post-Boot Actions. lb # [ 11.823445] dbus-broker-launch[519]: Invalid user-name in /nix/store/r3k08synkldj3yxnxmc97ljig0y68d44-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.864385] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 11.861721] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.879077] systemd-logind[523]: New seat seat0. worker1 # [ 11.869546] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.889527] systemd[1]: Started User Login Management. worker2 # connecting to host... worker1 # [ 11.878516] nsncd[495]: Sep 20 13:33:57.434 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # connecting to host... worker2 # [ 11.906102] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.894524] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.906306] systemd[1]: Starting linger-users.service... worker1 # [ 11.901741] systemd[1]: Starting User Login Management... worker2 # [ 11.916116] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.907822] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 11.924862] nsncd[497]: Sep 20 13:33:57.486 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.926957] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.927835] systemd[1]: Starting User Login Management... lb # [ 11.946332] dbus-broker-launch[519]: Ready worker2 # [ 11.947084] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.952211] systemd-logind[430]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 11.972162] systemd-logind[430]: New seat seat0. client # [ 11.973277] dbus-broker-launch[428]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.974362] dbus-broker-launch[428]: NSS returned no entry for 'systemd-timesync' client # [ 11.975386] dbus-broker-launch[428]: Invalid user-name in /nix/store/i87y3v12qnxz4jgnndbs0w0ih92vmmjw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 11.972988] dbus-broker-launch[500]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.987959] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.992585] systemd[1]: Stopping Host and Network Name Lookups... client # [ 12.000584] systemd[1]: Started User Login Management. lb # [ 12.000452] systemd[1]: Stopped target User and Group Name Lookups. client # [ 12.005391] systemd[1]: Starting linger-users.service... worker1 # [ 11.994596] dbus-broker-launch[500]: NSS returned no entry for 'systemd-timesync' lb # [ 12.005826] systemd[1]: Stopping User and Group Name Lookups... lb # [ 12.013462] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 12.020248] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 12.002042] dbus-broker-launch[500]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 12.023985] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 12.031013] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 12.031251] systemd[1]: linger-users.service: Deactivated successfully. client # [ 12.040382] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 12.041480] systemd[1]: Stopping Host and Network Name Lookups... client # [ 12.042317] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 12.039246] systemd[1]: Finished linger-users.service. client # [ 12.043157] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 12.053411] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync' lb # [ 12.053864] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 12.054556] dbus-broker-launch[501]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 12.048158] systemd[1]: Started D-Bus System Message Bus. client # [ 12.066183] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 12.076817] systemd[1]: Started D-Bus System Message Bus. client # [ 12.077667] systemd[1]: nscd.service: Deactivated successfully. client # [ 12.078472] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 12.100660] systemd[1]: Started D-Bus System Message Bus. client # [ 12.108671] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 12.097874] systemd-logind[510]: New seat seat0. lb # [ 12.109688] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 12.098736] systemd[1]: Started User Login Management. worker1 # [ 12.103880] systemd[1]: Starting linger-users.service... client # [ 12.119420] systemd[1]: Finished linger-users.service. worker2 # [ 12.120945] systemd-logind[522]: New seat seat0. client # [ 12.127280] dbus-broker-launch[428]: Ready worker1 # [ 12.117553] dbus-broker-launch[500]: Ready worker2 # [ 12.127286] systemd[1]: Started User Login Management. worker2 # [ 12.131448] systemd[1]: Starting linger-users.service... worker1 # [ 12.122381] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 12.123357] systemd[1]: Stopping Host and Network Name Lookups... client # [ 12.148322] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 12.137318] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 12.138283] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 12.139114] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 12.160472] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 12.139990] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 12.151183] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 12.163159] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 12.163884] systemd[1]: Finished resolvconf update. lb # [ 12.170154] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.158401] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 12.171685] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 12.181215] nsncd[589]: Sep 20 13:33:57.735 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 12.183521] systemd[1]: Stopping User and Group Name Lookups... lb # [ 12.191325] systemd[1]: Starting DHCP Client... worker2 # [ 12.191757] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 12.198442] systemd[1]: nscd.service: Deactivated successfully. lb # [ 12.201083] systemd[1]: Starting Extra networking commands.... worker2 # [ 12.204240] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 12.205519] dbus-broker-launch[501]: Ready worker2 # [ 12.206137] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 12.220411] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 12.225896] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.217607] systemd[1]: linger-users.service: Deactivated successfully. client # [ 12.232783] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 12.218712] systemd[1]: Finished linger-users.service. client # [ 12.238740] nsncd[502]: Sep 20 13:33:57.803 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 12.245758] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 12.244580] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client # [ 12.249676] systemd[1]: Reached target User and Group Name Lookups. lb # [ 12.248854] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 12.253228] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 12.255091] systemd[1]: linger-users.service: Deactivated successfully. client # [ 12.271202] mousedev: PS/2 mouse device common for all mice worker1 # [ 12.245538] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 12.246522] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 12.258236] systemd[1]: Finished linger-users.service. worker1 # [ 12.247408] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 12.260805] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line. client # [ 12.270697] systemd[1]: Finished resolvconf update. worker1 # [ 12.256640] nsncd[568]: Sep 20 13:33:57.822 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 12.270513] systemd[1]: Started backdoor.service. client # [ 12.283145] systemd[1]: Starting DHCP Client... worker2 # [ 12.281312] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 12.285220] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 12.289051] nsncd[570]: Sep 20 13:33:57.857 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 12.291120] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 12.297209] (udev-worker)[366]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 12.304756] (udev-worker)[366]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.298274] systemd[1]: Finished resolvconf update. worker1 # [ 12.299110] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.306246] systemd[1]: Starting DHCP Client... worker1 # [ 12.309451] systemd[1]: Starting Extra networking commands.... worker2 # [ 12.340110] systemd[1]: Finished resolvconf update. worker2 # [ 12.340996] systemd[1]: Reached target Preparation for Network. worker2 # [ 12.346811] systemd[1]: Starting DHCP Client... worker2 # [ 12.350091] systemd[1]: Starting Extra networking commands.... worker1 # [ 12.345322] (udev-worker)[379]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 12.351382] (udev-worker)[379]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.362481] (udev-worker)[376]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.415444] systemd-logind[522]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # connecting to host... client # [ 12.499622] dhcpcd[534]: dhcpcd-10.3.2 starting client # [ 12.515321] dhcpcd[543]: dev: loaded udev client # [ 12.530204] systemd[1]: Finished nftables firewall. client # [ 12.533814] systemd[1]: Reached target Preparation for Network. client # [ 12.539366] systemd[1]: Starting Address configuration of eth1... client # [ 12.546764] systemd[1]: Starting Extra networking commands.... worker2 # [ 12.562674] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 12.570532] systemd-logind[430]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 12.559496] dhcpcd[603]: dhcpcd-10.3.2 starting client # [ 12.588780] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.578981] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.578947] dhcpcd[638]: dev: loaded udev worker1 # [ 12.591412] systemd-logind[510]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 12.612635] dhcpcd[605]: dhcpcd-10.3.2 starting worker1 # [ 12.611333] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.617313] systemd[1]: Starting Address configuration of eth1... lb # [ 12.637173] dhcpcd[623]: dhcpcd-10.3.2 starting worker1 # [ 12.639327] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.639320] dhcpcd[640]: dev: loaded udev lb # [ 12.650871] dhcpcd[667]: dev: loaded udev worker1 # [ 12.668320] systemd[1]: Finished Extra networking commands.. worker1 # [ 12.669268] systemd[1]: Reached target Network. worker2 # [ 12.696034] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 12.680288] systemd[1]: Starting Permit User Sessions... client # [ 12.710871] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.716600] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 12.719004] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.709879] systemd[1]: Finished Extra networking commands.. lb # [ 12.713475] systemd[1]: Reached target Network. worker2 # [ 12.711430] systemd[1]: Finished Extra networking commands.. worker2 # [ 12.718640] systemd[1]: Reached target Network. worker2 # [ 12.719398] systemd[1]: Starting Permit User Sessions... lb # [ 12.721901] systemd[1]: Starting PostgreSQL Server... lb # [ 12.729506] systemd[1]: Starting Permit User Sessions... client # [ 12.735291] network-addresses-eth1-start[547]: adding address 192.168.1.1/24... done worker1 # [ 12.737085] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 12.763234] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 12.758302] network-addresses-eth1-start[547]: adding address 2001:db8:1::1/64... done client # [ 12.775092] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.775621] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 12.780905] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.781228] cfg80211: failed to load regulatory.db worker1 # [ 12.768484] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.782729] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.783240] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.798208] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.790474] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 12.790819] cfg80211: failed to load regulatory.db worker1 # [ 12.777241] systemd[1]: Started Getty on tty1. worker1 # [ 12.783302] systemd[1]: Reached target Login Prompts. worker2 # [ 12.802556] network-addresses-eth1-start[628]: adding address 192.168.1.4/24... done client # [ 12.803690] systemd[1]: Finished Address configuration of eth1. worker2 # [ 12.837188] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.839690] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.833496] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 12.844223] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.844552] cfg80211: failed to load regulatory.db worker2 # [ 12.845753] systemd[1]: Finished Permit User Sessions. worker2 # [ 12.850806] systemd[1]: Started Getty on tty1. worker2 # [ 12.853315] network-addresses-eth1-start[628]: adding address 2001:db8:1::4/64... done worker2 # [ 12.856325] systemd[1]: Reached target Login Prompts. worker1 # [ 12.847088] network-addresses-eth1-start[652]: adding address 192.168.1.3/24... done lb # [ 12.860992] systemd[1]: Finished Permit User Sessions. client # [ 12.867264] dhcpcd[606]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (551) - Operation not permitted client # [ 12.873756] dhcpcd[606]: .resolvconf-wrapped: clearing stale lock pid 551 lb # [ 12.877508] systemd[1]: Started Getty on tty1. lb # [ 12.878287] systemd[1]: Reached target Login Prompts. worker1 # [ 12.867439] network-addresses-eth1-start[652]: adding address 2001:db8:1::3/64... done worker2 # [ 12.884564] systemd[1]: Finished Address configuration of eth1. lb # [ 12.911101] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.891814] systemd[1]: Finished Address configuration of eth1. worker1 # [ 12.910260] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 12.899777] dhcpcd[638]: eth0: waiting for carrier client # [ 12.914869] systemd[1]: Finished Extra networking commands.. worker1 # [ 12.901407] dhcpcd[638]: eth0: waiting for carrier worker1 # [ 12.903857] dhcpcd[638]: eth0: carrier acquired client # [ 12.931361] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.921420] systemd[1]: Reached target Network. client # [ 12.925090] dhcpcd[543]: eth0: waiting for carrier client # [ 12.927010] dhcpcd[543]: eth0: carrier acquired client # [ 12.930280] systemd[1]: Starting Permit User Sessions... worker1 # [ 12.920542] dhcpcd[638]: DUID 00:01:00:01:32:42:9d:46:52:54:00:12:34:56 worker1 # [ 12.921602] dhcpcd[638]: eth0: IAID 00:12:34:56 worker1 # [ 12.922230] dhcpcd[638]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 12.948644] dhcpcd[543]: DUID 00:01:00:01:32:42:9d:46:52:54:00:12:34:56 worker2 # [ 12.959384] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 12.948746] dhcpcd[640]: eth0: waiting for carrier worker2 # [ 12.949512] dhcpcd[640]: eth0: carrier acquired client # [ 12.951488] dhcpcd[543]: eth0: IAID 00:12:34:56 client # [ 12.954263] dhcpcd[543]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 12.963921] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 12.964427] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 12.971563] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 12.971912] cfg80211: failed to load regulatory.db worker2 # [ 12.965692] dhcpcd[640]: DUID 00:01:00:01:32:42:9d:46:52:54:00:12:34:56 lb # [ 12.966326] dhcpcd[667]: no valid interfaces found worker2 # [ 12.966687] dhcpcd[640]: eth0: IAID 00:12:34:56 worker2 # [ 12.967315] dhcpcd[640]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 12.967631] dhcpcd[667]: no valid interfaces found client # [ 12.988445] systemd[1]: Finished Permit User Sessions. client # [ 12.996284] systemd[1]: Started Getty on tty1. client # [ 12.998760] systemd[1]: Reached target Login Prompts. worker2 # [ 13.017308] mousedev: PS/2 mouse device common for all mice worker1 # [ 13.042248] mousedev: PS/2 mouse device common for all mice worker2 # [ 13.055942] systemd-logind[522]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 13.119437] systemd-logind[510]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 13.167455] (udev-worker)[691]: Network interface NamePolicy= disabled on kernel command line. lb # [ 13.174682] postgresql-pre-start[705]: The files belonging to this database system will be owned by user "postgres". lb # [ 13.178313] postgresql-pre-start[705]: This user must also own the server process. lb # [ 13.187874] postgresql-pre-start[705]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 13.190433] postgresql-pre-start[705]: The default database encoding has accordingly been set to "UTF8". client: (finished: waiting for unit network-addresses-eth1.service, in 13.64 seconds) lb # [ 13.193380] postgresql-pre-start[705]: The default text search configuration will be set to "english". client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 13.194526] postgresql-pre-start[705]: Data page checksums are enabled. lb # [ 13.195327] postgresql-pre-start[705]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 13.201515] postgresql-pre-start[705]: creating subdirectories ... ok lb # [ 13.205826] postgresql-pre-start[705]: selecting dynamic shared memory implementation ... posix lb # [ 13.218852] (udev-worker)[700]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 13.230858] (udev-worker)[700]: Network interface NamePolicy= disabled on kernel command line. client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.06 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 13.443559] postgresql-pre-start[705]: selecting default "max_connections" ... 100 lb # [ 13.547782] systemd-logind[523]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 13.620215] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.632541] postgresql-pre-start[705]: selecting default "shared_buffers" ... 128MB lb # [ 13.699556] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 13.712000] systemd[1]: Starting Address configuration of eth1... worker2 # [ 13.725586] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker1 # [ 13.740523] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.758696] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 13.750018] dhcpcd[667]: eth0: waiting for carrier lb # [ 13.759829] dhcpcd[667]: eth0: carrier acquired lb # [ 13.781261] dhcpcd[667]: DUID 00:01:00:01:32:42:9d:47:52:54:00:12:34:56 lb # [ 13.783970] dhcpcd[667]: eth0: IAID 00:12:34:56 lb # [ 13.786913] dhcpcd[667]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 13.780570] dhcpcd[638]: eth0: soliciting a DHCP lease worker1 # [ 13.788712] dhcpcd[638]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 13.796252] dhcpcd[638]: eth0: probing address 10.0.2.15/24 lb # [ 13.832901] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 13.855845] network-addresses-eth1-start[736]: adding address 192.168.1.2/24... done lb # [ 13.875048] mousedev: PS/2 mouse device common for all mice lb # [ 13.868654] network-addresses-eth1-start[736]: adding address 2001:db8:1::2/64... done lb # [ 13.886461] systemd[1]: Finished Address configuration of eth1. client # [ 13.947161] systemd[1]: Starting Virtual Console Setup... client # [ 13.969974] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 13.975540] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 13.979205] systemd[1]: Stopped Virtual Console Setup. client # [ 13.984290] systemd[1]: Starting Virtual Console Setup... worker2 # [ 14.009531] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 14.038290] systemd[1]: Starting Virtual Console Setup... client # [ 14.046789] systemd-logind[430]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 14.053868] systemd-logind[523]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 14.046606] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 14.063137] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 14.068542] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 14.070480] systemd[1]: Starting Virtual Console Setup... worker1 # [ 14.065993] systemd[1]: Starting Virtual Console Setup... worker1 # [ 14.089306] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 14.093032] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 14.096486] systemd[1]: Starting Virtual Console Setup... worker2 # [ 14.120604] systemd-logind[522]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 14.151535] systemd-logind[510]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 14.419652] systemd-vconsole-setup[649]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 14.423766] systemd[1]: Finished Virtual Console Setup. worker2 # [ 14.519356] dhcpcd[640]: eth0: soliciting a DHCP lease worker2 # [ 14.523194] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.527857] dhcpcd[640]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 14.531333] systemd[1]: Finished Virtual Console Setup. worker2 # [ 14.532543] dhcpcd[640]: eth0: probing address 10.0.2.15/24 worker1 # [ 14.529351] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.533108] systemd[1]: Finished Virtual Console Setup. lb: (finished: waiting for unit network-addresses-eth1.service, in 1.30 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 14.651879] dhcpcd[667]: eth0: soliciting a DHCP lease lb # [ 14.656534] dhcpcd[667]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 14.664290] dhcpcd[667]: eth0: probing address 10.0.2.15/24 worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) client # [ 14.762287] dhcpcd[543]: eth0: soliciting a DHCP lease client # [ 14.768995] dhcpcd[543]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 14.772352] dhcpcd[543]: eth0: probing address 10.0.2.15/24 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } client # [ 14.877326] dhcpcd[543]: eth0: soliciting an IPv6 router worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds) lb: waiting for unit niks3.service client # [ 14.881307] dhcpcd[543]: eth0: Router Advertisement from fe80::2 client # [ 14.884151] dhcpcd[543]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 14.886992] dhcpcd[543]: eth0: adding route to fec0::/64 client # [ 14.889783] dhcpcd[543]: eth0: adding default route via fe80::2 worker1 # [ 14.982491] dhcpcd[638]: eth0: soliciting an IPv6 router worker1 # [ 14.986740] dhcpcd[638]: eth0: Router Advertisement from fe80::2 worker1 # [ 14.989830] dhcpcd[638]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 14.993292] dhcpcd[638]: eth0: adding route to fec0::/64 worker1 # [ 14.995826] dhcpcd[638]: eth0: adding default route via fe80::2 lb # [ 15.106983] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 15.594314] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 15.602973] systemd[1]: Starting Virtual Console Setup... worker2 # [ 15.633908] dhcpcd[640]: eth0: soliciting an IPv6 router worker2 # [ 15.637526] dhcpcd[640]: eth0: Router Advertisement from fe80::2 worker2 # [ 15.640934] dhcpcd[640]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 15.639245] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.644707] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 15.643900] dhcpcd[640]: eth0: adding route to fec0::/64 worker2 # [ 15.647492] dhcpcd[640]: eth0: adding default route via fe80::2 lb # [ 15.654373] systemd[1]: Starting Virtual Console Setup... lb # [ 15.835037] systemd-logind[523]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 16.131060] systemd-vconsole-setup[774]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 16.136728] systemd[1]: Finished Virtual Console Setup. lb # [ 16.299831] postgresql-pre-start[705]: selecting default time zone ... UTC lb # [ 16.304534] postgresql-pre-start[705]: creating configuration files ... ok lb # [ 16.385935] dhcpcd[667]: eth0: soliciting an IPv6 router lb # [ 16.386798] dhcpcd[667]: eth0: Router Advertisement from fe80::2 lb # [ 16.387608] dhcpcd[667]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 16.392115] dhcpcd[667]: eth0: adding route to fec0::/64 lb # [ 16.392922] dhcpcd[667]: eth0: adding default route via fe80::2 lb # [ 16.586348] postgresql-pre-start[705]: running bootstrap script ... ok lb # [ 17.220204] postgresql-pre-start[705]: performing post-bootstrap initialization ... ok lb # [ 17.404209] postgresql-pre-start[705]: syncing data to disk ... ok lb # [ 17.405178] postgresql-pre-start[705]: initdb: warning: enabling "trust" authentication for local connections lb # [ 17.406431] postgresql-pre-start[705]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 17.408577] postgresql-pre-start[705]: Success. You can now start the database server using: lb # [ 17.409837] postgresql-pre-start[705]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 17.535783] postgres[810]: [810] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.540694] postgres[810]: [810] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.541901] postgres[810]: [810] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.544098] postgres[810]: [810] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.558541] postgres[819]: [819] LOG: database system was shut down at 2026-09-20 13:34:02 GMT lb # [ 17.563485] postgres[810]: [810] LOG: database system is ready to accept connections lb # [ 17.572220] systemd[1]: Started PostgreSQL Server. lb # [ 17.580664] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 17.800573] postgresql-setup-start[830]: CREATE DATABASE lb # [ 17.850455] postgresql-setup-start[835]: CREATE ROLE lb # [ 17.873858] postgresql-setup-start[837]: ALTER DATABASE lb # [ 17.880730] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 17.882562] systemd[1]: Reached target PostgreSQL. worker1 # [ 18.888665] dhcpcd[638]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 18.892608] dhcpcd[638]: eth0: adding route to 10.0.2.0/24 worker1 # [ 18.895823] dhcpcd[638]: eth0: adding default route via 10.0.2.2 lb # [ 19.013558] dhcpcd[667]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 19.057207] systemd[1]: Started DHCP Client. worker1 # [ 19.059113] systemd[1]: Reached target Multi-User System. worker1 # [ 19.059931] systemd[1]: Startup finished in 1.001s (kernel) + 5.485s (initrd) + 12.572s (userspace) = 19.058s. lb # [ 19.016566] dhcpcd[667]: eth0: adding route to 10.0.2.0/24 lb # [ 19.016726] dhcpcd[667]: eth0: adding default route via 10.0.2.2 lb # [ 19.162006] systemd[1]: Started DHCP Client. lb # [ 19.168134] systemd[1]: Reached target Network is Online. lb # [ 19.171167] systemd[1]: Started Envoy reverse proxy. lb # [ 19.176603] systemd[1]: Started mock-oidc.service. lb # [ 19.278985] mock-oidc-server[910]: Mock OIDC Server running lb # [ 19.280238] mock-oidc-server[910]: OIDC Address: 192.168.1.2:8080 lb # [ 19.282021] mock-oidc-server[910]: Issue Address: 0.0.0.0:8081 lb # [ 19.283337] mock-oidc-server[910]: Issuer: http://192.168.1.2:8080/oidc lb # [ 19.285421] mock-oidc-server[910]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 19.287038] mock-oidc-server[910]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 19.289012] mock-oidc-server[910]: Issue tokens: http://0.0.0.0:8081/issue?sub=... client # [ 19.401784] dhcpcd[543]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 19.405959] dhcpcd[543]: eth0: adding route to 10.0.2.0/24 client # [ 19.406141] dhcpcd[543]: eth0: adding default route via 10.0.2.2 client # [ 19.602880] systemd[1]: Started DHCP Client. client # [ 19.607604] systemd[1]: Reached target Multi-User System. client # [ 19.608788] systemd[1]: Startup finished in 999ms (kernel) + 5.543s (initrd) + 13.063s (userspace) = 19.607s. worker2 # [ 19.786934] dhcpcd[640]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 19.791554] dhcpcd[640]: eth0: adding route to 10.0.2.0/24 worker2 # [ 19.794313] dhcpcd[640]: eth0: adding default route via 10.0.2.2 lb # [ 19.912648] envoy[909]: [2026-09-20 13:34:05.466][909][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 19.914572] envoy[909]: [2026-09-20 13:34:05.466][909][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 19.916130] envoy[909]: [2026-09-20 13:34:05.466][909][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 19.918238] envoy[909]: [2026-09-20 13:34:05.466][909][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 19.920990] envoy[909]: [2026-09-20 13:34:05.466][909][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 19.923709] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 19.926723] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 19.930616] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params worker2 # [ 19.952321] systemd[1]: Started DHCP Client. worker2 # [ 19.954003] systemd[1]: Reached target Multi-User System. worker2 # [ 19.955323] systemd[1]: Startup finished in 995ms (kernel) + 5.474s (initrd) + 13.484s (userspace) = 19.954s. lb # [ 19.956747] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 19.958515] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 19.965683] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 19.967800] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 19.970731] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 19.979082] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 19.981900] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 19.986673] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 19.990382] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 19.993370] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 19.997886] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 20.000807] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 20.003332] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 20.005305] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 20.010713] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 20.030844] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 20.033601] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 20.036561] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 20.039595] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 20.041964] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 20.044436] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 20.046524] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 20.049985] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 20.052942] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 20.054965] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 20.057013] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 20.059531] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 20.061718] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 20.064466] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 20.066135] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 20.068768] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 20.070858] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.073742] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 20.075626] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.078255] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 20.080306] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 20.083075] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 20.092378] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 20.094673] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 20.097014] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 20.098789] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.101784] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 20.104996] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 20.107483] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 20.111371] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 20.114243] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 20.119367] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 20.121697] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.123874] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 20.126078] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 20.127996] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 20.130309] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 20.133217] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 20.136910] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 20.139225] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 20.142899] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 20.146563] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 20.148602] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 20.155910] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 20.158139] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 20.163360] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 20.166022] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 20.171701] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 20.177423] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 20.208638] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 20.210451] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 20.212722] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 20.214691] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 20.218546] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 20.220565] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 20.223735] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 20.225810] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 20.227795] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 20.231961] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 20.239802] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 20.247313] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 20.250801] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 20.253279] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 20.255709] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 20.258516] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 20.261813] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 20.264489] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 20.266528] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 20.268582] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 20.270336] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 20.272806] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 20.275832] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 20.281657] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 20.283599] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 20.290492] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 20.292481] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 20.295059] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 20.297631] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 20.299806] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 20.303305] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 20.310447] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 20.312252] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 20.314311] envoy[909]: [2026-09-20 13:34:05.467][909][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 20.317999] envoy[909]: [2026-09-20 13:34:05.504][909][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 20.319658] envoy[909]: [2026-09-20 13:34:05.507][909][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 20.335648] envoy[909]: [2026-09-20 13:34:05.507][909][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 20.337660] envoy[909]: [2026-09-20 13:34:05.507][909][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 20.346927] envoy[909]: [2026-09-20 13:34:05.507][909][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 20.349041] envoy[909]: [2026-09-20 13:34:05.702][909][info][main] [source/server/server.cc:968] runtime: {} lb # [ 20.350478] envoy[909]: [2026-09-20 13:34:05.727][909][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 20.352468] envoy[909]: [2026-09-20 13:34:05.727][909][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 20.354178] envoy[909]: [2026-09-20 13:34:05.727][909][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 20.355765] envoy[909]: [2026-09-20 13:34:05.763][909][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 20.357785] envoy[909]: [2026-09-20 13:34:05.763][909][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 20.359473] envoy[909]: [2026-09-20 13:34:05.763][909][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 20.381983] envoy[909]: [2026-09-20 13:34:05.937][909][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 20.385529] systemd[1]: Reached target Network is Online. lb # [ 20.392612] envoy[909]: [2026-09-20 13:34:05.948][909][info][config] [source/server/configuration_impl.cc:164] loading stats configuration worker1 # [ 20.384302] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 20.395262] envoy[909]: [2026-09-20 13:34:05.950][909][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. worker2 # [ 20.397392] systemd[1]: Starting scheduler-token.service... lb # [ 20.398867] envoy[909]: [2026-09-20 13:34:05.950][909][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 20.532966] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 20.535302] systemd[1]: Finished scheduler-token.service. worker2 # [ 20.538686] systemd[1]: scheduler-token.service: Consumed 54ms CPU time over 137ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 20.542519] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 20.651163] nix-grpc-daemon[774]: ts=2026-09-20T13:34:06Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 20.664197] nix-grpc-daemon[774]: ts=2026-09-20T13:34:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 20.666484] nix-grpc-daemon[774]: ts=2026-09-20T13:34:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 20.718622] nix-grpc-daemon[774]: ts=2026-09-20T13:34:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 20.723583] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 20.755161] nix-grpc-daemon[774]: ts=2026-09-20T13:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 20.770861] nix-grpc-daemon[777]: ts=2026-09-20T13:34:06Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb # [ 20.768471] envoy[909]: [2026-09-20 13:34:06.324][909][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 20.777162] envoy[909]: [2026-09-20 13:34:06.329][909][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker2 # [ 20.783154] nix-grpc-daemon[777]: ts=2026-09-20T13:34:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 20.785512] nix-grpc-daemon[777]: ts=2026-09-20T13:34:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 20.782749] envoy[909]: [2026-09-20 13:34:06.329][909][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 20.788090] envoy[909]: [2026-09-20 13:34:06.329][909][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 20.831177] nix-grpc-daemon[777]: ts=2026-09-20T13:34:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 20.843430] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 20.873038] nix-grpc-daemon[777]: ts=2026-09-20T13:34:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.878270] nix-grpc-daemon[777]: ts=2026-09-20T13:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.956211] nix-grpc-daemon[774]: ts=2026-09-20T13:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 21.080412] nix-grpc-daemon[777]: ts=2026-09-20T13:34:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.085966] nix-grpc-daemon[777]: ts=2026-09-20T13:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.287526] nix-grpc-daemon[777]: ts=2026-09-20T13:34:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.293200] nix-grpc-daemon[777]: ts=2026-09-20T13:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.357012] nix-grpc-daemon[774]: ts=2026-09-20T13:34:06Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker2 # [ 21.494954] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.500797] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.702612] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.708303] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.912001] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.916281] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.113360] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.119240] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.161315] nix-grpc-daemon[774]: ts=2026-09-20T13:34:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.161767] nix-grpc-daemon[774]: ts=2026-09-20T13:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.321077] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.326998] nix-grpc-daemon[777]: ts=2026-09-20T13:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.362501] nix-grpc-daemon[774]: ts=2026-09-20T13:34:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.368338] nix-grpc-daemon[774]: ts=2026-09-20T13:34:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.528554] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.534348] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.569890] nix-grpc-daemon[774]: ts=2026-09-20T13:34:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.575348] nix-grpc-daemon[774]: ts=2026-09-20T13:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.735166] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.738159] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.777504] nix-grpc-daemon[774]: ts=2026-09-20T13:34:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.782236] nix-grpc-daemon[774]: ts=2026-09-20T13:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.941702] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.946793] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.979187] nix-grpc-daemon[774]: ts=2026-09-20T13:34:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.985528] nix-grpc-daemon[774]: ts=2026-09-20T13:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.150531] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.155566] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.190582] nix-grpc-daemon[774]: ts=2026-09-20T13:34:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.194956] nix-grpc-daemon[774]: ts=2026-09-20T13:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.352268] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.358112] nix-grpc-daemon[777]: ts=2026-09-20T13:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.391810] nix-grpc-daemon[774]: ts=2026-09-20T13:34:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.397187] nix-grpc-daemon[774]: ts=2026-09-20T13:34:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.559861] nix-grpc-daemon[777]: ts=2026-09-20T13:34:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.565568] nix-grpc-daemon[777]: ts=2026-09-20T13:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.598378] nix-grpc-daemon[774]: ts=2026-09-20T13:34:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.603899] nix-grpc-daemon[774]: ts=2026-09-20T13:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.767659] nix-grpc-daemon[777]: ts=2026-09-20T13:34:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.773585] nix-grpc-daemon[777]: ts=2026-09-20T13:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.806420] nix-grpc-daemon[774]: ts=2026-09-20T13:34:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.811618] nix-grpc-daemon[774]: ts=2026-09-20T13:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.975565] nix-grpc-daemon[777]: ts=2026-09-20T13:34:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.978867] nix-grpc-daemon[777]: ts=2026-09-20T13:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.013245] nix-grpc-daemon[774]: ts=2026-09-20T13:34:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.018898] nix-grpc-daemon[774]: ts=2026-09-20T13:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.180595] nix-grpc-daemon[777]: ts=2026-09-20T13:34:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.186975] nix-grpc-daemon[777]: ts=2026-09-20T13:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.223360] nix-grpc-daemon[774]: ts=2026-09-20T13:34:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.228635] nix-grpc-daemon[774]: ts=2026-09-20T13:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.389288] nix-grpc-daemon[777]: ts=2026-09-20T13:34:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.395015] nix-grpc-daemon[777]: ts=2026-09-20T13:34:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.429519] nix-grpc-daemon[774]: ts=2026-09-20T13:34:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.435398] nix-grpc-daemon[774]: ts=2026-09-20T13:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.597462] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.603217] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.636944] nix-grpc-daemon[774]: ts=2026-09-20T13:34:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.643109] nix-grpc-daemon[774]: ts=2026-09-20T13:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.805699] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.811844] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.844273] nix-grpc-daemon[774]: ts=2026-09-20T13:34:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.849886] nix-grpc-daemon[774]: ts=2026-09-20T13:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.014075] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.016282] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.051608] nix-grpc-daemon[774]: ts=2026-09-20T13:34:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.058496] nix-grpc-daemon[774]: ts=2026-09-20T13:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.218130] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.222648] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.262466] nix-grpc-daemon[774]: ts=2026-09-20T13:34:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.267043] nix-grpc-daemon[774]: ts=2026-09-20T13:34:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.420436] nix-grpc-daemon[777]: ts=2026-09-20T13:34:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.426126] nix-grpc-daemon[777]: ts=2026-09-20T13:34:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.463641] nix-grpc-daemon[774]: ts=2026-09-20T13:34:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.470131] nix-grpc-daemon[774]: ts=2026-09-20T13:34:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.627464] nix-grpc-daemon[777]: ts=2026-09-20T13:34:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.631646] nix-grpc-daemon[777]: ts=2026-09-20T13:34:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.670813] nix-grpc-daemon[774]: ts=2026-09-20T13:34:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.677252] nix-grpc-daemon[774]: ts=2026-09-20T13:34:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.835035] nix-grpc-daemon[777]: ts=2026-09-20T13:34:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.840988] nix-grpc-daemon[777]: ts=2026-09-20T13:34:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.878775] nix-grpc-daemon[774]: ts=2026-09-20T13:34:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.884434] nix-grpc-daemon[774]: ts=2026-09-20T13:34:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.045507] nix-grpc-daemon[777]: ts=2026-09-20T13:34:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.049955] nix-grpc-daemon[777]: ts=2026-09-20T13:34:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.087633] nix-grpc-daemon[774]: ts=2026-09-20T13:34:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.094201] nix-grpc-daemon[774]: ts=2026-09-20T13:34:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.246377] nix-grpc-daemon[777]: ts=2026-09-20T13:34:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.250608] nix-grpc-daemon[777]: ts=2026-09-20T13:34:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.297264] nix-grpc-daemon[774]: ts=2026-09-20T13:34:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.301910] nix-grpc-daemon[774]: ts=2026-09-20T13:34:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.452791] nix-grpc-daemon[777]: ts=2026-09-20T13:34:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.457958] nix-grpc-daemon[777]: ts=2026-09-20T13:34:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.497078] nix-grpc-daemon[774]: ts=2026-09-20T13:34:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.500174] nix-grpc-daemon[774]: ts=2026-09-20T13:34:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.655711] nix-grpc-daemon[777]: ts=2026-09-20T13:34:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.661799] nix-grpc-daemon[777]: ts=2026-09-20T13:34:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.701711] nix-grpc-daemon[774]: ts=2026-09-20T13:34:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.707398] nix-grpc-daemon[774]: ts=2026-09-20T13:34:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.862827] nix-grpc-daemon[777]: ts=2026-09-20T13:34:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.866120] nix-grpc-daemon[777]: ts=2026-09-20T13:34:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.909227] nix-grpc-daemon[774]: ts=2026-09-20T13:34:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.915086] nix-grpc-daemon[774]: ts=2026-09-20T13:34:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.069122] nix-grpc-daemon[777]: ts=2026-09-20T13:34:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.073493] nix-grpc-daemon[777]: ts=2026-09-20T13:34:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.116779] nix-grpc-daemon[774]: ts=2026-09-20T13:34:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.122469] nix-grpc-daemon[774]: ts=2026-09-20T13:34:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.275452] nix-grpc-daemon[777]: ts=2026-09-20T13:34:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.281251] nix-grpc-daemon[777]: ts=2026-09-20T13:34:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.327274] nix-grpc-daemon[774]: ts=2026-09-20T13:34:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.331716] nix-grpc-daemon[774]: ts=2026-09-20T13:34:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.482605] nix-grpc-daemon[777]: ts=2026-09-20T13:34:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.488915] nix-grpc-daemon[777]: ts=2026-09-20T13:34:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.528892] nix-grpc-daemon[774]: ts=2026-09-20T13:34:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.534651] nix-grpc-daemon[774]: ts=2026-09-20T13:34:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.690264] nix-grpc-daemon[777]: ts=2026-09-20T13:34:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.695989] nix-grpc-daemon[777]: ts=2026-09-20T13:34:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.735729] nix-grpc-daemon[774]: ts=2026-09-20T13:34:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.741694] nix-grpc-daemon[774]: ts=2026-09-20T13:34:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.897508] nix-grpc-daemon[777]: ts=2026-09-20T13:34:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.903443] nix-grpc-daemon[777]: ts=2026-09-20T13:34:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.943010] nix-grpc-daemon[774]: ts=2026-09-20T13:34:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.947911] nix-grpc-daemon[774]: ts=2026-09-20T13:34:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.109213] nix-grpc-daemon[777]: ts=2026-09-20T13:34:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.114042] nix-grpc-daemon[777]: ts=2026-09-20T13:34:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.149667] nix-grpc-daemon[774]: ts=2026-09-20T13:34:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.156248] nix-grpc-daemon[774]: ts=2026-09-20T13:34:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.310694] nix-grpc-daemon[777]: ts=2026-09-20T13:34:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.316507] nix-grpc-daemon[777]: ts=2026-09-20T13:34:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.361131] nix-grpc-daemon[774]: ts=2026-09-20T13:34:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.365439] nix-grpc-daemon[774]: ts=2026-09-20T13:34:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.518359] nix-grpc-daemon[777]: ts=2026-09-20T13:34:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.524926] nix-grpc-daemon[777]: ts=2026-09-20T13:34:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.563173] nix-grpc-daemon[774]: ts=2026-09-20T13:34:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.568420] nix-grpc-daemon[774]: ts=2026-09-20T13:34:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.727556] nix-grpc-daemon[777]: ts=2026-09-20T13:34:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.734138] nix-grpc-daemon[777]: ts=2026-09-20T13:34:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.773964] nix-grpc-daemon[774]: ts=2026-09-20T13:34:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.781222] nix-grpc-daemon[774]: ts=2026-09-20T13:34:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.936309] nix-grpc-daemon[777]: ts=2026-09-20T13:34:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.942845] nix-grpc-daemon[777]: ts=2026-09-20T13:34:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.982216] nix-grpc-daemon[774]: ts=2026-09-20T13:34:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.989083] nix-grpc-daemon[774]: ts=2026-09-20T13:34:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.147015] nix-grpc-daemon[777]: ts=2026-09-20T13:34:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.151456] nix-grpc-daemon[777]: ts=2026-09-20T13:34:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.190307] nix-grpc-daemon[774]: ts=2026-09-20T13:34:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.196079] nix-grpc-daemon[774]: ts=2026-09-20T13:34:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.348864] nix-grpc-daemon[777]: ts=2026-09-20T13:34:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.354450] nix-grpc-daemon[777]: ts=2026-09-20T13:34:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.398357] nix-grpc-daemon[774]: ts=2026-09-20T13:34:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.404220] nix-grpc-daemon[774]: ts=2026-09-20T13:34:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.555281] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.558266] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.601243] nix-grpc-daemon[774]: ts=2026-09-20T13:34:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.606900] nix-grpc-daemon[774]: ts=2026-09-20T13:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.759999] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.765522] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.807961] nix-grpc-daemon[774]: ts=2026-09-20T13:34:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.813648] nix-grpc-daemon[774]: ts=2026-09-20T13:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.966748] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.969822] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.015000] nix-grpc-daemon[774]: ts=2026-09-20T13:34:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.020682] nix-grpc-daemon[774]: ts=2026-09-20T13:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.173868] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.179053] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.221833] nix-grpc-daemon[774]: ts=2026-09-20T13:34:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.227330] nix-grpc-daemon[774]: ts=2026-09-20T13:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.380213] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.385787] nix-grpc-daemon[777]: ts=2026-09-20T13:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.432264] nix-grpc-daemon[774]: ts=2026-09-20T13:34:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.436497] nix-grpc-daemon[774]: ts=2026-09-20T13:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.588079] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.593502] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.632095] nix-grpc-daemon[774]: ts=2026-09-20T13:34:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.637594] nix-grpc-daemon[774]: ts=2026-09-20T13:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.795276] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.801268] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.839089] nix-grpc-daemon[774]: ts=2026-09-20T13:34:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.844767] nix-grpc-daemon[774]: ts=2026-09-20T13:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.003341] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.009152] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.046340] nix-grpc-daemon[774]: ts=2026-09-20T13:34:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.052179] nix-grpc-daemon[774]: ts=2026-09-20T13:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.213724] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.218244] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.223960] rustfs-bucket-start[1028]: mb s3://farm lb # [ 31.234639] systemd[1]: Finished rustfs-bucket.service. lb # [ 31.246258] systemd[1]: Starting niks3 server... worker1 # [ 31.253630] nix-grpc-daemon[774]: ts=2026-09-20T13:34:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.258985] nix-grpc-daemon[774]: ts=2026-09-20T13:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.415055] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.420459] nix-grpc-daemon[777]: ts=2026-09-20T13:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.459194] nix-grpc-daemon[774]: ts=2026-09-20T13:34:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.463607] nix-grpc-daemon[774]: ts=2026-09-20T13:34:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.490298] postgres[1043]: [1043] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 31.491662] postgres[1043]: [1043] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 31.531767] niks3-server[1038]: 2026/09/20 13:34:17 OK 20241026095416_initial_model.sql (25.04ms) lb # [ 31.536646] niks3-server[1038]: 2026/09/20 13:34:17 OK 20251210153512_drop_unused_gin_index.sql (5.21ms) lb # [ 31.543505] niks3-server[1038]: 2026/09/20 13:34:17 OK 20251218171726_add_pins.sql (6.78ms) lb # [ 31.549277] niks3-server[1038]: 2026/09/20 13:34:17 OK 20260628120000_add_object_size_and_stats.sql (5.71ms) lb # [ 31.556748] niks3-server[1038]: 2026/09/20 13:34:17 OK 20260905000000_add_claims.sql (7.44ms) lb # [ 31.562037] niks3-server[1038]: 2026/09/20 13:34:17 OK 20260920000000_drop_claims.sql (5.16ms) lb # [ 31.563344] niks3-server[1038]: 2026/09/20 13:34:17 goose: successfully migrated database to version: 20260920000000 lb # [ 31.569303] niks3-server[1038]: 2026/09/20 13:34:17 OK 1_commit_pending_closure.sql (7.23ms) lb # [ 31.573216] niks3-server[1038]: 2026/09/20 13:34:17 OK 2_object_stats_trigger.sql (3.75ms) lb # [ 31.574544] niks3-server[1038]: 2026/09/20 13:34:17 goose: up to current file version: 2 lb # [ 31.578910] niks3-server[1038]: 2026/09/20 13:34:17 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key worker2 # [ 31.617708] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.623336] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.629947] niks3-server[1038]: 2026/09/20 13:34:17 INFO Read proxy enabled — serving cache objects from S3 lb # [ 31.632089] niks3-server[1038]: 2026/09/20 13:34:17 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 31.636162] niks3-server[1038]: 2026/09/20 13:34:17 INFO systemd watchdog enabled interval=15s lb # [ 31.641064] systemd[1]: Started niks3 server. lb # [ 31.641778] niks3-server[1038]: 2026/09/20 13:34:17 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 31.646049] systemd[1]: Reached target Multi-User System. lb # [ 31.646941] systemd[1]: Startup finished in 1.016s (kernel) + 5.453s (initrd) + 25.171s (userspace) = 31.640s. lb # [ 31.654472] niks3-server[1038]: 2026/09/20 13:34:17 INFO lead: acquired remote=192.168.1.4:33290 worker2 # [ 31.655015] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=scheduler_take_over worker1 # [ 31.659491] nix-grpc-daemon[774]: ts=2026-09-20T13:34:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.664899] nix-grpc-daemon[774]: ts=2026-09-20T13:34:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.824799] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.830693] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.861869] nix-grpc-daemon[774]: ts=2026-09-20T13:34:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.867478] nix-grpc-daemon[774]: ts=2026-09-20T13:34:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.032597] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: waiting for unit niks3.service, in 17.18 seconds) lb: waiting for TCP port 5751 on localhost worker2 # [ 32.067923] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 32.073913] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:57124 worker1 # [ 32.068979] nix-grpc-daemon[774]: ts=2026-09-20T13:34:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.079906] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 32.087775] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57124 worker2 # [ 32.092917] nix-grpc-daemon[777]: ts=2026-09-20T13:34:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.10 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.07 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 32.268394] envoy[909]: conn peer=[::1]:36704 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=5 lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds) worker2 # [ 32.495117] systemd[1]: Starting scheduler-token.service... worker2 # [ 32.590905] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 32.598354] systemd[1]: Finished scheduler-token.service. worker2 # [ 32.599542] systemd[1]: scheduler-token.service: Consumed 42ms CPU time over 101ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.12 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.13 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.11 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 1.07 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 34.209827] nix-grpc-daemon[774]: ts=2026-09-20T13:34:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 34.223115] systemd[1]: Started Nix Daemon. worker1 # [ 34.575465] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 34.619382] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 1/5) worker1 # [ 34.696286] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 2/5) worker1 # [ 34.749076] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 332 ms (attempt 3/5) worker1 # [ 35.089024] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 437 ms (attempt 4/5) worker1 # [ 35.538657] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 35.565017] nix-grpc-daemon[774]: ts=2026-09-20T13:34:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 35.583023] nix-grpc-daemon[774]: ts=2026-09-20T13:34:21Z level=debug event=path_info_miss path=9f6bv5lb34q1i2zz9zicg65xmqpax058-nixos-system-client-test error="error: path '/nix/store/9f6bv5lb34q1i2zz9zicg65xmqpax058-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 35.596752] nix-grpc-daemon[774]: ts=2026-09-20T13:34:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 35.610143] nix-grpc-daemon[774]: ts=2026-09-20T13:34:21Z level=debug event=path_info_miss path=9f6bv5lb34q1i2zz9zicg65xmqpax058-nixos-system-client-test error="error: path '/nix/store/9f6bv5lb34q1i2zz9zicg65xmqpax058-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds) client: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds) worker1 # [ 36.140281] nix-grpc-daemon[774]: ts=2026-09-20T13:34:21Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 36.146604] nix-grpc-daemon[774]: ts=2026-09-20T13:34:21Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:34114 worker2 # [ 36.187548] nix-grpc-daemon[777]: ts=2026-09-20T13:34:21Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:57134 worker2 # [ 36.197499] systemd[1]: Started Nix Daemon. worker2 # [ 36.515576] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 36.546023] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5) worker2 # [ 36.590781] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 2/5) worker2 # [ 36.617929] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 248 ms (attempt 3/5) worker2 # [ 36.871313] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 363 ms (attempt 4/5) worker2 # [ 37.246816] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 37.266943] nix-grpc-daemon[777]: ts=2026-09-20T13:34:22Z level=debug event=path_info_miss path=9f6bv5lb34q1i2zz9zicg65xmqpax058-nixos-system-client-test error="error: path '/nix/store/9f6bv5lb34q1i2zz9zicg65xmqpax058-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 37.282688] nix-grpc-daemon[777]: ts=2026-09-20T13:34:22Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:57134 worker2 # [ 37.299512] nix-grpc-daemon[777]: ts=2026-09-20T13:34:22Z level=debug event=path_info_miss path=9f6bv5lb34q1i2zz9zicg65xmqpax058-nixos-system-client-test error="error: path '/nix/store/9f6bv5lb34q1i2zz9zicg65xmqpax058-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.08 seconds) worker2 # [ 39.734815] nix-grpc-daemon[777]: ts=2026-09-20T13:34:25Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 40.005938] nix-grpc-daemon[774]: ts=2026-09-20T13:34:25Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 6.24 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker2 # [ 40.297126] nix-grpc-daemon[777]: ts=2026-09-20T13:34:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57134 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 40.314254] nix-grpc-daemon[777]: ts=2026-09-20T13:34:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 40.366468] nix-grpc-daemon[777]: ts=2026-09-20T13:34:25Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 40.374803] nix-grpc-daemon[777]: ts=2026-09-20T13:34:25Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=1 lb # [ 40.387819] envoy[909]: conn peer=[2001:db8:1::1]:46258 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=1470 lb # [ 40.390017] envoy[909]: conn peer=[2001:db8:1::1]:46272 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2613 tx=406 ms=1185 lb # [ 40.391648] envoy[909]: conn peer=[2001:db8:1::1]:46282 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=27 lb # [ 40.393363] envoy[909]: conn peer=[2001:db8:1::1]:46288 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=16 worker2 # [ 40.425411] nix-grpc-daemon[777]: ts=2026-09-20T13:34:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 40.448682] nix-grpc-daemon[777]: ts=2026-09-20T13:34:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 client # copying 1 paths to 'lb:50051'... worker2 # [ 40.470070] nix-grpc-daemon[777]: ts=2026-09-20T13:34:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker2 # [ 40.499869] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 40.549524] nix-grpc-daemon[777]: ts=2026-09-20T13:34:26Z level=info event=niks3_push_started pid=872 worker2 # [ 40.869229] nix-grpc-daemon[872]: time=2026-09-20T13:34:26.442Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 41.093224] nix-daemon[858]: accepted connection from pid 885, user nix-grpc-daemon (trusted) worker2 # [ 41.116637] nix-daemon[858]: reaped child process 888, status = succeeded worker2 # [ 41.312320] nix-daemon[858]: accepted connection from pid 890, user nix-grpc-daemon (trusted) worker2 # [ 41.335414] nix-daemon[858]: reaped child process 893, status = succeeded lb # [ 41.350716] niks3-server[1038]: 2026/09/20 13:34:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 41.390192] nix-grpc-daemon[872]: time=2026-09-20T13:34:26.964Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 41.394043] nix-grpc-daemon[872]: time=2026-09-20T13:34:26.966Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 41.446958] niks3-server[1038]: 2026/09/20 13:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 41.476668] niks3-server[1038]: 2026/09/20 13:34:27 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 41.504589] niks3-server[1038]: 2026/09/20 13:34:27 INFO Signed narinfos id=1 count=1 worker2 # [ 41.509940] nix-grpc-daemon[872]: time=2026-09-20T13:34:27.083Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.523697] niks3-server[1038]: 2026/09/20 13:34:27 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 41.531804] niks3-server[1038]: 2026/09/20 13:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 41.546436] niks3-server[1038]: 2026/09/20 13:34:27 INFO Completed upload id=1 worker2 # [ 41.547033] nix-grpc-daemon[872]: time=2026-09-20T13:34:27.121Z level=INFO msg="Upload complete. (668ms)" lb # [ 41.557451] niks3-server[1038]: 2026/09/20 13:34:27 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo worker2 # [ 41.565226] nix-grpc-daemon[777]: ts=2026-09-20T13:34:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=1 paths=1 nar_bytes_in=504 worker2 # [ 41.589414] nix-grpc-daemon[777]: ts=2026-09-20T13:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 41.595370] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 41.604653] nix-daemon[858]: reaped child process 870, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker2 # [ 41.621481] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-t1 worker2 # [ 42.679395] nix-daemon[858]: reaped child process 897, status = succeeded worker2 # [ 42.913968] nix-daemon[858]: accepted connection from pid 912, user nix-grpc-daemon (trusted) worker2 # [ 42.945345] nix-daemon[858]: reaped child process 915, status = succeeded lb # [ 42.962928] niks3-server[1038]: 2026/09/20 13:34:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 42.980148] nix-grpc-daemon[872]: time=2026-09-20T13:34:28.553Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 42.982063] nix-grpc-daemon[872]: time=2026-09-20T13:34:28.553Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 43.041972] niks3-server[1038]: 2026/09/20 13:34:28 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 43.067901] niks3-server[1038]: 2026/09/20 13:34:28 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 43.074446] niks3-server[1038]: 2026/09/20 13:34:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign worker2 # [ 43.080210] nix-grpc-daemon[872]: time=2026-09-20T13:34:28.653Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.084995] niks3-server[1038]: 2026/09/20 13:34:28 INFO Signed narinfos id=2 count=1 lb # [ 43.094852] niks3-server[1038]: 2026/09/20 13:34:28 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 43.112146] niks3-server[1038]: 2026/09/20 13:34:28 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 43.121012] niks3-server[1038]: 2026/09/20 13:34:28 INFO Completed upload id=2 worker2 # [ 43.118884] nix-grpc-daemon[872]: time=2026-09-20T13:34:28.693Z level=INFO msg="Upload complete. (482ms)" lb # [ 43.122486] niks3-server[1038]: 2026/09/20 13:34:28 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker2 # [ 43.149660] nix-grpc-daemon[777]: ts=2026-09-20T13:34:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 43.168524] nix-grpc-daemon[777]: ts=2026-09-20T13:34:28Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 43.175487] nix-grpc-daemon[777]: ts=2026-09-20T13:34:28Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 43.181242] nix-daemon[858]: reaped child process 895, status = succeeded worker2 # [ 43.194537] nix-grpc-daemon[777]: ts=2026-09-20T13:34:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 43.208767] nix-grpc-daemon[777]: ts=2026-09-20T13:34:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 43.222185] nix-grpc-daemon[872]: time=2026-09-20T13:34:28.796Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 43.234079] nix-grpc-daemon[777]: ts=2026-09-20T13:34:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker2 # [ 43.258482] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 43.494245] nix-daemon[858]: accepted connection from pid 922, user nix-grpc-daemon (trusted) worker2 # [ 43.516828] nix-daemon[858]: reaped child process 925, status = succeeded worker2 # [ 43.710393] nix-daemon[858]: accepted connection from pid 927, user nix-grpc-daemon (trusted) worker2 # [ 43.733589] nix-daemon[858]: reaped child process 930, status = succeeded lb # [ 43.739219] niks3-server[1038]: 2026/09/20 13:34:29 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 43.752176] nix-grpc-daemon[872]: time=2026-09-20T13:34:29.326Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 43.753766] nix-grpc-daemon[872]: time=2026-09-20T13:34:29.326Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 43.780617] niks3-server[1038]: 2026/09/20 13:34:29 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 43.799549] niks3-server[1038]: 2026/09/20 13:34:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker2 # [ 43.806867] nix-grpc-daemon[872]: time=2026-09-20T13:34:29.380Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.814221] niks3-server[1038]: 2026/09/20 13:34:29 INFO Signed narinfos id=3 count=1 lb # [ 43.822166] niks3-server[1038]: 2026/09/20 13:34:29 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 43.830306] niks3-server[1038]: 2026/09/20 13:34:29 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 43.843834] niks3-server[1038]: 2026/09/20 13:34:29 INFO Completed upload id=3 worker2 # [ 43.844443] nix-grpc-daemon[872]: time=2026-09-20T13:34:29.418Z level=INFO msg="Upload complete. (565ms)" lb # [ 43.846378] niks3-server[1038]: 2026/09/20 13:34:29 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker2 # [ 43.856528] nix-grpc-daemon[777]: ts=2026-09-20T13:34:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 43.872454] nix-grpc-daemon[777]: ts=2026-09-20T13:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 43.885016] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 43.890819] nix-daemon[858]: reaped child process 920, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... worker2 # [ 43.902752] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv client # farm-b> LOG-farm-b-t1 worker2 # [ 45.132370] nix-daemon[858]: reaped child process 934, status = succeeded worker2 # [ 45.292186] nix-daemon[858]: accepted connection from pid 949, user nix-grpc-daemon (trusted) worker2 # [ 45.312797] nix-daemon[858]: reaped child process 952, status = succeeded lb # [ 45.327372] niks3-server[1038]: 2026/09/20 13:34:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.340899] nix-grpc-daemon[872]: time=2026-09-20T13:34:30.914Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 45.342432] nix-grpc-daemon[872]: time=2026-09-20T13:34:30.914Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 45.373494] niks3-server[1038]: 2026/09/20 13:34:30 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker2 # [ 45.384701] nix-grpc-daemon[872]: time=2026-09-20T13:34:30.958Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.386707] niks3-server[1038]: 2026/09/20 13:34:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 45.396548] niks3-server[1038]: 2026/09/20 13:34:30 INFO Signed narinfos id=4 count=1 lb # [ 45.398643] niks3-server[1038]: 2026/09/20 13:34:30 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 45.409135] niks3-server[1038]: 2026/09/20 13:34:30 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 45.412622] niks3-server[1038]: 2026/09/20 13:34:30 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete worker2 # [ 45.412488] nix-grpc-daemon[872]: time=2026-09-20T13:34:30.986Z level=INFO msg="Upload complete. (294ms)" lb # [ 45.415472] niks3-server[1038]: 2026/09/20 13:34:30 INFO Completed upload id=4 lb # [ 45.418510] niks3-server[1038]: 2026/09/20 13:34:30 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker2 # [ 45.426884] nix-grpc-daemon[777]: ts=2026-09-20T13:34:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 45.445489] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 45.449721] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 45.454026] nix-daemon[858]: reaped child process 932, status = succeeded worker2 # [ 45.484887] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 45.501342] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 45.518352] nix-grpc-daemon[872]: time=2026-09-20T13:34:31.092Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 45.530750] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker2 # [ 45.550465] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 45.753414] nix-daemon[858]: accepted connection from pid 958, user nix-grpc-daemon (trusted) worker2 # [ 45.774684] nix-daemon[858]: reaped child process 961, status = succeeded worker2 # [ 45.952152] nix-daemon[858]: accepted connection from pid 963, user nix-grpc-daemon (trusted) worker2 # [ 45.971709] nix-daemon[858]: reaped child process 966, status = succeeded lb # [ 45.982654] niks3-server[1038]: 2026/09/20 13:34:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.994073] nix-grpc-daemon[872]: time=2026-09-20T13:34:31.568Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 45.995618] nix-grpc-daemon[872]: time=2026-09-20T13:34:31.568Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 46.012432] niks3-server[1038]: 2026/09/20 13:34:31 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst worker2 # [ 46.027147] nix-grpc-daemon[872]: time=2026-09-20T13:34:31.601Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.029581] niks3-server[1038]: 2026/09/20 13:34:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 46.041034] niks3-server[1038]: 2026/09/20 13:34:31 INFO Signed narinfos id=5 count=1 lb # [ 46.043553] niks3-server[1038]: 2026/09/20 13:34:31 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 46.052269] niks3-server[1038]: 2026/09/20 13:34:31 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 46.059639] niks3-server[1038]: 2026/09/20 13:34:31 INFO Completed upload id=5 worker2 # [ 46.061807] nix-grpc-daemon[872]: time=2026-09-20T13:34:31.634Z level=INFO msg="Upload complete. (490ms)" lb # [ 46.063377] niks3-server[1038]: 2026/09/20 13:34:31 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker2 # [ 46.070213] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 46.081917] nix-grpc-daemon[777]: ts=2026-09-20T13:34:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 46.099171] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 46.106124] nix-daemon[858]: reaped child process 956, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... worker2 # [ 46.122606] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv client # farm-top> LOG-farm-top-t1 worker2 # [ 47.569024] nix-daemon[858]: reaped child process 970, status = succeeded worker2 # [ 47.742493] nix-daemon[858]: accepted connection from pid 986, user nix-grpc-daemon (trusted) worker2 # [ 47.761670] nix-daemon[858]: reaped child process 989, status = succeeded lb # [ 47.773980] niks3-server[1038]: 2026/09/20 13:34:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.787551] nix-grpc-daemon[872]: time=2026-09-20T13:34:33.360Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 47.789336] nix-grpc-daemon[872]: time=2026-09-20T13:34:33.360Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 47.807241] niks3-server[1038]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 47.827544] niks3-server[1038]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst worker2 # [ 47.846449] nix-grpc-daemon[872]: time=2026-09-20T13:34:33.420Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.840626] niks3-server[1038]: 2026/09/20 13:34:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 47.850845] niks3-server[1038]: 2026/09/20 13:34:33 INFO Signed narinfos id=6 count=1 lb # [ 47.856288] niks3-server[1038]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 47.863821] niks3-server[1038]: 2026/09/20 13:34:33 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 47.873320] niks3-server[1038]: 2026/09/20 13:34:33 INFO Completed upload id=6 lb # [ 47.876384] niks3-server[1038]: 2026/09/20 13:34:33 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker2 # [ 47.872744] nix-grpc-daemon[872]: time=2026-09-20T13:34:33.447Z level=INFO msg="Upload complete. (328ms)" worker2 # [ 47.889532] nix-grpc-daemon[777]: ts=2026-09-20T13:34:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker2 # [ 47.905615] nix-daemon[858]: reaped child process 968, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.90 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.55 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.25 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 49.352781] nix-grpc-daemon[774]: ts=2026-09-20T13:34:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34114 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 49.366045] nix-grpc-daemon[774]: ts=2026-09-20T13:34:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34114 worker2 # [ 49.413246] nix-grpc-daemon[777]: ts=2026-09-20T13:34:34Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.34 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.43 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 lb # [ 50.386284] envoy[909]: conn peer=[2001:db8:1::1]:46304 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9510 tx=3822 ms=7611 lb # [ 50.391391] envoy[909]: conn peer=[2001:db8:1::1]:32868 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=481 ms=76 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 50.471020] nix-grpc-daemon[777]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 50.478844] nix-grpc-daemon[777]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 50.486743] nix-grpc-daemon[872]: time=2026-09-20T13:34:36.059Z level=INFO msg="All 2 paths already cached" worker2 # [ 50.499620] nix-grpc-daemon[777]: ts=2026-09-20T13:34:36Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 50.506810] nix-grpc-daemon[777]: ts=2026-09-20T13:34:36Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 50.544731] nix-grpc-daemon[777]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 50.561333] nix-grpc-daemon[777]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 50.577739] nix-grpc-daemon[872]: time=2026-09-20T13:34:36.152Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker2 # [ 50.588127] nix-grpc-daemon[777]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 50.604180] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 50.808562] nix-daemon[858]: accepted connection from pid 1018, user nix-grpc-daemon (trusted) worker2 # [ 50.827080] nix-daemon[858]: reaped child process 1021, status = succeeded worker2 # [ 51.008134] nix-daemon[858]: accepted connection from pid 1023, user nix-grpc-daemon (trusted) worker2 # [ 51.026791] nix-daemon[858]: reaped child process 1026, status = succeeded lb # [ 51.041530] niks3-server[1038]: 2026/09/20 13:34:36 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 51.049656] nix-grpc-daemon[872]: time=2026-09-20T13:34:36.623Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 51.051205] nix-grpc-daemon[872]: time=2026-09-20T13:34:36.623Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 51.067912] niks3-server[1038]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst worker2 # [ 51.082201] nix-grpc-daemon[872]: time=2026-09-20T13:34:36.656Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.083693] niks3-server[1038]: 2026/09/20 13:34:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 51.093682] niks3-server[1038]: 2026/09/20 13:34:36 INFO Signed narinfos id=7 count=1 lb # [ 51.104677] niks3-server[1038]: 2026/09/20 13:34:36 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 51.113333] niks3-server[1038]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 51.117738] niks3-server[1038]: 2026/09/20 13:34:36 INFO Completed upload id=7 worker2 # [ 51.118002] nix-grpc-daemon[872]: time=2026-09-20T13:34:36.692Z level=INFO msg="Upload complete. (495ms)" lb # [ 51.120162] niks3-server[1038]: 2026/09/20 13:34:36 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker2 # [ 51.127606] nix-grpc-daemon[777]: ts=2026-09-20T13:34:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 51.141013] nix-grpc-daemon[777]: ts=2026-09-20T13:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 51.148500] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 51.153869] nix-daemon[858]: reaped child process 1016, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... worker2 # [ 51.166274] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv client # farm-top> LOG-farm-top-t1b worker2 # [ 52.408402] nix-daemon[858]: reaped child process 1030, status = succeeded worker2 # [ 52.574168] nix-daemon[858]: accepted connection from pid 1045, user nix-grpc-daemon (trusted) worker2 # [ 52.592694] nix-daemon[858]: reaped child process 1048, status = succeeded lb # [ 52.605247] niks3-server[1038]: 2026/09/20 13:34:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 52.616523] nix-grpc-daemon[872]: time=2026-09-20T13:34:38.189Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 52.618232] nix-grpc-daemon[872]: time=2026-09-20T13:34:38.190Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 52.650578] niks3-server[1038]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 52.665033] niks3-server[1038]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 52.674994] nix-grpc-daemon[872]: time=2026-09-20T13:34:38.249Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.680127] niks3-server[1038]: 2026/09/20 13:34:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 52.683883] niks3-server[1038]: 2026/09/20 13:34:38 INFO Signed narinfos id=8 count=1 lb # [ 52.691856] niks3-server[1038]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 52.701884] niks3-server[1038]: 2026/09/20 13:34:38 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 52.707536] niks3-server[1038]: 2026/09/20 13:34:38 INFO Completed upload id=8 worker2 # [ 52.706886] nix-grpc-daemon[872]: time=2026-09-20T13:34:38.281Z level=INFO msg="Upload complete. (326ms)" lb # [ 52.710855] niks3-server[1038]: 2026/09/20 13:34:38 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker2 # [ 52.721489] nix-grpc-daemon[777]: ts=2026-09-20T13:34:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker2 # [ 52.740207] nix-daemon[858]: reaped child process 1028, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.54 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.20 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 53.303471] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: bb58625030f7471494e56eda84eda921 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 53.558706] nix[885]: don't know how to build these paths: client # [ 53.559728] nix[885]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 53.543442] nix-grpc-daemon[774]: ts=2026-09-20T13:34:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34114 worker2 # [ 53.568199] nix-grpc-daemon[777]: ts=2026-09-20T13:34:39Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 53.568626] nix-grpc-daemon[777]: ts=2026-09-20T13:34:39Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 53.572670] nix-grpc-daemon[774]: ts=2026-09-20T13:34:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 53.592804] nix-grpc-daemon[774]: ts=2026-09-20T13:34:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34114 client # [ 53.619991] nix[885]: copying 1 paths to 'lb:50051'... client # [ 53.623992] nix[885]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker1 # [ 53.609578] nix-grpc-daemon[774]: ts=2026-09-20T13:34:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 53.626559] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 53.661572] nix-grpc-daemon[774]: ts=2026-09-20T13:34:39Z level=info event=niks3_push_started pid=861 worker1 # [ 53.931169] nix-grpc-daemon[861]: time=2026-09-20T13:34:39.501Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 54.127378] nix-daemon[835]: accepted connection from pid 874, user nix-grpc-daemon (trusted) worker1 # [ 54.147511] nix-daemon[835]: reaped child process 877, status = succeeded worker1 # [ 54.329030] nix-daemon[835]: accepted connection from pid 879, user nix-grpc-daemon (trusted) worker1 # [ 54.348244] nix-daemon[835]: reaped child process 882, status = succeeded lb # [ 54.370915] niks3-server[1038]: 2026/09/20 13:34:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 54.370272] nix-grpc-daemon[861]: time=2026-09-20T13:34:39.942Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 54.372194] nix-grpc-daemon[861]: time=2026-09-20T13:34:39.944Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 54.409657] niks3-server[1038]: 2026/09/20 13:34:39 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst client # [ 54.421886] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. worker1 # [ 54.421057] nix-grpc-daemon[861]: time=2026-09-20T13:34:39.992Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.424999] niks3-server[1038]: 2026/09/20 13:34:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 54.436839] niks3-server[1038]: 2026/09/20 13:34:39 INFO Signed narinfos id=9 count=1 client # Running as unit: dedup2.service; invocation ID: 3906679a87f749f0a6629f7de2e05324 lb # [ 54.446327] niks3-server[1038]: 2026/09/20 13:34:40 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds) lb # [ 54.456674] niks3-server[1038]: 2026/09/20 13:34:40 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 54.465962] niks3-server[1038]: 2026/09/20 13:34:40 INFO Completed upload id=9 lb # [ 54.469686] niks3-server[1038]: 2026/09/20 13:34:40 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker1 # [ 54.458206] nix-grpc-daemon[861]: time=2026-09-20T13:34:40.026Z level=INFO msg="Upload complete. (513ms)" worker1 # [ 54.467853] nix-grpc-daemon[774]: ts=2026-09-20T13:34:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34114 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 54.487254] nix-grpc-daemon[774]: ts=2026-09-20T13:34:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 54.496407] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 54.504753] nix-daemon[835]: reaped child process 859, status = succeeded client # [ 54.529064] nix[885]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker1 # [ 54.519563] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # [ 54.755790] nix[901]: don't know how to build these paths: client # [ 54.756874] nix[901]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 54.752244] nix-grpc-daemon[777]: ts=2026-09-20T13:34:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 54.766338] nix-grpc-daemon[777]: ts=2026-09-20T13:34:40Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker1 # [ 54.762664] nix-grpc-daemon[774]: ts=2026-09-20T13:34:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34114 client # [ 54.786407] nix[901]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.07 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 58.168522] nix-daemon[835]: reaped child process 890, status = succeeded worker1 # [ 58.352428] nix-daemon[835]: accepted connection from pid 915, user nix-grpc-daemon (trusted) worker1 # [ 58.373176] nix-daemon[835]: reaped child process 918, status = succeeded lb # [ 58.396639] niks3-server[1038]: 2026/09/20 13:34:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 58.394938] nix-grpc-daemon[861]: time=2026-09-20T13:34:43.966Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 58.397843] nix-grpc-daemon[861]: time=2026-09-20T13:34:43.968Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 58.445031] niks3-server[1038]: 2026/09/20 13:34:44 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 58.456061] niks3-server[1038]: 2026/09/20 13:34:44 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls worker1 # [ 58.453313] nix-grpc-daemon[861]: time=2026-09-20T13:34:44.024Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.465393] niks3-server[1038]: 2026/09/20 13:34:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 58.472499] niks3-server[1038]: 2026/09/20 13:34:44 INFO Signed narinfos id=10 count=1 lb # [ 58.475186] niks3-server[1038]: 2026/09/20 13:34:44 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 58.487599] niks3-server[1038]: 2026/09/20 13:34:44 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 58.496253] niks3-server[1038]: 2026/09/20 13:34:44 INFO Completed upload id=10 lb # [ 58.499517] niks3-server[1038]: 2026/09/20 13:34:44 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker1 # [ 58.484914] nix-grpc-daemon[861]: time=2026-09-20T13:34:44.057Z level=INFO msg="Upload complete. (349ms)" worker1 # [ 58.497358] nix-grpc-daemon[774]: ts=2026-09-20T13:34:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34114 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 58.512705] nix-grpc-daemon[774]: ts=2026-09-20T13:34:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34114 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 58.520855] nix-daemon[835]: reaped child process 887, status = succeeded client # [ 58.574776] systemd[1]: dedup2.service: Deactivated successfully. client # [ 58.579127] systemd[1]: dedup2.service: Consumed 191ms CPU time over 4.157s wall clock time, 31M memory peak, 7.3K incoming IP traffic, 6.3K outgoing IP traffic. client # [ 58.590641] systemd[1]: dedup1.service: Deactivated successfully. client # [ 58.593128] systemd[1]: dedup1.service: Consumed 156ms CPU time over 5.284s wall clock time, 35.2M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.35 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 59.800630] systemd[1]: Started Nix Daemon. client # [ 59.992542] nix-daemon[943]: accepted connection from pid 940, user root (trusted) worker1 # [ 60.181316] nix-grpc-daemon[774]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 60.188464] nix-grpc-daemon[774]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34114 worker2 # [ 60.215982] nix-grpc-daemon[777]: ts=2026-09-20T13:34:45Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 60.216629] nix-grpc-daemon[777]: ts=2026-09-20T13:34:45Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 60.261601] nix-grpc-daemon[777]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 60.283765] nix-grpc-daemon[777]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 60.300490] nix-grpc-daemon[777]: ts=2026-09-20T13:34:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 60.323952] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) lb # [ 60.387484] envoy[909]: conn peer=[2001:db8:1::1]:32876 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1706 ms=2263 lb # [ 60.392872] envoy[909]: conn peer=[2001:db8:1::1]:55844 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1086 ms=3786 lb # [ 60.397857] envoy[909]: conn peer=[2001:db8:1::1]:55828 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1371 ms=4974 worker2 # [ 60.544185] nix-daemon[858]: accepted connection from pid 1084, user nix-grpc-daemon (trusted) worker2 # [ 60.563134] nix-daemon[858]: reaped child process 1087, status = succeeded worker2 # [ 60.738295] nix-daemon[858]: accepted connection from pid 1089, user nix-grpc-daemon (trusted) worker2 # [ 60.755530] nix-daemon[858]: reaped child process 1092, status = succeeded lb # [ 60.771785] niks3-server[1038]: 2026/09/20 13:34:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 60.781875] nix-grpc-daemon[872]: time=2026-09-20T13:34:46.355Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 60.783397] nix-grpc-daemon[872]: time=2026-09-20T13:34:46.355Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" worker2 # [ 60.817629] nix-grpc-daemon[872]: time=2026-09-20T13:34:46.391Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.805341] niks3-server[1038]: 2026/09/20 13:34:46 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 60.820174] niks3-server[1038]: 2026/09/20 13:34:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 60.831550] niks3-server[1038]: 2026/09/20 13:34:46 INFO Signed narinfos id=11 count=1 lb # [ 60.839974] niks3-server[1038]: 2026/09/20 13:34:46 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 60.843515] niks3-server[1038]: 2026/09/20 13:34:46 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete worker2 # [ 60.850123] nix-grpc-daemon[872]: time=2026-09-20T13:34:46.424Z level=INFO msg="Upload complete. (508ms)" lb # [ 60.851247] niks3-server[1038]: 2026/09/20 13:34:46 INFO Completed upload id=11 lb # [ 60.855325] niks3-server[1038]: 2026/09/20 13:34:46 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker2 # [ 60.860942] nix-grpc-daemon[777]: ts=2026-09-20T13:34:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 60.871574] nix-grpc-daemon[777]: ts=2026-09-20T13:34:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 60.878600] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 60.883539] nix-daemon[858]: reaped child process 1082, status = succeeded worker2 # [ 60.894420] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 61.923993] nix-daemon[858]: reaped child process 1096, status = succeeded worker2 # [ 62.090508] nix-daemon[858]: accepted connection from pid 1111, user nix-grpc-daemon (trusted) worker2 # [ 62.110134] nix-daemon[858]: reaped child process 1114, status = succeeded lb # [ 62.123433] niks3-server[1038]: 2026/09/20 13:34:47 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 62.132473] nix-grpc-daemon[872]: time=2026-09-20T13:34:47.706Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 62.133979] nix-grpc-daemon[872]: time=2026-09-20T13:34:47.706Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 62.165272] niks3-server[1038]: 2026/09/20 13:34:47 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 62.178428] niks3-server[1038]: 2026/09/20 13:34:47 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls worker2 # [ 62.185759] nix-grpc-daemon[872]: time=2026-09-20T13:34:47.759Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.189775] niks3-server[1038]: 2026/09/20 13:34:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 62.198192] niks3-server[1038]: 2026/09/20 13:34:47 INFO Signed narinfos id=12 count=1 lb # [ 62.202202] niks3-server[1038]: 2026/09/20 13:34:47 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 62.212333] niks3-server[1038]: 2026/09/20 13:34:47 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 62.218492] niks3-server[1038]: 2026/09/20 13:34:47 INFO Completed upload id=12 worker2 # [ 62.217927] nix-grpc-daemon[872]: time=2026-09-20T13:34:47.792Z level=INFO msg="Upload complete. (311ms)" lb # [ 62.221233] niks3-server[1038]: 2026/09/20 13:34:47 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker2 # [ 62.229729] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker1 # [ 62.223177] nix-grpc-daemon[774]: ts=2026-09-20T13:34:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34114 worker2 # [ 62.248384] nix-daemon[858]: reaped child process 1094, status = succeeded worker1 # [ 62.239249] nix-grpc-daemon[774]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker2 # [ 62.303088] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 62.310371] nix-grpc-daemon[777]: ts=2026-09-20T13:34:47Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 62.560167] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:57134 worker1 # [ 62.553285] nix-grpc-daemon[774]: ts=2026-09-20T13:34:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 62.565244] nix-grpc-daemon[861]: time=2026-09-20T13:34:48.135Z level=INFO msg="All 1 paths already cached" worker2 # [ 62.589656] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 62.599047] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 62.607918] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 62.615809] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 62.626890] nix-grpc-daemon[872]: time=2026-09-20T13:34:48.201Z level=INFO msg="All 1 paths already cached" worker2 # [ 62.636656] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 62.652728] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 62.852535] nix-daemon[858]: accepted connection from pid 1120, user nix-grpc-daemon (trusted) worker2 # [ 62.873191] nix-daemon[858]: reaped child process 1123, status = succeeded worker2 # [ 63.049344] nix-daemon[858]: accepted connection from pid 1125, user nix-grpc-daemon (trusted) worker2 # [ 63.067505] nix-daemon[858]: reaped child process 1128, status = succeeded lb # [ 63.078337] niks3-server[1038]: 2026/09/20 13:34:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 63.088267] nix-grpc-daemon[872]: time=2026-09-20T13:34:48.662Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 63.090316] nix-grpc-daemon[872]: time=2026-09-20T13:34:48.664Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 63.109300] niks3-server[1038]: 2026/09/20 13:34:48 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst lb # [ 63.125387] niks3-server[1038]: 2026/09/20 13:34:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker2 # [ 63.135094] nix-grpc-daemon[872]: time=2026-09-20T13:34:48.708Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.140488] niks3-server[1038]: 2026/09/20 13:34:48 INFO Signed narinfos id=13 count=1 lb # [ 63.143464] niks3-server[1038]: 2026/09/20 13:34:48 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 63.154597] niks3-server[1038]: 2026/09/20 13:34:48 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 63.162670] niks3-server[1038]: 2026/09/20 13:34:48 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker2 # [ 63.167247] nix-grpc-daemon[872]: time=2026-09-20T13:34:48.741Z level=INFO msg="Upload complete. (498ms)" lb # [ 63.167085] niks3-server[1038]: 2026/09/20 13:34:48 INFO Completed upload id=13 worker2 # [ 63.175120] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 63.180481] nix-grpc-daemon[777]: ts=2026-09-20T13:34:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 63.191195] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 63.195538] nix-daemon[858]: reaped child process 1118, status = succeeded worker2 # [ 63.205883] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 64.429289] nix-daemon[858]: reaped child process 1132, status = succeeded worker2 # [ 64.591168] nix-daemon[858]: accepted connection from pid 1147, user nix-grpc-daemon (trusted) worker2 # [ 64.612169] nix-daemon[858]: reaped child process 1150, status = succeeded lb # [ 64.624841] niks3-server[1038]: 2026/09/20 13:34:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 64.635465] nix-grpc-daemon[872]: time=2026-09-20T13:34:50.208Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 64.637142] nix-grpc-daemon[872]: time=2026-09-20T13:34:50.208Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 64.657930] niks3-server[1038]: 2026/09/20 13:34:50 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 64.674973] niks3-server[1038]: 2026/09/20 13:34:50 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 64.684388] niks3-server[1038]: 2026/09/20 13:34:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign worker2 # [ 64.690120] nix-grpc-daemon[872]: time=2026-09-20T13:34:50.264Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.693632] niks3-server[1038]: 2026/09/20 13:34:50 INFO Signed narinfos id=14 count=1 lb # [ 64.699650] niks3-server[1038]: 2026/09/20 13:34:50 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 64.708516] niks3-server[1038]: 2026/09/20 13:34:50 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 64.714774] niks3-server[1038]: 2026/09/20 13:34:50 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo lb # [ 64.720417] niks3-server[1038]: 2026/09/20 13:34:50 INFO Completed upload id=14 worker2 # [ 64.720680] nix-grpc-daemon[872]: time=2026-09-20T13:34:50.295Z level=INFO msg="Upload complete. (303ms)" worker1 # [ 64.722794] nix-grpc-daemon[774]: ts=2026-09-20T13:34:50Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34114 worker2 # [ 64.732988] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker1 # [ 64.735700] nix-grpc-daemon[774]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker2 # [ 64.750161] nix-daemon[858]: reaped child process 1130, status = succeeded worker2 # [ 64.790102] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 64.794760] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 65.050051] nix-grpc-daemon[774]: ts=2026-09-20T13:34:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:34114 worker2 # [ 65.065690] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 65.075736] nix-grpc-daemon[872]: time=2026-09-20T13:34:50.650Z level=INFO msg="All 2 paths already cached" worker2 # [ 65.095709] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 65.103084] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 65.141140] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 65.157710] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 65.173358] nix-grpc-daemon[872]: time=2026-09-20T13:34:50.747Z level=INFO msg="All 2 paths already cached" worker2 # [ 65.183430] nix-grpc-daemon[777]: ts=2026-09-20T13:34:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 65.197851] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 65.405030] nix-daemon[858]: accepted connection from pid 1156, user nix-grpc-daemon (trusted) worker2 # [ 65.426320] nix-daemon[858]: reaped child process 1159, status = succeeded worker2 # [ 65.598383] nix-daemon[858]: accepted connection from pid 1161, user nix-grpc-daemon (trusted) worker2 # [ 65.615834] nix-daemon[858]: reaped child process 1164, status = succeeded lb # [ 65.627500] niks3-server[1038]: 2026/09/20 13:34:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 65.637545] nix-grpc-daemon[872]: time=2026-09-20T13:34:51.211Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 65.639445] nix-grpc-daemon[872]: time=2026-09-20T13:34:51.213Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 65.661134] niks3-server[1038]: 2026/09/20 13:34:51 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker2 # [ 65.672423] nix-grpc-daemon[872]: time=2026-09-20T13:34:51.246Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.676289] niks3-server[1038]: 2026/09/20 13:34:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 65.687917] niks3-server[1038]: 2026/09/20 13:34:51 INFO Signed narinfos id=15 count=1 lb # [ 65.692564] niks3-server[1038]: 2026/09/20 13:34:51 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls worker2 # [ 65.701138] nix-grpc-daemon[872]: time=2026-09-20T13:34:51.275Z level=INFO msg="Upload complete. (485ms)" lb # [ 65.702914] niks3-server[1038]: 2026/09/20 13:34:51 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 65.707777] niks3-server[1038]: 2026/09/20 13:34:51 INFO Completed upload id=15 worker2 # [ 65.708179] nix-grpc-daemon[777]: ts=2026-09-20T13:34:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 65.711831] niks3-server[1038]: 2026/09/20 13:34:51 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker2 # [ 65.722687] nix-grpc-daemon[777]: ts=2026-09-20T13:34:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 65.729098] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 65.734338] nix-daemon[858]: reaped child process 1154, status = succeeded worker2 # [ 65.748215] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 66.568686] nix-daemon[858]: reaped child process 1168, status = succeeded worker2 # [ 66.727398] nix-daemon[858]: accepted connection from pid 1183, user nix-grpc-daemon (trusted) worker2 # [ 66.748219] nix-daemon[858]: reaped child process 1186, status = succeeded lb # [ 66.760819] niks3-server[1038]: 2026/09/20 13:34:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 66.798492] nix-grpc-daemon[872]: time=2026-09-20T13:34:52.372Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 66.803803] nix-grpc-daemon[872]: time=2026-09-20T13:34:52.374Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 66.831718] niks3-server[1038]: 2026/09/20 13:34:52 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 66.843425] niks3-server[1038]: 2026/09/20 13:34:52 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker2 # [ 66.850243] nix-grpc-daemon[872]: time=2026-09-20T13:34:52.424Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.856321] niks3-server[1038]: 2026/09/20 13:34:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 66.864759] niks3-server[1038]: 2026/09/20 13:34:52 INFO Signed narinfos id=16 count=1 lb # [ 66.868626] niks3-server[1038]: 2026/09/20 13:34:52 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 66.875211] niks3-server[1038]: 2026/09/20 13:34:52 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 66.882123] niks3-server[1038]: 2026/09/20 13:34:52 INFO Completed upload id=16 lb # [ 66.886406] niks3-server[1038]: 2026/09/20 13:34:52 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker2 # [ 66.880659] nix-grpc-daemon[872]: time=2026-09-20T13:34:52.455Z level=INFO msg="Upload complete. (322ms)" worker2 # [ 66.893328] nix-grpc-daemon[777]: ts=2026-09-20T13:34:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker2 # [ 66.910637] nix-daemon[858]: reaped child process 1166, status = succeeded worker2 # [ 66.936112] nix-grpc-daemon[777]: ts=2026-09-20T13:34:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57134 worker1 # [ 66.950769] nix-grpc-daemon[774]: ts=2026-09-20T13:34:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 66.964697] nix-grpc-daemon[774]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker1 # [ 66.982784] nix-grpc-daemon[774]: ts=2026-09-20T13:34:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34114 duration_s=0 paths=1 nar_bytes_out=232 client # [ 67.130150] nix-daemon[943]: reaped child process 945, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.58 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.71 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.45 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 68.447548] nix-daemon[943]: accepted connection from pid 1025, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 68.644227] nix-grpc-daemon[777]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:57134 client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 68.637502] nix-grpc-daemon[774]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 68.847634] nix-daemon[835]: accepted connection from pid 937, user nix-grpc-daemon (trusted) worker1 # [ 68.866429] nix-daemon[835]: reaped child process 940, status = succeeded lb # [ 68.891304] niks3-server[1038]: 2026/09/20 13:34:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 68.887699] nix-grpc-daemon[861]: time=2026-09-20T13:34:54.459Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 68.889354] nix-grpc-daemon[861]: time=2026-09-20T13:34:54.459Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 68.920650] niks3-server[1038]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 68.931411] niks3-server[1038]: 2026/09/20 13:34:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 68.926167] nix-grpc-daemon[861]: time=2026-09-20T13:34:54.498Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.943962] niks3-server[1038]: 2026/09/20 13:34:54 INFO Signed narinfos id=17 count=1 lb # [ 68.949663] niks3-server[1038]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 68.959237] niks3-server[1038]: 2026/09/20 13:34:54 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 68.964260] niks3-server[1038]: 2026/09/20 13:34:54 INFO Completed upload id=17 worker1 # [ 68.952758] nix-grpc-daemon[861]: time=2026-09-20T13:34:54.525Z level=INFO msg="Upload complete. (309ms)" lb # [ 68.967227] niks3-server[1038]: 2026/09/20 13:34:54 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker2 # [ 68.991187] nix-grpc-daemon[777]: ts=2026-09-20T13:34:54Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 68.997780] nix-grpc-daemon[777]: ts=2026-09-20T13:34:54Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 69.025413] nix-grpc-daemon[774]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 69.040327] nix-grpc-daemon[774]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34114 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 69.057856] nix-grpc-daemon[774]: ts=2026-09-20T13:34:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34114 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 69.072534] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 69.287179] nix-daemon[835]: accepted connection from pid 944, user nix-grpc-daemon (trusted) worker1 # [ 69.308088] nix-daemon[835]: reaped child process 947, status = succeeded worker1 # [ 69.484147] nix-daemon[835]: accepted connection from pid 949, user nix-grpc-daemon (trusted) worker1 # [ 69.502731] nix-daemon[835]: reaped child process 952, status = succeeded lb # [ 69.525530] niks3-server[1038]: 2026/09/20 13:34:55 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 69.535064] niks3-server[1038]: 2026/09/20 13:34:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 69.532844] nix-grpc-daemon[861]: time=2026-09-20T13:34:55.104Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 69.534474] nix-grpc-daemon[861]: time=2026-09-20T13:34:55.104Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker1 # [ 69.536231] nix-grpc-daemon[861]: time=2026-09-20T13:34:55.104Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 69.573141] niks3-server[1038]: 2026/09/20 13:34:55 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 69.586361] niks3-server[1038]: 2026/09/20 13:34:55 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 69.601132] niks3-server[1038]: 2026/09/20 13:34:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 69.606812] niks3-server[1038]: 2026/09/20 13:34:55 INFO Signed narinfos id=18 count=1 worker1 # [ 69.595998] nix-grpc-daemon[861]: time=2026-09-20T13:34:55.167Z level=INFO msg="Uploading 3 narinfos" lb # [ 69.609899] niks3-server[1038]: 2026/09/20 13:34:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 69.616931] niks3-server[1038]: 2026/09/20 13:34:55 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 69.619695] niks3-server[1038]: 2026/09/20 13:34:55 INFO Signed narinfos id=19 count=2 lb # [ 69.626541] niks3-server[1038]: 2026/09/20 13:34:55 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 69.640389] niks3-server[1038]: 2026/09/20 13:34:55 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 69.647184] niks3-server[1038]: 2026/09/20 13:34:55 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 69.652381] niks3-server[1038]: 2026/09/20 13:34:55 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 69.655886] niks3-server[1038]: 2026/09/20 13:34:55 INFO Completed upload id=18 lb # [ 69.659067] niks3-server[1038]: 2026/09/20 13:34:55 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 69.662003] niks3-server[1038]: 2026/09/20 13:34:55 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 69.664759] niks3-server[1038]: 2026/09/20 13:34:55 INFO Completed upload id=19 worker1 # [ 69.653514] nix-grpc-daemon[861]: time=2026-09-20T13:34:55.225Z level=INFO msg="Upload complete. (561ms)" worker1 # [ 69.664880] nix-grpc-daemon[774]: ts=2026-09-20T13:34:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34114 duration_s=0 paths=2 nar_bytes_in=984 worker1 # [ 69.684545] nix-grpc-daemon[774]: ts=2026-09-20T13:34:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 69.692791] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 69.698884] nix-daemon[835]: reaped child process 942, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker1 # [ 69.712917] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 70.381735] envoy[909]: conn peer=[2001:db8:1::1]:59776 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=35 lb # [ 70.386576] envoy[909]: conn peer=[2001:db8:1::1]:55848 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3407 tx=1777 ms=2136 lb # [ 70.391512] envoy[909]: conn peer=[2001:db8:1::1]:59806 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=22 lb # [ 70.396308] envoy[909]: conn peer=[2001:db8:1::1]:59790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3862 tx=1967 ms=2248 lb # [ 70.401073] envoy[909]: conn peer=[2001:db8:1::1]:59820 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2111 ms=1993 lb # [ 70.406597] envoy[909]: conn peer=[2001:db8:1::1]:59822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=407 ms=96 worker1 # [ 70.562739] nix-daemon[835]: reaped child process 956, status = succeeded worker1 # [ 70.745764] nix-daemon[835]: accepted connection from pid 971, user nix-grpc-daemon (trusted) worker1 # [ 70.763688] nix-daemon[835]: reaped child process 974, status = succeeded lb # [ 70.789391] niks3-server[1038]: 2026/09/20 13:34:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 70.787039] nix-grpc-daemon[861]: time=2026-09-20T13:34:56.359Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 70.819472] niks3-server[1038]: 2026/09/20 13:34:56 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 70.831966] niks3-server[1038]: 2026/09/20 13:34:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker1 # [ 70.828306] nix-grpc-daemon[861]: time=2026-09-20T13:34:56.400Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.845211] niks3-server[1038]: 2026/09/20 13:34:56 INFO Signed narinfos id=20 count=1 lb # [ 70.851899] niks3-server[1038]: 2026/09/20 13:34:56 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 70.860122] niks3-server[1038]: 2026/09/20 13:34:56 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 70.867770] niks3-server[1038]: 2026/09/20 13:34:56 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo lb # [ 70.873770] niks3-server[1038]: 2026/09/20 13:34:56 INFO Completed upload id=20 worker1 # [ 70.862634] nix-grpc-daemon[861]: time=2026-09-20T13:34:56.434Z level=INFO msg="Upload complete. (335ms)" worker1 # [ 70.873287] nix-grpc-daemon[774]: ts=2026-09-20T13:34:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34114 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker1 # [ 70.891265] nix-daemon[835]: reaped child process 954, status = succeeded client # copying 1 paths... worker2 # [ 70.930496] nix-grpc-daemon[777]: ts=2026-09-20T13:34:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 70.948112] nix-grpc-daemon[777]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 70.987886] nix-grpc-daemon[774]: ts=2026-09-20T13:34:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 70.993444] nix-grpc-daemon[774]: ts=2026-09-20T13:34:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34114 duration_s=0 paths=1 nar_bytes_out=120 client # [ 71.091889] nix-daemon[943]: reaped child process 1028, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.88 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 71.315601] nix-daemon[943]: accepted connection from pid 1047, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 71.547529] nix-grpc-daemon[774]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:34114 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 71.563899] nix-grpc-daemon[777]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 71.592287] nix-grpc-daemon[777]: ts=2026-09-20T13:34:57Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 71.599828] nix-grpc-daemon[777]: ts=2026-09-20T13:34:57Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 71.610030] nix-grpc-daemon[777]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 71.621579] nix-grpc-daemon[777]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57134 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 71.640998] nix-grpc-daemon[777]: ts=2026-09-20T13:34:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 71.657039] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 71.677427] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 38 ms (attempt 1/5) worker2 # [ 71.721069] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 7 ms (attempt 2/5) worker2 # [ 71.728872] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 318 ms (attempt 3/5) worker2 # [ 72.048180] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 508 ms (attempt 4/5) worker2 # [ 72.557507] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 72.567243] nix-grpc-daemon[777]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 72.809918] nix-daemon[858]: accepted connection from pid 1202, user nix-grpc-daemon (trusted) worker2 # [ 72.831085] nix-daemon[858]: reaped child process 1205, status = succeeded worker2 # [ 73.007776] nix-daemon[858]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker2 # [ 73.025975] nix-daemon[858]: reaped child process 1210, status = succeeded lb # [ 73.041153] niks3-server[1038]: 2026/09/20 13:34:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 73.049329] nix-grpc-daemon[872]: time=2026-09-20T13:34:58.623Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 73.050817] nix-grpc-daemon[872]: time=2026-09-20T13:34:58.623Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 73.066999] niks3-server[1038]: 2026/09/20 13:34:58 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst worker2 # [ 73.089195] nix-grpc-daemon[872]: time=2026-09-20T13:34:58.663Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.082758] niks3-server[1038]: 2026/09/20 13:34:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 73.095598] niks3-server[1038]: 2026/09/20 13:34:58 INFO Signed narinfos id=21 count=1 lb # [ 73.101750] niks3-server[1038]: 2026/09/20 13:34:58 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 73.193307] niks3-server[1038]: 2026/09/20 13:34:58 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 73.200128] niks3-server[1038]: 2026/09/20 13:34:58 INFO Completed upload id=21 worker2 # [ 73.199210] nix-grpc-daemon[872]: time=2026-09-20T13:34:58.773Z level=INFO msg="Upload complete. (597ms)" lb # [ 73.203877] niks3-server[1038]: 2026/09/20 13:34:58 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker2 # [ 73.214376] nix-grpc-daemon[777]: ts=2026-09-20T13:34:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=1 paths=1 nar_bytes_in=568 worker2 # [ 73.225422] nix-grpc-daemon[777]: ts=2026-09-20T13:34:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 73.241119] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 73.247683] nix-daemon[858]: reaped child process 1196, status = succeeded worker2 # [ 73.258729] nix-grpc-daemon[777]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker2 # [ 73.275808] nix-daemon[858]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 74.503599] nix-daemon[858]: reaped child process 1215, status = succeeded worker2 # [ 74.673744] nix-daemon[858]: accepted connection from pid 1230, user nix-grpc-daemon (trusted) worker2 # [ 74.692417] nix-daemon[858]: reaped child process 1233, status = succeeded lb # [ 74.707099] niks3-server[1038]: 2026/09/20 13:35:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 74.869996] nix-grpc-daemon[872]: time=2026-09-20T13:35:00.442Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" worker2 # [ 74.903294] nix-grpc-daemon[872]: time=2026-09-20T13:35:00.477Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.894998] niks3-server[1038]: 2026/09/20 13:35:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 74.907799] niks3-server[1038]: 2026/09/20 13:35:00 INFO Signed narinfos id=22 count=1 lb # [ 74.916571] niks3-server[1038]: 2026/09/20 13:35:00 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 74.925936] niks3-server[1038]: 2026/09/20 13:35:00 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 74.936533] niks3-server[1038]: 2026/09/20 13:35:00 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 74.945669] niks3-server[1038]: 2026/09/20 13:35:00 INFO Completed upload id=22 worker2 # [ 74.946018] nix-grpc-daemon[872]: time=2026-09-20T13:35:00.520Z level=INFO msg="Upload complete. (454ms)" lb # [ 74.949044] niks3-server[1038]: 2026/09/20 13:35:00 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo client # copying 1 paths... worker2 # [ 74.959564] nix-grpc-daemon[777]: ts=2026-09-20T13:35:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker1 # [ 74.954229] nix-grpc-daemon[774]: ts=2026-09-20T13:35:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34114 worker2 # [ 74.980326] nix-daemon[858]: reaped child process 1212, status = succeeded worker1 # [ 74.969169] nix-grpc-daemon[774]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 75.017724] nix-grpc-daemon[774]: ts=2026-09-20T13:35:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 75.023018] nix-grpc-daemon[774]: ts=2026-09-20T13:35:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34114 duration_s=0 paths=1 nar_bytes_out=120 client # [ 75.166741] nix-daemon[943]: reaped child process 1050, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 4.07 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 75.380444] nix-daemon[943]: accepted connection from pid 1068, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 75.586144] nix-grpc-daemon[777]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:57134 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 75.582947] nix-grpc-daemon[774]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 75.595423] nix-grpc-daemon[861]: time=2026-09-20T13:35:01.166Z level=INFO msg="All 1 paths already cached" worker2 # [ 75.625558] nix-grpc-daemon[777]: ts=2026-09-20T13:35:01Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 75.632575] nix-grpc-daemon[777]: ts=2026-09-20T13:35:01Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 75.623980] nix-grpc-daemon[774]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 75.639478] nix-grpc-daemon[774]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 75.654409] nix-grpc-daemon[861]: time=2026-09-20T13:35:01.226Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 75.664897] nix-grpc-daemon[774]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 75.680731] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 75.885623] nix-daemon[835]: accepted connection from pid 979, user nix-grpc-daemon (trusted) worker1 # [ 75.904942] nix-daemon[835]: reaped child process 982, status = succeeded worker1 # [ 76.081756] nix-daemon[835]: accepted connection from pid 984, user nix-grpc-daemon (trusted) worker1 # [ 76.100135] nix-daemon[835]: reaped child process 987, status = succeeded lb # [ 76.123608] niks3-server[1038]: 2026/09/20 13:35:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.121857] nix-grpc-daemon[861]: time=2026-09-20T13:35:01.693Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 76.123361] nix-grpc-daemon[861]: time=2026-09-20T13:35:01.693Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 76.152640] niks3-server[1038]: 2026/09/20 13:35:01 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 76.166833] niks3-server[1038]: 2026/09/20 13:35:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker1 # [ 76.162275] nix-grpc-daemon[861]: time=2026-09-20T13:35:01.734Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.179485] niks3-server[1038]: 2026/09/20 13:35:01 INFO Signed narinfos id=23 count=1 lb # [ 76.186003] niks3-server[1038]: 2026/09/20 13:35:01 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 76.194425] niks3-server[1038]: 2026/09/20 13:35:01 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete worker1 # [ 76.187401] nix-grpc-daemon[861]: time=2026-09-20T13:35:01.759Z level=INFO msg="Upload complete. (488ms)" lb # [ 76.199449] niks3-server[1038]: 2026/09/20 13:35:01 INFO Completed upload id=23 lb # [ 76.203223] niks3-server[1038]: 2026/09/20 13:35:01 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker1 # [ 76.197837] nix-grpc-daemon[774]: ts=2026-09-20T13:35:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34114 duration_s=0 paths=1 nar_bytes_in=568 worker1 # [ 76.207945] nix-grpc-daemon[774]: ts=2026-09-20T13:35:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34114 worker1 # [ 76.217116] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 76.219885] nix-daemon[835]: reaped child process 977, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker1 # [ 76.231186] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 77.480695] nix-daemon[835]: reaped child process 991, status = succeeded worker1 # [ 77.658951] nix-daemon[835]: accepted connection from pid 1006, user nix-grpc-daemon (trusted) worker1 # [ 77.676988] nix-daemon[835]: reaped child process 1009, status = succeeded lb # [ 77.700610] niks3-server[1038]: 2026/09/20 13:35:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 77.697936] nix-grpc-daemon[861]: time=2026-09-20T13:35:03.268Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 77.724356] niks3-server[1038]: 2026/09/20 13:35:03 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 77.720707] nix-grpc-daemon[861]: time=2026-09-20T13:35:03.292Z level=INFO msg="Uploading 1 narinfos" lb # [ 77.733768] niks3-server[1038]: 2026/09/20 13:35:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 77.740920] niks3-server[1038]: 2026/09/20 13:35:03 INFO Signed narinfos id=24 count=1 lb # [ 77.742778] niks3-server[1038]: 2026/09/20 13:35:03 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 77.749473] niks3-server[1038]: 2026/09/20 13:35:03 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete worker1 # [ 77.743109] nix-grpc-daemon[861]: time=2026-09-20T13:35:03.315Z level=INFO msg="Upload complete. (298ms)" lb # [ 77.755389] niks3-server[1038]: 2026/09/20 13:35:03 INFO Completed upload id=24 lb # [ 77.757467] niks3-server[1038]: 2026/09/20 13:35:03 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker1 # [ 77.752880] nix-grpc-daemon[774]: ts=2026-09-20T13:35:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34114 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker1 # [ 77.763452] nix-daemon[835]: reaped child process 989, status = succeeded client # copying 1 paths... worker1 # [ 77.798143] nix-grpc-daemon[774]: ts=2026-09-20T13:35:03Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34114 client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 77.849582] nix-grpc-daemon[777]: ts=2026-09-20T13:35:03Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57134 worker2 # [ 77.862459] nix-grpc-daemon[777]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... worker2 # [ 77.885334] nix-grpc-daemon[777]: ts=2026-09-20T13:35:03Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:57134 duration_s=0 paths=1 nar_bytes_out=120 client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.85 seconds) client # [ 78.025506] nix-daemon[943]: reaped child process 1071, status = succeeded (finished: subtest: an input only one worker has still reaches the builder, in 10.75 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.48 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.46 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds) worker2 # [ 79.493899] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 79.880286] nix-grpc-daemon[777]: ts=2026-09-20T13:35:05Z level=info event=signal_exit worker2 # [ 80.130756] nix-grpc-daemon[777]: ts=2026-09-20T13:35:05Z level=info event=scheduler_yield worker1 # [ 80.124205] nix-grpc-daemon[774]: ts=2026-09-20T13:35:05Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 80.138033] nix-grpc-daemon[777]: ts=2026-09-20T13:35:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57124 worker2 # [ 80.143004] nix-grpc-daemon[777]: ts=2026-09-20T13:35:05Z level=info event=worker_gone addr=192.168.1.3:50051 lb # [ 80.144845] niks3-server[1038]: 2026/09/20 13:35:05 INFO lead: released remote=192.168.1.4:33290 worker2 # [ 80.149043] nix-grpc-daemon[777]: ts=2026-09-20T13:35:05Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 80.155347] nix-grpc-daemon[777]: ts=2026-09-20T13:35:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57124 worker2 # [ 80.160164] nix-grpc-daemon[777]: ts=2026-09-20T13:35:05Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 80.324298] nix-grpc-daemon[774]: ts=2026-09-20T13:35:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.329826] nix-grpc-daemon[774]: ts=2026-09-20T13:35:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.350618] nix-grpc-daemon[777]: ts=2026-09-20T13:35:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.356181] nix-grpc-daemon[777]: ts=2026-09-20T13:35:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 80.383358] envoy[909]: conn peer=[2001:db8:1::1]:59836 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3852 tx=1878 ms=2373 lb # [ 80.389214] envoy[909]: conn peer=[2001:db8:1::1]:46810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=23 lb # [ 80.394121] envoy[909]: conn peer=[2001:db8:1::1]:46820 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3700 tx=1919 ms=3530 lb # [ 80.399154] envoy[909]: conn peer=[2001:db8:1::1]:46822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=66 lb # [ 80.404228] envoy[909]: conn peer=[2001:db8:1::1]:46826 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1779 ms=2360 lb # [ 80.409935] envoy[909]: conn peer=[2001:db8:1::1]:46836 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=107 worker1 # [ 80.530672] nix-grpc-daemon[774]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.536092] nix-grpc-daemon[774]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.557342] nix-grpc-daemon[777]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.562850] nix-grpc-daemon[777]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 80.736916] nix-grpc-daemon[774]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.742209] nix-grpc-daemon[774]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.764151] nix-grpc-daemon[777]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.769333] nix-grpc-daemon[777]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 80.942861] nix-grpc-daemon[774]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 80.948397] nix-grpc-daemon[774]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.973387] nix-grpc-daemon[777]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.977843] nix-grpc-daemon[777]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.132170] nix-grpc-daemon[777]: ts=2026-09-20T13:35:06Z level=info event=scheduler_restarting worker1 # [ 81.151467] nix-grpc-daemon[774]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.155844] nix-grpc-daemon[774]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.181955] nix-daemon[858]: reaped child process 861, status = succeeded worker2 # [ 81.201154] nix-grpc-daemon[777]: ts=2026-09-20T13:35:06Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 81.352221] nix-grpc-daemon[774]: ts=2026-09-20T13:35:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.357507] nix-grpc-daemon[774]: ts=2026-09-20T13:35:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.558342] nix-grpc-daemon[774]: ts=2026-09-20T13:35:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.563860] nix-grpc-daemon[774]: ts=2026-09-20T13:35:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.644949] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 81.651747] systemd[1]: Stopped Nix worker-protocol over gRPC. lb # [ 81.653468] niks3-server[1038]: 2026/09/20 13:35:07 INFO lead: acquired remote=192.168.1.3:42912 worker1 # [ 81.643347] nix-grpc-daemon[774]: ts=2026-09-20T13:35:07Z level=info event=scheduler_take_over worker2 # [ 81.657154] systemd[1]: nix-grpc-daemon.service: Consumed 3.757s CPU time over 1min 1.096s wall clock time, 59.5M memory peak, 92.9K incoming IP traffic, 232K outgoing IP traffic. worker2 # [ 81.668714] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 81.670665] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 81.675929] systemd[1]: nix-grpc-daemon.socket: Consumed 679us CPU time over 1min 10.013s wall clock time, 256K memory peak, 90.3K incoming IP traffic, 73.1K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.10 seconds) worker1 # [ 81.764936] nix-grpc-daemon[774]: ts=2026-09-20T13:35:07Z level=info event=scheduler_connected addr=lb:50051 client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 81.770198] nix-grpc-daemon[774]: ts=2026-09-20T13:35:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.971383] nix-grpc-daemon[774]: ts=2026-09-20T13:35:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.993635] nix-grpc-daemon[774]: ts=2026-09-20T13:35:07Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:43824 worker1 # [ 82.000633] nix-grpc-daemon[774]: ts=2026-09-20T13:35:07Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 82.049336] nix-grpc-daemon[774]: ts=2026-09-20T13:35:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34114 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker1 # [ 82.057041] nix-grpc-daemon[774]: ts=2026-09-20T13:35:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34114 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.32 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 82.222365] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 82.299544] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 82.755905] nix-grpc-daemon[774]: ts=2026-09-20T13:35:08Z level=info event=signal_exit worker2 # [ 83.013720] systemd[1]: Starting scheduler-token.service... worker1 # [ 83.008304] nix-grpc-daemon[774]: ts=2026-09-20T13:35:08Z level=info event=scheduler_yield lb # [ 83.021246] niks3-server[1038]: 2026/09/20 13:35:08 INFO lead: released remote=192.168.1.3:42912 worker1 # [ 83.019608] nix-grpc-daemon[774]: ts=2026-09-20T13:35:08Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 83.025863] nix-grpc-daemon[774]: ts=2026-09-20T13:35:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:43824 worker1 # [ 83.030406] nix-grpc-daemon[774]: ts=2026-09-20T13:35:08Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 83.118251] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 83.124210] systemd[1]: Finished scheduler-token.service. worker2 # [ 83.125581] systemd[1]: scheduler-token.service: Consumed 53ms CPU time over 109ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 83.132803] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 83.220649] nix-grpc-daemon[774]: ts=2026-09-20T13:35:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.230697] nix-grpc-daemon[774]: ts=2026-09-20T13:35:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 83.317668] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:08Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 83.321191] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 83.323721] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 83.332100] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:08Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 83.333851] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 83.345421] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:08Z level=info event=scheduler_take_over lb # [ 83.345401] niks3-server[1038]: 2026/09/20 13:35:08 INFO lead: acquired remote=192.168.1.4:58182 worker2 # [ 83.364318] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.369041] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 83.431657] nix-grpc-daemon[774]: ts=2026-09-20T13:35:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.450123] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:09Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:47170 worker2 # [ 83.455238] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 83.570702] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.584166] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:09Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 83.589819] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:09Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:47170 worker2 # [ 83.595224] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:09Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 84.034143] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:09Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47170 worker2 # [ 84.039091] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:09Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 84.033570] nix-grpc-daemon[774]: ts=2026-09-20T13:35:09Z level=info event=scheduler_restarting worker1 # [ 84.052271] nix-grpc-daemon[774]: ts=2026-09-20T13:35:09Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 84.071813] nix-daemon[835]: reaped child process 837, status = succeeded worker1 # [ 84.885675] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 84.886118] nix-grpc-daemon[774]: E0000 00:00:1789911310.457554 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true worker1 # [ 84.886268] nix-grpc-daemon[774]: E0000 00:00:1789911310.457878 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 85.549045] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 85.553418] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 85.560911] systemd[1]: nix-grpc-daemon.service: Consumed 2.052s CPU time over 1min 5.167s wall clock time, 48.7M memory peak, 51.4K incoming IP traffic, 91.7K outgoing IP traffic. worker1 # [ 85.574107] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 85.583544] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 85.585898] systemd[1]: nix-grpc-daemon.socket: Consumed 619us CPU time over 1min 13.965s wall clock time, 256K memory peak, 70.5K incoming IP traffic, 62.4K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 85.934351] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:47172 worker2 # [ 85.950547] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 85.978009] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 1/5) worker2 # [ 86.043781] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 9 ms (attempt 2/5) worker2 # [ 86.060485] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 159 ms (attempt 3/5) worker2 # [ 86.220642] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 183 ms (attempt 4/5) worker2 # [ 86.404986] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 86.432160] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47172 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 86.451443] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 86.482036] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:12Z level=info event=niks3_push_started pid=1316 worker2 # [ 86.702587] nix-grpc-daemon[1316]: time=2026-09-20T13:35:12.276Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 86.878160] nix-daemon[858]: accepted connection from pid 1329, user nix-grpc-daemon (trusted) worker2 # [ 86.897155] nix-daemon[858]: reaped child process 1332, status = succeeded lb # [ 86.909216] niks3-server[1038]: 2026/09/20 13:35:12 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 86.920419] niks3-server[1038]: 2026/09/20 13:35:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.930149] nix-grpc-daemon[1316]: time=2026-09-20T13:35:12.504Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 86.934962] nix-grpc-daemon[1316]: time=2026-09-20T13:35:12.506Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 86.937275] nix-grpc-daemon[1316]: time=2026-09-20T13:35:12.506Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 86.975443] niks3-server[1038]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 86.986881] niks3-server[1038]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst worker2 # [ 87.000152] nix-grpc-daemon[1316]: time=2026-09-20T13:35:12.573Z level=INFO msg="Uploading 3 narinfos" lb # [ 87.000340] niks3-server[1038]: 2026/09/20 13:35:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 87.003231] niks3-server[1038]: 2026/09/20 13:35:12 INFO Signed narinfos id=25 count=1 lb # [ 87.014959] niks3-server[1038]: 2026/09/20 13:35:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 87.022881] niks3-server[1038]: 2026/09/20 13:35:12 INFO Signed narinfos id=26 count=2 lb # [ 87.029048] niks3-server[1038]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 87.036553] niks3-server[1038]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 87.044568] niks3-server[1038]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 87.053786] niks3-server[1038]: 2026/09/20 13:35:12 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 87.062213] niks3-server[1038]: 2026/09/20 13:35:12 INFO Completed upload id=25 lb # [ 87.063515] niks3-server[1038]: 2026/09/20 13:35:12 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete worker2 # [ 87.066395] nix-grpc-daemon[1316]: time=2026-09-20T13:35:12.640Z level=INFO msg="Upload complete. (359ms)" lb # [ 87.068626] niks3-server[1038]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 87.071627] niks3-server[1038]: 2026/09/20 13:35:12 INFO Completed upload id=26 lb # [ 87.076501] niks3-server[1038]: 2026/09/20 13:35:12 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo worker2 # [ 87.080931] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47172 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 87.097145] nix-daemon[858]: reaped child process 1314, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.43 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds) worker1 # [ 87.224967] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 87.231659] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 87.425755] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:12Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 87.428467] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 87.432736] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 87.440991] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 87.442685] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 87.470380] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.486456] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:13Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:47170 worker2 # [ 87.492288] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.62 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 88.912789] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 89.337579] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:14Z level=info event=signal_exit worker2 # [ 89.549507] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=scheduler_yield lb # [ 89.553354] niks3-server[1038]: 2026/09/20 13:35:15 INFO lead: released remote=192.168.1.4:58182 worker1 # [ 89.545345] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:15Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 89.559687] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47170 worker2 # [ 89.567605] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 89.571903] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 89.576392] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47170 worker2 # [ 89.580788] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 89.745386] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.750688] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.767834] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.773262] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.951478] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.956900] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.974281] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.979547] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.157709] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.162785] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.181001] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.186174] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.363731] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.369108] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 90.386377] envoy[909]: conn peer=[2001:db8:1::4]:40066 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=46816 tx=2834 ms=60311 worker2 # [ 90.388480] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=scheduler_connected addr=lb:50051 lb # [ 90.391962] envoy[909]: conn peer=[2001:db8:1::1]:50332 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=27 lb # [ 90.397937] envoy[909]: conn peer=192.168.1.3:44908 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9193 tx=2501 ms=62177 worker2 # [ 90.399076] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 90.403940] envoy[909]: conn peer=[2001:db8:1::1]:50344 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1008 tx=305 ms=1162 worker2 # [ 90.554740] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:16Z level=info event=scheduler_restarting worker1 # [ 90.571486] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.585008] nix-daemon[858]: reaped child process 1309, status = succeeded worker1 # [ 90.575874] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.615752] nix-grpc-daemon[1260]: ts=2026-09-20T13:35:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 90.771891] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.776812] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.977676] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.982825] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.183611] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.188918] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.365180] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 91.372659] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 91.375214] systemd[1]: nix-grpc-daemon.service: Consumed 459ms CPU time over 8.233s wall clock time, 31.1M memory peak, 19.6K incoming IP traffic, 26.9K outgoing IP traffic. worker2 # [ 91.390685] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 91.399258] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 91.389851] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.403969] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 9.183s wall clock time, 256K memory peak, 17.7K incoming IP traffic, 14.5K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 91.395199] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1 # [ 91.597863] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.602087] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.798270] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.803393] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.004386] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.009496] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.210269] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.215503] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.416370] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.421465] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.452946] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:18Z level=info event=scheduler_take_over lb # [ 92.465247] niks3-server[1038]: 2026/09/20 13:35:18 INFO lead: acquired remote=192.168.1.3:37716 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) worker1 # [ 92.623130] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.630751] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:18Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:34846 worker1 # [ 92.635258] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker1 # [ 93.945908] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 93.960984] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 93.980637] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 93.998532] nix-grpc-daemon[1032]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 1/5) worker1 # [ 94.072280] nix-grpc-daemon[1032]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 110 ms (attempt 2/5) worker1 # [ 94.189958] nix-grpc-daemon[1032]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 292 ms (attempt 3/5) worker1 # [ 94.489653] nix-grpc-daemon[1032]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 413 ms (attempt 4/5) worker1 # [ 94.911213] nix-grpc-daemon[1032]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 94.949874] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:20Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 94.955345] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:20Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 94.993480] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 95.010202] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34854 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 95.025347] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 95.041836] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker1 # [ 95.069459] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:20Z level=info event=niks3_push_started pid=1105 worker1 # [ 95.284551] nix-grpc-daemon[1105]: time=2026-09-20T13:35:20.856Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 95.463267] nix-daemon[835]: accepted connection from pid 1118, user nix-grpc-daemon (trusted) worker1 # [ 95.480292] nix-daemon[835]: reaped child process 1121, status = succeeded worker1 # [ 95.660481] nix-daemon[835]: accepted connection from pid 1123, user nix-grpc-daemon (trusted) worker1 # [ 95.677267] nix-daemon[835]: reaped child process 1126, status = succeeded lb # [ 95.703118] niks3-server[1038]: 2026/09/20 13:35:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 95.703237] nix-grpc-daemon[1105]: time=2026-09-20T13:35:21.274Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 95.705277] nix-grpc-daemon[1105]: time=2026-09-20T13:35:21.274Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 95.743167] niks3-server[1038]: 2026/09/20 13:35:21 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 95.759198] niks3-server[1038]: 2026/09/20 13:35:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker1 # [ 95.754107] nix-grpc-daemon[1105]: time=2026-09-20T13:35:21.325Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.769617] niks3-server[1038]: 2026/09/20 13:35:21 INFO Signed narinfos id=27 count=1 lb # [ 95.777683] niks3-server[1038]: 2026/09/20 13:35:21 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 95.791343] niks3-server[1038]: 2026/09/20 13:35:21 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete worker1 # [ 95.786490] nix-grpc-daemon[1105]: time=2026-09-20T13:35:21.358Z level=INFO msg="Upload complete. (497ms)" lb # [ 95.799476] niks3-server[1038]: 2026/09/20 13:35:21 INFO Completed upload id=27 lb # [ 95.803970] niks3-server[1038]: 2026/09/20 13:35:21 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker1 # [ 95.795711] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34854 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 95.810543] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 95.820282] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker1 # [ 95.823309] nix-daemon[835]: reaped child process 1103, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... worker1 # [ 95.834906] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv client # farm-a> LOG-farm-a-on-standby worker1 # [ 96.881564] nix-daemon[835]: reaped child process 1130, status = succeeded worker1 # [ 97.062894] nix-daemon[835]: accepted connection from pid 1145, user nix-grpc-daemon (trusted) worker1 # [ 97.080004] nix-daemon[835]: reaped child process 1148, status = succeeded lb # [ 97.105011] niks3-server[1038]: 2026/09/20 13:35:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.108460] nix-grpc-daemon[1105]: time=2026-09-20T13:35:22.679Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 97.110074] nix-grpc-daemon[1105]: time=2026-09-20T13:35:22.679Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 97.156400] niks3-server[1038]: 2026/09/20 13:35:22 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 97.168516] niks3-server[1038]: 2026/09/20 13:35:22 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 97.176054] niks3-server[1038]: 2026/09/20 13:35:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 97.181711] niks3-server[1038]: 2026/09/20 13:35:22 INFO Signed narinfos id=28 count=1 worker1 # [ 97.171271] nix-grpc-daemon[1105]: time=2026-09-20T13:35:22.742Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.187370] niks3-server[1038]: 2026/09/20 13:35:22 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 97.196306] niks3-server[1038]: 2026/09/20 13:35:22 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 97.203421] niks3-server[1038]: 2026/09/20 13:35:22 INFO Completed upload id=28 worker1 # [ 97.192225] nix-grpc-daemon[1105]: time=2026-09-20T13:35:22.764Z level=INFO msg="Upload complete. (343ms)" lb # [ 97.207237] niks3-server[1038]: 2026/09/20 13:35:22 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker1 # [ 97.213180] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 97.225746] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:22Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 97.229088] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:22Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 97.232578] nix-daemon[835]: reaped child process 1128, status = succeeded worker1 # [ 97.258270] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 97.272885] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 97.288276] nix-grpc-daemon[1105]: time=2026-09-20T13:35:22.860Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 97.298265] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 97.314285] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker1 # [ 97.510896] nix-daemon[835]: accepted connection from pid 1154, user nix-grpc-daemon (trusted) worker1 # [ 97.529793] nix-daemon[835]: reaped child process 1157, status = succeeded worker1 # [ 97.702155] nix-daemon[835]: accepted connection from pid 1159, user nix-grpc-daemon (trusted) worker1 # [ 97.719156] nix-daemon[835]: reaped child process 1162, status = succeeded lb # [ 97.741317] niks3-server[1038]: 2026/09/20 13:35:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.741734] nix-grpc-daemon[1105]: time=2026-09-20T13:35:23.313Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 97.743190] nix-grpc-daemon[1105]: time=2026-09-20T13:35:23.313Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 97.774918] niks3-server[1038]: 2026/09/20 13:35:23 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst worker1 # [ 97.781653] nix-grpc-daemon[1105]: time=2026-09-20T13:35:23.353Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.786568] niks3-server[1038]: 2026/09/20 13:35:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 97.799817] niks3-server[1038]: 2026/09/20 13:35:23 INFO Signed narinfos id=29 count=1 lb # [ 97.804921] niks3-server[1038]: 2026/09/20 13:35:23 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 97.816072] niks3-server[1038]: 2026/09/20 13:35:23 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 97.821144] niks3-server[1038]: 2026/09/20 13:35:23 INFO Completed upload id=29 worker1 # [ 97.809295] nix-grpc-daemon[1105]: time=2026-09-20T13:35:23.381Z level=INFO msg="Upload complete. (478ms)" lb # [ 97.824358] niks3-server[1038]: 2026/09/20 13:35:23 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker1 # [ 97.820415] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34854 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 97.830166] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 97.836777] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker1 # [ 97.841252] nix-daemon[835]: reaped child process 1152, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker1 # [ 97.853048] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-on-standby worker1 # [ 98.477693] nix-daemon[835]: reaped child process 1166, status = succeeded worker1 # [ 98.638437] nix-daemon[835]: accepted connection from pid 1181, user nix-grpc-daemon (trusted) worker1 # [ 98.656841] nix-daemon[835]: reaped child process 1184, status = succeeded lb # [ 98.682662] niks3-server[1038]: 2026/09/20 13:35:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 98.682619] nix-grpc-daemon[1105]: time=2026-09-20T13:35:24.253Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 98.684269] nix-grpc-daemon[1105]: time=2026-09-20T13:35:24.254Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 98.717101] niks3-server[1038]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 98.731544] niks3-server[1038]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 98.740107] niks3-server[1038]: 2026/09/20 13:35:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker1 # [ 98.734406] nix-grpc-daemon[1105]: time=2026-09-20T13:35:24.306Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.749959] niks3-server[1038]: 2026/09/20 13:35:24 INFO Signed narinfos id=30 count=1 lb # [ 98.755224] niks3-server[1038]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 98.762338] niks3-server[1038]: 2026/09/20 13:35:24 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 98.769813] niks3-server[1038]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo lb # [ 98.774404] niks3-server[1038]: 2026/09/20 13:35:24 INFO Completed upload id=30 worker1 # [ 98.762797] nix-grpc-daemon[1105]: time=2026-09-20T13:35:24.335Z level=INFO msg="Upload complete. (301ms)" worker1 # [ 98.778680] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 duration_s=0 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 98.794062] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:24Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 98.797804] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:24Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 98.801741] nix-daemon[835]: reaped child process 1164, status = succeeded worker1 # [ 98.824531] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 98.839120] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 98.854451] nix-grpc-daemon[1105]: time=2026-09-20T13:35:24.426Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 98.864782] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 98.878699] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker1 # [ 99.079032] nix-daemon[835]: accepted connection from pid 1190, user nix-grpc-daemon (trusted) worker1 # [ 99.098612] nix-daemon[835]: reaped child process 1193, status = succeeded worker1 # [ 99.270525] nix-daemon[835]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker1 # [ 99.287017] nix-daemon[835]: reaped child process 1198, status = succeeded lb # [ 99.313922] niks3-server[1038]: 2026/09/20 13:35:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 99.312100] nix-grpc-daemon[1105]: time=2026-09-20T13:35:24.884Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 99.314076] nix-grpc-daemon[1105]: time=2026-09-20T13:35:24.886Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 99.344541] niks3-server[1038]: 2026/09/20 13:35:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker1 # [ 99.340631] nix-grpc-daemon[1105]: time=2026-09-20T13:35:24.912Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.359921] niks3-server[1038]: 2026/09/20 13:35:24 INFO Signed narinfos id=31 count=1 lb # [ 99.368966] niks3-server[1038]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst lb # [ 99.377323] niks3-server[1038]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 99.386725] niks3-server[1038]: 2026/09/20 13:35:24 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete worker1 # [ 99.379536] nix-grpc-daemon[1105]: time=2026-09-20T13:35:24.951Z level=INFO msg="Upload complete. (484ms)" lb # [ 99.391649] niks3-server[1038]: 2026/09/20 13:35:24 INFO Completed upload id=31 lb # [ 99.396566] niks3-server[1038]: 2026/09/20 13:35:24 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker1 # [ 99.388255] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34854 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 99.398729] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 99.405330] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker1 # [ 99.410162] nix-daemon[835]: reaped child process 1188, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 99.423519] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) lb # [ 100.384564] envoy[909]: conn peer=[2001:db8:1::4]:34674 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4919 tx=429 ms=7250 client # farm-top> LOG-farm-top-on-standby worker1 # [ 100.870155] nix-daemon[835]: reaped child process 1202, status = succeeded worker1 # [ 101.048417] nix-daemon[835]: accepted connection from pid 1217, user nix-grpc-daemon (trusted) worker1 # [ 101.067691] nix-daemon[835]: reaped child process 1220, status = succeeded lb # [ 101.094115] niks3-server[1038]: 2026/09/20 13:35:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 101.094344] nix-grpc-daemon[1105]: time=2026-09-20T13:35:26.664Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 101.095827] nix-grpc-daemon[1105]: time=2026-09-20T13:35:26.664Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 101.135033] niks3-server[1038]: 2026/09/20 13:35:26 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst worker1 # [ 101.135576] nix-grpc-daemon[1105]: time=2026-09-20T13:35:26.707Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.149743] niks3-server[1038]: 2026/09/20 13:35:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 101.160466] niks3-server[1038]: 2026/09/20 13:35:26 INFO Signed narinfos id=32 count=1 lb # [ 101.162769] niks3-server[1038]: 2026/09/20 13:35:26 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 101.169565] niks3-server[1038]: 2026/09/20 13:35:26 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 101.178373] niks3-server[1038]: 2026/09/20 13:35:26 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete worker1 # [ 101.166395] nix-grpc-daemon[1105]: time=2026-09-20T13:35:26.738Z level=INFO msg="Upload complete. (332ms)" lb # [ 101.181424] niks3-server[1038]: 2026/09/20 13:35:26 INFO Completed upload id=32 lb # [ 101.184171] niks3-server[1038]: 2026/09/20 13:35:26 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker1 # [ 101.177561] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 101.196190] nix-daemon[835]: reaped child process 1200, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.55 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds) worker2 # [ 101.576992] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 101.584896] systemd[1]: Starting scheduler-token.service... worker2 # [ 101.686359] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 101.692563] systemd[1]: Finished scheduler-token.service. worker2 # [ 101.693826] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 104ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 101.699773] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 101.878321] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:27Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 101.880904] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:27Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 101.884998] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:27Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 101.892735] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:27Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 101.894476] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 101.927442] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.928234] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:27Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 101.933757] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:27Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:34846 worker1 # [ 101.939184] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.64 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 102.357736] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds) client # Running as unit: rs.service; invocation ID: bc7e265d73c441ad9b5e78d5ca4c656e client # [ 102.598607] nix[1170]: don't know how to build these paths: client # [ 102.600432] nix[1170]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 102.583111] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 102.598619] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:28Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 102.606876] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:28Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 102.644971] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 102.661153] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34854 client # [ 102.688470] nix[1170]: copying 1 paths to 'lb:50051'... client # [ 102.694475] nix[1170]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 102.678903] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 102.693874] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker1 # [ 102.901098] nix-daemon[835]: accepted connection from pid 1233, user nix-grpc-daemon (trusted) worker1 # [ 102.919806] nix-daemon[835]: reaped child process 1236, status = succeeded worker1 # [ 103.091541] nix-daemon[835]: accepted connection from pid 1238, user nix-grpc-daemon (trusted) worker1 # [ 103.108911] nix-daemon[835]: reaped child process 1241, status = succeeded lb # [ 103.134334] niks3-server[1038]: 2026/09/20 13:35:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 103.131276] nix-grpc-daemon[1105]: time=2026-09-20T13:35:28.702Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 103.132893] nix-grpc-daemon[1105]: time=2026-09-20T13:35:28.703Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 103.165678] niks3-server[1038]: 2026/09/20 13:35:28 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst worker1 # [ 103.172718] nix-grpc-daemon[1105]: time=2026-09-20T13:35:28.744Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.177979] niks3-server[1038]: 2026/09/20 13:35:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 103.188916] niks3-server[1038]: 2026/09/20 13:35:28 INFO Signed narinfos id=33 count=1 lb # [ 103.191356] niks3-server[1038]: 2026/09/20 13:35:28 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 103.203169] niks3-server[1038]: 2026/09/20 13:35:28 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete worker1 # [ 103.195824] nix-grpc-daemon[1105]: time=2026-09-20T13:35:28.768Z level=INFO msg="Upload complete. (485ms)" lb # [ 103.206638] niks3-server[1038]: 2026/09/20 13:35:28 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo lb # [ 103.210424] niks3-server[1038]: 2026/09/20 13:35:28 INFO Completed upload id=33 worker1 # [ 103.204276] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34854 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 103.216949] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 worker1 # [ 103.223501] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker1 # [ 103.228791] nix-daemon[835]: reaped child process 1231, status = succeeded client # [ 103.253226] nix[1170]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker1 # [ 103.241917] nix-daemon[835]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 105.304634] systemd-journald[275]: Received client request to rotate journal, rotating. worker2 # [ 105.324315] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/15bed43e0db44e4b9d4647440c422766. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 105.370297] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds) client: must succeed: sleep 5.0 worker1 # [ 105.454950] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:31Z level=info event=draining lb # [ 110.383262] envoy[909]: conn peer=[2001:db8:1::1]:47552 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9623 tx=3881 ms=7265 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 110.889972] nix-daemon[835]: reaped child process 1245, status = succeeded worker1 # [ 111.076475] nix-daemon[835]: accepted connection from pid 1285, user nix-grpc-daemon (trusted) worker1 # [ 111.095765] nix-daemon[835]: reaped child process 1288, status = succeeded lb # [ 111.120927] niks3-server[1038]: 2026/09/20 13:35:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 111.120465] nix-grpc-daemon[1105]: time=2026-09-20T13:35:36.692Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 111.121974] nix-grpc-daemon[1105]: time=2026-09-20T13:35:36.692Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 111.162009] niks3-server[1038]: 2026/09/20 13:35:36 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 111.176640] niks3-server[1038]: 2026/09/20 13:35:36 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst worker1 # [ 111.178063] nix-grpc-daemon[1105]: time=2026-09-20T13:35:36.749Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.189406] niks3-server[1038]: 2026/09/20 13:35:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 111.194899] niks3-server[1038]: 2026/09/20 13:35:36 INFO Signed narinfos id=34 count=1 lb # [ 111.200872] niks3-server[1038]: 2026/09/20 13:35:36 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 111.208328] niks3-server[1038]: 2026/09/20 13:35:36 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 111.214489] niks3-server[1038]: 2026/09/20 13:35:36 INFO Completed upload id=34 worker1 # [ 111.202799] nix-grpc-daemon[1105]: time=2026-09-20T13:35:36.775Z level=INFO msg="Upload complete. (345ms)" lb # [ 111.217027] niks3-server[1038]: 2026/09/20 13:35:36 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 111.217313] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34854 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 111.234128] nix-daemon[835]: reaped child process 1243, status = succeeded client # [ 111.271095] systemd[1]: rs.service: Deactivated successfully. client # [ 111.276773] systemd[1]: rs.service: Consumed 162ms CPU time over 8.917s wall clock time, 37.2M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic. worker1 # [ 111.455970] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=signal_exit worker1 # [ 111.678276] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=scheduler_yield lb # [ 111.692272] niks3-server[1038]: 2026/09/20 13:35:37 INFO lead: released remote=192.168.1.3:37716 worker1 # [ 111.686565] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 111.699912] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:37Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 111.693160] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34846 worker1 # [ 111.697668] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 111.701703] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34846 worker1 # [ 111.706222] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=worker_gone addr=192.168.1.4:50051 worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.12 seconds) client: waiting for success: ! systemctl is-active rs worker1 # [ 111.887732] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.899906] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:50051 lb # [ 111.905614] niks3-server[1038]: 2026/09/20 13:35:37 INFO lead: acquired remote=192.168.1.4:47506 worker1 # [ 111.893259] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.906561] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:37Z level=info event=scheduler_take_over worker2 # [ 111.910226] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 112.093856] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.107403] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.099179] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.112729] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1 # [ 112.302045] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.313856] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.306270] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.318907] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.502769] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.508198] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.519989] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.525113] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.683902] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:38Z level=info event=scheduler_restarting worker2 # [ 112.727759] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.731978] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.731944] nix-grpc-daemon[1032]: ts=2026-09-20T13:35:38Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 112.737731] nix-daemon[835]: reaped child process 1096, status = succeeded worker2 # [ 112.928788] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.933838] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 113.134967] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.140187] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2 # [ 113.341325] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.346545] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.547543] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.564123] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:39Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 113.569336] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:39Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53310 worker2 # [ 113.574624] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:39Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 113.620207] nix-grpc-daemon[1032]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 113.620489] nix-grpc-daemon[1032]: E0000 00:00:1789911339.190955 1075 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 113.620686] nix-grpc-daemon[1032]: E0000 00:00:1789911339.191270 1075 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 114.111590] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 114.119063] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 114.124804] systemd[1]: nix-grpc-daemon.service: Consumed 1.803s CPU time over 26.877s wall clock time, 34.6M memory peak, 48.9K incoming IP traffic, 92.8K outgoing IP traffic. worker1 # [ 114.137405] systemd[1]: Starting Nix worker-protocol over gRPC... lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 114.334184] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:39Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 114.336965] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 114.341109] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 114.349128] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 114.350914] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 114.368380] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:39Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 114.384576] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:39Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53310 worker2 # [ 114.384833] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.18 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 114.541116] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 275f92ecde0f445d90451f54cbefea04 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds) worker2 # [ 114.773005] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53320 worker2 # [ 114.787921] nix-daemon[858]: accepted connection from pid 1356, user nix-grpc-daemon (trusted) client # [ 114.808471] nix[1206]: don't know how to build these paths: client # [ 114.810700] nix[1206]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 114.815921] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:40Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 114.823790] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:40Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 114.868626] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53320 worker2 # [ 114.885712] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5) worker2 # [ 114.975253] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 155 ms (attempt 2/5) worker2 # [ 115.130770] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 397 ms (attempt 3/5) worker2 # [ 115.536403] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 4/5) worker2 # [ 115.545123] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 115.566206] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53320 client # [ 115.584458] nix[1206]: copying 1 paths to 'lb:50051'... worker2 # [ 115.582602] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53320 client # [ 115.587853] nix[1206]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 115.600404] nix-daemon[858]: accepted connection from pid 1356, user nix-grpc-daemon (trusted) worker2 # [ 115.629362] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:41Z level=info event=niks3_push_started pid=1468 worker2 # [ 115.855983] nix-grpc-daemon[1468]: time=2026-09-20T13:35:41.427Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 116.037849] nix-daemon[858]: accepted connection from pid 1485, user nix-grpc-daemon (trusted) worker2 # [ 116.057871] nix-daemon[858]: reaped child process 1488, status = succeeded worker2 # [ 116.231345] nix-daemon[858]: accepted connection from pid 1490, user nix-grpc-daemon (trusted) worker2 # [ 116.248344] nix-daemon[858]: reaped child process 1493, status = succeeded lb # [ 116.265717] niks3-server[1038]: 2026/09/20 13:35:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 116.276075] nix-grpc-daemon[1468]: time=2026-09-20T13:35:41.849Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 116.277635] nix-grpc-daemon[1468]: time=2026-09-20T13:35:41.849Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 116.301207] niks3-server[1038]: 2026/09/20 13:35:41 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 116.315358] nix-grpc-daemon[1468]: time=2026-09-20T13:35:41.889Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.314983] niks3-server[1038]: 2026/09/20 13:35:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 116.326820] niks3-server[1038]: 2026/09/20 13:35:41 INFO Signed narinfos id=35 count=1 lb # [ 116.336306] niks3-server[1038]: 2026/09/20 13:35:41 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 116.346028] niks3-server[1038]: 2026/09/20 13:35:41 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete worker2 # [ 116.352808] nix-grpc-daemon[1468]: time=2026-09-20T13:35:41.927Z level=INFO msg="Upload complete. (497ms)" lb # [ 116.356330] niks3-server[1038]: 2026/09/20 13:35:41 INFO Completed upload id=35 worker2 # [ 116.360165] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53320 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 116.376267] nix-grpc-daemon[1468]: time=2026-09-20T13:35:41.942Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 116.382598] nix-grpc-daemon[1356]: ts=2026-09-20T13:35:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53320 worker2 # [ 116.390783] nix-daemon[858]: accepted connection from pid 1356, user nix-grpc-daemon (trusted) worker2 # [ 116.394933] nix-daemon[858]: reaped child process 1466, status = succeeded worker2 # [ 116.403110] nix-daemon[858]: accepted connection from pid 1356, user nix-grpc-daemon (trusted) client # [ 116.406348] nix[1206]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 118.562202] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1356 (nix-grpc-daemon) on client request. worker2 # [ 118.564176] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 118.578143] niks3-server[1038]: 2026/09/20 13:35:44 INFO lead: released remote=192.168.1.4:47506 worker2 # [ 118.597033] systemd[1]: Starting scheduler-token.service... client # [ 118.596567] nix[1206]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 118.581013] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:44Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 118.596945] nix[1206]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 118.612306] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 118.613846] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 118.615088] systemd[1]: nix-grpc-daemon.service: Consumed 562ms CPU time over 16.907s wall clock time, 31.6M memory peak, 16.7K incoming IP traffic, 30.6K outgoing IP traffic. worker2 # [ 118.640926] nix-daemon[858]: reaped child process 1459, status = succeeded worker2 # [ 118.644715] nix-daemon[858]: reaped child process 1495, status = succeeded worker2 # [ 118.648868] nix-daemon[1497]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 118.659232] nix-daemon[858]: reaped child process 1497, status = failed with exit code 1 worker2 # [ 118.702767] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 118.705560] systemd[1]: Finished scheduler-token.service. worker2 # [ 118.706368] systemd[1]: scheduler-token.service: Consumed 25ms CPU time over 105ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 118.710246] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 118.714018] systemd[1]: Starting scheduler-token.service... worker2 # [ 118.788472] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 118.790254] systemd[1]: Finished scheduler-token.service. worker2 # [ 118.793924] systemd[1]: scheduler-token.service: Consumed 24ms CPU time over 76ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 118.797797] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 118.790037] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.964530] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 118.967382] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 118.971567] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 118.979873] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 118.988605] systemd[1]: Started Nix worker-protocol over gRPC. worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.48 seconds) client: must succeed: sleep 5.0 worker1 # [ 118.984594] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 119.001373] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=info event=scheduler_take_over lb # [ 119.001475] niks3-server[1038]: 2026/09/20 13:35:44 INFO lead: acquired remote=192.168.1.4:35670 worker2 # [ 119.011239] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.017089] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 119.018374] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53326 worker2 # [ 119.020264] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 119.102345] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 119.106991] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 119.162777] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53342 worker2 # [ 119.176799] nix-daemon[858]: accepted connection from pid 1539, user nix-grpc-daemon (trusted) worker2 # [ 119.194934] nix-daemon[858]: accepted connection from pid 1539, user nix-grpc-daemon (trusted) worker1 # [ 119.185481] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 119.202359] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53326 worker2 # [ 119.210137] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:44Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 client # [ 119.224131] nix[1206]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 119.224242] nix-daemon[858]: accepted connection from pid 1539, user nix-grpc-daemon (trusted) lb # [ 120.383782] envoy[909]: conn peer=[2001:db8:1::1]:54688 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1348 ms=8645 lb # [ 120.388947] envoy[909]: conn peer=[2001:db8:1::3]:54142 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3890 tx=1213 ms=25252 lb # [ 120.393944] envoy[909]: conn peer=[2001:db8:1::4]:52332 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=8006 tx=595 ms=16683 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 124.446456] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:50Z level=info event=niks3_push_started pid=1618 worker2 # [ 124.466961] nix-daemon[858]: reaped child process 1594, status = succeeded worker2 # [ 124.654008] nix-grpc-daemon[1618]: time=2026-09-20T13:35:50.227Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 124.828208] nix-daemon[858]: accepted connection from pid 1631, user nix-grpc-daemon (trusted) worker2 # [ 124.846419] nix-daemon[858]: reaped child process 1634, status = succeeded lb # [ 124.860753] niks3-server[1038]: 2026/09/20 13:35:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 124.872081] nix-grpc-daemon[1618]: time=2026-09-20T13:35:50.444Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 124.873576] nix-grpc-daemon[1618]: time=2026-09-20T13:35:50.444Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 124.908852] niks3-server[1038]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 124.925354] niks3-server[1038]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 124.937575] niks3-server[1038]: 2026/09/20 13:35:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 124.942646] niks3-server[1038]: 2026/09/20 13:35:50 INFO Signed narinfos id=36 count=1 worker2 # [ 124.943615] nix-grpc-daemon[1618]: time=2026-09-20T13:35:50.516Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.951119] niks3-server[1038]: 2026/09/20 13:35:50 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 124.963798] niks3-server[1038]: 2026/09/20 13:35:50 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete worker2 # [ 124.970257] nix-grpc-daemon[1618]: time=2026-09-20T13:35:50.544Z level=INFO msg="Upload complete. (312ms)" lb # [ 124.971015] niks3-server[1038]: 2026/09/20 13:35:50 INFO Completed upload id=36 worker2 # [ 124.984906] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53342 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker2 # [ 125.002457] nix-grpc-daemon[1618]: time=2026-09-20T13:35:50.570Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 125.008599] nix-daemon[858]: reaped child process 1592, status = succeeded client # [ 125.028584] systemd[1]: mid.service: Deactivated successfully. client # [ 125.032860] systemd[1]: mid.service: Consumed 165ms CPU time over 10.492s wall clock time, 37.2M memory peak, 9.6K incoming IP traffic, 10.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.09 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 125.607757] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: f3069f89e4be48ddb525ac6fa5d103f8 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) worker1 # [ 125.822809] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 125.837087] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) client # [ 125.870350] nix[1242]: don't know how to build these paths: client # [ 125.871685] nix[1242]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker1 # [ 125.913221] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 125.930340] nix-grpc-daemon[1295]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5) worker1 # [ 125.973260] nix-grpc-daemon[1295]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 2/5) worker1 # [ 126.080919] nix-grpc-daemon[1295]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 222 ms (attempt 3/5) worker1 # [ 126.310533] nix-grpc-daemon[1295]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 639 ms (attempt 4/5) worker2 # [ 125.879905] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:51Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker2 # [ 125.885795] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:51Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 126.958778] nix-grpc-daemon[1295]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 126.979930] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 client # [ 127.009331] nix[1242]: copying 1 paths to 'lb:50051'... worker1 # [ 126.995203] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 client # [ 127.013722] nix[1242]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker1 # [ 127.015094] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 127.043806] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:52Z level=info event=niks3_push_started pid=1387 worker1 # [ 127.258891] nix-grpc-daemon[1387]: time=2026-09-20T13:35:52.830Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker1.key ca="" worker1 # [ 127.435884] nix-daemon[835]: accepted connection from pid 1400, user nix-grpc-daemon (trusted) worker1 # [ 127.452370] nix-daemon[835]: reaped child process 1403, status = succeeded worker1 # [ 127.628419] nix-daemon[835]: accepted connection from pid 1405, user nix-grpc-daemon (trusted) worker1 # [ 127.645236] nix-daemon[835]: reaped child process 1408, status = succeeded lb # [ 127.670711] niks3-server[1038]: 2026/09/20 13:35:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 127.674233] nix-grpc-daemon[1387]: time=2026-09-20T13:35:53.245Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 127.675781] nix-grpc-daemon[1387]: time=2026-09-20T13:35:53.245Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" worker1 # [ 127.720280] nix-grpc-daemon[1387]: time=2026-09-20T13:35:53.291Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.722720] niks3-server[1038]: 2026/09/20 13:35:53 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 127.734760] niks3-server[1038]: 2026/09/20 13:35:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 127.748685] niks3-server[1038]: 2026/09/20 13:35:53 INFO Signed narinfos id=37 count=1 worker1 # [ 127.749157] nix-grpc-daemon[1387]: time=2026-09-20T13:35:53.321Z level=INFO msg="Upload complete. (486ms)" lb # [ 127.755390] niks3-server[1038]: 2026/09/20 13:35:53 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 127.766826] niks3-server[1038]: 2026/09/20 13:35:53 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 127.772738] niks3-server[1038]: 2026/09/20 13:35:53 INFO Completed upload id=37 worker1 # [ 127.760328] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 127.775294] niks3-server[1038]: 2026/09/20 13:35:53 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker1 # [ 127.772617] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 127.782863] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 127.785345] nix-daemon[835]: reaped child process 1385, status = succeeded client # [ 127.811196] nix[1242]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker1 # [ 127.800229] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 129.334523] systemd[1]: intr.service: Sent signal SIGINT to main process 1242 (nix) on client request. worker1 # [ 129.325543] nix-grpc-daemon[1295]: ts=2026-09-20T13:35:54Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 129.342770] nix[1242]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) client # [ 129.355234] nix[1242]: error: interrupted by the user client # [ 129.389723] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 129.394666] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 129.396877] systemd[1]: intr.service: Consumed 144ms CPU time over 3.785s wall clock time, 39.2M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic. worker1 # [ 129.426662] nix-daemon[835]: reaped child process 1410, status = succeeded worker1 # [ 129.432609] nix-daemon[1412]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 129.438024] nix-daemon[835]: reaped child process 1412, status = failed with exit code 1 lb # [ 130.385734] envoy[909]: conn peer=[2001:db8:1::1]:51550 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3854 tx=1638 ms=10225 lb # [ 130.390779] envoy[909]: conn peer=[2001:db8:1::1]:58738 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=755 ms=3542 (finished: subtest: interrupting the client stops the build on the worker, in 5.11 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 130.744713] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 566ce8e28ba847f7a3be8ab07160d4dc client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds) client # [ 130.985464] nix[1263]: don't know how to build these paths: client # [ 130.986521] nix[1263]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 130.981405] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53342 worker2 # [ 130.995818] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:56Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 131.002913] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:56Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 131.040257] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53342 worker2 # [ 131.056107] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 1/5) worker2 # [ 131.093509] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 195 ms (attempt 2/5) worker2 # [ 131.296089] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 3/5) worker2 # [ 131.487725] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 4/5) worker2 # [ 131.498898] nix-grpc-daemon[1539]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 131.520133] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53342 client # [ 131.536633] nix[1263]: copying 1 paths to 'lb:50051'... client # [ 131.542701] nix[1263]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker2 # [ 131.538556] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53342 worker2 # [ 131.555123] nix-daemon[858]: accepted connection from pid 1539, user nix-grpc-daemon (trusted) worker2 # [ 131.755796] nix-daemon[858]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker2 # [ 131.772413] nix-daemon[858]: reaped child process 1676, status = succeeded worker2 # [ 131.944021] nix-daemon[858]: accepted connection from pid 1678, user nix-grpc-daemon (trusted) worker2 # [ 131.960585] nix-daemon[858]: reaped child process 1681, status = succeeded lb # [ 131.973991] niks3-server[1038]: 2026/09/20 13:35:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 131.984463] nix-grpc-daemon[1618]: time=2026-09-20T13:35:57.558Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 131.986548] nix-grpc-daemon[1618]: time=2026-09-20T13:35:57.560Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 132.004199] niks3-server[1038]: 2026/09/20 13:35:57 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker2 # [ 132.018045] nix-grpc-daemon[1618]: time=2026-09-20T13:35:57.592Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.018526] niks3-server[1038]: 2026/09/20 13:35:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 132.029771] niks3-server[1038]: 2026/09/20 13:35:57 INFO Signed narinfos id=38 count=1 lb # [ 132.036179] niks3-server[1038]: 2026/09/20 13:35:57 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 132.046201] niks3-server[1038]: 2026/09/20 13:35:57 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete worker2 # [ 132.051902] nix-grpc-daemon[1618]: time=2026-09-20T13:35:57.626Z level=INFO msg="Upload complete. (480ms)" lb # [ 132.052932] niks3-server[1038]: 2026/09/20 13:35:57 INFO Completed upload id=38 worker2 # [ 132.057336] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53342 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 132.056761] niks3-server[1038]: 2026/09/20 13:35:57 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker2 # [ 132.071726] nix-grpc-daemon[1539]: ts=2026-09-20T13:35:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53342 worker2 # [ 132.079595] nix-daemon[858]: accepted connection from pid 1539, user nix-grpc-daemon (trusted) worker2 # [ 132.080958] nix-daemon[858]: reaped child process 1671, status = succeeded worker2 # [ 132.091236] nix-daemon[858]: accepted connection from pid 1539, user nix-grpc-daemon (trusted) client # [ 132.094723] nix[1263]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done worker2 # activating the configuration... worker2 # [ 134.210127] nixos[1716]: switching to system configuration /nix/store/vpqlg46ygzls84ir4568iq9j341mmmsv-nixos-system-worker2-test worker2 # [ 134.212166] systemd[1]: Stopped target Local File Systems. worker2 # [ 134.214887] systemd[1]: Stopped target Remote File Systems. worker2 # setting up /etc... worker2 # [ 134.971512] systemd[1]: Reload requested from client PID 1716 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 134.973694] systemd[1]: Reloading... worker2 # [ 135.879495] systemd[1]: Reloading finished in 902 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 135.958309] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 136.118930] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 136.121781] systemd[1]: Reached target Reactivate sysinit units. worker2 # [ 136.132281] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 136.133435] dbus-broker-launch[501]: Caught SIGHUP, trigger reload. worker2 # [ 136.134285] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 136.152230] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 136.154940] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync' worker2 # [ 136.160277] dbus-broker-launch[501]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 136.182998] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 136.204671] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 136.209138] systemd[1]: Reached target Local File Systems. worker2 # [ 136.214921] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 136.219558] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 136.224548] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 136.225719] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 136.227747] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 136.245353] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 136.246624] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 136.251100] systemd[1]: Reached target Remote File Systems. worker2 # [ 136.253113] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 136.256124] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 136.732965] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 136.736610] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 136.742072] systemd[1]: Starting linger-users.service... worker2 # [ 136.800791] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 136.801724] systemd[1]: Finished linger-users.service. worker2 # [ 136.990839] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:02Z level=info event=draining worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 137.058683] nixos[1716]: finished switching to system configuration /nix/store/vpqlg46ygzls84ir4568iq9j341mmmsv-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.67 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 137.381398] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53342 worker1 # [ 137.368430] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54420 worker2 # [ 137.403158] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:02Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 137.405306] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:02Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 137.440744] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 137.456767] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 client # copying 1 paths to 'lb:50051'... worker1 # [ 137.473459] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker1 # [ 137.500849] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 137.712629] nix-daemon[835]: accepted connection from pid 1462, user nix-grpc-daemon (trusted) worker1 # [ 137.730912] nix-daemon[835]: reaped child process 1465, status = succeeded worker1 # [ 137.906424] nix-daemon[835]: accepted connection from pid 1467, user nix-grpc-daemon (trusted) worker1 # [ 137.926151] nix-daemon[835]: reaped child process 1470, status = succeeded lb # [ 137.954606] niks3-server[1038]: 2026/09/20 13:36:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 137.952728] nix-grpc-daemon[1387]: time=2026-09-20T13:36:03.524Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 137.954265] nix-grpc-daemon[1387]: time=2026-09-20T13:36:03.524Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 137.986120] niks3-server[1038]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker1 # [ 137.989402] nix-grpc-daemon[1387]: time=2026-09-20T13:36:03.561Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.002572] niks3-server[1038]: 2026/09/20 13:36:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 138.012815] niks3-server[1038]: 2026/09/20 13:36:03 INFO Signed narinfos id=39 count=1 lb # [ 138.022409] niks3-server[1038]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls worker1 # [ 138.015613] nix-grpc-daemon[1387]: time=2026-09-20T13:36:03.587Z level=INFO msg="Upload complete. (497ms)" lb # [ 138.029705] niks3-server[1038]: 2026/09/20 13:36:03 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 138.034796] niks3-server[1038]: 2026/09/20 13:36:03 INFO Completed upload id=39 worker1 # [ 138.024341] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=528 lb # [ 138.038840] niks3-server[1038]: 2026/09/20 13:36:03 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker1 # [ 138.039522] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 138.044228] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 138.049896] nix-daemon[835]: reaped child process 1460, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker1 # [ 138.061574] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-during-drain worker1 # [ 139.090492] nix-daemon[835]: reaped child process 1474, status = succeeded worker1 # [ 139.257598] nix-daemon[835]: accepted connection from pid 1489, user nix-grpc-daemon (trusted) worker1 # [ 139.274872] nix-daemon[835]: reaped child process 1492, status = succeeded lb # [ 139.298273] niks3-server[1038]: 2026/09/20 13:36:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 139.296391] nix-grpc-daemon[1387]: time=2026-09-20T13:36:04.868Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 139.300994] nix-grpc-daemon[1387]: time=2026-09-20T13:36:04.870Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 139.343418] niks3-server[1038]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst worker1 # [ 139.344170] nix-grpc-daemon[1387]: time=2026-09-20T13:36:04.915Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.365090] niks3-server[1038]: 2026/09/20 13:36:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 139.385486] niks3-server[1038]: 2026/09/20 13:36:04 INFO Signed narinfos id=40 count=1 lb # [ 139.397366] niks3-server[1038]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 139.405834] niks3-server[1038]: 2026/09/20 13:36:04 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 139.409863] niks3-server[1038]: 2026/09/20 13:36:04 INFO Completed upload id=40 worker1 # [ 139.398885] nix-grpc-daemon[1387]: time=2026-09-20T13:36:04.970Z level=INFO msg="Upload complete. (327ms)" lb # [ 139.412428] niks3-server[1038]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker2 # [ 139.421872] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:04Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 lb # [ 139.421309] niks3-server[1038]: 2026/09/20 13:36:04 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls worker2 # [ 139.423745] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:04Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 139.414829] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker1 # [ 139.430087] nix-daemon[835]: reaped child process 1472, status = succeeded worker1 # [ 139.463010] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 139.478650] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 139.496666] nix-grpc-daemon[1387]: time=2026-09-20T13:36:05.068Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 139.506698] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker1 # [ 139.530769] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 139.738126] nix-daemon[835]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker1 # [ 139.756204] nix-daemon[835]: reaped child process 1499, status = succeeded worker1 # [ 139.929216] nix-daemon[835]: accepted connection from pid 1501, user nix-grpc-daemon (trusted) worker1 # [ 139.947737] nix-daemon[835]: reaped child process 1504, status = succeeded lb # [ 139.970393] niks3-server[1038]: 2026/09/20 13:36:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 139.972491] nix-grpc-daemon[1387]: time=2026-09-20T13:36:05.544Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 139.974010] nix-grpc-daemon[1387]: time=2026-09-20T13:36:05.544Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 140.005073] niks3-server[1038]: 2026/09/20 13:36:05 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst lb # [ 140.018386] niks3-server[1038]: 2026/09/20 13:36:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker1 # [ 140.014650] nix-grpc-daemon[1387]: time=2026-09-20T13:36:05.586Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.030682] niks3-server[1038]: 2026/09/20 13:36:05 INFO Signed narinfos id=41 count=1 lb # [ 140.037450] niks3-server[1038]: 2026/09/20 13:36:05 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 140.050114] niks3-server[1038]: 2026/09/20 13:36:05 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 140.055083] niks3-server[1038]: 2026/09/20 13:36:05 INFO Completed upload id=41 worker1 # [ 140.043809] nix-grpc-daemon[1387]: time=2026-09-20T13:36:05.616Z level=INFO msg="Upload complete. (495ms)" lb # [ 140.057893] niks3-server[1038]: 2026/09/20 13:36:05 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker1 # [ 140.052293] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 140.066708] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 140.073839] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 140.078834] nix-daemon[835]: reaped child process 1494, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker1 # [ 140.091610] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 140.913635] nix-daemon[835]: reaped child process 1508, status = succeeded client # farm-b> LOG-farm-b-during-drain worker1 # [ 141.075988] nix-daemon[835]: accepted connection from pid 1523, user nix-grpc-daemon (trusted) worker1 # [ 141.095905] nix-daemon[835]: reaped child process 1526, status = succeeded lb # [ 141.119469] niks3-server[1038]: 2026/09/20 13:36:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 141.120104] nix-grpc-daemon[1387]: time=2026-09-20T13:36:06.691Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 141.121613] nix-grpc-daemon[1387]: time=2026-09-20T13:36:06.691Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 141.156661] niks3-server[1038]: 2026/09/20 13:36:06 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 141.168816] niks3-server[1038]: 2026/09/20 13:36:06 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker1 # [ 141.169895] nix-grpc-daemon[1387]: time=2026-09-20T13:36:06.741Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.181268] niks3-server[1038]: 2026/09/20 13:36:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 141.187821] niks3-server[1038]: 2026/09/20 13:36:06 INFO Signed narinfos id=42 count=1 lb # [ 141.193008] niks3-server[1038]: 2026/09/20 13:36:06 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 141.199693] niks3-server[1038]: 2026/09/20 13:36:06 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 141.206093] niks3-server[1038]: 2026/09/20 13:36:06 INFO Completed upload id=42 worker1 # [ 141.194866] nix-grpc-daemon[1387]: time=2026-09-20T13:36:06.767Z level=INFO msg="Upload complete. (291ms)" lb # [ 141.209687] niks3-server[1038]: 2026/09/20 13:36:06 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker1 # [ 141.204944] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker2 # [ 141.222481] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:06Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker2 # [ 141.224436] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:06Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 141.221059] nix-daemon[835]: reaped child process 1506, status = succeeded worker1 # [ 141.256891] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 141.273244] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 141.287538] nix-grpc-daemon[1387]: time=2026-09-20T13:36:06.859Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 141.303765] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker1 # [ 141.327961] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 141.531559] nix-daemon[835]: accepted connection from pid 1530, user nix-grpc-daemon (trusted) worker1 # [ 141.551570] nix-daemon[835]: reaped child process 1533, status = succeeded worker1 # [ 141.726129] nix-daemon[835]: accepted connection from pid 1535, user nix-grpc-daemon (trusted) worker1 # [ 141.743841] nix-daemon[835]: reaped child process 1538, status = succeeded lb # [ 141.767021] niks3-server[1038]: 2026/09/20 13:36:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 141.765895] nix-grpc-daemon[1387]: time=2026-09-20T13:36:07.337Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 141.767407] nix-grpc-daemon[1387]: time=2026-09-20T13:36:07.337Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 141.798788] niks3-server[1038]: 2026/09/20 13:36:07 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst worker1 # [ 141.798441] nix-grpc-daemon[1387]: time=2026-09-20T13:36:07.370Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.813746] niks3-server[1038]: 2026/09/20 13:36:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 141.823210] niks3-server[1038]: 2026/09/20 13:36:07 INFO Signed narinfos id=43 count=1 lb # [ 141.827945] niks3-server[1038]: 2026/09/20 13:36:07 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls worker1 # [ 141.822021] nix-grpc-daemon[1387]: time=2026-09-20T13:36:07.394Z level=INFO msg="Upload complete. (476ms)" lb # [ 141.834886] niks3-server[1038]: 2026/09/20 13:36:07 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete worker1 # [ 141.828239] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 141.841405] niks3-server[1038]: 2026/09/20 13:36:07 INFO Completed upload id=43 lb # [ 141.844265] niks3-server[1038]: 2026/09/20 13:36:07 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker1 # [ 141.839099] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 141.842240] nix-daemon[835]: reaped child process 1528, status = succeeded worker1 # [ 141.849158] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker1 # [ 141.859920] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> LOG-farm-top-during-drain worker1 # [ 143.300183] nix-daemon[835]: reaped child process 1542, status = succeeded worker1 # [ 143.485372] nix-daemon[835]: accepted connection from pid 1557, user nix-grpc-daemon (trusted) worker1 # [ 143.504327] nix-daemon[835]: reaped child process 1560, status = succeeded lb # [ 143.531497] niks3-server[1038]: 2026/09/20 13:36:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 143.531044] nix-grpc-daemon[1387]: time=2026-09-20T13:36:09.101Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 143.532800] nix-grpc-daemon[1387]: time=2026-09-20T13:36:09.101Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 143.570569] niks3-server[1038]: 2026/09/20 13:36:09 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst worker1 # [ 143.572397] nix-grpc-daemon[1387]: time=2026-09-20T13:36:09.144Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.587262] niks3-server[1038]: 2026/09/20 13:36:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 143.595486] niks3-server[1038]: 2026/09/20 13:36:09 INFO Signed narinfos id=44 count=1 worker1 # [ 143.591375] nix-grpc-daemon[1387]: time=2026-09-20T13:36:09.163Z level=INFO msg="Upload complete. (318ms)" lb # [ 143.603131] niks3-server[1038]: 2026/09/20 13:36:09 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 143.608588] niks3-server[1038]: 2026/09/20 13:36:09 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 143.612361] niks3-server[1038]: 2026/09/20 13:36:09 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 143.616854] niks3-server[1038]: 2026/09/20 13:36:09 INFO Completed upload id=44 lb # [ 143.618865] niks3-server[1038]: 2026/09/20 13:36:09 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker1 # [ 143.601036] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker1 # [ 143.614339] nix-daemon[835]: reaped child process 1540, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.54 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 144.155062] nix-daemon[858]: reaped child process 1689, status = succeeded worker2 # [ 144.330000] nix-daemon[858]: accepted connection from pid 1863, user nix-grpc-daemon (trusted) worker2 # [ 144.348825] nix-daemon[858]: reaped child process 1866, status = succeeded lb # [ 144.360217] niks3-server[1038]: 2026/09/20 13:36:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 144.370121] nix-grpc-daemon[1618]: time=2026-09-20T13:36:09.943Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 144.371715] nix-grpc-daemon[1618]: time=2026-09-20T13:36:09.943Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 144.393188] niks3-server[1038]: 2026/09/20 13:36:09 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst worker2 # [ 144.411418] nix-grpc-daemon[1618]: time=2026-09-20T13:36:09.984Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.409932] niks3-server[1038]: 2026/09/20 13:36:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 144.423246] niks3-server[1038]: 2026/09/20 13:36:09 INFO Signed narinfos id=45 count=1 lb # [ 144.429356] niks3-server[1038]: 2026/09/20 13:36:09 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 144.436225] niks3-server[1038]: 2026/09/20 13:36:09 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 144.445785] nix-grpc-daemon[1618]: time=2026-09-20T13:36:10.020Z level=INFO msg="Upload complete. (328ms)" lb # [ 144.446035] niks3-server[1038]: 2026/09/20 13:36:09 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 144.451713] niks3-server[1038]: 2026/09/20 13:36:10 INFO Completed upload id=45 lb # [ 144.454579] niks3-server[1038]: 2026/09/20 13:36:10 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker2 # [ 144.461035] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53342 duration_s=12 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker2 # [ 144.474709] nix-daemon[858]: reaped child process 1687, status = succeeded client # [ 144.504970] systemd[1]: sw.service: Deactivated successfully. client # [ 144.509575] systemd[1]: sw.service: Consumed 157ms CPU time over 13.763s wall clock time, 37.2M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic. worker2 # [ 144.993194] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:10Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.11 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 145.202917] systemd[1]: Starting scheduler-token.service... worker2 # [ 145.226276] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:10Z level=info event=scheduler_yield lb # [ 145.226263] niks3-server[1038]: 2026/09/20 13:36:10 INFO lead: released remote=192.168.1.4:35670 worker1 # [ 145.219257] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:10Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 145.234154] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53326 worker2 # [ 145.239178] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:10Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 145.243837] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:10Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 145.248353] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53326 worker2 # [ 145.252175] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:10Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 145.321090] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 145.325254] systemd[1]: Finished scheduler-token.service. worker2 # [ 145.326565] systemd[1]: scheduler-token.service: Consumed 36ms CPU time over 121ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker1 # [ 145.419290] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.424517] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 145.439952] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 145.446547] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 145.625615] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.630784] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 145.649722] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 145.653876] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 145.831508] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 145.836802] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 145.850251] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 145.855413] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 146.037599] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 146.042441] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 146.056426] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 146.061226] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 146.227576] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:11Z level=info event=scheduler_restarting worker1 # [ 146.245045] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 146.260625] nix-daemon[858]: reaped child process 1590, status = succeeded worker1 # [ 146.249457] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 146.281046] nix-grpc-daemon[1539]: ts=2026-09-20T13:36:11Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 146.445537] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 146.450752] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 146.530693] nix-grpc-daemon[1539]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 146.535485] nix-grpc-daemon[1539]: E0000 00:00:1789911372.104998 1582 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 19, started true, shutdown true worker2 # [ 146.542039] nix-grpc-daemon[1539]: E0000 00:00:1789911372.109743 1582 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 146.651803] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 146.657021] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 146.857718] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 146.862864] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 147.047543] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 147.053643] systemd[1]: nix-grpc-daemon.service: Consumed 853ms CPU time over 28.437s wall clock time, 31.9M memory peak, 25.9K incoming IP traffic, 36.1K outgoing IP traffic. worker2 # [ 147.074460] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 147.063703] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 147.069720] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 147.272175] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:12Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 147.274741] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 147.278896] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 147.271659] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 147.286870] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 147.276217] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 147.295134] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 147.299875] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:12Z level=info event=scheduler_take_over worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.19 seconds) lb # [ 147.298944] niks3-server[1038]: 2026/09/20 13:36:12 INFO lead: acquired remote=192.168.1.4:36622 lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 147.310298] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 147.312293] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1 # [ 147.472161] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 147.477525] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 147.513845] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 147.519038] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 147.678301] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 147.683745] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 147.720398] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 147.725409] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 147.884777] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 147.890761] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 147.926511] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 147.931786] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 148.091436] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.108124] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57604 worker2 # [ 148.113546] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 148.132818] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.145924] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 148.150485] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:57604 worker2 # [ 148.155829] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 17.94 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 148.868008] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 148.882912] nix-daemon[858]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker1 # [ 148.894729] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker2 # [ 148.954896] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:14Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker2 # [ 148.961031] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:14Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 148.966921] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:14Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker2 # [ 148.972455] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:14Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 148.988853] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 149.004405] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 149.019868] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 149.034847] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 149.247256] nix-daemon[835]: accepted connection from pid 1564, user nix-grpc-daemon (trusted) worker1 # [ 149.265047] nix-daemon[835]: reaped child process 1567, status = succeeded worker1 # [ 149.448614] nix-daemon[835]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 149.466100] nix-daemon[835]: reaped child process 1572, status = succeeded lb # [ 149.490258] niks3-server[1038]: 2026/09/20 13:36:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.488196] nix-grpc-daemon[1387]: time=2026-09-20T13:36:15.059Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 149.489638] nix-grpc-daemon[1387]: time=2026-09-20T13:36:15.059Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 149.517893] niks3-server[1038]: 2026/09/20 13:36:15 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 149.515178] nix-grpc-daemon[1387]: time=2026-09-20T13:36:15.087Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.527550] niks3-server[1038]: 2026/09/20 13:36:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 149.535580] niks3-server[1038]: 2026/09/20 13:36:15 INFO Signed narinfos id=46 count=1 lb # [ 149.540636] niks3-server[1038]: 2026/09/20 13:36:15 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 149.548837] niks3-server[1038]: 2026/09/20 13:36:15 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 149.554663] niks3-server[1038]: 2026/09/20 13:36:15 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo lb # [ 149.559342] niks3-server[1038]: 2026/09/20 13:36:15 INFO Completed upload id=46 worker1 # [ 149.548097] nix-grpc-daemon[1387]: time=2026-09-20T13:36:15.120Z level=INFO msg="Upload complete. (495ms)" worker1 # [ 149.555538] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 149.567923] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 149.574139] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 149.578207] nix-daemon[835]: reaped child process 1562, status = succeeded worker1 # [ 149.590409] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) lb # [ 150.391889] envoy[909]: conn peer=[2001:db8:1::1]:42746 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9543 tx=3866 ms=6254 worker1 # [ 150.637420] nix-daemon[835]: reaped child process 1576, status = succeeded worker1 # [ 150.828980] nix-daemon[835]: accepted connection from pid 1591, user nix-grpc-daemon (trusted) worker1 # [ 150.848329] nix-daemon[835]: reaped child process 1594, status = succeeded lb # [ 150.396993] envoy[909]: conn peer=[2001:db8:1::1]:42740 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2939 tx=1353 ms=13493 lb # [ 150.397133] envoy[909]: conn peer=[2001:db8:1::4]:48206 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4556 tx=568 ms=27267 lb # [ 150.871629] niks3-server[1038]: 2026/09/20 13:36:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.880416] nix-grpc-daemon[1387]: time=2026-09-20T13:36:16.451Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.881904] nix-grpc-daemon[1387]: time=2026-09-20T13:36:16.451Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 150.918636] niks3-server[1038]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 150.934363] niks3-server[1038]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 150.942244] niks3-server[1038]: 2026/09/20 13:36:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 150.936722] nix-grpc-daemon[1387]: time=2026-09-20T13:36:16.508Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.949696] niks3-server[1038]: 2026/09/20 13:36:16 INFO Signed narinfos id=47 count=1 lb # [ 150.955229] niks3-server[1038]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 150.964108] niks3-server[1038]: 2026/09/20 13:36:16 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 150.972674] niks3-server[1038]: 2026/09/20 13:36:16 INFO Completed upload id=47 worker1 # [ 150.961141] nix-grpc-daemon[1387]: time=2026-09-20T13:36:16.533Z level=INFO msg="Upload complete. (360ms)" lb # [ 150.975784] niks3-server[1038]: 2026/09/20 13:36:16 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 150.973207] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=1 worker2 # [ 150.989881] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:16Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 150.997160] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:16Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 150.993448] nix-daemon[835]: reaped child process 1574, status = succeeded worker1 # [ 151.021230] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 151.036132] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 151.051209] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 151.065413] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 151.268494] nix-daemon[835]: accepted connection from pid 1598, user nix-grpc-daemon (trusted) worker1 # [ 151.286306] nix-daemon[835]: reaped child process 1601, status = succeeded worker1 # [ 151.463231] nix-daemon[835]: accepted connection from pid 1603, user nix-grpc-daemon (trusted) worker1 # [ 151.479270] nix-daemon[835]: reaped child process 1606, status = succeeded lb # [ 151.505233] niks3-server[1038]: 2026/09/20 13:36:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.502793] nix-grpc-daemon[1387]: time=2026-09-20T13:36:17.074Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.504391] nix-grpc-daemon[1387]: time=2026-09-20T13:36:17.074Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 151.533251] niks3-server[1038]: 2026/09/20 13:36:17 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 151.536315] nix-grpc-daemon[1387]: time=2026-09-20T13:36:17.108Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.550702] niks3-server[1038]: 2026/09/20 13:36:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 151.561430] niks3-server[1038]: 2026/09/20 13:36:17 INFO Signed narinfos id=48 count=1 lb # [ 151.565451] niks3-server[1038]: 2026/09/20 13:36:17 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 151.573181] niks3-server[1038]: 2026/09/20 13:36:17 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete worker1 # [ 151.565852] nix-grpc-daemon[1387]: time=2026-09-20T13:36:17.138Z level=INFO msg="Upload complete. (484ms)" lb # [ 151.578037] niks3-server[1038]: 2026/09/20 13:36:17 INFO Completed upload id=48 lb # [ 151.581444] niks3-server[1038]: 2026/09/20 13:36:17 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 151.572277] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 151.581145] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 151.592198] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 151.597136] nix-daemon[835]: reaped child process 1596, status = succeeded worker1 # [ 151.608161] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 152.652486] nix-daemon[835]: reaped child process 1610, status = succeeded worker1 # [ 152.842079] nix-daemon[835]: accepted connection from pid 1625, user nix-grpc-daemon (trusted) worker1 # [ 152.861295] nix-daemon[835]: reaped child process 1628, status = succeeded lb # [ 152.887772] niks3-server[1038]: 2026/09/20 13:36:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.892437] nix-grpc-daemon[1387]: time=2026-09-20T13:36:18.461Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.893969] nix-grpc-daemon[1387]: time=2026-09-20T13:36:18.461Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 152.942513] niks3-server[1038]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 152.966125] niks3-server[1038]: 2026/09/20 13:36:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 152.960255] nix-grpc-daemon[1387]: time=2026-09-20T13:36:18.531Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.976359] niks3-server[1038]: 2026/09/20 13:36:18 INFO Signed narinfos id=49 count=1 lb # [ 152.978741] niks3-server[1038]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 152.989946] niks3-server[1038]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 152.998975] niks3-server[1038]: 2026/09/20 13:36:18 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 153.005070] niks3-server[1038]: 2026/09/20 13:36:18 INFO Completed upload id=49 worker1 # [ 152.993944] nix-grpc-daemon[1387]: time=2026-09-20T13:36:18.566Z level=INFO msg="Upload complete. (373ms)" lb # [ 153.007374] niks3-server[1038]: 2026/09/20 13:36:18 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker2 # [ 153.014876] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:18Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 153.009668] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=1 worker2 # [ 153.030105] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:18Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 153.031510] nix-daemon[835]: reaped child process 1608, status = succeeded worker1 # [ 153.057317] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 153.077594] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 153.094987] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 153.112192] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 153.365346] nix-daemon[835]: accepted connection from pid 1632, user nix-grpc-daemon (trusted) worker1 # [ 153.386921] nix-daemon[835]: reaped child process 1635, status = succeeded worker1 # [ 153.599271] nix-daemon[835]: accepted connection from pid 1637, user nix-grpc-daemon (trusted) worker1 # [ 153.622063] nix-daemon[835]: reaped child process 1640, status = succeeded lb # [ 153.645916] niks3-server[1038]: 2026/09/20 13:36:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.647094] nix-grpc-daemon[1387]: time=2026-09-20T13:36:19.217Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 153.648776] nix-grpc-daemon[1387]: time=2026-09-20T13:36:19.218Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 153.687834] niks3-server[1038]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst worker1 # [ 153.693177] nix-grpc-daemon[1387]: time=2026-09-20T13:36:19.264Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.708319] niks3-server[1038]: 2026/09/20 13:36:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 153.719309] niks3-server[1038]: 2026/09/20 13:36:19 INFO Signed narinfos id=50 count=1 lb # [ 153.725851] niks3-server[1038]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 153.734835] niks3-server[1038]: 2026/09/20 13:36:19 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 153.742615] niks3-server[1038]: 2026/09/20 13:36:19 INFO Completed upload id=50 worker1 # [ 153.730668] nix-grpc-daemon[1387]: time=2026-09-20T13:36:19.302Z level=INFO msg="Upload complete. (598ms)" lb # [ 153.746327] niks3-server[1038]: 2026/09/20 13:36:19 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 153.741373] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 153.757530] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 153.774374] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 153.782685] nix-daemon[835]: reaped child process 1630, status = succeeded worker1 # [ 153.800746] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 155.031401] nix-daemon[835]: reaped child process 1644, status = succeeded worker1 # [ 155.228455] nix-daemon[835]: accepted connection from pid 1659, user nix-grpc-daemon (trusted) worker1 # [ 155.253269] nix-daemon[835]: reaped child process 1662, status = succeeded lb # [ 155.288451] niks3-server[1038]: 2026/09/20 13:36:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.288955] nix-grpc-daemon[1387]: time=2026-09-20T13:36:20.858Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 155.290535] nix-grpc-daemon[1387]: time=2026-09-20T13:36:20.858Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 155.329477] niks3-server[1038]: 2026/09/20 13:36:20 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 155.353440] niks3-server[1038]: 2026/09/20 13:36:20 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 155.363794] niks3-server[1038]: 2026/09/20 13:36:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 155.359163] nix-grpc-daemon[1387]: time=2026-09-20T13:36:20.930Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.373773] niks3-server[1038]: 2026/09/20 13:36:20 INFO Signed narinfos id=51 count=1 lb # [ 155.378883] niks3-server[1038]: 2026/09/20 13:36:20 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 155.390514] niks3-server[1038]: 2026/09/20 13:36:20 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 155.396950] niks3-server[1038]: 2026/09/20 13:36:20 INFO Completed upload id=51 worker1 # [ 155.385931] nix-grpc-daemon[1387]: time=2026-09-20T13:36:20.958Z level=INFO msg="Upload complete. (369ms)" lb # [ 155.399724] niks3-server[1038]: 2026/09/20 13:36:20 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker2 # [ 155.415923] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:20Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 155.416599] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:20Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 155.403148] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=1 worker1 # [ 155.424488] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 155.437546] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 155.443631] nix-daemon[835]: reaped child process 1642, status = succeeded worker1 # [ 155.459016] nix-grpc-daemon[1387]: time=2026-09-20T13:36:21.031Z level=INFO msg="All 1 paths already cached" worker1 # [ 155.469835] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 155.484217] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 155.735713] nix-daemon[835]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker1 # [ 155.755217] nix-daemon[835]: reaped child process 1669, status = succeeded worker1 # [ 155.962664] nix-daemon[835]: accepted connection from pid 1671, user nix-grpc-daemon (trusted) worker1 # [ 155.980711] nix-daemon[835]: reaped child process 1674, status = succeeded lb # [ 156.008370] niks3-server[1038]: 2026/09/20 13:36:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.010043] nix-grpc-daemon[1387]: time=2026-09-20T13:36:21.581Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 156.011564] nix-grpc-daemon[1387]: time=2026-09-20T13:36:21.581Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 156.048547] niks3-server[1038]: 2026/09/20 13:36:21 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst lb # [ 156.066196] niks3-server[1038]: 2026/09/20 13:36:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker1 # [ 156.063243] nix-grpc-daemon[1387]: time=2026-09-20T13:36:21.635Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.078336] niks3-server[1038]: 2026/09/20 13:36:21 INFO Signed narinfos id=52 count=1 lb # [ 156.084259] niks3-server[1038]: 2026/09/20 13:36:21 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 156.094849] niks3-server[1038]: 2026/09/20 13:36:21 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 156.106488] niks3-server[1038]: 2026/09/20 13:36:21 INFO Completed upload id=52 worker1 # [ 156.095297] nix-grpc-daemon[1387]: time=2026-09-20T13:36:21.667Z level=INFO msg="Upload complete. (592ms)" lb # [ 156.111226] niks3-server[1038]: 2026/09/20 13:36:21 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 156.109606] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 156.121172] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 156.139015] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 156.146188] nix-daemon[835]: reaped child process 1664, status = succeeded worker1 # [ 156.161402] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 157.624963] nix-daemon[835]: reaped child process 1678, status = succeeded worker1 # [ 157.828668] nix-daemon[835]: accepted connection from pid 1693, user nix-grpc-daemon (trusted) worker1 # [ 157.849648] nix-daemon[835]: reaped child process 1696, status = succeeded lb # [ 157.878229] niks3-server[1038]: 2026/09/20 13:36:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.884476] nix-grpc-daemon[1387]: time=2026-09-20T13:36:23.455Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 157.886006] nix-grpc-daemon[1387]: time=2026-09-20T13:36:23.455Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 157.937161] niks3-server[1038]: 2026/09/20 13:36:23 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 157.953875] niks3-server[1038]: 2026/09/20 13:36:23 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 157.965557] niks3-server[1038]: 2026/09/20 13:36:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 157.971601] niks3-server[1038]: 2026/09/20 13:36:23 INFO Signed narinfos id=53 count=1 worker1 # [ 157.958765] nix-grpc-daemon[1387]: time=2026-09-20T13:36:23.530Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.988168] niks3-server[1038]: 2026/09/20 13:36:23 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 158.002286] niks3-server[1038]: 2026/09/20 13:36:23 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls worker1 # [ 157.996652] nix-grpc-daemon[1387]: time=2026-09-20T13:36:23.568Z level=INFO msg="Upload complete. (418ms)" lb # [ 158.010484] niks3-server[1038]: 2026/09/20 13:36:23 INFO Completed upload id=53 worker2 # [ 158.019429] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:23Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 158.009078] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=1 lb # [ 158.028115] niks3-server[1038]: 2026/09/20 13:36:23 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker1 # [ 158.034449] nix-daemon[835]: reaped child process 1676, status = succeeded worker1 # [ 158.054336] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker2 # [ 158.071959] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:23Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 158.074624] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 158.093099] nix-grpc-daemon[1387]: time=2026-09-20T13:36:23.665Z level=INFO msg="All 1 paths already cached" worker1 # [ 158.103990] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 158.123037] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 158.380380] nix-daemon[835]: accepted connection from pid 1700, user nix-grpc-daemon (trusted) worker1 # [ 158.402424] nix-daemon[835]: reaped child process 1703, status = succeeded worker1 # [ 158.606425] nix-daemon[835]: accepted connection from pid 1705, user nix-grpc-daemon (trusted) worker1 # [ 158.629056] nix-daemon[835]: reaped child process 1708, status = succeeded lb # [ 158.651983] niks3-server[1038]: 2026/09/20 13:36:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.660364] nix-grpc-daemon[1387]: time=2026-09-20T13:36:24.232Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.661863] nix-grpc-daemon[1387]: time=2026-09-20T13:36:24.232Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 158.708046] niks3-server[1038]: 2026/09/20 13:36:24 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 158.720622] niks3-server[1038]: 2026/09/20 13:36:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 158.719205] nix-grpc-daemon[1387]: time=2026-09-20T13:36:24.291Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.733367] niks3-server[1038]: 2026/09/20 13:36:24 INFO Signed narinfos id=54 count=1 lb # [ 158.740405] niks3-server[1038]: 2026/09/20 13:36:24 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 158.755036] niks3-server[1038]: 2026/09/20 13:36:24 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker1 # [ 158.750235] nix-grpc-daemon[1387]: time=2026-09-20T13:36:24.322Z level=INFO msg="Upload complete. (606ms)" lb # [ 158.763554] niks3-server[1038]: 2026/09/20 13:36:24 INFO Completed upload id=54 lb # [ 158.769564] niks3-server[1038]: 2026/09/20 13:36:24 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 158.760737] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 158.777737] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 158.794806] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 158.805482] nix-daemon[835]: reaped child process 1698, status = succeeded worker1 # [ 158.816863] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 159.841770] nix-daemon[835]: reaped child process 1712, status = succeeded worker1 # [ 159.999047] nix-daemon[835]: accepted connection from pid 1727, user nix-grpc-daemon (trusted) worker1 # [ 160.016302] nix-daemon[835]: reaped child process 1730, status = succeeded lb # [ 160.043036] niks3-server[1038]: 2026/09/20 13:36:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.044376] nix-grpc-daemon[1387]: time=2026-09-20T13:36:25.615Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 160.045843] nix-grpc-daemon[1387]: time=2026-09-20T13:36:25.615Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 160.079914] niks3-server[1038]: 2026/09/20 13:36:25 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 160.096310] niks3-server[1038]: 2026/09/20 13:36:25 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 160.107098] niks3-server[1038]: 2026/09/20 13:36:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 160.101465] nix-grpc-daemon[1387]: time=2026-09-20T13:36:25.673Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.116286] niks3-server[1038]: 2026/09/20 13:36:25 INFO Signed narinfos id=55 count=1 lb # [ 160.118943] niks3-server[1038]: 2026/09/20 13:36:25 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 160.128103] niks3-server[1038]: 2026/09/20 13:36:25 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 160.136323] niks3-server[1038]: 2026/09/20 13:36:25 INFO Completed upload id=55 worker1 # [ 160.124747] nix-grpc-daemon[1387]: time=2026-09-20T13:36:25.697Z level=INFO msg="Upload complete. (294ms)" lb # [ 160.138980] niks3-server[1038]: 2026/09/20 13:36:25 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker2 # [ 160.145440] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:25Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 160.136928] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=1 worker2 # [ 160.158684] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:25Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 160.151964] nix-daemon[835]: reaped child process 1710, status = succeeded worker1 # [ 160.189286] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 160.204381] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 160.219390] nix-grpc-daemon[1387]: time=2026-09-20T13:36:25.791Z level=INFO msg="All 1 paths already cached" worker1 # [ 160.228345] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 160.241713] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 160.438065] nix-daemon[835]: accepted connection from pid 1734, user nix-grpc-daemon (trusted) worker1 # [ 160.456587] nix-daemon[835]: reaped child process 1737, status = succeeded worker1 # [ 160.628771] nix-daemon[835]: accepted connection from pid 1739, user nix-grpc-daemon (trusted) worker1 # [ 160.647103] nix-daemon[835]: reaped child process 1742, status = succeeded lb # [ 160.670058] niks3-server[1038]: 2026/09/20 13:36:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.667832] nix-grpc-daemon[1387]: time=2026-09-20T13:36:26.239Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 160.669427] nix-grpc-daemon[1387]: time=2026-09-20T13:36:26.239Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 160.696059] niks3-server[1038]: 2026/09/20 13:36:26 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst worker1 # [ 160.697813] nix-grpc-daemon[1387]: time=2026-09-20T13:36:26.269Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.713817] niks3-server[1038]: 2026/09/20 13:36:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 160.723534] niks3-server[1038]: 2026/09/20 13:36:26 INFO Signed narinfos id=56 count=1 lb # [ 160.728714] niks3-server[1038]: 2026/09/20 13:36:26 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls worker1 # [ 160.726002] nix-grpc-daemon[1387]: time=2026-09-20T13:36:26.298Z level=INFO msg="Upload complete. (468ms)" lb # [ 160.737886] niks3-server[1038]: 2026/09/20 13:36:26 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 160.742654] niks3-server[1038]: 2026/09/20 13:36:26 INFO Completed upload id=56 worker1 # [ 160.732216] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 160.745973] niks3-server[1038]: 2026/09/20 13:36:26 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 160.744124] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 160.752303] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 160.755109] nix-daemon[835]: reaped child process 1732, status = succeeded worker1 # [ 160.767353] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 161.812331] nix-daemon[835]: reaped child process 1746, status = succeeded worker1 # [ 161.988633] nix-daemon[835]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 162.004823] nix-daemon[835]: reaped child process 1764, status = succeeded lb # [ 162.031116] niks3-server[1038]: 2026/09/20 13:36:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.032463] nix-grpc-daemon[1387]: time=2026-09-20T13:36:27.601Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 162.034289] nix-grpc-daemon[1387]: time=2026-09-20T13:36:27.601Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 162.070022] niks3-server[1038]: 2026/09/20 13:36:27 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst worker1 # [ 162.073975] nix-grpc-daemon[1387]: time=2026-09-20T13:36:27.645Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.086618] niks3-server[1038]: 2026/09/20 13:36:27 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 162.097536] niks3-server[1038]: 2026/09/20 13:36:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 162.102820] niks3-server[1038]: 2026/09/20 13:36:27 INFO Signed narinfos id=57 count=1 lb # [ 162.110235] niks3-server[1038]: 2026/09/20 13:36:27 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls worker1 # [ 162.103900] nix-grpc-daemon[1387]: time=2026-09-20T13:36:27.676Z level=INFO msg="Upload complete. (326ms)" lb # [ 162.115969] niks3-server[1038]: 2026/09/20 13:36:27 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 162.120475] niks3-server[1038]: 2026/09/20 13:36:27 INFO Completed upload id=57 lb # [ 162.124366] niks3-server[1038]: 2026/09/20 13:36:27 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker2 # [ 162.126180] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:27Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 162.117152] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=1 worker2 # [ 162.138695] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:27Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 162.136322] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 162.144538] nix-daemon[835]: reaped child process 1744, status = succeeded worker1 # [ 162.152495] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 162.164576] nix-grpc-daemon[1387]: time=2026-09-20T13:36:27.736Z level=INFO msg="All 2 paths already cached" worker1 # [ 162.173907] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 162.187395] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 162.377350] nix-daemon[835]: accepted connection from pid 1768, user nix-grpc-daemon (trusted) worker1 # [ 162.396774] nix-daemon[835]: reaped child process 1771, status = succeeded worker1 # [ 162.566365] nix-daemon[835]: accepted connection from pid 1773, user nix-grpc-daemon (trusted) worker1 # [ 162.582915] nix-daemon[835]: reaped child process 1776, status = succeeded lb # [ 162.606834] niks3-server[1038]: 2026/09/20 13:36:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.604563] nix-grpc-daemon[1387]: time=2026-09-20T13:36:28.176Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 162.606052] nix-grpc-daemon[1387]: time=2026-09-20T13:36:28.176Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 162.635860] niks3-server[1038]: 2026/09/20 13:36:28 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 162.636409] nix-grpc-daemon[1387]: time=2026-09-20T13:36:28.208Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.649133] niks3-server[1038]: 2026/09/20 13:36:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 162.658582] niks3-server[1038]: 2026/09/20 13:36:28 INFO Signed narinfos id=58 count=1 lb # [ 162.668214] niks3-server[1038]: 2026/09/20 13:36:28 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete worker1 # [ 162.663066] nix-grpc-daemon[1387]: time=2026-09-20T13:36:28.235Z level=INFO msg="Upload complete. (461ms)" lb # [ 162.676927] niks3-server[1038]: 2026/09/20 13:36:28 INFO Completed upload id=58 lb # [ 162.681944] niks3-server[1038]: 2026/09/20 13:36:28 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls worker1 # [ 162.670879] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 162.686164] niks3-server[1038]: 2026/09/20 13:36:28 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 162.676633] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 162.685395] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 162.689831] nix-daemon[835]: reaped child process 1766, status = succeeded worker1 # [ 162.702421] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 163.735084] nix-daemon[835]: reaped child process 1780, status = succeeded worker1 # [ 163.901885] nix-daemon[835]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker1 # [ 163.921220] nix-daemon[835]: reaped child process 1798, status = succeeded lb # [ 163.947125] niks3-server[1038]: 2026/09/20 13:36:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.946767] nix-grpc-daemon[1387]: time=2026-09-20T13:36:29.517Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.948406] nix-grpc-daemon[1387]: time=2026-09-20T13:36:29.517Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 163.987459] niks3-server[1038]: 2026/09/20 13:36:29 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst worker1 # [ 163.987086] nix-grpc-daemon[1387]: time=2026-09-20T13:36:29.559Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.002972] niks3-server[1038]: 2026/09/20 13:36:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 164.011517] niks3-server[1038]: 2026/09/20 13:36:29 INFO Signed narinfos id=59 count=1 lb # [ 164.015292] niks3-server[1038]: 2026/09/20 13:36:29 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 164.023135] niks3-server[1038]: 2026/09/20 13:36:29 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 164.028403] niks3-server[1038]: 2026/09/20 13:36:29 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 164.033098] niks3-server[1038]: 2026/09/20 13:36:29 INFO Completed upload id=59 worker1 # [ 164.021347] nix-grpc-daemon[1387]: time=2026-09-20T13:36:29.593Z level=INFO msg="Upload complete. (308ms)" lb # [ 164.035385] niks3-server[1038]: 2026/09/20 13:36:29 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker2 # [ 164.042765] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:29Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 164.032979] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=1 worker1 # [ 164.047954] nix-daemon[835]: reaped child process 1778, status = succeeded worker1 # [ 164.085398] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 164.100435] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 164.115838] nix-grpc-daemon[1387]: time=2026-09-20T13:36:29.688Z level=INFO msg="All 2 paths already cached" worker1 # [ 164.124867] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 164.138454] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 164.346448] nix-daemon[835]: accepted connection from pid 1802, user nix-grpc-daemon (trusted) worker1 # [ 164.364409] nix-daemon[835]: reaped child process 1805, status = succeeded worker1 # [ 164.541254] nix-daemon[835]: accepted connection from pid 1807, user nix-grpc-daemon (trusted) worker1 # [ 164.558500] nix-daemon[835]: reaped child process 1810, status = succeeded lb # [ 164.580983] niks3-server[1038]: 2026/09/20 13:36:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.579038] nix-grpc-daemon[1387]: time=2026-09-20T13:36:30.151Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 164.580596] nix-grpc-daemon[1387]: time=2026-09-20T13:36:30.151Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 164.609433] niks3-server[1038]: 2026/09/20 13:36:30 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 164.608035] nix-grpc-daemon[1387]: time=2026-09-20T13:36:30.180Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.624509] niks3-server[1038]: 2026/09/20 13:36:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 164.634634] niks3-server[1038]: 2026/09/20 13:36:30 INFO Signed narinfos id=60 count=1 lb # [ 164.638892] niks3-server[1038]: 2026/09/20 13:36:30 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 164.646746] niks3-server[1038]: 2026/09/20 13:36:30 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 164.634821] nix-grpc-daemon[1387]: time=2026-09-20T13:36:30.207Z level=INFO msg="Upload complete. (480ms)" worker1 # [ 164.640412] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 164.652937] niks3-server[1038]: 2026/09/20 13:36:30 INFO Completed upload id=60 lb # [ 164.656842] niks3-server[1038]: 2026/09/20 13:36:30 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 164.648709] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 164.658411] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 164.662786] nix-daemon[835]: reaped child process 1800, status = succeeded worker1 # [ 164.674723] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 165.511523] nix-daemon[835]: reaped child process 1814, status = succeeded worker1 # [ 165.689612] nix-daemon[835]: accepted connection from pid 1829, user nix-grpc-daemon (trusted) worker1 # [ 165.707581] nix-daemon[835]: reaped child process 1832, status = succeeded lb # [ 165.735058] niks3-server[1038]: 2026/09/20 13:36:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.734773] nix-grpc-daemon[1387]: time=2026-09-20T13:36:31.304Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.736345] nix-grpc-daemon[1387]: time=2026-09-20T13:36:31.305Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 165.770744] niks3-server[1038]: 2026/09/20 13:36:31 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 165.783550] niks3-server[1038]: 2026/09/20 13:36:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 165.777628] nix-grpc-daemon[1387]: time=2026-09-20T13:36:31.349Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.793762] niks3-server[1038]: 2026/09/20 13:36:31 INFO Signed narinfos id=61 count=1 lb # [ 165.800197] niks3-server[1038]: 2026/09/20 13:36:31 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 165.808688] niks3-server[1038]: 2026/09/20 13:36:31 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 165.816745] niks3-server[1038]: 2026/09/20 13:36:31 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 165.821534] niks3-server[1038]: 2026/09/20 13:36:31 INFO Completed upload id=61 worker1 # [ 165.809552] nix-grpc-daemon[1387]: time=2026-09-20T13:36:31.381Z level=INFO msg="Upload complete. (326ms)" lb # [ 165.823600] niks3-server[1038]: 2026/09/20 13:36:31 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker2 # [ 165.829281] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:31Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 165.821098] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=1 worker1 # [ 165.837225] nix-daemon[835]: reaped child process 1812, status = succeeded worker1 # [ 165.869606] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 165.885644] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 165.900710] nix-grpc-daemon[1387]: time=2026-09-20T13:36:31.472Z level=INFO msg="All 2 paths already cached" worker1 # [ 165.909598] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 165.923626] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 166.124441] nix-daemon[835]: accepted connection from pid 1836, user nix-grpc-daemon (trusted) worker1 # [ 166.140510] nix-daemon[835]: reaped child process 1839, status = succeeded worker1 # [ 166.318066] nix-daemon[835]: accepted connection from pid 1841, user nix-grpc-daemon (trusted) worker1 # [ 166.334548] nix-daemon[835]: reaped child process 1844, status = succeeded lb # [ 166.357017] niks3-server[1038]: 2026/09/20 13:36:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.354824] nix-grpc-daemon[1387]: time=2026-09-20T13:36:31.926Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 166.356399] nix-grpc-daemon[1387]: time=2026-09-20T13:36:31.926Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 166.384658] niks3-server[1038]: 2026/09/20 13:36:31 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 166.387695] nix-grpc-daemon[1387]: time=2026-09-20T13:36:31.959Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.399244] niks3-server[1038]: 2026/09/20 13:36:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 166.406467] niks3-server[1038]: 2026/09/20 13:36:31 INFO Signed narinfos id=62 count=1 lb # [ 166.414245] niks3-server[1038]: 2026/09/20 13:36:31 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 166.423278] niks3-server[1038]: 2026/09/20 13:36:31 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 166.430185] niks3-server[1038]: 2026/09/20 13:36:31 INFO Completed upload id=62 worker1 # [ 166.418581] nix-grpc-daemon[1387]: time=2026-09-20T13:36:31.990Z level=INFO msg="Upload complete. (478ms)" lb # [ 166.432319] niks3-server[1038]: 2026/09/20 13:36:31 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 166.427433] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 166.439046] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 166.445565] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 166.450536] nix-daemon[835]: reaped child process 1834, status = succeeded worker1 # [ 166.463419] nix-daemon[835]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker1 # [ 167.495193] nix-daemon[835]: reaped child process 1848, status = succeeded worker1 # [ 167.659348] nix-daemon[835]: accepted connection from pid 1863, user nix-grpc-daemon (trusted) worker1 # [ 167.675339] nix-daemon[835]: reaped child process 1866, status = succeeded lb # [ 167.706060] niks3-server[1038]: 2026/09/20 13:36:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.703846] nix-grpc-daemon[1387]: time=2026-09-20T13:36:33.274Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 167.705800] nix-grpc-daemon[1387]: time=2026-09-20T13:36:33.274Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 167.737179] niks3-server[1038]: 2026/09/20 13:36:33 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 167.753801] niks3-server[1038]: 2026/09/20 13:36:33 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 167.768303] niks3-server[1038]: 2026/09/20 13:36:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign worker1 # [ 167.762979] nix-grpc-daemon[1387]: time=2026-09-20T13:36:33.334Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.777822] niks3-server[1038]: 2026/09/20 13:36:33 INFO Signed narinfos id=63 count=1 lb # [ 167.784518] niks3-server[1038]: 2026/09/20 13:36:33 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 167.792770] niks3-server[1038]: 2026/09/20 13:36:33 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete worker1 # [ 167.787210] nix-grpc-daemon[1387]: time=2026-09-20T13:36:33.359Z level=INFO msg="Upload complete. (314ms)" lb # [ 167.800965] niks3-server[1038]: 2026/09/20 13:36:33 INFO Completed upload id=63 lb # [ 167.805099] niks3-server[1038]: 2026/09/20 13:36:33 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 167.801297] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54420 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=1 worker1 # [ 167.818983] nix-daemon[835]: reaped child process 1846, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.28 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 168.049496] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics client # Running as unit: gpu.service; invocation ID: 66bdf27603e948328bf06ceec67e2752 client # [ 168.286190] nix[1343]: don't know how to build these paths: client # [ 168.288078] nix[1343]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker1 # [ 168.269939] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54420 worker1 # [ 168.277612] nix-grpc-daemon[1295]: ts=2026-09-20T13:36:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 client # [ 168.315868] nix[1343]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker worker2 # [ 168.312682] nix-grpc-daemon[1883]: ts=2026-09-20T13:36:33Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 170.392578] envoy[909]: conn peer=[2001:db8:1::1]:59570 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27178 tx=10697 ms=18968 client # [ 198.325700] nix[1343]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu} client # [ 198.343841] nix[1343]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 198.397612] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 198.407742] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 198.410972] systemd[1]: gpu.service: Consumed 178ms CPU time over 30.354s wall clock time, 33.2M memory peak, 6.7K incoming IP traffic, 5.8K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.39 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 50.58 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.14 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' lb # [ 200.394920] envoy[909]: conn peer=[2001:db8:1::1]:42066 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=30068 worker1 # [ 200.405569] nix-grpc-daemon[1295]: ts=2026-09-20T13:37:05Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 worker1 # [ 201.691637] nix-grpc-daemon[1295]: ts=2026-09-20T13:37:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54420 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 201.703939] nix-grpc-daemon[1295]: ts=2026-09-20T13:37:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54420 worker2 # [ 201.750210] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:07Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 201.751128] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:07Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 201.794067] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 201.816195] nix-grpc-daemon[1883]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 1/5) worker2 # [ 201.895521] nix-grpc-daemon[1883]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 2/5) worker2 # [ 201.979949] nix-grpc-daemon[1883]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 305 ms (attempt 3/5) worker2 # [ 202.285427] nix-grpc-daemon[1883]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 375 ms (attempt 4/5) worker2 # [ 202.661653] nix-grpc-daemon[1883]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 202.682113] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57608 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 202.700000] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 202.717737] nix-daemon[858]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker2 # [ 202.751133] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:08Z level=info event=niks3_push_started pid=1969 worker2 # [ 202.972407] nix-grpc-daemon[1969]: time=2026-09-20T13:37:08.546Z level=INFO msg="Configuring client TLS" cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.pem key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/worker2.key ca="" worker2 # [ 203.147727] nix-daemon[858]: accepted connection from pid 1982, user nix-grpc-daemon (trusted) worker2 # [ 203.165614] nix-daemon[858]: reaped child process 1985, status = succeeded worker2 # [ 203.336958] nix-daemon[858]: accepted connection from pid 1987, user nix-grpc-daemon (trusted) worker2 # [ 203.355696] nix-daemon[858]: reaped child process 1990, status = succeeded lb # [ 203.369243] niks3-server[1038]: 2026/09/20 13:37:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 203.380067] nix-grpc-daemon[1969]: time=2026-09-20T13:37:08.953Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 203.381540] nix-grpc-daemon[1969]: time=2026-09-20T13:37:08.953Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 203.410624] niks3-server[1038]: 2026/09/20 13:37:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker2 # [ 203.421636] nix-grpc-daemon[1969]: time=2026-09-20T13:37:08.995Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.424280] niks3-server[1038]: 2026/09/20 13:37:08 INFO Signed narinfos id=64 count=1 lb # [ 203.433241] niks3-server[1038]: 2026/09/20 13:37:08 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 203.441981] niks3-server[1038]: 2026/09/20 13:37:08 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 203.453966] niks3-server[1038]: 2026/09/20 13:37:09 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 203.459218] niks3-server[1038]: 2026/09/20 13:37:09 INFO Completed upload id=64 worker2 # [ 203.459346] nix-grpc-daemon[1969]: time=2026-09-20T13:37:09.033Z level=INFO msg="Upload complete. (482ms)" lb # [ 203.462072] niks3-server[1038]: 2026/09/20 13:37:09 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 203.468311] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57608 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 203.484450] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 203.490836] nix-daemon[858]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker2 # [ 203.496478] nix-daemon[858]: reaped child process 1967, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 203.511345] nix-daemon[858]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-drain worker2 # [ 204.335246] nix-daemon[858]: reaped child process 1994, status = succeeded worker2 # [ 204.496748] nix-daemon[858]: accepted connection from pid 2009, user nix-grpc-daemon (trusted) worker2 # [ 204.515831] nix-daemon[858]: reaped child process 2012, status = succeeded lb # [ 204.527852] niks3-server[1038]: 2026/09/20 13:37:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 204.540432] nix-grpc-daemon[1969]: time=2026-09-20T13:37:10.112Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 204.541920] nix-grpc-daemon[1969]: time=2026-09-20T13:37:10.112Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 204.565665] niks3-server[1038]: 2026/09/20 13:37:10 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 204.576325] niks3-server[1038]: 2026/09/20 13:37:10 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 204.589717] niks3-server[1038]: 2026/09/20 13:37:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 204.596600] niks3-server[1038]: 2026/09/20 13:37:10 INFO Signed narinfos id=65 count=1 worker2 # [ 204.597168] nix-grpc-daemon[1969]: time=2026-09-20T13:37:10.170Z level=INFO msg="Uploading 1 narinfos" lb # [ 204.600373] niks3-server[1038]: 2026/09/20 13:37:10 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 204.611785] niks3-server[1038]: 2026/09/20 13:37:10 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete worker2 # [ 204.617537] nix-grpc-daemon[1969]: time=2026-09-20T13:37:10.192Z level=INFO msg="Upload complete. (296ms)" lb # [ 204.617994] niks3-server[1038]: 2026/09/20 13:37:10 INFO Completed upload id=65 lb # [ 204.620993] niks3-server[1038]: 2026/09/20 13:37:10 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 204.629641] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57608 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=1 worker2 # [ 204.645128] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:10Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker2 # [ 204.650921] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:10Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 204.654952] nix-daemon[858]: reaped child process 1992, status = succeeded worker2 # [ 204.693065] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 204.707562] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 204.722631] nix-grpc-daemon[1969]: time=2026-09-20T13:37:10.297Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 204.732855] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 204.747103] nix-daemon[858]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker2 # [ 204.945604] nix-daemon[858]: accepted connection from pid 2018, user nix-grpc-daemon (trusted) worker2 # [ 204.964270] nix-daemon[858]: reaped child process 2021, status = succeeded worker2 # [ 205.139094] nix-daemon[858]: accepted connection from pid 2023, user nix-grpc-daemon (trusted) worker2 # [ 205.158562] nix-daemon[858]: reaped child process 2026, status = succeeded lb # [ 205.169187] niks3-server[1038]: 2026/09/20 13:37:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.179474] nix-grpc-daemon[1969]: time=2026-09-20T13:37:10.753Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 205.181120] nix-grpc-daemon[1969]: time=2026-09-20T13:37:10.753Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 205.196644] niks3-server[1038]: 2026/09/20 13:37:10 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst lb # [ 205.212483] niks3-server[1038]: 2026/09/20 13:37:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker2 # [ 205.221700] nix-grpc-daemon[1969]: time=2026-09-20T13:37:10.795Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.224746] niks3-server[1038]: 2026/09/20 13:37:10 INFO Signed narinfos id=66 count=1 lb # [ 205.233055] niks3-server[1038]: 2026/09/20 13:37:10 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 205.245213] niks3-server[1038]: 2026/09/20 13:37:10 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 205.251070] niks3-server[1038]: 2026/09/20 13:37:10 INFO Completed upload id=66 worker2 # [ 205.251265] nix-grpc-daemon[1969]: time=2026-09-20T13:37:10.825Z level=INFO msg="Upload complete. (488ms)" lb # [ 205.254285] niks3-server[1038]: 2026/09/20 13:37:10 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 205.260270] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57608 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 205.269013] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 205.279985] nix-daemon[858]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker2 # [ 205.285317] nix-daemon[858]: reaped child process 2016, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 205.298598] nix-daemon[858]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-drain worker2 # [ 206.346070] nix-daemon[858]: reaped child process 2030, status = succeeded worker2 # [ 206.524849] nix-daemon[858]: accepted connection from pid 2045, user nix-grpc-daemon (trusted) worker2 # [ 206.541561] nix-daemon[858]: reaped child process 2048, status = succeeded lb # [ 206.555331] niks3-server[1038]: 2026/09/20 13:37:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 206.565347] nix-grpc-daemon[1969]: time=2026-09-20T13:37:12.138Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 206.566943] nix-grpc-daemon[1969]: time=2026-09-20T13:37:12.138Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 206.583914] niks3-server[1038]: 2026/09/20 13:37:12 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 206.593748] niks3-server[1038]: 2026/09/20 13:37:12 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 206.606833] niks3-server[1038]: 2026/09/20 13:37:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 206.611778] nix-grpc-daemon[1969]: time=2026-09-20T13:37:12.185Z level=INFO msg="Uploading 1 narinfos" lb # [ 206.613803] niks3-server[1038]: 2026/09/20 13:37:12 INFO Signed narinfos id=67 count=1 lb # [ 206.621170] niks3-server[1038]: 2026/09/20 13:37:12 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 206.629853] niks3-server[1038]: 2026/09/20 13:37:12 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 206.636809] niks3-server[1038]: 2026/09/20 13:37:12 INFO Completed upload id=67 worker2 # [ 206.637172] nix-grpc-daemon[1969]: time=2026-09-20T13:37:12.211Z level=INFO msg="Upload complete. (327ms)" lb # [ 206.640164] niks3-server[1038]: 2026/09/20 13:37:12 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 206.653364] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57608 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=1 worker2 # [ 206.666600] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:12Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 206.670435] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:12Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 206.674237] nix-daemon[858]: reaped child process 2028, status = succeeded worker2 # [ 206.700215] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 206.714065] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 206.727792] nix-grpc-daemon[1969]: time=2026-09-20T13:37:12.302Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 206.737747] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 206.751172] nix-daemon[858]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker2 # [ 206.945282] nix-daemon[858]: accepted connection from pid 2054, user nix-grpc-daemon (trusted) worker2 # [ 206.964541] nix-daemon[858]: reaped child process 2057, status = succeeded worker2 # [ 207.136098] nix-daemon[858]: accepted connection from pid 2059, user nix-grpc-daemon (trusted) worker2 # [ 207.150880] nix-daemon[858]: reaped child process 2062, status = succeeded lb # [ 207.165710] niks3-server[1038]: 2026/09/20 13:37:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 207.174592] nix-grpc-daemon[1969]: time=2026-09-20T13:37:12.748Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 207.176127] nix-grpc-daemon[1969]: time=2026-09-20T13:37:12.748Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 207.192245] niks3-server[1038]: 2026/09/20 13:37:12 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 207.204647] nix-grpc-daemon[1969]: time=2026-09-20T13:37:12.778Z level=INFO msg="Uploading 1 narinfos" lb # [ 207.207716] niks3-server[1038]: 2026/09/20 13:37:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 207.217985] niks3-server[1038]: 2026/09/20 13:37:12 INFO Signed narinfos id=68 count=1 lb # [ 207.222535] niks3-server[1038]: 2026/09/20 13:37:12 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 207.230012] niks3-server[1038]: 2026/09/20 13:37:12 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete worker2 # [ 207.234321] nix-grpc-daemon[1969]: time=2026-09-20T13:37:12.808Z level=INFO msg="Upload complete. (468ms)" lb # [ 207.234293] niks3-server[1038]: 2026/09/20 13:37:12 INFO Completed upload id=68 lb # [ 207.237281] niks3-server[1038]: 2026/09/20 13:37:12 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 207.240257] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57608 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 207.253298] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57608 worker2 # [ 207.258590] nix-daemon[858]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker2 # [ 207.263301] nix-daemon[858]: reaped child process 2052, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 207.275959] nix-daemon[858]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-drain worker2 # [ 208.120422] nix-daemon[858]: reaped child process 2066, status = succeeded worker2 # [ 208.295184] nix-daemon[858]: accepted connection from pid 2081, user nix-grpc-daemon (trusted) worker2 # [ 208.313537] nix-daemon[858]: reaped child process 2084, status = succeeded lb # [ 208.331026] niks3-server[1038]: 2026/09/20 13:37:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 208.341815] nix-grpc-daemon[1969]: time=2026-09-20T13:37:13.914Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 208.345404] nix-grpc-daemon[1969]: time=2026-09-20T13:37:13.914Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 208.373934] niks3-server[1038]: 2026/09/20 13:37:13 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst worker2 # [ 208.388057] nix-grpc-daemon[1969]: time=2026-09-20T13:37:13.962Z level=INFO msg="Uploading 1 narinfos" lb # [ 208.390846] niks3-server[1038]: 2026/09/20 13:37:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 208.400814] niks3-server[1038]: 2026/09/20 13:37:13 INFO Signed narinfos id=69 count=1 lb # [ 208.403652] niks3-server[1038]: 2026/09/20 13:37:13 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 208.408960] niks3-server[1038]: 2026/09/20 13:37:13 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 208.419659] niks3-server[1038]: 2026/09/20 13:37:13 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 208.425523] niks3-server[1038]: 2026/09/20 13:37:13 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo lb # [ 208.430178] niks3-server[1038]: 2026/09/20 13:37:13 INFO Completed upload id=69 worker2 # [ 208.430201] nix-grpc-daemon[1969]: time=2026-09-20T13:37:14.004Z level=INFO msg="Upload complete. (345ms)" worker2 # [ 208.445094] nix-grpc-daemon[1883]: ts=2026-09-20T13:37:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57608 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=1 worker2 # [ 208.461884] nix-daemon[858]: reaped child process 2064, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ca.pem&client-cert=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.pem&client-key=/nix/store/1k2a3bdhnmd3p212243kr1xfai6n0fph-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.04 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 209.410525] nix-grpc-daemon[1295]: ts=2026-09-20T13:37:14Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.90 seconds) (finished: run the VM test script, in 211.05 seconds) test script finished in 211.34s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) lb # [ 210.396557] envoy[909]: conn peer=[2001:db8:1::1]:40510 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9506 tx=3912 ms=6751 kill QemuMachine (pid 52) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.22 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh