tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm lb # Disk image does not exist, creating the virtualisation disk image... worker1 # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 51) worker1: QEMU running (pid 50) worker2 # Disk image does not exist, creating the virtualisation disk image... lb # Formatting '/build/vm-state-lb/tmp.pqMcCdx4Qt', fmt=raw size=1073741824 client: QEMU running (pid 49) worker1 # Formatting '/build/vm-state-worker1/tmp.NOgEfWg5LU', fmt=raw size=1073741824 worker2: QEMU running (pid 52) client # Disk image does not exist, creating the virtualisation disk image... worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Formatting '/build/vm-state-worker2/tmp.RzLmHsxsUr', fmt=raw size=1073741824 lb # mke2fs 1.47.4 (6-Mar-2025) client # Formatting '/build/vm-state-client/tmp.LLleIHii58', fmt=raw size=1073741824 (finished: start all VMs, in 0.48 seconds) lb # Discarding device blocks: 0/262144 done client # mke2fs 1.47.4 (6-Mar-2025) client: waiting for unit network-addresses-eth1.service lb # Creating filesystem with 262144 4k blocks and 65536 inodes client # Discarding device blocks: 0/262144 done client: waiting for the VM to finish booting lb # Filesystem UUID: 786c49ae-8289-420c-bba5-9774400483cb client # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done lb # Superblock backups stored on blocks: client # Filesystem UUID: 3d2ad251-c0e5-441f-9f9c-e6b65b15088c worker2 # Discarding device blocks: 0/262144 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # 32768, 98304, 163840, 229376 client # Superblock backups stored on blocks: worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: e2269f16-9a6d-40cf-a9ea-5496e61e819e lb # client # 32768, 98304, 163840, 229376 worker2 # Filesystem UUID: fb6f5575-0a40-4c04-a7b8-b0c52e6f3576 worker1 # Superblock backups stored on blocks: lb # Allocating group tables: 0/8 done client # worker2 # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 lb # Writing inode tables: 0/8 done client # Allocating group tables: 0/8 done worker2 # 32768, 98304, 163840, 229376 worker1 # lb # Creating journal (8192 blocks): done client # Writing inode tables: 0/8 done worker2 # worker1 # Allocating group tables: 0/8 done lb # Writing superblocks and filesystem accounting information: 0/8 done client # Creating journal (8192 blocks): done worker2 # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done lb # client # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done lb # Virtualisation disk image created. client # worker2 # Creating journal (8192 blocks): done client # Virtualisation disk image created. worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # worker1 # worker2 # Virtualisation disk image created. worker1 # Virtualisation disk image created. lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] KASLR enabled lb # [ 0.000000] random: crng init done lb # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Zone ranges: lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA32 empty lb # [ 0.000000] Normal empty lb # [ 0.000000] Device empty lb # [ 0.000000] Movable zone start for each node lb # [ 0.000000] Early memory node ranges lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/hf80c6d06lwc040q6hd4338fw0f5x8bc-nixos-system-lb-test/init regInfo=/nix/store/j7xhxpc23qa8jm0xmjyqz7vk57vrzvr2-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] random: crng init done client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] KASLR enabled worker2 # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] random: crng init done worker2 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/j7xhxpc23qa8jm0xmjyqz7vk57vrzvr2-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Zone ranges: worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] DMA32 empty client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Normal empty client # [ 0.000000] Zone ranges: worker2 # [ 0.000000] DMA32 empty worker1 # [ 0.000000] Device empty worker2 # [ 0.000000] Normal empty lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] Device empty lb # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] DMA32 empty worker1 # [ 0.000000] Early memory node ranges client # [ 0.000000] Normal empty worker2 # [ 0.000000] Movable zone start for each node lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] Device empty worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Early memory node ranges client # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Early memory node ranges lb # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] Policy zone: DMA client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/dh5phwhcmbkhljl79ynwgb5vwa5cwbjb-nixos-system-worker1-test/init regInfo=/nix/store/017mb1sp5dzsmhgicnlfi2m1dqfaydlz-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/h62cvxqbccaqvhayh56ps1gx34979y26-nixos-system-worker2-test/init regInfo=/nix/store/iwqp1884c321zy59dm9fmxhmb9bkh32y-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/017mb1sp5dzsmhgicnlfi2m1dqfaydlz-closure-info/registration", will be passed to user space. client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5dwn502h5kcmk6n9yvgspbhv8xp80kb2-nixos-system-client-test/init regInfo=/nix/store/sbcz10zhdp5zkwimhpbkjc9fxm11nv35-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/iwqp1884c321zy59dm9fmxhmb9bkh32y-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/sbcz10zhdp5zkwimhpbkjc9fxm11nv35-closure-info/registration", will be passed to user space. lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 worker2 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Policy zone: DMA lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] Policy zone: DMA lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000032] arm-pv: using stolen time PV worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000646] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000837] Console: colour dummy device 80x25 client # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000844] printk: legacy console [tty0] enabled worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.001059] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.001065] pid_max: default: 32768 minimum: 301 client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.001141] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.001307] landlock: Up and running. client # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.001310] Yama: becoming mindful. worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.001954] LSM support for eBPF active client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.002124] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.002158] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.003290] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.004059] rcu: Hierarchical SRCU implementation. worker1 # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.004063] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.005223] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.005320] EFI services will not be available. worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.005449] smp: Bringing up secondary CPUs ... worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.005457] smp: Brought up 1 node, 1 CPU client # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.005460] SMP: Total of 1 processors activated. client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.005466] CPU: All CPU(s) started at EL1 worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.005477] CPU features: detected: Branch Target Identification worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.005481] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.005484] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.005488] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.005491] CPU features: detected: Common not Private translations worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 lb # [ 0.005494] CPU features: detected: CRC32 instructions worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.005497] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.005501] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.005504] CPU features: detected: Data independent timing control (DIT) client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.005508] CPU features: detected: E0PD client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.005510] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.000028] arm-pv: using stolen time PV lb # [ 0.005513] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000029] arm-pv: using stolen time PV lb # [ 0.005516] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.000390] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.005520] CPU features: detected: Fine Grained Traps worker1 # [ 0.000572] Console: colour dummy device 80x25 client # [ 0.000028] arm-pv: using stolen time PV worker2 # [ 0.000403] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.000580] printk: legacy console [tty0] enabled worker2 # [ 0.000601] Console: colour dummy device 80x25 lb # [ 0.005524] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.000399] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000609] printk: legacy console [tty0] enabled lb # [ 0.005529] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.000556] Console: colour dummy device 80x25 worker1 # [ 0.000795] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.005532] CPU features: detected: LSE atomic instructions worker1 # [ 0.000802] pid_max: default: 32768 minimum: 301 client # [ 0.000563] printk: legacy console [tty0] enabled worker2 # [ 0.000828] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.005535] CPU features: detected: Privileged Access Never worker2 # [ 0.000835] pid_max: default: 32768 minimum: 301 worker1 # [ 0.000872] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.005537] CPU features: detected: PMUv3 client # [ 0.000759] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.001007] landlock: Up and running. worker2 # [ 0.000903] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.001010] Yama: becoming mindful. client # [ 0.000766] pid_max: default: 32768 minimum: 301 lb # [ 0.005540] CPU features: detected: RAS Extension Support worker2 # [ 0.001037] landlock: Up and running. worker1 # [ 0.001454] LSM support for eBPF active worker2 # [ 0.001040] Yama: becoming mindful. client # [ 0.000841] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.001495] LSM support for eBPF active client # [ 0.001000] landlock: Up and running. lb # [ 0.005542] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.001609] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.001002] Yama: becoming mindful. lb # [ 0.005545] CPU features: detected: Random Number Generator worker2 # [ 0.001646] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.001644] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.001447] LSM support for eBPF active lb # [ 0.005548] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.002803] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.001608] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.001683] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.005551] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.003588] rcu: Hierarchical SRCU implementation. worker2 # [ 0.002908] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.001643] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.003592] rcu: Max phase no-delay instances is 1000. lb # [ 0.005554] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.003690] rcu: Hierarchical SRCU implementation. worker1 # [ 0.004817] fsl-mc MSI: its@8080000 domain created client # [ 0.002805] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.003694] rcu: Max phase no-delay instances is 1000. lb # [ 0.005558] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.004905] EFI services will not be available. client # [ 0.003565] rcu: Hierarchical SRCU implementation. worker2 # [ 0.004885] fsl-mc MSI: its@8080000 domain created lb # [ 0.005599] alternatives: applying system-wide alternatives worker1 # [ 0.004972] smp: Bringing up secondary CPUs ... client # [ 0.003569] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.004974] EFI services will not be available. worker1 # [ 0.004980] smp: Brought up 1 node, 1 CPU client # [ 0.004742] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.005048] smp: Bringing up secondary CPUs ... lb # [ 0.008554] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.004983] SMP: Total of 1 processors activated. client # [ 0.004831] EFI services will not be available. worker2 # [ 0.005056] smp: Brought up 1 node, 1 CPU worker1 # [ 0.004988] CPU: All CPU(s) started at EL1 client # [ 0.004894] smp: Bringing up secondary CPUs ... worker2 # [ 0.005059] SMP: Total of 1 processors activated. client # [ 0.004902] smp: Brought up 1 node, 1 CPU worker1 # [ 0.004999] CPU features: detected: Branch Target Identification worker2 # [ 0.005064] CPU: All CPU(s) started at EL1 lb # [ 0.008769] Memory: 1406564K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) lb # [ 0.009189] devtmpfs: initialized client # [ 0.004906] SMP: Total of 1 processors activated. worker2 # [ 0.005075] CPU features: detected: Branch Target Identification worker1 # [ 0.005004] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.004911] CPU: All CPU(s) started at EL1 lb # [ 0.011021] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.005080] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.004921] CPU features: detected: Branch Target Identification worker1 # [ 0.005007] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.004926] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.011051] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.005083] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.005011] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.011213] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.004929] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.005014] CPU features: detected: Common not Private translations worker2 # [ 0.005087] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.011218] 0 pages in range for non-PLT usage worker1 # [ 0.005017] CPU features: detected: CRC32 instructions lb # [ 0.011219] 508288 pages in range for PLT usage worker2 # [ 0.005090] CPU features: detected: Common not Private translations client # [ 0.004933] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.011327] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.005093] CPU features: detected: CRC32 instructions worker1 # [ 0.005020] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.012087] DMI not present or invalid. client # [ 0.004936] CPU features: detected: Common not Private translations worker2 # [ 0.005096] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.005024] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.004952] CPU features: detected: CRC32 instructions lb # [ 0.015448] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.005100] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.005027] CPU features: detected: Data independent timing control (DIT) lb # [ 0.018060] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.004955] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.005030] CPU features: detected: E0PD worker2 # [ 0.005103] CPU features: detected: Data independent timing control (DIT) client # [ 0.004959] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.018251] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.005106] CPU features: detected: E0PD worker1 # [ 0.005033] CPU features: detected: Enhanced Counter Virtualization client # [ 0.004962] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.005108] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.018444] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.005036] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.004965] CPU features: detected: E0PD lb # [ 0.018466] audit: initializing netlink subsys (disabled) worker2 # [ 0.005111] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.005039] CPU features: detected: Enhanced Virtualization Traps client # [ 0.004968] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.019056] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.005042] CPU features: detected: Fine Grained Traps worker2 # [ 0.005114] CPU features: detected: Enhanced Virtualization Traps client # [ 0.004971] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.019058] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.005117] CPU features: detected: Fine Grained Traps worker1 # [ 0.005046] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.004974] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.019061] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.005051] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.004977] CPU features: detected: Fine Grained Traps worker2 # [ 0.005121] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.019066] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.005054] CPU features: detected: LSE atomic instructions worker2 # [ 0.005126] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.004980] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.019069] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.005057] CPU features: detected: Privileged Access Never worker2 # [ 0.005129] CPU features: detected: LSE atomic instructions worker1 # [ 0.005060] CPU features: detected: PMUv3 worker2 # [ 0.005132] CPU features: detected: Privileged Access Never lb # [ 0.019093] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.005063] CPU features: detected: RAS Extension Support worker2 # [ 0.005135] CPU features: detected: PMUv3 lb # [ 0.019101] cpuidle: using governor ladder lb # [ 0.019107] cpuidle: using governor menu worker1 # [ 0.005065] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.005138] CPU features: detected: RAS Extension Support worker1 # [ 0.005068] CPU features: detected: Random Number Generator worker2 # [ 0.005140] CPU features: detected: RASv1p1 Extension Support lb # [ 0.019295] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.005070] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.005143] CPU features: detected: Random Number Generator lb # [ 0.019310] ASID allocator initialised with 65536 entries lb # [ 0.020446] Serial: AMBA PL011 UART driver worker2 # [ 0.005146] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.005073] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.005149] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.025709] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.005152] CPU features: detected: TLB range maintenance instructions lb # [ 0.025865] printk: console [ttyAMA0] enabled worker2 # [ 0.005156] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.005194] alternatives: applying system-wide alternatives worker2 # [ 0.008204] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.004985] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.004988] CPU features: detected: LSE atomic instructions worker2 # [ 0.008441] Memory: 1406536K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker2 # [ 0.008815] devtmpfs: initialized client # [ 0.004992] CPU features: detected: Privileged Access Never client # [ 0.004994] CPU features: detected: PMUv3 worker2 # [ 0.010644] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.004997] CPU features: detected: RAS Extension Support worker2 # [ 0.010667] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.004999] CPU features: detected: RASv1p1 Extension Support lb # [ 0.143095] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.010860] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.005002] CPU features: detected: Random Number Generator worker1 # [ 0.005076] CPU features: detected: TLB range maintenance instructions lb # [ 0.143111] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.010864] 0 pages in range for non-PLT usage client # [ 0.005005] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.005081] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.143116] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.010865] 508288 pages in range for PLT usage client # [ 0.005008] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.005117] alternatives: applying system-wide alternatives lb # [ 0.143120] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.005011] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.008125] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.143125] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.005015] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.143129] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.005051] alternatives: applying system-wide alternatives worker1 # [ 0.008280] Memory: 1406532K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) lb # [ 0.143133] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.007889] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.008735] devtmpfs: initialized lb # [ 0.143137] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.010492] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.008098] Memory: 1406532K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker1 # [ 0.010515] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.008458] devtmpfs: initialized worker1 # [ 0.010694] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.150360] fbcon: Taking over console client # [ 0.010265] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.150375] ACPI: Interpreter disabled. worker1 # [ 0.010699] 0 pages in range for non-PLT usage worker1 # [ 0.010700] 508288 pages in range for PLT usage client # [ 0.010288] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.010808] pinctrl core: initialized pinctrl subsystem client # [ 0.010457] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.011596] DMI not present or invalid. worker2 # [ 0.010974] pinctrl core: initialized pinctrl subsystem client # [ 0.010462] 0 pages in range for non-PLT usage worker1 # [ 0.014817] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.011677] DMI not present or invalid. client # [ 0.010463] 508288 pages in range for PLT usage client # [ 0.010572] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.014893] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.017013] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.011325] DMI not present or invalid. worker2 # [ 0.017086] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.017209] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.014561] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.017263] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.017407] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.016706] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.017429] audit: initializing netlink subsys (disabled) worker2 # [ 0.017463] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.016891] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.018016] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.017482] audit: initializing netlink subsys (disabled) client # [ 0.017105] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.018018] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.018048] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.017125] audit: initializing netlink subsys (disabled) worker1 # [ 0.018021] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.018050] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.159338] iommu: Default domain type: Translated client # [ 0.017673] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.018026] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.018053] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.159348] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.017676] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.018029] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.018059] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.159683] SCSI subsystem initialized client # [ 0.017679] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.018061] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.018052] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.017684] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.018060] cpuidle: using governor ladder lb # [ 0.161567] usbcore: registered new interface driver usbfs worker2 # [ 0.018086] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.018066] cpuidle: using governor menu client # [ 0.017687] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.161600] usbcore: registered new interface driver hub worker2 # [ 0.018094] cpuidle: using governor ladder worker1 # [ 0.018250] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.018100] cpuidle: using governor menu lb # [ 0.161617] usbcore: registered new device driver usb client # [ 0.017710] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.018264] ASID allocator initialised with 65536 entries client # [ 0.017720] cpuidle: using governor ladder lb # [ 0.161907] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.018283] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.019401] Serial: AMBA PL011 UART driver client # [ 0.017725] cpuidle: using governor menu worker2 # [ 0.018317] ASID allocator initialised with 65536 entries lb # [ 0.161913] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.017911] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.019491] Serial: AMBA PL011 UART driver worker1 # [ 0.024550] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.161922] PTP clock support registered lb # [ 0.161970] EDAC MC: Ver: 3.0.0 client # [ 0.017925] ASID allocator initialised with 65536 entries worker1 # [ 0.024669] printk: console [ttyAMA0] enabled worker2 # [ 0.024636] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.019102] Serial: AMBA PL011 UART driver lb # [ 0.166396] scmi_core: SCMI protocol bus registered worker2 # [ 0.024751] printk: console [ttyAMA0] enabled client # [ 0.024157] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.144064] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.167350] FPGA manager framework client # [ 0.024272] printk: console [ttyAMA0] enabled worker1 # [ 0.144083] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.144219] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.168237] vgaarb: loaded worker2 # [ 0.144235] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.144088] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.168841] clocksource: Switched to clocksource arch_sys_counter client # [ 0.144025] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.144092] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.144241] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.144041] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.144245] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.144096] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.144046] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.144101] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.144250] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.144050] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.144254] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.144105] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.144055] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.144109] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.144258] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.144059] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.144262] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.144064] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.151288] fbcon: Taking over console worker1 # [ 0.151302] ACPI: Interpreter disabled. client # [ 0.144068] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.174749] VFS: Disk quotas dquot_6.6.0 lb # [ 0.174788] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.151519] fbcon: Taking over console worker2 # [ 0.151531] ACPI: Interpreter disabled. lb # [ 0.176399] netfs: FS-Cache loaded client # [ 0.151267] fbcon: Taking over console worker2 # [ 0.153356] iommu: Default domain type: Translated lb # [ 0.176530] pnp: PnP ACPI: disabled client # [ 0.151280] ACPI: Interpreter disabled. worker2 # [ 0.153366] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.155050] SCSI subsystem initialized lb # [ 0.180268] NET: Registered PF_INET protocol family lb # [ 0.180532] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.159364] iommu: Default domain type: Translated worker1 # [ 0.159373] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.158590] iommu: Default domain type: Translated worker1 # [ 0.159727] SCSI subsystem initialized client # [ 0.158598] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.160283] SCSI subsystem initialized worker1 # [ 0.161699] usbcore: registered new interface driver usbfs worker1 # [ 0.161731] usbcore: registered new interface driver hub client # [ 0.160948] usbcore: registered new interface driver usbfs worker1 # [ 0.161755] usbcore: registered new device driver usb worker2 # [ 0.162487] usbcore: registered new interface driver usbfs worker1 # [ 0.162019] pps_core: LinuxPPS API ver. 1 registered client # [ 0.160979] usbcore: registered new interface driver hub worker2 # [ 0.162519] usbcore: registered new interface driver hub client # [ 0.160997] usbcore: registered new device driver usb worker2 # [ 0.162537] usbcore: registered new device driver usb worker1 # [ 0.162025] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.161299] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.162798] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.162035] PTP clock support registered worker1 # [ 0.162082] EDAC MC: Ver: 3.0.0 client # [ 0.161305] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.162804] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.161321] PTP clock support registered worker1 # [ 0.166599] scmi_core: SCMI protocol bus registered worker2 # [ 0.162814] PTP clock support registered client # [ 0.161382] EDAC MC: Ver: 3.0.0 worker2 # [ 0.162861] EDAC MC: Ver: 3.0.0 worker1 # [ 0.167565] FPGA manager framework client # [ 0.165845] scmi_core: SCMI protocol bus registered worker2 # [ 0.167413] scmi_core: SCMI protocol bus registered worker1 # [ 0.168499] vgaarb: loaded client # [ 0.166792] FPGA manager framework worker2 # [ 0.168370] FPGA manager framework worker1 # [ 0.169123] clocksource: Switched to clocksource arch_sys_counter client # [ 0.167700] vgaarb: loaded worker2 # [ 0.169265] vgaarb: loaded client # [ 0.168307] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.170973] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.169898] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.170473] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.171009] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.170498] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.172832] netfs: FS-Cache loaded worker2 # [ 0.172943] pnp: PnP ACPI: disabled worker1 # [ 0.174716] netfs: FS-Cache loaded client # [ 0.172831] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.174839] pnp: PnP ACPI: disabled client # [ 0.172873] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.174545] netfs: FS-Cache loaded client # [ 0.174664] pnp: PnP ACPI: disabled worker1 # [ 0.178653] NET: Registered PF_INET protocol family worker1 # [ 0.178926] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.178434] NET: Registered PF_INET protocol family worker2 # [ 0.178799] NET: Registered PF_INET protocol family client # [ 0.178708] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.179067] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.208413] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.208452] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.208480] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.208549] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.208691] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.208762] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.208794] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.208829] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.216101] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.216128] NET: Registered PF_XDP protocol family lb # [ 0.216144] PCI: CLS 0 bytes, default 64 lb # [ 0.216376] Trying to unpack rootfs image as initramfs... lb # [ 0.227245] kvm [1]: HYP mode not available worker2 # [ 0.207779] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.207819] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.207845] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.208020] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.207916] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.208059] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.208062] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.207008] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.208145] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.208088] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.207048] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.208178] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.208161] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.207076] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.208213] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.208304] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.207153] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.208298] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.208381] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.207295] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.208342] NET: Registered PF_XDP protocol family worker2 # [ 0.208359] PCI: CLS 0 bytes, default 64 worker1 # [ 0.208417] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.207369] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.208589] Trying to unpack rootfs image as initramfs... worker1 # [ 0.208452] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.207402] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.208547] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.207438] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.208603] NET: Registered PF_XDP protocol family client # [ 0.207523] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.208619] PCI: CLS 0 bytes, default 64 client # [ 0.207575] NET: Registered PF_XDP protocol family worker1 # [ 0.208842] Trying to unpack rootfs image as initramfs... client # [ 0.207592] PCI: CLS 0 bytes, default 64 client # [ 0.207805] Trying to unpack rootfs image as initramfs... worker2 # [ 0.223531] kvm [1]: HYP mode not available worker1 # [ 0.226725] kvm [1]: HYP mode not available client # [ 0.225747] kvm [1]: HYP mode not available lb # [ 0.310763] Initialise system trusted keyrings lb # [ 0.311501] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.312757] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.313589] 9p: Installing v9fs 9p2000 file system support client # [ 0.309413] Initialise system trusted keyrings client # [ 0.310138] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.311380] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.312133] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.314448] Initialise system trusted keyrings worker2 # [ 0.315194] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.316454] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.317674] Initialise system trusted keyrings worker2 # [ 0.317222] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.318419] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.341563] Key type asymmetric registered lb # [ 0.341589] Asymmetric key parser 'x509' registered worker1 # [ 0.319719] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.341656] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.343766] io scheduler mq-deadline registered worker1 # [ 0.320491] 9p: Installing v9fs 9p2000 file system support lb # [ 0.343778] io scheduler kyber registered lb # [ 0.352958] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.337873] Key type asymmetric registered lb # [ 0.353548] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.353915] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.353932] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.353943] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.340690] Key type asymmetric registered lb # [ 0.353951] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.340714] Asymmetric key parser 'x509' registered lb # [ 0.353973] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.340781] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.342893] io scheduler mq-deadline registered lb # [ 0.353995] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.342903] io scheduler kyber registered lb # [ 0.354078] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.345926] Asymmetric key parser 'x509' registered lb # [ 0.354088] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.354094] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.346003] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.354099] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.347611] io scheduler mq-deadline registered worker2 # [ 0.347621] io scheduler kyber registered lb # [ 0.354104] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.349185] Key type asymmetric registered worker1 # [ 0.349209] Asymmetric key parser 'x509' registered lb # [ 0.354183] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.349277] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.354615] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.351413] io scheduler mq-deadline registered lb # [ 0.354798] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.351423] io scheduler kyber registered lb # [ 0.354815] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.354843] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.354859] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.355312] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.352451] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.355493] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.355508] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.355536] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.355973] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.353788] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.356153] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.354188] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.358012] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.356169] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.354205] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.356198] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.356638] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.354217] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.361240] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.356817] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.354225] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.359332] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.356832] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.354246] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.356882] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.359704] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.357328] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.359721] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.354268] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.357508] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.362563] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.354337] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.359733] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.357523] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.354346] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.362969] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.357552] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.359741] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.354352] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.362986] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.358000] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.354357] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.359761] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.358181] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.362998] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.354362] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.359787] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.358196] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.363006] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.354418] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.359868] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.358224] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.359878] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.363028] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.358700] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.354850] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.359884] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.355036] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.358880] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.363049] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.359890] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.355052] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.358895] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.363122] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.355082] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.359895] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.358924] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.363131] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.355098] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.358939] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.363137] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.359951] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.355548] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.363142] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.359385] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.360396] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.355732] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.359569] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.360582] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.363147] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.355748] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.360598] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.359598] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.363236] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.355777] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.360628] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.360035] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.363674] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.356226] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.360644] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.360218] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.363860] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.361104] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.360247] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.363876] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.375842] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.361287] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.375862] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.363906] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.360640] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.361303] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.375891] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.363921] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.360818] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.361332] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.364375] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.361790] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.364557] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.364573] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.381281] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.364602] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.381301] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.365058] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.381330] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.381795] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.384615] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.384634] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.385150] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.384664] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.385170] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.385121] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.385201] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.385663] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.388491] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.385846] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.388509] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.385861] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.409107] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.388541] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.409376] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.385890] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.388996] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.409394] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.409423] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.409885] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.410071] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.384384] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.410086] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.384576] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.410115] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.384592] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.410693] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.384625] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.410704] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.385105] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.385291] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.410710] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.385306] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.410755] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.385336] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.410802] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.385791] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.397208] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.410849] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.385975] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.397231] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.385991] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.410896] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.397261] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.386020] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.410942] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.397734] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.397919] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.386469] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.410990] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.386653] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.397934] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.411038] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.386669] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.397963] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.411086] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.386698] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.398414] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.398426] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.386713] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.411134] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.398597] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.398619] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.398612] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.387195] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.411201] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.398635] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.387383] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.398642] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.411248] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.398664] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.387413] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.398658] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.411269] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.399127] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.411291] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.399311] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.399151] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.387864] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.388052] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.399339] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.399326] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.411312] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.388082] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.399368] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.399355] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.411336] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.399371] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.388483] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.411358] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.399825] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.388667] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.400012] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.399838] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.411380] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.400025] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.411402] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.388911] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.400043] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.389164] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.411424] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.400054] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.400439] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.389181] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.400619] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.411445] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.400509] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.389210] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.411468] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.400696] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.400869] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.411490] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.389698] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.401122] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.400725] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.389882] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.411511] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.401116] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.389897] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.411532] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.401297] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.411553] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.389926] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.401547] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.411574] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.390485] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.401825] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.411595] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.418152] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.390496] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.401842] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.411617] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.418184] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.390502] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.401872] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.411638] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.418657] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.390546] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.411660] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker2 # [ 0.402386] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.418844] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.411681] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.402569] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.390592] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.418859] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.411708] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.402584] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.418889] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.390637] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.411718] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.402613] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.419455] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.390683] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.411723] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.403194] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.419466] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.390728] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.403206] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.419472] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.390774] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.403211] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.419516] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.390820] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.403255] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.419563] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.390866] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.403301] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.419609] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.390913] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.403347] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.419655] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.390980] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.403393] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.419701] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.391026] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.403439] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.391048] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.419747] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.403484] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.391070] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.419795] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.403530] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.391091] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.419842] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.391115] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.403576] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.456923] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.419888] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.391136] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.403622] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.391158] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.419964] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.403693] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.391179] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.420009] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.403738] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.391201] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.420031] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.403760] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.391223] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.420052] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.403781] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.391245] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.420073] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.403802] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.391268] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.420097] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.403825] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.391289] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.420119] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.403846] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.391311] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.420140] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.403868] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.391332] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.420162] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.391354] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.403889] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.420183] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.391375] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.403911] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.420205] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.391396] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.403933] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.420227] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.391417] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.403955] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.391439] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.420249] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.403977] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.391461] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.420270] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.403997] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.391488] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.420291] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.404018] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.391497] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.420312] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.404039] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.391501] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.420333] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.404060] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.420354] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.404081] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.420375] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.404102] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.420396] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.404123] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.420418] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker2 # [ 0.404145] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.420439] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.404166] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.420464] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.404192] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.420473] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.404201] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.420478] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.404206] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.452698] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.405364] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.477174] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.479325] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.461721] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.489039] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.491423] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.478440] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.480985] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.482347] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.500988] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.484383] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.481516] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.503959] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.483409] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.505914] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.508204] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.487300] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.489192] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.490316] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.495630] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.518513] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.520250] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.499256] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.501199] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.501722] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.503692] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.501498] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.504186] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.532121] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.512700] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.513668] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.515730] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.515639] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.513568] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.517627] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.544677] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.547129] msm_serial: driver initialized lb # [ 0.547278] SuperH (H)SCI(F) driver initialized lb # [ 0.547333] STM32 USART driver initialized worker2 # [ 0.527577] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.529561] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.525694] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.524850] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.528677] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.526982] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.530465] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.528961] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.532801] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.531036] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.541136] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.549503] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.551147] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.553301] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.551984] msm_serial: driver initialized client # [ 0.552132] SuperH (H)SCI(F) driver initialized client # [ 0.552186] STM32 USART driver initialized worker1 # [ 0.555757] msm_serial: driver initialized worker1 # [ 0.555899] SuperH (H)SCI(F) driver initialized worker1 # [ 0.555952] STM32 USART driver initialized worker2 # [ 0.554093] msm_serial: driver initialized worker2 # [ 0.554226] SuperH (H)SCI(F) driver initialized worker2 # [ 0.554285] STM32 USART driver initialized lb # [ 0.581451] loop: module loaded lb # [ 0.581614] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.582382] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.593443] megasas: 07.734.00.00-rc1 lb # [ 0.594174] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.596306] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.596356] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.597967] Using buffer write method lb # [ 0.598034] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.599752] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.599781] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.586355] loop: module loaded client # [ 0.586522] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.588827] loop: module loaded worker1 # [ 0.589711] loop: module loaded client # [ 0.587253] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.588996] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.589898] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.589709] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.590617] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.620742] Using buffer write method client # [ 0.592857] megasas: 07.734.00.00-rc1 lb # [ 0.620775] Concatenating MTD devices: worker2 # [ 0.594497] megasas: 07.734.00.00-rc1 lb # [ 0.620779] (0): "0.flash" lb # [ 0.620783] (1): "0.flash" client # [ 0.593631] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.620787] into device "0.flash" worker2 # [ 0.595248] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.595876] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.597457] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.595900] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.597477] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.597749] megasas: 07.734.00.00-rc1 worker1 # [ 0.598451] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.600671] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.600699] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.602272] Using buffer write method worker1 # [ 0.602350] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.605257] Using buffer write method worker2 # [ 0.606917] Using buffer write method worker1 # [ 0.604106] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.605319] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.606990] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.604164] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.608250] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.609839] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.608276] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.609871] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.623088] Using buffer write method worker1 # [ 0.623122] Concatenating MTD devices: worker1 # [ 0.623127] (0): "0.flash" client # [ 0.622241] Using buffer write method worker1 # [ 0.623131] (1): "0.flash" worker2 # [ 0.623758] Using buffer write method worker1 # [ 0.623134] into device "0.flash" client # [ 0.622274] Concatenating MTD devices: worker2 # [ 0.623792] Concatenating MTD devices: client # [ 0.622278] (0): "0.flash" worker2 # [ 0.623796] (0): "0.flash" client # [ 0.622282] (1): "0.flash" worker2 # [ 0.623800] (1): "0.flash" client # [ 0.622285] into device "0.flash" worker2 # [ 0.623803] into device "0.flash" lb # [ 0.836874] Freeing initrd memory: 26140K lb # [ 0.842758] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.846511] thunder_xcv, ver 1.0 lb # [ 0.846554] thunder_bgx, ver 1.0 lb # [ 0.846577] nicpf, ver 1.0 lb # [ 0.847114] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.847122] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.847146] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.847154] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.847184] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.847189] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.847217] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.847223] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.847357] sky2: driver version 1.30 lb # [ 0.849502] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.849527] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.833684] Freeing initrd memory: 26160K lb # [ 0.849722] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.859202] usbcore: registered new interface driver usb-storage lb # [ 0.859295] usbcore: registered new interface driver usbserial_generic lb # [ 0.859310] usbserial: USB Serial support registered for generic lb # [ 0.859903] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.863437] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.839580] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.863782] hub 1-0:1.0: USB hub found lb # [ 0.863802] hub 1-0:1.0: 6 ports detected lb # [ 0.866053] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.843802] Freeing initrd memory: 26148K lb # [ 0.866079] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T13:53:41 UTC (1789998821) lb # [ 0.866407] i2c_dev: i2c /dev entries driver client # [ 0.843163] thunder_xcv, ver 1.0 client # [ 0.843208] thunder_bgx, ver 1.0 client # [ 0.843231] nicpf, ver 1.0 client # [ 0.843786] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.843792] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.846166] Freeing initrd memory: 26148K client # [ 0.843817] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.843824] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.849841] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.843854] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.871365] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.871378] sdhci: Copyright(c) Pierre Ossman client # [ 0.843859] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.871642] Synopsys Designware Multimedia Card Interface Driver client # [ 0.843883] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.872007] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 0.843889] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.844020] sky2: driver version 1.30 worker2 # [ 0.852134] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.876303] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.876545] usbcore: registered new interface driver usbhid lb # [ 0.876552] usbhid: USB HID core driver client # [ 0.852990] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.853018] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.853241] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.853526] thunder_xcv, ver 1.0 worker1 # [ 0.853563] thunder_bgx, ver 1.0 client # [ 0.855920] usbcore: registered new interface driver usb-storage lb # [ 0.879482] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.853585] nicpf, ver 1.0 client # [ 0.856058] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.855911] thunder_xcv, ver 1.0 worker1 # [ 0.854136] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.855957] thunder_bgx, ver 1.0 lb # [ 0.882062] drop_monitor: Initializing network drop monitor service client # [ 0.856074] usbserial: USB Serial support registered for generic worker2 # [ 0.855980] nicpf, ver 1.0 worker1 # [ 0.854143] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.882241] NET: Registered PF_INET6 protocol family worker2 # [ 0.856531] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.854167] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.856538] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.884116] Segment Routing with IPv6 worker1 # [ 0.854175] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.858942] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.884135] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.856562] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.854204] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.884164] NET: Registered PF_PACKET protocol family worker2 # [ 0.856570] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.854210] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.856600] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.854236] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.860451] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.856605] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 0.854242] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.854372] sky2: driver version 1.30 client # [ 0.860475] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T13:53:41 UTC (1789998821) worker2 # [ 0.856629] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.860771] i2c_dev: i2c /dev entries driver worker1 # [ 0.855946] usbcore: registered new interface driver usb-storage worker2 # [ 0.856635] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.856766] sky2: driver version 1.30 worker1 # [ 0.856030] usbcore: registered new interface driver usbserial_generic lb # [ 0.885955] 9pnet: Installing 9P2000 support worker2 # [ 0.858608] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.887943] Key type dns_resolver registered worker1 # [ 0.856045] usbserial: USB Serial support registered for generic worker2 # [ 0.858654] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.856622] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.857833] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.858862] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.857859] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.858125] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.865570] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.868511] usbcore: registered new interface driver usb-storage worker1 # [ 0.869515] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.865580] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.868596] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.869830] hub 1-0:1.0: USB hub found client # [ 0.865841] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.869845] hub 1-0:1.0: 6 ports detected worker2 # [ 0.868614] usbserial: USB Serial support registered for generic client # [ 0.866211] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.869201] hv_vmbus: registering driver hyperv_keyboard client # [ 0.867854] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.872771] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.868105] usbcore: registered new interface driver usbhid client # [ 0.868111] usbhid: USB HID core driver worker2 # [ 0.872703] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.872799] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T13:53:41 UTC (1789998821) lb # [ 0.894893] registered taskstats version 1 worker2 # [ 0.873008] hub 1-0:1.0: USB hub found lb # [ 0.895048] Loading compiled-in X.509 certificates worker2 # [ 0.873027] hub 1-0:1.0: 6 ports detected client # [ 0.872698] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.874838] i2c_dev: i2c /dev entries driver client # [ 0.873003] hub 1-0:1.0: USB hub found client # [ 0.873033] hub 1-0:1.0: 6 ports detected worker2 # [ 0.875269] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.875294] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T13:53:41 UTC (1789998821) worker2 # [ 0.875604] i2c_dev: i2c /dev entries driver client # [ 0.875878] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.903287] Demotion targets for Node 0: null client # [ 0.878567] drop_monitor: Initializing network drop monitor service worker1 # [ 0.878030] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.903387] Key type .fscrypt registered client # [ 0.878685] NET: Registered PF_INET6 protocol family worker1 # [ 0.878039] sdhci: Copyright(c) Pierre Ossman lb # [ 0.903393] Key type fscrypt-provisioning registered client # [ 0.880583] Segment Routing with IPv6 worker1 # [ 0.878298] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.903480] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.880464] sdhci: Secure Digital Host Controller Interface driver client # [ 0.880599] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.880473] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.878665] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.903499] ima: Allocated hash algorithm: sha1 client # [ 0.880627] NET: Registered PF_PACKET protocol family lb # [ 0.903518] ima: No architecture policies found worker1 # [ 0.880306] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.880738] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.880545] usbcore: registered new interface driver usbhid worker2 # [ 0.881101] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.880552] usbhid: USB HID core driver lb # [ 0.907383] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.882179] 9pnet: Installing 9P2000 support worker2 # [ 0.885363] hid: raw HID events driver (C) Jiri Kosina client # [ 0.884219] Key type dns_resolver registered worker2 # [ 0.885626] usbcore: registered new interface driver usbhid worker2 # [ 0.885632] usbhid: USB HID core driver worker1 # [ 0.885982] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.887467] drop_monitor: Initializing network drop monitor service worker1 # [ 0.887631] NET: Registered PF_INET6 protocol family worker1 # [ 0.890646] Segment Routing with IPv6 worker2 # [ 0.888401] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.890664] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.889877] drop_monitor: Initializing network drop monitor service worker1 # [ 0.890693] NET: Registered PF_PACKET protocol family worker2 # [ 0.891850] NET: Registered PF_INET6 protocol family worker1 # [ 0.892361] 9pnet: Installing 9P2000 support worker2 # [ 0.892993] Segment Routing with IPv6 worker2 # [ 0.893012] In-situ OAM (IOAM) with IPv6 client # [ 0.891189] registered taskstats version 1 worker2 # [ 0.893041] NET: Registered PF_PACKET protocol family client # [ 0.891343] Loading compiled-in X.509 certificates worker1 # [ 0.895224] Key type dns_resolver registered worker2 # [ 0.894896] 9pnet: Installing 9P2000 support worker2 # [ 0.896925] Key type dns_resolver registered lb # [ 0.924630] clk: Disabling unused clocks client # [ 0.899961] Demotion targets for Node 0: null lb # [ 0.924654] PM: genpd: Disabling unused power domains client # [ 0.900059] Key type .fscrypt registered client # [ 0.900066] Key type fscrypt-provisioning registered client # [ 0.900153] ima: No TPM chip found, activating TPM-bypass! client # [ 0.900172] ima: Allocated hash algorithm: sha1 client # [ 0.900192] ima: No architecture policies found worker1 # [ 0.901551] registered taskstats version 1 worker1 # [ 0.901706] Loading compiled-in X.509 certificates lb # [ 0.928862] Freeing unused kernel memory: 4736K client # [ 0.904231] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.903758] registered taskstats version 1 lb # [ 0.929031] Run /init as init process worker2 # [ 0.903916] Loading compiled-in X.509 certificates worker1 # [ 0.910067] Demotion targets for Node 0: null worker1 # [ 0.910167] Key type .fscrypt registered worker1 # [ 0.910174] Key type fscrypt-provisioning registered worker1 # [ 0.910271] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.910290] ima: Allocated hash algorithm: sha1 worker2 # [ 0.912237] Demotion targets for Node 0: null worker1 # [ 0.910312] ima: No architecture policies found worker2 # [ 0.912337] Key type .fscrypt registered worker2 # [ 0.912343] Key type fscrypt-provisioning registered worker1 # [ 0.914267] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.912434] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.912453] ima: Allocated hash algorithm: sha1 worker2 # [ 0.912474] ima: No architecture policies found worker2 # [ 0.916500] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.943028] systemd[1]: Successfully made /usr/ read-only. client # [ 0.921263] clk: Disabling unused clocks client # [ 0.921287] PM: genpd: Disabling unused power domains client # [ 0.925449] Freeing unused kernel memory: 4736K client # [ 0.925651] Run /init as init process worker1 # [ 0.932815] clk: Disabling unused clocks worker1 # [ 0.932844] PM: genpd: Disabling unused power domains worker1 # [ 0.937072] Freeing unused kernel memory: 4736K worker2 # [ 0.934722] clk: Disabling unused clocks worker1 # [ 0.937849] Run /init as init process worker2 # [ 0.934750] PM: genpd: Disabling unused power domains worker2 # [ 0.939044] Freeing unused kernel memory: 4736K worker2 # [ 0.939249] Run /init as init process client # [ 0.942490] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 0.951409] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 0.956038] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.108918] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.117204] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.117981] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.120384] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.261229] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.277705] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.289262] systemd[1]: Detected virtualization qemu. lb # [ 1.291262] systemd[1]: Detected architecture arm64. lb # [ 1.293108] systemd[1]: Running in initrd. worker1 # [ 1.269499] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.295575] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.270206] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.298417] systemd[1]: Hostname set to . client # [ 1.272607] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.278414] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.278470] systemd[1]: Detected virtualization qemu. client # [ 1.278536] systemd[1]: Detected architecture arm64. worker1 # [ 1.286202] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.278558] systemd[1]: Running in initrd. worker1 # [ 1.298012] systemd[1]: Detected virtualization qemu. client # [ 1.279401] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.299973] systemd[1]: Detected architecture arm64. worker2 # [ 1.290819] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.279658] systemd[1]: Hostname set to . worker1 # [ 1.301872] systemd[1]: Running in initrd. worker2 # [ 1.302671] systemd[1]: Detected virtualization qemu. worker1 # [ 1.304389] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.304552] systemd[1]: Detected architecture arm64. worker2 # [ 1.306416] systemd[1]: Running in initrd. worker1 # [ 1.307217] systemd[1]: Hostname set to . worker2 # [ 1.308740] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.311530] systemd[1]: Hostname set to . lb # [ 1.345159] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.353443] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.354188] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.360529] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.468884] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.473999] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.477212] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.480394] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.610598] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.599822] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.625059] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.630516] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker1 # [ 1.610752] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.628938] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.635624] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.636787] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.637102] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.640408] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker1 # [ 1.642528] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.644226] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.721967] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.731269] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.732440] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.708137] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.733871] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.734925] systemd[1]: Reached target Path Units. lb # [ 1.735729] systemd[1]: Reached target Slice Units. lb # [ 1.736550] systemd[1]: Reached target Swaps. lb # [ 1.737347] systemd[1]: Reached target Timer Units. lb # [ 1.738366] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.739556] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.740652] systemd[1]: Listening on Journal Sockets. lb # [ 1.741702] systemd[1]: Listening on udev Control Socket. lb # [ 1.742702] systemd[1]: Listening on udev Kernel Socket. client # [ 1.718584] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.743669] systemd[1]: Reached target Socket Units. client # [ 1.719768] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.746118] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.721207] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.721242] systemd[1]: Reached target Path Units. client # [ 1.721261] systemd[1]: Reached target Slice Units. client # [ 1.721280] systemd[1]: Reached target Swaps. client # [ 1.721300] systemd[1]: Reached target Timer Units. client # [ 1.721480] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.729428] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.721636] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.721769] systemd[1]: Listening on Journal Sockets. client # [ 1.721898] systemd[1]: Listening on udev Control Socket. client # [ 1.722006] systemd[1]: Listening on udev Kernel Socket. client # [ 1.722028] systemd[1]: Reached target Socket Units. lb # [ 1.756417] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.732861] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.757662] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.736487] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.739786] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.741057] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.740466] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.742594] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.743848] systemd[1]: Reached target Path Units. client # [ 1.741667] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.744741] systemd[1]: Reached target Slice Units. worker1 # [ 1.745701] systemd[1]: Reached target Swaps. lb # [ 1.766292] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.746519] systemd[1]: Reached target Timer Units. worker1 # [ 1.747712] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.748360] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.749282] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.747791] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.749533] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.750712] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.751059] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.751982] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.752084] systemd[1]: Reached target Path Units. worker2 # [ 1.752869] systemd[1]: Reached target Slice Units. worker1 # [ 1.753298] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.753679] systemd[1]: Reached target Swaps. worker1 # [ 1.754426] systemd[1]: Reached target Socket Units. worker2 # [ 1.754494] systemd[1]: Reached target Timer Units. worker2 # [ 1.755451] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.756730] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.757495] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.757816] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.758859] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.758977] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.759001] systemd[1]: Reached target Socket Units. worker2 # [ 1.763018] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.786837] systemd[1]: Starting Journal Service... worker1 # [ 1.768898] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.766982] systemd[1]: Starting Journal Service... worker1 # [ 1.770435] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.773214] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.797202] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.774525] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.797311] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.780045] systemd[1]: Starting Load Kernel Modules... client # [ 1.781139] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.782807] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.787471] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.813410] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.789493] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.802278] systemd[1]: Starting Journal Service... worker1 # [ 1.809369] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.810150] systemd[1]: Starting Journal Service... worker1 # [ 1.810499] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.814068] systemd[1]: Starting Load Kernel Modules... lb # [ 1.837673] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.814993] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.812523] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.813546] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.813817] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.814032] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.819130] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.820659] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.844966] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.845950] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.846244] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.830200] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.831947] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.857330] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.841352] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.838093] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.846204] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.849251] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.850154] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.850456] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.843503] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.856389] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.881868] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.859512] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.866115] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.867578] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.870384] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.872624] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.872852] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.872861] [drm] features: -context_init client # [ 1.873546] [drm] number of scanouts: 1 lb # [ 1.899662] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.873564] [drm] number of cap sets: 0 worker2 # [ 1.876405] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.902029] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.877418] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.873697] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.904461] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.879790] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.878325] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.878557] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.878567] [drm] features: -context_init worker1 # [ 1.879268] [drm] number of scanouts: 1 worker1 # [ 1.879286] [drm] number of cap sets: 0 worker2 # [ 1.884962] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 1.889363] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.892701] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.892719] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.916967] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.921426] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 1.921673] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 1.921683] [drm] features: -context_init worker2 # [ 1.897967] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.922380] [drm] number of scanouts: 1 worker1 # [ 1.901556] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.902498] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 1.922399] [drm] number of cap sets: 0 worker2 # [ 1.902728] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.902738] [drm] features: -context_init worker2 # [ 1.903422] [drm] number of scanouts: 1 worker2 # [ 1.903440] [drm] number of cap sets: 0 worker1 # [ 1.906295] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.906316] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 1.917736] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.922555] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.925719] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.944981] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 1.945000] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 1.920585] Console: switching to colour frame buffer device 160x50 worker2 # [ 1.924975] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.927332] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.924996] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.932024] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.956958] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.957130] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.957158] systemd[1]: Reached target Local File Systems. client # [ 1.936956] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.937146] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.937179] systemd[1]: Reached target Local File Systems. worker1 # [ 1.937404] Console: switching to colour frame buffer device 160x50 lb # [ 1.965295] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.944661] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.973064] Console: switching to colour frame buffer device 160x50 worker2 # [ 1.954177] Console: switching to colour frame buffer device 160x50 client # [ 1.960515] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.960490] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 1.965703] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 1.972528] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.977245] systemd[1]: Finished Load Kernel Modules. lb # [ 2.001490] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 1.980216] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.979695] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.979895] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.979930] systemd[1]: Reached target Local File Systems. worker2 # [ 1.984805] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.017481] systemd[1]: Finished Load Kernel Modules. lb # [ 2.020415] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.998425] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.001450] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 2.001844] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 2.001881] systemd[1]: Reached target Local File Systems. worker1 # [ 2.006915] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.008989] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.010308] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.037069] systemd[1]: Started Journal Service. lb # [ 2.026994] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.028075] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.032371] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.036377] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.012243] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.041305] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.029595] systemd[1]: Started Journal Service. client # [ 2.016356] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.049242] systemd[1]: Starting Create System Files and Directories... client # [ 2.023896] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.028375] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.045433] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.046505] systemd[1]: Finished Apply Kernel Variables. client # [ 2.032271] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.061313] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker1 # [ 2.050041] systemd[1]: Started Journal Service. client # [ 2.036153] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.042988] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.044266] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.044552] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker1 # [ 2.052281] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.065178] systemd[1]: Started Journal Service. worker1 # [ 2.054392] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.081125] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.057161] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.064327] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.063151] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.061534] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.069409] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.068326] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.069404] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.094211] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.070367] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.071372] systemd[1]: Starting Create System Files and Directories... lb # [ 2.104678] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.079221] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.085687] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 2.089052] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.098968] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker2 # [ 2.113429] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.125207] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.128826] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.157009] systemd[1]: Starting Virtual Console Setup... client # [ 2.135925] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.176100] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.183744] systemd[1]: Starting Virtual Console Setup... lb # [ 2.213863] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.215486] systemd[1]: Finished Virtual Console Setup. client # [ 2.193164] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.195661] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.224433] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.227795] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.232507] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.235709] systemd[1]: Finished Virtual Console Setup. client # [ 2.766088] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.767047] systemd[1]: Reached target System Initialization. client # [ 2.767846] systemd[1]: Reached target Basic System. lb # [ 2.811056] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.812035] systemd[1]: Reached target System Initialization. lb # [ 2.812872] systemd[1]: Reached target Basic System. worker2 # [ 2.831388] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.832666] systemd[1]: Reached target System Initialization. worker2 # [ 2.833488] systemd[1]: Reached target Basic System. worker1 # [ 2.854587] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.856144] systemd[1]: Reached target System Initialization. worker1 # [ 2.860456] systemd[1]: Reached target Basic System. client # [ 2.895770] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.925790] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.935357] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.973866] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.981439] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.985405] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.982477] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.995091] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.002875] (udev-worker)[107]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.037564] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.040551] systemd[1]: Reached target Initrd Root Device. lb # [ 3.043882] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.016271] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.024630] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.021410] systemd[1]: Reached target Initrd Root Device. client # [ 3.025556] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.036137] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.066015] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.067932] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.067356] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.072121] systemd[1]: Reached target Initrd Root Device. lb # [ 3.097447] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.077268] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.102943] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.074871] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.077029] systemd[1]: Mounting /sysroot... lb # [ 3.116290] systemd[1]: Mounting /sysroot... worker1 # [ 3.100692] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.103762] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.106084] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.124649] EXT4-fs (vda): mounted filesystem 3d2ad251-c0e5-441f-9f9c-e6b65b15088c r/w with ordered data mode. Quota mode: none. lb # [ 3.151307] EXT4-fs (vda): mounted filesystem 786c49ae-8289-420c-bba5-9774400483cb r/w with ordered data mode. Quota mode: none. client # [ 3.113923] systemd[1]: Mounted /sysroot. lb # [ 3.143557] systemd[1]: Mounted /sysroot. client # [ 3.116085] systemd[1]: Reached target Initrd Root File System. lb # [ 3.145566] systemd[1]: Reached target Initrd Root File System. lb # [ 3.148110] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.120902] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.125871] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.134438] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.137447] systemd[1]: Mounting /sysroot... lb # [ 3.171548] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.148297] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.151543] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.180117] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.160665] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.156767] systemd[1]: Reloading... lb # [ 3.184244] systemd[1]: Reloading... worker1 # [ 3.167657] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.178661] systemd[1]: Mounting /sysroot... worker2 # [ 3.188899] EXT4-fs (vda): mounted filesystem fb6f5575-0a40-4c04-a7b8-b0c52e6f3576 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.180765] systemd[1]: Mounted /sysroot. worker2 # [ 3.182945] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.188365] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.225664] EXT4-fs (vda): mounted filesystem e2269f16-9a6d-40cf-a9ea-5496e61e819e r/w with ordered data mode. Quota mode: none. worker1 # [ 3.217646] systemd[1]: Mounted /sysroot. worker2 # [ 3.215751] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.221345] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.223224] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.221903] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.227893] systemd[1]: Reloading... worker1 # [ 3.247476] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.251782] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.257507] systemd[1]: Reloading... lb # [ 3.386222] systemd[1]: Reloading finished in 205 ms. client # [ 3.359297] systemd[1]: Reloading finished in 205 ms. lb # [ 3.407235] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... lb # [ 3.411363] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.416712] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.419232] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.396537] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... lb # [ 3.428211] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.401969] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.404920] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.436205] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.409467] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.414569] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.444565] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.416850] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.445672] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.430740] systemd[1]: Reloading finished in 206 ms. client # [ 3.436474] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.437544] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.462186] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.463957] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.469107] systemd[1]: Reloading finished in 214 ms. worker2 # [ 3.469102] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.472131] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.479520] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.480868] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.501262] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.503157] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.503419] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.508205] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.513308] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.518179] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.520717] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.525011] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.549548] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.551012] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.804493] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.779221] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.822465] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.795127] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.826286] systemd[1]: Mounting /sysroot/run... client # [ 3.800095] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.812121] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.841972] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.821357] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.853083] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.830722] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.837427] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.839434] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.843110] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.851000] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.856702] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.858986] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.864933] systemd[1]: Mounting /sysroot/run... client # [ 3.869221] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.877897] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.884696] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.910362] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.886826] systemd[1]: Mounted /sysroot/run. lb # [ 3.918129] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.921177] systemd[1]: Mounted /sysroot/run. lb # [ 3.931413] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.907168] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.933754] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.905414] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.911073] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.940227] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.913505] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.918719] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.922658] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.924521] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.931284] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.934829] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.941059] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.967097] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.968857] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.947067] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.946972] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.947699] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.953369] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.957140] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.964880] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.966209] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.973599] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.977381] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.992348] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 4.002268] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.003345] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.220846] (udev-worker)[95]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.227645] (udev-worker)[95]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.250711] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.277991] (udev-worker)[97]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.253050] systemd[1]: Stopped Virtual Console Setup. client # [ 4.254135] systemd[1]: Stopping Virtual Console Setup... client # [ 4.259830] systemd[1]: Starting Virtual Console Setup... lb # [ 4.286156] (udev-worker)[97]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.280147] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.281228] systemd[1]: Stopped Virtual Console Setup. client # [ 4.283955] systemd[1]: Starting Virtual Console Setup... lb # [ 4.314667] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.320126] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.321243] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.322114] systemd[1]: Starting Virtual Console Setup... client # [ 4.307874] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.338207] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.311380] systemd[1]: Finished Virtual Console Setup. lb # [ 4.339663] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.314660] (udev-worker)[107]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.344255] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.320652] (udev-worker)[107]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory lb # [ 4.367871] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 4.344835] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.371348] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.347959] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.352251] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 4.353085] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.364690] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.366133] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.368344] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.388879] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 4.392383] systemd[1]: Finished Virtual Console Setup. worker1 # [ 4.397522] (udev-worker)[98]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.404140] (udev-worker)[98]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.439231] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.442170] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.442944] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.447751] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.472824] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.476108] systemd[1]: Finished Virtual Console Setup. lb # [ 4.807622] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.780147] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.813403] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.842705] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.845378] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.873752] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.877323] systemd[1]: Reached target Initrd File Systems. client # [ 4.849085] systemd[1]: Reached target Initrd File Systems. lb # [ 4.882245] systemd[1]: Starting Find NixOS closure... client # [ 4.854250] systemd[1]: Starting Find NixOS closure... lb # [ 4.892419] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.864426] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.872486] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.875561] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.884440] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.889010] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.902581] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.908265] systemd[1]: Reached target Initrd File Systems. lb # [ 4.935779] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.940285] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.918400] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.921137] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.918414] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.954004] systemd[1]: Finished Find NixOS closure. client # [ 4.926421] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 4.956559] systemd[1]: Reached target Initrd Default Target. lb # [ 4.959748] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.936662] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.941566] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.940170] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.946469] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.944353] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.959450] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.963029] systemd[1]: Reached target Initrd Default Target. lb # [ 4.990071] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.968867] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.992837] systemd[1]: Stopped target Basic System. worker2 # [ 4.968506] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.996417] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.997574] systemd[1]: Stopped target Path Units. lb # [ 4.999662] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.975647] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.975702] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.004252] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 5.005672] systemd[1]: Stopped target Slice Units. lb # [ 5.006591] systemd[1]: Stopped target Socket Units. lb # [ 5.007472] systemd[1]: Stopped target System Initialization. client # [ 4.980652] systemd[1]: Stopped target Basic System. client # [ 4.981723] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.987251] systemd[1]: Finished Find NixOS closure. client # [ 4.982861] systemd[1]: Stopped target Path Units. lb # [ 5.012247] systemd[1]: Stopped target Swaps. client # [ 4.983861] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 5.013543] systemd[1]: Stopped target Timer Units. worker1 # [ 4.990755] systemd[1]: Reached target Initrd Default Target. lb # [ 5.016128] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 5.017680] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.993104] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.996794] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 5.019858] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.992223] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.996493] systemd[1]: Stopped target Basic System. client # [ 4.993674] systemd[1]: Stopped target Slice Units. client # [ 4.994585] systemd[1]: Stopped target Socket Units. client # [ 4.995493] systemd[1]: Stopped target System Initialization. lb # [ 5.024914] systemd[1]: Stopped Find NixOS closure. client # [ 4.997734] systemd[1]: Stopped target Swaps. worker2 # [ 5.000522] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.002871] systemd[1]: Stopped target Path Units. lb # [ 5.027395] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 4.999744] systemd[1]: Stopped target Timer Units. client # [ 5.004205] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 5.008185] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.005215] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.006177] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 5.009773] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.007384] systemd[1]: Stopped Find NixOS closure. worker2 # [ 5.011293] systemd[1]: Stopped target Slice Units. lb # [ 5.036620] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.037544] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 5.038573] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.013895] systemd[1]: Stopped target Socket Units. worker1 # [ 5.015716] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.039310] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.017675] systemd[1]: Stopped target Basic System. worker2 # [ 5.016155] systemd[1]: Stopped target System Initialization. client # [ 5.013370] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 5.018468] systemd[1]: Stopped target Swaps. worker1 # [ 5.020376] systemd[1]: Stopped target Initrd Root Device. client # [ 5.015456] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.018861] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.024304] systemd[1]: Stopped target Path Units. worker2 # [ 5.024141] systemd[1]: Stopped target Timer Units. worker1 # [ 5.025280] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 5.025195] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 5.026402] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.023218] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.028145] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.027509] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.053779] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.054587] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.032247] systemd[1]: Stopped target Slice Units. lb # [ 5.055796] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.033186] systemd[1]: Stopped target Socket Units. worker1 # [ 5.034093] systemd[1]: Stopped target System Initialization. worker1 # [ 5.036126] systemd[1]: Stopped target Swaps. worker2 # [ 5.036226] systemd[1]: Stopped Find NixOS closure. worker2 # [ 5.037320] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.062521] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.039633] systemd[1]: Stopped target Timer Units. worker2 # [ 5.038469] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 5.039432] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.036140] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.042043] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 5.065304] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.066675] systemd[1]: Stopped target Local File Systems. client # [ 5.039118] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.068251] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.039970] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.046541] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.070659] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.051780] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.075863] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.047609] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 5.076981] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 5.078005] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.049908] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 5.079003] systemd[1]: Stopped Virtual Console Setup. client # [ 5.051818] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.079714] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.081534] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 5.057310] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.054091] systemd[1]: Stopped target Local File Systems. lb # [ 5.082461] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.083443] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.060643] systemd[1]: Stopped Find NixOS closure. lb # [ 5.084377] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.061518] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.056669] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 5.085303] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.062650] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.086280] systemd[1]: systemd-udevd.service: Consumed 1.361s CPU time over 3.109s wall clock time, 22.3M memory peak. client # [ 5.058539] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.063670] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.062668] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 5.087666] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.060227] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.063921] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.068586] systemd[1]: Stopped Load Kernel Modules. client # [ 5.065292] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.069527] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.066297] systemd[1]: Stopped Virtual Console Setup. client # [ 5.067017] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.067915] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 5.096324] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.069005] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.097213] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.069991] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 5.073483] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 5.098446] systemd[1]: Closed udev Control Socket. client # [ 5.070809] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.099163] systemd[1]: Starting Cleanup udev Database... client # [ 5.071704] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 5.076429] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.079504] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.078803] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.104180] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 5.080192] systemd[1]: Stopped target Local File Systems. client # [ 5.076287] systemd[1]: systemd-udevd.service: Consumed 1.343s CPU time over 3.121s wall clock time, 22.4M memory peak. worker1 # [ 5.081931] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 5.105272] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.106115] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.078090] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 5.082375] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.084161] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.107224] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 5.084240] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.086083] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.088114] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.084175] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.112680] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 5.088436] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.085069] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.113655] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.089256] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.090801] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.086030] systemd[1]: Closed udev Control Socket. client # [ 5.086724] systemd[1]: Starting Cleanup udev Database... worker2 # [ 5.090249] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.092194] systemd[1]: Stopped Create System Files and Directories. client # [ 5.087471] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 5.092204] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 5.092990] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 5.093917] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 5.094820] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.096622] systemd[1]: Stopped target Local File Systems. worker2 # [ 5.095814] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.092253] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.097488] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 5.096751] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.093111] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.098445] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 5.097735] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.094178] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 5.098573] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.100159] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.095144] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 5.099474] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.104198] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.100131] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.105278] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.104254] systemd[1]: systemd-udevd.service: Consumed 1.374s CPU time over 3.107s wall clock time, 25.3M memory peak. worker1 # [ 5.106490] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 5.105727] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.108180] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.109486] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 5.108482] systemd[1]: Closed udev Control Socket. worker1 # [ 5.110516] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.111432] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 5.135650] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.112522] systemd[1]: systemd-udevd.service: Consumed 1.430s CPU time over 3.091s wall clock time, 25.4M memory peak. worker2 # [ 5.112205] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.113924] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 5.113040] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.114913] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 5.114099] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.115762] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.140503] systemd[1]: Finished Cleanup udev Database. worker2 # [ 5.116102] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.141299] systemd[1]: Reached target Switch Root. lb # [ 5.141991] systemd[1]: Starting NixOS Activation... worker1 # [ 5.120786] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 5.120187] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 5.121191] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 5.122139] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.124174] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.125353] systemd[1]: Closed udev Control Socket. client # [ 5.121941] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.123033] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.128173] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.128995] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.132180] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.127542] systemd[1]: Reached target Switch Root. worker1 # [ 5.133082] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.128839] systemd[1]: Starting NixOS Activation... worker1 # [ 5.136183] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.137175] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.140277] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.147595] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 5.152511] systemd[1]: Finished Cleanup udev Database. worker2 # [ 5.153270] systemd[1]: Reached target Switch Root. worker2 # [ 5.153950] systemd[1]: Starting NixOS Activation... worker1 # [ 5.163018] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.166528] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.167305] systemd[1]: Reached target Switch Root. worker1 # [ 5.168689] systemd[1]: Starting NixOS Activation... lb # [ 5.302575] initrd-nixos-activation-start[181]: booting system configuration /nix/store/hf80c6d06lwc040q6hd4338fw0f5x8bc-nixos-system-lb-test client # [ 5.285324] initrd-nixos-activation-start[181]: booting system configuration /nix/store/5dwn502h5kcmk6n9yvgspbhv8xp80kb2-nixos-system-client-test worker2 # [ 5.312417] initrd-nixos-activation-start[180]: booting system configuration /nix/store/h62cvxqbccaqvhayh56ps1gx34979y26-nixos-system-worker2-test worker1 # [ 5.332134] initrd-nixos-activation-start[179]: booting system configuration /nix/store/dh5phwhcmbkhljl79ynwgb5vwa5cwbjb-nixos-system-worker1-test lb # [ 5.366798] initrd-nixos-activation-start[181]: running activation script... client # [ 5.347547] initrd-nixos-activation-start[181]: running activation script... worker2 # [ 5.375197] initrd-nixos-activation-start[180]: running activation script... worker1 # [ 5.396664] initrd-nixos-activation-start[179]: running activation script... client # [ 5.752837] initrd-nixos-activation-start[204]: setting up /etc... lb # [ 5.781586] initrd-nixos-activation-start[204]: setting up /etc... worker2 # [ 5.784977] initrd-nixos-activation-start[203]: setting up /etc... worker1 # [ 5.807319] initrd-nixos-activation-start[202]: setting up /etc... client # [ 6.012093] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.014815] systemd[1]: Finished NixOS Activation. client # [ 6.015968] systemd[1]: Starting Switch Root... lb # [ 6.044422] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 6.047135] systemd[1]: Finished NixOS Activation. lb # [ 6.052197] systemd[1]: Starting Switch Root... client # [ 6.039238] systemd[1]: Switching root. worker2 # [ 6.046650] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 6.071412] systemd[1]: Switching root. worker2 # [ 6.049547] systemd[1]: Finished NixOS Activation. worker2 # [ 6.050702] systemd[1]: Starting Switch Root... worker1 # [ 6.069056] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.071807] systemd[1]: Finished NixOS Activation. worker2 # [ 6.071436] systemd[1]: Switching root. worker1 # [ 6.076308] systemd[1]: Starting Switch Root... worker1 # [ 6.095541] systemd[1]: Switching root. client # [ 6.226457] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.251260] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.268799] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.284553] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 6.821897] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.833121] systemd[1]: Detected virtualization qemu. client # [ 6.835863] systemd[1]: Detected architecture arm64. lb # [ 6.853625] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.839348] systemd[1]: Detected first boot. lb # [ 6.865065] systemd[1]: Detected virtualization qemu. lb # [ 6.867760] systemd[1]: Detected architecture arm64. client # [ 6.845929] systemd[1]: Initializing machine ID from random generator. lb # [ 6.871416] systemd[1]: Detected first boot. lb # [ 6.878531] systemd[1]: Initializing machine ID from random generator. worker2 # [ 6.875016] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.886906] systemd[1]: Detected virtualization qemu. worker2 # [ 6.889863] systemd[1]: Detected architecture arm64. worker2 # [ 6.892825] systemd[1]: Detected first boot. worker1 # [ 6.887084] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.899218] systemd[1]: Detected virtualization qemu. worker2 # [ 6.900560] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.902766] systemd[1]: Detected architecture arm64. worker1 # [ 6.904881] systemd[1]: Detected first boot. worker1 # [ 6.911723] systemd[1]: Initializing machine ID from random generator. lb # [ 7.195588] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.171726] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 7.224006] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 7.225008] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.355972] systemd[1]: Applying preset policy. lb # [ 7.380740] systemd[1]: Applying preset policy. worker1 # [ 7.415410] systemd[1]: Applying preset policy. worker2 # [ 7.418540] systemd[1]: Applying preset policy. client # [ 7.831038] systemd[1]: Populated /etc with preset unit settings. lb # [ 7.880187] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.903255] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.905346] systemd[1]: Populated /etc with preset unit settings. client # [ 8.334533] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.335832] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.340178] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.344735] systemd[1]: Created slice Slice /system/getty. client # [ 8.346647] systemd[1]: Created slice User and Session Slice. client # [ 8.348908] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.351245] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.353603] systemd[1]: Expecting device /dev/hvc0... client # [ 8.355477] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.357458] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.358563] systemd[1]: Stopped target initrd-fs.target. client # [ 8.361004] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.362082] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.364542] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.365734] systemd[1]: Reached target Path Units. client # [ 8.368245] systemd[1]: Reached target Remote File Systems. client # [ 8.369316] systemd[1]: Reached target Slice Units. client # [ 8.370730] systemd[1]: Reached target Swaps. client # [ 8.374795] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 8.403946] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.379418] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.405471] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.383239] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 8.407285] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 8.411848] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.388419] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.387097] systemd[1]: Listening on Factory Reset Management. client # [ 8.387498] systemd[1]: Listening on Hostname Service Socket. lb # [ 8.413575] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.389733] systemd[1]: Stopped initrd-switch-root.service. lb # [ 8.414520] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 8.417363] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 8.393194] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.393398] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.418411] systemd[1]: Expecting device /dev/hvc0... client # [ 8.395375] systemd[1]: Listening on Journal Audit Socket. lb # [ 8.419885] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 8.397489] systemd[1]: Created slice Slice /system/getty. lb # [ 8.421491] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 8.399666] systemd[1]: Created slice User and Session Slice. lb # [ 8.423233] systemd[1]: Stopped target initrd-fs.target. client # [ 8.399451] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 8.400927] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 8.424701] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.400051] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 8.426222] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.402883] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.402167] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.404590] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.427803] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.404338] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.429523] systemd[1]: Reached target Path Units. worker2 # [ 8.406133] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.408353] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 8.430907] systemd[1]: Reached target Remote File Systems. worker2 # [ 8.407650] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.432395] systemd[1]: Reached target Slice Units. worker2 # [ 8.409232] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 8.410044] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.410849] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.433897] systemd[1]: Reached target Swaps. worker1 # [ 8.413379] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.412421] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.414108] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.438311] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.415791] systemd[1]: Reached target Path Units. client # [ 8.415250] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.417412] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.417257] systemd[1]: Reached target Remote File Systems. client # [ 8.416710] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.419669] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.418924] systemd[1]: Reached target Slice Units. lb # [ 8.443081] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.418191] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 8.420378] systemd[1]: Reached target Swaps. worker1 # [ 8.420979] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 8.423504] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.422299] systemd[1]: Mounting Huge Pages File System... lb # [ 8.446966] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.424832] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.424839] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 8.426972] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 8.450839] systemd[1]: Listening on Factory Reset Management. client # [ 8.426303] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 8.428013] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.452059] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.429620] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 8.429786] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.431061] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.432570] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.434014] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 8.457897] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.434213] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.434373] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 8.436560] systemd[1]: Reached target Path Units. worker1 # [ 8.437609] systemd[1]: Reached target Remote File Systems. lb # [ 8.459990] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 8.438021] systemd[1]: Listening on Factory Reset Management. worker1 # [ 8.439113] systemd[1]: Reached target Slice Units. worker2 # [ 8.439261] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.441311] systemd[1]: Reached target Swaps. lb # [ 8.464536] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.467000] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.443375] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.445296] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.445244] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.469558] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.447385] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.450308] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.472059] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.451682] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 8.454362] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.454156] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 8.455752] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.458443] systemd[1]: Listening on Factory Reset Management. worker2 # [ 8.457768] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 8.459724] systemd[1]: Listening on Hostname Service Socket. lb # [ 8.483782] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.459230] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.486165] systemd[1]: Listening on udev Control Socket. lb # [ 8.488405] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.466554] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.468294] systemd[1]: Listening on Journal Audit Socket. client # [ 8.467321] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.493270] systemd[1]: Mounting Huge Pages File System... worker2 # [ 8.469494] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 8.469973] systemd[1]: Listening on udev Control Socket. worker2 # [ 8.470339] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.473115] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.471036] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.498481] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 8.475642] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 8.476541] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.478220] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.480678] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 8.480718] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.504949] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 8.486803] systemd[1]: Mounting Kernel Debug File System... client # [ 8.484890] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.487045] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.492490] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.494030] systemd[1]: Listening on udev Control Socket. client # [ 8.491630] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 8.517374] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.496352] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 8.498091] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.500558] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.505234] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 8.529582] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.507159] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.509603] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.513561] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.542651] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 8.522563] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.546554] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.523040] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 8.529452] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 8.533081] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.538305] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.564006] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 8.542568] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.567971] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 8.545600] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 8.570864] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.550022] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 8.549382] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.552161] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.562924] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.586297] systemd[1]: Starting Load Kernel Module fuse... lb # [ 8.591135] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.569397] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.569755] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.570859] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 8.571251] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.581759] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.586489] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.590059] systemd[1]: Starting Journal Service... worker1 # [ 10.414223] systemd[1]: Starting Journal Service... worker2 # [ 10.427724] systemd[1]: Starting Load Kernel Modules... worker1 # [ 10.446777] systemd[1]: Starting Load Kernel Modules... client # [ 10.455236] systemd[1]: Starting Journal Service... lb # [ 10.487273] systemd[1]: Starting Journal Service... worker2 # [ 10.489790] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 10.501621] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 10.502245] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 10.504872] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 10.543675] systemd[1]: Starting Load Kernel Modules... worker1 # [ 10.521990] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 10.526758] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 10.529375] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 10.538560] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 10.543396] systemd[1]: Mounted Huge Pages File System. worker2 # [ 10.544141] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 10.544983] systemd[1]: Mounted Kernel Debug File System. client # [ 10.547354] fuse: init (API version 7.45) client # [ 10.549539] systemd[1]: Starting Load Kernel Modules... worker2 # [ 10.554127] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 10.557011] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 10.557904] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 10.574435] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 10.577556] systemd[1]: Mounted Huge Pages File System. client # [ 10.577045] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 10.602693] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 10.580323] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 10.583524] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 10.587966] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 10.592616] systemd[1]: Mounted Kernel Configuration File System. lb # [ 10.637786] fuse: init (API version 7.45) worker2 # [ 10.617862] systemd[1]: Finished Create List of Static Device Nodes. client # [ 10.618941] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 10.646090] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 10.623515] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 10.646531] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 10.630605] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 10.677145] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 10.653844] systemd[1]: Finished Create List of Static Device Nodes. client # [ 10.660579] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 10.664372] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 10.684961] systemd-journald[275]: Collecting audit messages is enabled. client # [ 10.668102] systemd-journald[275]: Collecting audit messages is enabled. lb # [ 10.700628] systemd[1]: Listening on Journal Log Access Socket. lb # [ 10.691041] systemd[1]: Queued start job for default target Multi-User System. lb # [ 10.693894] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 10.677341] systemd[1]: Queued start job for default target Multi-User System. client # [ 10.678668] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 10.712846] systemd-modules-load[276]: Module 'atkbd' is built in client # [ 10.685567] systemd-modules-load[276]: Module 'atkbd' is built in lb # [ 10.727098] systemd[1]: Started Journal Service. client # [ 10.703091] systemd[1]: Started Journal Service. lb # [ 10.719833] systemd-modules-load[276]: Module 'loop' is built in client # [ 10.692461] systemd-modules-load[276]: Module 'loop' is built in client # [ 10.696548] systemd[1]: Listening on Journal Log Access Socket. lb # [ 10.725018] systemd[1]: Mounted Huge Pages File System. client # [ 10.698317] systemd[1]: Mounted Huge Pages File System. lb # [ 10.728950] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 10.718610] EXT4-fs (vda): re-mounted fb6f5575-0a40-4c04-a7b8-b0c52e6f3576. client # [ 10.705103] systemd[1]: Mounted POSIX Message Queue File System. client # [ 10.707106] systemd[1]: Mounted Kernel Debug File System. lb # [ 10.735101] systemd[1]: Mounted Kernel Debug File System. lb # [ 10.741422] systemd[1]: Mounted Kernel Trace File System. client # [ 10.716737] systemd[1]: Mounted Kernel Trace File System. client # [ 10.717682] systemd[1]: Finished Create List of Static Device Nodes. client # [ 10.718732] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 10.719841] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 10.737446] systemd[1]: Finished Load Kernel Modules. lb # [ 10.750867] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 10.751866] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 10.744959] systemd[1]: Starting Firewall... worker1 # [ 10.745401] EXT4-fs (vda): re-mounted e2269f16-9a6d-40cf-a9ea-5496e61e819e. lb # [ 10.760949] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 10.732768] systemd[1]: Mounted Kernel Configuration File System. lb # [ 10.761866] systemd[1]: Mounted Kernel Configuration File System. lb # [ 10.762729] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 10.763647] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 10.753028] systemd[1]: Starting Apply Kernel Variables... client # [ 10.737353] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 10.758967] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 10.761510] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 10.762279] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 10.747077] systemd[1]: Finished Load Kernel Module fuse. client # [ 10.747917] systemd[1]: Finished Load Kernel Modules. worker1 # [ 10.765074] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 10.764055] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 10.777523] systemd[1]: Finished Load Kernel Modules. worker1 # [ 10.772799] systemd[1]: Finished Load Kernel Modules. worker2 # [ 10.777177] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 10.779480] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 10.781482] systemd[1]: Starting Firewall... worker2 # [ 10.786674] systemd-journald[274]: Collecting audit messages is enabled. worker1 # [ 10.790407] systemd[1]: Starting Apply Kernel Variables... client # [ 10.775279] systemd[1]: Mounting FUSE Control File System... client # [ 10.779474] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 10.795807] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 10.798463] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 10.797362] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 10.798060] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 10.812175] systemd[1]: Mounting FUSE Control File System... worker1 # [ 10.798463] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 10.800461] EXT4-fs (vda): re-mounted 3d2ad251-c0e5-441f-9f9c-e6b65b15088c. lb # [ 10.836994] EXT4-fs (vda): re-mounted 786c49ae-8289-420c-bba5-9774400483cb. worker1 # [ 10.816495] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 10.828202] systemd[1]: Starting Firewall... worker1 # [ 10.820006] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 10.804826] systemd-oomd[277]: No swap; memory pressure usage will be degraded worker2 # [ 10.821626] systemd[1]: Started Journal Service. worker1 # [ 10.825760] systemd-journald[273]: Collecting audit messages is enabled. client # [ 10.815298] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 10.845116] fuse: init (API version 7.45) worker2 # [ 10.832744] systemd[1]: Queued start job for default target Multi-User System. lb # [ 10.857237] systemd-oomd[277]: No swap; memory pressure usage will be degraded worker2 # [ 10.833961] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 10.862559] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 10.842776] systemd-modules-load[275]: Module 'atkbd' is built in client # [ 10.840145] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 10.860360] systemd[1]: Started Journal Service. client # [ 10.844284] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 10.849967] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 10.855031] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 10.857369] systemd-modules-load[275]: Module 'loop' is built in lb # [ 10.884157] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 10.856460] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 10.862723] systemd-modules-load[274]: Module 'atkbd' is built in lb # [ 10.887808] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 10.866243] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 10.889276] fuse: init (API version 7.45) worker1 # [ 10.882448] systemd-modules-load[274]: Module 'loop' is built in client # [ 10.878302] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 10.906736] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 10.890114] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 10.882698] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 10.907160] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 10.905033] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 10.920198] systemd[1]: Finished Load Kernel Module fuse. lb # [ 10.945606] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 10.910916] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 10.933302] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 10.938434] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 10.948762] systemd-oomd[276]: No swap; memory pressure usage will be degraded lb # [ 10.978056] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 10.953688] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 10.980398] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 10.960446] systemd[1]: Reached target First Boot Complete. lb # [ 10.989467] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 10.965101] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 10.962176] systemd[1]: Finished Apply Kernel Variables. lb # [ 10.998228] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 10.976913] systemd-oomd[275]: No swap; memory pressure usage will be degraded worker1 # [ 10.983226] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 10.990032] systemd[1]: Reached target First Boot Complete. worker1 # [ 10.997758] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 10.993547] systemd[1]: Mounted FUSE Control File System. worker2 # [ 11.016610] systemd-journald[274]: Received client request to flush runtime journal. client # [ 11.016562] systemd-journald[275]: Received client request to flush runtime journal. worker1 # [ 11.033536] systemd-journald[273]: Received client request to flush runtime journal. lb # [ 11.064373] systemd[1]: Mounted FUSE Control File System. lb # [ 11.072881] systemd[1]: Finished Apply Kernel Variables. client # [ 11.068307] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 11.072408] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 11.075698] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 11.084343] systemd[1]: Finished Apply Kernel Variables. client # [ 11.080930] systemd[1]: Reached target First Boot Complete. worker2 # [ 11.088896] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 11.083728] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 11.096871] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 11.100534] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 11.138252] systemd-journald[275]: Received client request to flush runtime journal. worker1 # [ 11.113627] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 11.129152] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 11.130370] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 11.136421] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 11.172057] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 11.168899] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 11.173576] systemd[1]: Reached target Preparation for Local File Systems. client # [ 11.172003] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 11.177682] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 11.174541] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 11.213429] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 11.220956] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 11.221928] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 11.222710] systemd[1]: Reached target First Boot Complete. lb # [ 11.223496] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 11.210040] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 11.211216] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 11.213973] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 11.282963] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 11.286284] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 11.290242] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 11.297728] systemd-udevd[308]: Using default interface naming scheme 'v261'. worker2 # [ 11.320559] systemd-udevd[313]: Using default interface naming scheme 'v261'. worker1 # [ 11.367698] systemd-udevd[312]: Using default interface naming scheme 'v261'. lb # [ 11.429989] systemd-udevd[317]: Using default interface naming scheme 'v261'. client # [ 11.457232] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 11.525710] systemd[1]: Mounting /run/wrappers... worker2 # [ 11.534415] systemd[1]: Mounting FUSE Control File System... worker2 # [ 11.548409] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 11.563019] systemd[1]: Mounting /run/wrappers... worker1 # [ 11.566799] systemd[1]: Mounting FUSE Control File System... worker1 # [ 11.589747] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 11.598082] systemd[1]: Mounted FUSE Control File System. lb # [ 11.637708] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 11.622615] systemd[1]: Mounted FUSE Control File System. worker2 # [ 11.633456] systemd[1]: Mounted /run/wrappers. worker2 # [ 11.643051] systemd[1]: Reached target Local File Systems. worker2 # [ 11.645250] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 11.649226] systemd[1]: Starting register-nix-paths.service... worker2 # [ 11.654897] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 11.668217] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 11.669244] systemd[1]: Mounting /run/wrappers... lb # [ 11.698837] systemd[1]: Mounting /run/wrappers... worker1 # [ 11.676180] systemd[1]: Mounted /run/wrappers. worker1 # [ 11.679298] systemd[1]: Reached target Local File Systems. worker2 # [ 11.677978] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 11.685363] systemd[1]: Starting Create System Files and Directories... worker1 # [ 11.693530] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 11.694605] systemd[1]: Starting register-nix-paths.service... worker1 # [ 11.707954] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 11.713015] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 11.721529] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 11.725790] systemd[1]: Mounted /run/wrappers. client # [ 11.726755] systemd[1]: Reached target Local File Systems. worker1 # [ 11.736553] systemd[1]: Starting Create System Files and Directories... client # [ 11.731444] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 11.739606] systemd[1]: Starting register-nix-paths.service... lb # [ 11.770561] systemd[1]: Mounted /run/wrappers. client # [ 11.744126] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 11.745739] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 11.771545] systemd[1]: Reached target Local File Systems. lb # [ 11.781485] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 11.784281] systemd[1]: Starting register-nix-paths.service... client # [ 11.761373] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 11.794456] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 11.795420] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 11.787990] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 11.814721] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 11.796786] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 11.808297] systemd[1]: Starting Create System Files and Directories... lb # [ 11.860133] systemd[1]: Starting Create System Files and Directories... worker1 # [ 11.840935] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 11.847746] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 11.951783] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 11.931680] systemd[1]: Finished Create System Files and Directories. client # [ 11.931941] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 11.940662] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 11.968904] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 11.948898] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 11.947532] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 11.964262] systemd[1]: Finished Create System Files and Directories. worker1 # [ 11.971001] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 11.978414] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 12.095068] systemd[1]: Finished Create System Files and Directories. worker2 # [ 12.076782] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 12.108213] systemd[1]: Starting Rebuild Journal Catalog... client # [ 12.074883] systemd[1]: Finished Create System Files and Directories. lb # [ 12.114764] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 12.091291] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 12.092174] systemd[1]: Starting Rebuild Journal Catalog... client # [ 12.121121] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 12.172161] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 12.176155] systemd[1]: Starting Update is Completed... worker1 # [ 12.187290] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 12.190267] systemd[1]: Starting Update is Completed... lb # [ 12.268557] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 12.262601] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 12.281378] systemd[1]: Finished Update is Completed. worker1 # [ 12.289429] systemd[1]: Finished Update is Completed. lb # [ 12.343064] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 12.355401] systemd[1]: Starting Update is Completed... client # [ 12.334246] systemd[1]: Finished Rebuild Journal Catalog. client # [ 12.339873] systemd[1]: Starting Update is Completed... lb # [ 12.451493] systemd[1]: Finished Update is Completed. client # [ 12.454035] systemd[1]: Finished Update is Completed. client # [ 12.620326] systemd[1]: Finished Coldplug All udev Devices. client # [ 12.746624] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 12.752407] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 12.755732] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 12.812422] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 12.815370] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 12.871741] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 12.876650] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 12.936464] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 12.939777] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 12.981901] systemd[1]: Finished Firewall. client # [ 13.041447] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 13.068188] systemd[1]: Finished Firewall. client # [ 13.100158] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 13.432357] systemd[1]: Finished Firewall. client # [ 13.405956] (udev-worker)[310]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 13.413217] (udev-worker)[326]: Network interface NamePolicy= disabled on kernel command line. client # [ 13.417012] (udev-worker)[310]: Network interface NamePolicy= disabled on kernel command line. lb # [ 13.449753] systemd[1]: Finished register-nix-paths.service. worker2 # [ 13.465749] systemd[1]: Finished Coldplug All udev Devices. lb # [ 13.542504] systemd[1]: Finished Coldplug All udev Devices. lb # [ 13.543499] systemd[1]: Reached target System Initialization. lb # [ 13.546814] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 13.548167] systemd[1]: Started niks3 garbage collection timer. lb # [ 13.553085] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 13.554148] systemd[1]: Reached target Timer Units. lb # [ 13.554888] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 13.563445] systemd[1]: Listening on niks3 server socket. lb # [ 13.564407] systemd[1]: Listening on Nix Daemon Socket. lb # [ 13.565198] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 13.566347] systemd[1]: Reached target Socket Units. lb # [ 13.567050] systemd[1]: Reached target Basic System. worker2 # [ 13.544443] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 13.571329] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 13.577658] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 13.589944] systemd[1]: Starting Post-Boot Actions... worker1 # [ 13.594863] systemd[1]: Finished Coldplug All udev Devices. lb # [ 13.619133] systemd[1]: Started Reset console on configuration changes. lb # [ 13.654435] systemd[1]: Starting resolvconf update... lb # [ 13.673276] systemd[1]: Started rustfs.service. lb # [ 13.700294] systemd[1]: Starting rustfs-bucket.service... client # [ 13.683284] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 13.690772] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 13.688881] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 13.695396] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 13.697864] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 13.701470] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 13.712254] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 13.715686] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 13.717354] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 13.746767] nsncd[501]: Sep 21 13:53:54.391 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 13.720164] systemd[1]: Finished register-nix-paths.service. lb # [ 13.755526] systemd[1]: Finished Post-Boot Actions. lb # [ 13.764792] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 13.752119] mousedev: PS/2 mouse device common for all mice worker2 # [ 13.777492] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 13.810142] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 13.817674] systemd[1]: Reached target User and Group Name Lookups. lb # [ 13.828583] systemd[1]: Starting D-Bus System Message Bus... lb # [ 13.834955] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 13.835424] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 13.872573] systemd[1]: Starting User Login Management... lb # [ 13.884285] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 13.862282] systemd[1]: Finished register-nix-paths.service. worker2 # [ 13.864451] systemd[1]: Reached target System Initialization. worker2 # [ 13.866188] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 13.869221] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 13.873798] systemd[1]: Reached target Timer Units. worker2 # [ 13.878333] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 13.889065] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 13.892451] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 13.904428] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 13.908445] systemd[1]: Reached target Socket Units. worker2 # [ 13.923894] systemd[1]: Reached target Basic System. worker2 # [ 13.929479] systemd[1]: Started backdoor.service. worker1 # [ 13.933194] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 13.935880] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 13.940704] systemd[1]: Finished register-nix-paths.service. worker1 # [ 13.943876] systemd[1]: Reached target System Initialization. worker1 # [ 13.946482] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 13.948970] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 13.948496] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 13.950847] systemd[1]: Reached target Timer Units. worker1 # [ 13.956359] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 13.957359] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 13.958915] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 13.957894] systemd[1]: Starting Post-Boot Actions... worker1 # [ 13.961247] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 13.965786] systemd[1]: Started Reset console on configuration changes. worker1 # [ 13.967183] systemd[1]: Reached target Socket Units. worker1 # [ 13.973120] systemd[1]: Reached target Basic System. worker1 # [ 13.982895] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 13.979427] systemd[1]: Starting resolvconf update... worker2 # [ 13.989906] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 13.991612] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 14.003293] systemd[1]: Starting Post-Boot Actions... worker1 # [ 14.009729] systemd[1]: Started Reset console on configuration changes. worker1 # [ 14.017868] systemd[1]: Starting resolvconf update... worker1 # [ 14.022412] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 14.035276] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 14.040842] systemd[1]: Finished Post-Boot Actions. worker1 # [ 14.044410] systemd[1]: Started backdoor.service. lb # [ 14.090999] dbus-broker-launch[525]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 14.102733] dbus-broker-launch[525]: NSS returned no entry for 'systemd-timesync' lb # [ 14.110229] dbus-broker-launch[525]: Invalid user-name in /nix/store/kxmx3smba321l9v2dpmh9zahhsbc77yh-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # connecting to host... worker2 # [ 14.100419] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 14.101630] nsncd[496]: Sep 21 13:53:54.734 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 14.103581] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 14.136068] systemd-logind[528]: New seat seat0. lb # [ 14.145147] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 14.121425] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 14.125557] systemd[1]: Finished Post-Boot Actions. worker2 # [ 14.128712] systemd[1]: Starting User Login Management... lb # [ 14.151714] systemd[1]: Started User Login Management. worker2 # [ 14.134665] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 14.165167] systemd[1]: Starting linger-users.service... lb # [ 14.172110] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 14.177567] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 14.187733] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 14.190910] systemd[1]: Stopping User and Group Name Lookups... lb # [ 14.191760] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 14.173024] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 14.200798] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 14.181588] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 14.192341] nsncd[494]: Sep 21 13:53:54.814 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 14.211773] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 14.226527] dbus-broker-launch[525]: Ready worker2 # [ 14.202210] dbus-broker-launch[500]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 14.202689] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 14.211639] systemd[1]: Starting User Login Management... worker1 # connecting to host... worker2 # [ 14.222251] dbus-broker-launch[500]: NSS returned no entry for 'systemd-timesync' worker1 # [ 14.225390] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 14.229674] dbus-broker-launch[500]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 14.230910] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 14.234126] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 14.237623] systemd[1]: Reached target System Initialization. client # [ 14.240260] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 14.242586] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 14.247208] systemd[1]: Reached target Timer Units. client # [ 14.248685] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 14.250801] systemd[1]: Listening on Nix Daemon Socket. lb # [ 14.280653] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 14.254597] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 14.257611] systemd[1]: Reached target Socket Units. client # [ 14.262201] systemd[1]: Reached target Basic System. client # [ 14.263516] systemd[1]: Started backdoor.service. worker2 # [ 14.268002] systemd[1]: Started D-Bus System Message Bus. client # [ 14.265124] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 14.268673] systemd[1]: Starting nftables firewall... worker1 # [ 14.275300] dbus-broker-launch[498]: Looking up NSS user entry for 'systemd-timesync'... client # [ 14.292277] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 14.301738] dbus-broker-launch[498]: NSS returned no entry for 'systemd-timesync' client # [ 14.298383] systemd[1]: Starting Post-Boot Actions... worker1 # [ 14.305218] dbus-broker-launch[498]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 14.333092] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 14.306752] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 14.338576] systemd[1]: Finished linger-users.service. worker2 # [ 14.323464] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 14.332764] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 14.333641] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 14.334440] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 14.335562] systemd-logind[510]: New seat seat0. client # [ 14.333142] systemd[1]: Started Reset console on configuration changes. lb # [ 14.371360] systemd[1]: Finished resolvconf update. worker1 # [ 14.351997] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 14.352426] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 14.355953] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 14.359613] systemd[1]: Started User Login Management. lb # [ 14.388903] systemd[1]: Reached target Preparation for Network. worker2 # [ 14.364963] systemd[1]: Starting linger-users.service... worker2 # [ 14.365717] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 14.391010] nsncd[589]: Sep 21 13:53:55.036 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 14.364902] systemd[1]: Starting resolvconf update... worker2 # [ 14.371460] dbus-broker-launch[500]: Ready lb # [ 14.398414] systemd[1]: Starting DHCP Client... lb # [ 14.403022] systemd[1]: Starting Extra networking commands.... lb # [ 14.406883] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 14.410346] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 14.395999] systemd-logind[518]: New seat seat0. worker1 # [ 14.397798] systemd[1]: Started User Login Management. worker1 # [ 14.406156] dbus-broker-launch[498]: Ready client # connecting to host... worker1 # [ 14.408241] systemd[1]: Starting linger-users.service... lb # [ 14.435984] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 14.420370] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 14.421981] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 14.422995] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 14.447774] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 14.424577] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 14.430691] nsncd[567]: Sep 21 13:53:55.060 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 14.436556] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 14.437482] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 14.423849] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 14.438361] systemd[1]: Finished linger-users.service. worker1 # [ 14.440865] systemd[1]: Stopping User and Group Name Lookups... client # [ 14.436794] systemd[1]: Finished Post-Boot Actions. worker1 # [ 14.444468] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 14.450554] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 14.451431] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client: Guest shell says: b'Spawning backdoor root shell...\n' worker1 # [ 14.458151] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 14.470224] systemd[1]: Finished resolvconf update. worker2 # [ 14.474512] systemd[1]: Reached target Preparation for Network. worker2 # [ 14.478298] systemd[1]: Starting DHCP Client... client # [ 14.470937] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 14.481209] systemd[1]: Starting Extra networking commands.... worker1 # [ 14.513361] systemd[1]: linger-users.service: Deactivated successfully. client: connected to guest root shell worker1 # [ 14.514322] systemd[1]: Finished linger-users.service. client: (connecting took 14.96 seconds) worker1 # [ 14.528559] systemd[1]: Started Name Service Cache Daemon (nsncd). client: (finished: waiting for the VM to finish booting, in 14.96 seconds) worker1 # [ 14.532554] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 14.534524] nsncd[566]: Sep 21 13:53:55.168 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 14.476830] nsncd[462]: Sep 21 13:53:55.131 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 14.537257] systemd[1]: Reached target User and Group Name Lookups. client # [ 14.485205] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 14.488499] systemd[1]: Reached target Host and Network Name Lookups. client # [ 14.489917] systemd[1]: Reached target User and Group Name Lookups. client # [ 14.502988] systemd[1]: Starting User Login Management... client # [ 14.510968] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 14.572390] systemd[1]: Finished resolvconf update. worker1 # [ 14.573200] systemd[1]: Reached target Preparation for Network. worker1 # [ 14.579885] systemd[1]: Starting DHCP Client... worker1 # [ 14.583338] systemd[1]: Starting Extra networking commands.... worker2 # [ 14.597745] (udev-worker)[597]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 14.619206] (udev-worker)[598]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 14.647812] (udev-worker)[598]: Network interface NamePolicy= disabled on kernel command line. lb # [ 14.712190] dhcpcd[618]: dhcpcd-10.3.2 starting lb # [ 14.730028] dhcpcd[667]: dev: loaded udev lb # [ 14.746427] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 14.722917] dhcpcd[611]: dhcpcd-10.3.2 starting client # [ 14.722701] dbus-broker-launch[481]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 14.759363] systemd[1]: Started backdoor.service. worker2 # [ 14.741681] dhcpcd[652]: dev: loaded udev client # [ 14.732753] systemd-logind[492]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 14.746243] systemd-logind[492]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 14.753417] systemd-logind[492]: New seat seat0. client # [ 14.762844] systemd[1]: Started User Login Management. lb # [ 14.807953] 8021q: 802.1Q VLAN Support v1.8 client # [ 14.763606] dbus-broker-launch[481]: NSS returned no entry for 'systemd-timesync' worker2 # [ 14.792389] 8021q: 802.1Q VLAN Support v1.8 client # [ 14.771645] dbus-broker-launch[481]: Invalid user-name in /nix/store/ydh4ywywm30g15n5m6x5vfz42682s2cc-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 14.783764] systemd[1]: Starting linger-users.service... worker1 # [ 14.797890] (udev-worker)[597]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 14.797545] systemd[1]: Finished Extra networking commands.. worker2 # [ 14.799574] systemd[1]: Reached target Network. worker1 # [ 14.804877] (udev-worker)[593]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 14.807039] (udev-worker)[593]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 14.803606] systemd[1]: Starting Permit User Sessions... lb # [ 14.831590] systemd[1]: Finished Extra networking commands.. client # [ 14.806619] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 14.836981] systemd[1]: Reached target Network. client # [ 14.812453] systemd[1]: Stopping Host and Network Name Lookups... client # [ 14.819479] systemd[1]: Stopped target User and Group Name Lookups. client # [ 14.827029] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 14.832639] dhcpcd[611]: dhcpcd-10.3.2 starting client # [ 14.827844] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 14.855433] systemd[1]: Starting PostgreSQL Server... lb # [ 14.866052] systemd[1]: Starting Permit User Sessions... client # [ 14.840494] systemd[1]: nscd.service: Deactivated successfully. client # [ 14.841342] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 14.852709] dhcpcd[649]: dev: loaded udev client # [ 14.855487] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 14.896632] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # connecting to host... worker1 # [ 14.900541] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 14.892746] systemd[1]: Finished Permit User Sessions. client # [ 14.890241] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 14.893282] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 14.899022] systemd[1]: Started Getty on tty1. worker2 # [ 14.901251] systemd[1]: Reached target Login Prompts. client # [ 14.900412] systemd[1]: Finished linger-users.service. client # [ 14.901437] dbus-broker-launch[481]: Ready worker1 # [ 14.914567] systemd[1]: Finished Extra networking commands.. worker1 # [ 14.919943] systemd[1]: Reached target Network. worker2 # [ 14.933000] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 14.933489] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 14.938469] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 14.938786] cfg80211: failed to load regulatory.db worker1 # [ 14.930700] systemd[1]: Starting Permit User Sessions... worker2 # [ 14.954608] systemd-logind[510]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 14.970078] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 14.975927] systemd[1]: Starting Address configuration of eth1... client # [ 14.980325] systemd[1]: Finished resolvconf update. worker1 # [ 15.000560] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 14.992834] systemd[1]: Starting DHCP Client... lb # [ 15.034323] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 15.025209] systemd[1]: Finished Permit User Sessions. worker1 # [ 15.014160] systemd[1]: Finished Permit User Sessions. client # [ 15.010615] nsncd[572]: Sep 21 13:53:55.665 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 15.040372] systemd[1]: Started Getty on tty1. worker1 # [ 15.018141] systemd[1]: Started Getty on tty1. lb # [ 15.044093] systemd[1]: Reached target Login Prompts. worker1 # [ 15.021096] systemd[1]: Reached target Login Prompts. client # [ 15.020370] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 15.038217] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 15.039140] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 15.039642] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 15.027547] dhcpcd[652]: eth0: waiting for carrier client # [ 15.024963] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 15.031918] dhcpcd[652]: eth0: waiting for carrier worker1 # [ 15.044584] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 15.027743] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 15.044913] cfg80211: failed to load regulatory.db worker2 # [ 15.033438] dhcpcd[652]: eth0: carrier acquired worker2 # [ 15.050481] dhcpcd[652]: DUID 00:01:00:01:32:43:f3:73:52:54:00:12:34:56 worker2 # [ 15.051411] dhcpcd[652]: eth0: IAID 00:12:34:56 worker2 # [ 15.053758] dhcpcd[652]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 15.097117] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 15.097637] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 15.102810] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 15.103136] cfg80211: failed to load regulatory.db lb # [ 15.098028] dhcpcd[667]: no valid interfaces found lb # [ 15.099838] dhcpcd[667]: no valid interfaces found lb # [ 15.102060] dhcpcd[667]: libudev: received NULL device lb # [ 15.105043] dhcpcd[667]: libudev: received NULL device worker2 # [ 15.099720] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 15.102615] systemd-logind[518]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 15.125962] (udev-worker)[663]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 15.132711] (udev-worker)[663]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 15.109461] network-addresses-eth1-start[680]: adding address 192.168.1.4/24... done worker1 # [ 15.131506] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 15.143923] (udev-worker)[670]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 15.121753] dhcpcd[649]: eth0: waiting for carrier worker2 # [ 15.121827] network-addresses-eth1-start[680]: adding address 2001:db8:1::4/64... done worker1 # [ 15.124116] dhcpcd[649]: libudev: received NULL device worker1 # [ 15.126501] dhcpcd[649]: libudev: received NULL device worker1 # [ 15.129237] dhcpcd[649]: eth0: carrier acquired worker1 # [ 15.139347] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 15.144159] systemd[1]: Starting Address configuration of eth1... worker2 # [ 15.143342] systemd[1]: Finished Address configuration of eth1. worker1 # [ 15.156104] dhcpcd[649]: DUID 00:01:00:01:32:43:f3:73:52:54:00:12:34:56 worker1 # [ 15.157041] dhcpcd[649]: eth0: IAID 00:12:34:56 worker1 # [ 15.157691] dhcpcd[649]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 15.160604] dhcpcd[649]: eth0: IAID 00:12:34:56 client # [ 15.200694] dhcpcd[602]: dhcpcd-10.3.2 starting worker2 # [ 15.221963] mousedev: PS/2 mouse device common for all mice client # [ 15.214747] dhcpcd[611]: dev: loaded udev worker1 # [ 15.254997] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 15.268904] mousedev: PS/2 mouse device common for all mice worker1 # [ 15.263762] network-addresses-eth1-start[681]: adding address 192.168.1.3/24... done client # [ 15.278181] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 15.279014] systemd-logind[510]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 15.282396] network-addresses-eth1-start[681]: adding address 2001:db8:1::3/64... done client # [ 15.287443] systemd[1]: Finished nftables firewall. client # [ 15.291355] systemd[1]: Reached target Preparation for Network. lb # [ 15.321160] postgresql-pre-start[707]: The files belonging to this database system will be owned by user "postgres". lb # [ 15.322617] postgresql-pre-start[707]: This user must also own the server process. client # [ 15.296335] systemd[1]: Starting Address configuration of eth1... worker1 # [ 15.304822] systemd[1]: Finished Address configuration of eth1. worker1 # [ 15.306722] dhcpcd[649]: eth0: soliciting a DHCP lease worker1 # [ 15.312683] dhcpcd[649]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 15.337310] postgresql-pre-start[707]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 15.338615] postgresql-pre-start[707]: The default database encoding has accordingly been set to "UTF8". client # [ 15.311627] systemd[1]: Starting Extra networking commands.... lb # [ 15.339768] postgresql-pre-start[707]: The default text search configuration will be set to "english". worker1 # [ 15.320218] dhcpcd[649]: eth0: probing address 10.0.2.15/24 lb # [ 15.346586] postgresql-pre-start[707]: Data page checksums are enabled. lb # [ 15.350727] postgresql-pre-start[707]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 15.355656] postgresql-pre-start[707]: creating subdirectories ... ok lb # [ 15.358507] postgresql-pre-start[707]: selecting dynamic shared memory implementation ... posix worker1 # [ 15.404997] systemd-logind[518]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 15.419745] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 15.444632] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 15.461820] systemd[1]: Starting Address configuration of eth1... client # [ 15.462804] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 15.466962] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 15.467396] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 15.472502] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 15.472837] cfg80211: failed to load regulatory.db client # [ 15.483687] network-addresses-eth1-start[619]: adding address 192.168.1.1/24... done client # [ 15.507992] network-addresses-eth1-start[619]: adding address 2001:db8:1::1/64... done client # [ 15.539830] systemd[1]: Finished Address configuration of eth1. client # [ 15.553734] dhcpcd[646]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (622) - Operation not permitted client # [ 15.555538] dhcpcd[646]: .resolvconf-wrapped: clearing stale lock pid 622 lb # [ 15.583651] postgresql-pre-start[707]: selecting default "max_connections" ... 100 lb # [ 15.619968] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 15.611868] dhcpcd[667]: eth0: waiting for carrier lb # [ 15.614651] dhcpcd[667]: eth0: carrier acquired lb # [ 15.637945] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 15.622529] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 15.609636] dhcpcd[611]: eth0: waiting for carrier lb # [ 15.639868] dhcpcd[667]: DUID 00:01:00:01:32:43:f3:74:52:54:00:12:34:56 client # [ 15.613183] dhcpcd[611]: libudev: received NULL device lb # [ 15.643268] dhcpcd[667]: eth0: IAID 00:12:34:56 client # [ 15.615621] dhcpcd[611]: libudev: received NULL device client # [ 15.619857] dhcpcd[611]: eth0: carrier acquired lb # [ 15.647251] dhcpcd[667]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 15.660377] network-addresses-eth1-start[719]: adding address 192.168.1.2/24... done client # [ 15.633716] dhcpcd[611]: DUID 00:01:00:01:32:43:f3:74:52:54:00:12:34:56 client # [ 15.635875] dhcpcd[611]: eth0: IAID 00:12:34:56 client # [ 15.638322] dhcpcd[611]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 15.654576] systemd[1]: Finished Extra networking commands.. client # [ 15.657762] systemd[1]: Reached target Network. lb # [ 15.685718] network-addresses-eth1-start[719]: adding address 2001:db8:1::2/64... done client # [ 15.663616] systemd[1]: Starting Permit User Sessions... lb # [ 15.694573] systemd-logind[528]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 15.737517] systemd[1]: Finished Address configuration of eth1. client # [ 15.710343] systemd[1]: Finished Permit User Sessions. client # [ 15.718257] systemd[1]: Started Getty on tty1. client # [ 15.721269] systemd[1]: Reached target Login Prompts. lb # [ 15.802844] postgresql-pre-start[707]: selecting default "shared_buffers" ... 128MB worker2 # [ 15.853726] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 15.936551] dhcpcd[667]: eth0: soliciting a DHCP lease lb # [ 15.940470] dhcpcd[667]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 15.948262] dhcpcd[667]: eth0: probing address 10.0.2.15/24 client # [ 15.934862] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 16.029346] mousedev: PS/2 mouse device common for all mice client: (finished: waiting for unit network-addresses-eth1.service, in 16.43 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } worker1 # [ 16.026959] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 16.154311] systemd-logind[528]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 16.141352] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker2 # [ 16.156573] systemd[1]: Starting Virtual Console Setup... worker2 # [ 16.173570] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 16.180183] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 16.182640] systemd[1]: Starting Virtual Console Setup... lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) client # [ 16.219977] systemd[1]: Starting Virtual Console Setup... worker2 # [ 16.235448] systemd-logind[510]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 16.240446] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 16.242048] systemd[1]: Stopped Virtual Console Setup. client # [ 16.248311] systemd[1]: Starting Virtual Console Setup... client # [ 16.277091] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } client # [ 16.322883] systemd-logind[492]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 16.398910] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 16.412173] systemd[1]: Starting Virtual Console Setup... worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker1 # [ 16.431902] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 16.433692] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 16.436697] systemd[1]: Starting Virtual Console Setup... worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit niks3.service worker1 # [ 16.494955] systemd-logind[518]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 16.628829] systemd-vconsole-setup[701]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 16.633155] systemd[1]: Finished Virtual Console Setup. client # [ 16.668936] systemd-vconsole-setup[709]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 16.672651] systemd[1]: Finished Virtual Console Setup. worker1 # [ 16.801836] dhcpcd[649]: eth0: soliciting an IPv6 router worker1 # [ 16.803204] dhcpcd[649]: eth0: Router Advertisement from fe80::2 worker1 # [ 16.804778] dhcpcd[649]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 16.805860] dhcpcd[649]: eth0: adding route to fec0::/64 worker1 # [ 16.806682] dhcpcd[649]: eth0: adding default route via fe80::2 worker2 # [ 16.817446] dhcpcd[652]: eth0: soliciting an IPv6 router worker2 # [ 16.821075] dhcpcd[652]: eth0: Router Advertisement from fe80::2 worker2 # [ 16.823553] dhcpcd[652]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 16.826414] dhcpcd[652]: eth0: adding route to fec0::/64 worker2 # [ 16.828705] dhcpcd[652]: eth0: adding default route via fe80::2 worker1 # [ 16.866267] systemd-vconsole-setup[707]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 16.870210] systemd[1]: Finished Virtual Console Setup. worker2 # [ 16.937616] dhcpcd[652]: eth0: soliciting a DHCP lease worker2 # [ 16.941094] dhcpcd[652]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 16.944840] dhcpcd[652]: eth0: probing address 10.0.2.15/24 lb # [ 17.055693] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 17.481875] dhcpcd[611]: eth0: soliciting a DHCP lease client # [ 17.485146] dhcpcd[611]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 17.492382] dhcpcd[611]: eth0: probing address 10.0.2.15/24 lb # [ 17.602819] systemd[1]: Starting Virtual Console Setup... lb # [ 17.652560] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 17.658208] systemd[1]: Stopped Virtual Console Setup. lb # [ 17.673418] systemd[1]: Starting Virtual Console Setup... lb # [ 17.722176] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 17.835019] systemd-logind[528]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 17.814972] dhcpcd[611]: eth0: soliciting an IPv6 router client # [ 17.818580] dhcpcd[611]: eth0: Router Advertisement from fe80::2 client # [ 17.821437] dhcpcd[611]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 17.825097] dhcpcd[611]: eth0: adding route to fec0::/64 client # [ 17.827333] dhcpcd[611]: eth0: adding default route via fe80::2 lb # [ 18.152888] systemd-vconsole-setup[779]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 18.161768] systemd[1]: Finished Virtual Console Setup. lb # [ 18.214551] dhcpcd[667]: eth0: soliciting an IPv6 router lb # [ 18.215748] dhcpcd[667]: eth0: Router Advertisement from fe80::2 lb # [ 18.217618] dhcpcd[667]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 18.218692] dhcpcd[667]: eth0: adding route to fec0::/64 lb # [ 18.219643] dhcpcd[667]: eth0: adding default route via fe80::2 lb # [ 18.368777] postgresql-pre-start[707]: selecting default time zone ... UTC lb # [ 18.372558] postgresql-pre-start[707]: creating configuration files ... ok lb # [ 18.642977] postgresql-pre-start[707]: running bootstrap script ... ok lb # [ 19.260176] postgresql-pre-start[707]: performing post-bootstrap initialization ... ok lb # [ 19.383809] postgresql-pre-start[707]: syncing data to disk ... ok lb # [ 19.384871] postgresql-pre-start[707]: initdb: warning: enabling "trust" authentication for local connections lb # [ 19.386197] postgresql-pre-start[707]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 19.388332] postgresql-pre-start[707]: Success. You can now start the database server using: lb # [ 19.389520] postgresql-pre-start[707]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 19.507969] postgres[804]: [804] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 19.513534] postgres[804]: [804] LOG: listening on IPv6 address "::1", port 5432 lb # [ 19.514694] postgres[804]: [804] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 19.516582] postgres[804]: [804] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 19.528838] postgres[813]: [813] LOG: database system was shut down at 2026-09-21 13:53:59 GMT lb # [ 19.535274] postgres[804]: [804] LOG: database system is ready to accept connections lb # [ 19.539519] systemd[1]: Started PostgreSQL Server. lb # [ 19.548333] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 19.762867] postgresql-setup-start[824]: CREATE DATABASE lb # [ 19.816211] postgresql-setup-start[829]: CREATE ROLE lb # [ 19.839211] postgresql-setup-start[831]: ALTER DATABASE lb # [ 19.846105] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 19.847873] systemd[1]: Reached target PostgreSQL. worker1 # [ 19.960986] dhcpcd[649]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 19.964222] dhcpcd[649]: eth0: adding route to 10.0.2.0/24 worker1 # [ 19.966528] dhcpcd[649]: eth0: adding default route via 10.0.2.2 worker1 # [ 20.157635] systemd[1]: Started DHCP Client. worker1 # [ 20.159425] systemd[1]: Reached target Multi-User System. worker1 # [ 20.160784] systemd[1]: Startup finished in 928ms (kernel) + 5.472s (initrd) + 13.757s (userspace) = 20.159s. lb # [ 20.546609] dhcpcd[667]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 20.549743] dhcpcd[667]: eth0: adding route to 10.0.2.0/24 lb # [ 20.549907] dhcpcd[667]: eth0: adding default route via 10.0.2.2 lb # [ 20.708730] systemd[1]: Started DHCP Client. lb # [ 20.714499] systemd[1]: Reached target Network is Online. lb # [ 20.717226] systemd[1]: Started Envoy reverse proxy. lb # [ 20.724679] systemd[1]: Started mock-oidc.service. lb # [ 20.815942] mock-oidc-server[904]: Mock OIDC Server running lb # [ 20.817553] mock-oidc-server[904]: OIDC Address: 192.168.1.2:8080 lb # [ 20.818888] mock-oidc-server[904]: Issue Address: 0.0.0.0:8081 lb # [ 20.820225] mock-oidc-server[904]: Issuer: http://192.168.1.2:8080/oidc lb # [ 20.821295] mock-oidc-server[904]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 20.822563] mock-oidc-server[904]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 20.824199] mock-oidc-server[904]: Issue tokens: http://0.0.0.0:8081/issue?sub=... worker2 # [ 21.053577] dhcpcd[652]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 21.056976] dhcpcd[652]: eth0: adding route to 10.0.2.0/24 worker2 # [ 21.060518] dhcpcd[652]: eth0: adding default route via 10.0.2.2 worker2 # [ 21.229805] systemd[1]: Started DHCP Client. worker2 # [ 21.231784] systemd[1]: Reached target Multi-User System. worker2 # [ 21.233089] systemd[1]: Startup finished in 929ms (kernel) + 5.452s (initrd) + 14.849s (userspace) = 21.231s. lb # [ 21.406438] envoy[903]: [2026-09-21 13:54:02.051][903][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 21.408364] envoy[903]: [2026-09-21 13:54:02.051][903][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 21.410130] envoy[903]: [2026-09-21 13:54:02.051][903][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 21.412096] envoy[903]: [2026-09-21 13:54:02.051][903][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 21.414428] envoy[903]: [2026-09-21 13:54:02.051][903][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 21.417333] envoy[903]: [2026-09-21 13:54:02.051][903][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 21.419949] envoy[903]: [2026-09-21 13:54:02.051][903][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 21.423503] envoy[903]: [2026-09-21 13:54:02.051][903][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 21.447773] envoy[903]: [2026-09-21 13:54:02.051][903][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 21.452172] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 21.459817] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 21.461978] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 21.465640] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 21.470572] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 21.474320] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 21.479049] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 21.481688] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 21.486637] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 21.493880] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 21.495927] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 21.498837] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 21.501074] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 21.506304] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 21.521527] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 21.523447] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 21.526267] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 21.530145] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 21.532140] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 21.534207] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 21.536392] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 21.538288] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 21.541124] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 21.543094] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 21.545340] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 21.547058] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 21.550263] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 21.553062] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 21.554689] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 21.557322] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 21.559082] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 21.562425] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 21.564475] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 21.566556] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 21.568720] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 21.571453] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 21.580372] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 21.582655] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 21.584975] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 21.586856] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 21.589635] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 21.592675] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 21.595217] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 21.598761] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 21.601580] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 21.606393] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 21.608880] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 21.611036] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 21.613286] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 21.615260] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 21.617787] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 21.620869] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 21.624111] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 21.626367] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 21.629876] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 21.633696] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 21.636073] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 21.642940] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 21.644850] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 21.650146] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 21.652058] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 21.656862] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 21.662181] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 21.693565] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 21.695591] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 21.697627] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 21.699547] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 21.704121] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 21.706088] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 21.709205] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 21.711148] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 21.713333] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 21.715861] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 21.723998] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 21.734067] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 21.740772] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 21.745207] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 21.747795] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 21.750877] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 21.755413] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 21.759302] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 21.762116] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 21.763997] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 21.769507] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 21.771671] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 21.775460] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 21.781857] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 21.784035] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 21.792145] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 21.795371] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 21.801116] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 21.803169] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 21.806065] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 21.809656] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 21.816566] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 21.818583] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 21.823462] envoy[903]: [2026-09-21 13:54:02.052][903][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 21.827738] envoy[903]: [2026-09-21 13:54:02.087][903][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 21.829462] envoy[903]: [2026-09-21 13:54:02.089][903][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 21.845857] envoy[903]: [2026-09-21 13:54:02.089][903][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 21.847757] envoy[903]: [2026-09-21 13:54:02.089][903][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 21.857629] envoy[903]: [2026-09-21 13:54:02.089][903][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 21.860723] envoy[903]: [2026-09-21 13:54:02.259][903][info][main] [source/server/server.cc:968] runtime: {} lb # [ 21.863839] envoy[903]: [2026-09-21 13:54:02.282][903][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 21.867368] envoy[903]: [2026-09-21 13:54:02.282][903][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 21.870702] envoy[903]: [2026-09-21 13:54:02.282][903][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 21.873129] envoy[903]: [2026-09-21 13:54:02.291][903][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 21.876574] envoy[903]: [2026-09-21 13:54:02.291][903][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 21.878409] envoy[903]: [2026-09-21 13:54:02.291][903][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 21.882720] envoy[903]: [2026-09-21 13:54:02.528][903][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker1 # [ 21.861631] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 21.861032] systemd[1]: Reached target Network is Online. lb # [ 21.890723] envoy[903]: [2026-09-21 13:54:02.537][903][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 21.893777] envoy[903]: [2026-09-21 13:54:02.539][903][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. worker2 # [ 21.871619] systemd[1]: Starting scheduler-token.service... lb # [ 21.897486] envoy[903]: [2026-09-21 13:54:02.539][903][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 21.995124] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 22.000833] systemd[1]: Finished scheduler-token.service. worker2 # [ 22.002397] systemd[1]: scheduler-token.service: Consumed 56ms CPU time over 126ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 22.010857] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 22.095205] nix-grpc-daemon[772]: ts=2026-09-21T13:54:02Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 22.107885] nix-grpc-daemon[772]: ts=2026-09-21T13:54:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 22.110469] nix-grpc-daemon[772]: ts=2026-09-21T13:54:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 22.149130] nix-grpc-daemon[772]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 22.150687] nix-grpc-daemon[772]: E0000 00:00:1789998842.789119 772 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 22.164225] nix-grpc-daemon[772]: E0000 00:00:1789998842.804356 772 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 22.167771] nix-grpc-daemon[772]: ts=2026-09-21T13:54:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 22.172268] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 22.225166] envoy[903]: [2026-09-21 13:54:02.871][903][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 22.227793] envoy[903]: [2026-09-21 13:54:02.871][903][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker1 # [ 22.205615] nix-grpc-daemon[772]: E0000 00:00:1789998842.844609 814 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 22.232712] envoy[903]: [2026-09-21 13:54:02.871][903][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 22.238127] envoy[903]: [2026-09-21 13:54:02.884][903][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 22.224053] nix-grpc-daemon[772]: E0000 00:00:1789998842.864110 814 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 22.228061] nix-grpc-daemon[772]: E0000 00:00:1789998842.867295 814 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 22.233978] nix-grpc-daemon[778]: ts=2026-09-21T13:54:02Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 22.245553] nix-grpc-daemon[772]: E0000 00:00:1789998842.884976 814 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 22.245354] nix-grpc-daemon[778]: ts=2026-09-21T13:54:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 22.247693] nix-grpc-daemon[778]: ts=2026-09-21T13:54:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 22.256291] nix-grpc-daemon[772]: ts=2026-09-21T13:54:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.258523] nix-grpc-daemon[772]: ts=2026-09-21T13:54:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.285855] nix-grpc-daemon[778]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 22.287402] nix-grpc-daemon[778]: E0000 00:00:1789998842.924221 778 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 22.300524] nix-grpc-daemon[778]: E0000 00:00:1789998842.938946 778 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 22.304191] nix-grpc-daemon[778]: ts=2026-09-21T13:54:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 22.306159] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 22.339454] nix-grpc-daemon[778]: E0000 00:00:1789998842.976886 818 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 22.358706] nix-grpc-daemon[778]: E0000 00:00:1789998842.997046 818 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 22.364055] nix-grpc-daemon[778]: E0000 00:00:1789998843.000407 818 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 22.380144] nix-grpc-daemon[778]: E0000 00:00:1789998843.017749 818 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 22.394363] nix-grpc-daemon[778]: ts=2026-09-21T13:54:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.396235] nix-grpc-daemon[778]: ts=2026-09-21T13:54:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.460306] nix-grpc-daemon[772]: ts=2026-09-21T13:54:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.465528] nix-grpc-daemon[772]: ts=2026-09-21T13:54:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.597484] nix-grpc-daemon[778]: ts=2026-09-21T13:54:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.602600] nix-grpc-daemon[778]: ts=2026-09-21T13:54:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.666245] nix-grpc-daemon[772]: ts=2026-09-21T13:54:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.671640] nix-grpc-daemon[772]: ts=2026-09-21T13:54:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.803702] nix-grpc-daemon[778]: ts=2026-09-21T13:54:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.809000] nix-grpc-daemon[778]: ts=2026-09-21T13:54:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.872954] nix-grpc-daemon[772]: ts=2026-09-21T13:54:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.878290] nix-grpc-daemon[772]: ts=2026-09-21T13:54:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.009937] nix-grpc-daemon[778]: ts=2026-09-21T13:54:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.014989] nix-grpc-daemon[778]: ts=2026-09-21T13:54:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.079402] nix-grpc-daemon[772]: ts=2026-09-21T13:54:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.084397] nix-grpc-daemon[772]: ts=2026-09-21T13:54:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 23.083410] dhcpcd[611]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 23.216105] nix-grpc-daemon[778]: ts=2026-09-21T13:54:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.221089] nix-grpc-daemon[778]: ts=2026-09-21T13:54:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 23.087308] dhcpcd[611]: eth0: adding route to 10.0.2.0/24 client # [ 23.087527] dhcpcd[611]: eth0: adding default route via 10.0.2.2 client # [ 23.240411] systemd[1]: Started DHCP Client. client # [ 23.245336] systemd[1]: Reached target Multi-User System. client # [ 23.246203] systemd[1]: Startup finished in 913ms (kernel) + 5.422s (initrd) + 16.908s (userspace) = 23.244s. worker1 # [ 23.286471] nix-grpc-daemon[772]: ts=2026-09-21T13:54:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.291480] nix-grpc-daemon[772]: ts=2026-09-21T13:54:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.423918] nix-grpc-daemon[778]: ts=2026-09-21T13:54:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.428262] nix-grpc-daemon[778]: ts=2026-09-21T13:54:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.492456] nix-grpc-daemon[772]: ts=2026-09-21T13:54:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.497793] nix-grpc-daemon[772]: ts=2026-09-21T13:54:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.624554] nix-grpc-daemon[778]: ts=2026-09-21T13:54:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.629556] nix-grpc-daemon[778]: ts=2026-09-21T13:54:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.698779] nix-grpc-daemon[772]: ts=2026-09-21T13:54:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.703942] nix-grpc-daemon[772]: ts=2026-09-21T13:54:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.830779] nix-grpc-daemon[778]: ts=2026-09-21T13:54:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.835908] nix-grpc-daemon[778]: ts=2026-09-21T13:54:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.904782] nix-grpc-daemon[772]: ts=2026-09-21T13:54:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.909689] nix-grpc-daemon[772]: ts=2026-09-21T13:54:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.036992] nix-grpc-daemon[778]: ts=2026-09-21T13:54:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.041941] nix-grpc-daemon[778]: ts=2026-09-21T13:54:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.110815] nix-grpc-daemon[772]: ts=2026-09-21T13:54:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.116006] nix-grpc-daemon[772]: ts=2026-09-21T13:54:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.243053] nix-grpc-daemon[778]: ts=2026-09-21T13:54:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.248123] nix-grpc-daemon[778]: ts=2026-09-21T13:54:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.318541] nix-grpc-daemon[772]: ts=2026-09-21T13:54:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.322719] nix-grpc-daemon[772]: ts=2026-09-21T13:54:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.450748] nix-grpc-daemon[778]: ts=2026-09-21T13:54:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.454933] nix-grpc-daemon[778]: ts=2026-09-21T13:54:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.519258] nix-grpc-daemon[772]: ts=2026-09-21T13:54:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.524597] nix-grpc-daemon[772]: ts=2026-09-21T13:54:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.651435] nix-grpc-daemon[778]: ts=2026-09-21T13:54:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.656624] nix-grpc-daemon[778]: ts=2026-09-21T13:54:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.725547] nix-grpc-daemon[772]: ts=2026-09-21T13:54:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.730767] nix-grpc-daemon[772]: ts=2026-09-21T13:54:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.858205] nix-grpc-daemon[778]: ts=2026-09-21T13:54:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.869292] nix-grpc-daemon[778]: ts=2026-09-21T13:54:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.931846] nix-grpc-daemon[772]: ts=2026-09-21T13:54:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.937206] nix-grpc-daemon[772]: ts=2026-09-21T13:54:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.067289] nix-grpc-daemon[778]: ts=2026-09-21T13:54:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.072891] nix-grpc-daemon[778]: ts=2026-09-21T13:54:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.138277] nix-grpc-daemon[772]: ts=2026-09-21T13:54:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.141824] nix-grpc-daemon[772]: ts=2026-09-21T13:54:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.273979] nix-grpc-daemon[778]: ts=2026-09-21T13:54:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.278918] nix-grpc-daemon[778]: ts=2026-09-21T13:54:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.344423] nix-grpc-daemon[772]: ts=2026-09-21T13:54:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.348505] nix-grpc-daemon[772]: ts=2026-09-21T13:54:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.481573] nix-grpc-daemon[778]: ts=2026-09-21T13:54:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.485435] nix-grpc-daemon[778]: ts=2026-09-21T13:54:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.544760] nix-grpc-daemon[772]: ts=2026-09-21T13:54:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.549947] nix-grpc-daemon[772]: ts=2026-09-21T13:54:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.682426] nix-grpc-daemon[778]: ts=2026-09-21T13:54:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.687350] nix-grpc-daemon[778]: ts=2026-09-21T13:54:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.750876] nix-grpc-daemon[772]: ts=2026-09-21T13:54:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.755793] nix-grpc-daemon[772]: ts=2026-09-21T13:54:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.888488] nix-grpc-daemon[778]: ts=2026-09-21T13:54:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.893445] nix-grpc-daemon[778]: ts=2026-09-21T13:54:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.956636] nix-grpc-daemon[772]: ts=2026-09-21T13:54:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.961418] nix-grpc-daemon[772]: ts=2026-09-21T13:54:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.094430] nix-grpc-daemon[778]: ts=2026-09-21T13:54:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.099712] nix-grpc-daemon[778]: ts=2026-09-21T13:54:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.162405] nix-grpc-daemon[772]: ts=2026-09-21T13:54:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.167646] nix-grpc-daemon[772]: ts=2026-09-21T13:54:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.301074] nix-grpc-daemon[778]: ts=2026-09-21T13:54:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.306887] nix-grpc-daemon[778]: ts=2026-09-21T13:54:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.370031] nix-grpc-daemon[772]: ts=2026-09-21T13:54:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.373838] nix-grpc-daemon[772]: ts=2026-09-21T13:54:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.509495] nix-grpc-daemon[778]: ts=2026-09-21T13:54:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.513629] nix-grpc-daemon[778]: ts=2026-09-21T13:54:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.570533] nix-grpc-daemon[772]: ts=2026-09-21T13:54:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.575627] nix-grpc-daemon[772]: ts=2026-09-21T13:54:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.710461] nix-grpc-daemon[778]: ts=2026-09-21T13:54:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.715771] nix-grpc-daemon[778]: ts=2026-09-21T13:54:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.776583] nix-grpc-daemon[772]: ts=2026-09-21T13:54:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.781555] nix-grpc-daemon[772]: ts=2026-09-21T13:54:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.917079] nix-grpc-daemon[778]: ts=2026-09-21T13:54:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.922320] nix-grpc-daemon[778]: ts=2026-09-21T13:54:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.982521] nix-grpc-daemon[772]: ts=2026-09-21T13:54:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.987559] nix-grpc-daemon[772]: ts=2026-09-21T13:54:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.123596] nix-grpc-daemon[778]: ts=2026-09-21T13:54:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.128967] nix-grpc-daemon[778]: ts=2026-09-21T13:54:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.188418] nix-grpc-daemon[772]: ts=2026-09-21T13:54:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.193342] nix-grpc-daemon[772]: ts=2026-09-21T13:54:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.329922] nix-grpc-daemon[778]: ts=2026-09-21T13:54:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.334957] nix-grpc-daemon[778]: ts=2026-09-21T13:54:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.395954] nix-grpc-daemon[772]: ts=2026-09-21T13:54:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.399914] nix-grpc-daemon[772]: ts=2026-09-21T13:54:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.537948] nix-grpc-daemon[778]: ts=2026-09-21T13:54:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.542111] nix-grpc-daemon[778]: ts=2026-09-21T13:54:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.596255] nix-grpc-daemon[772]: ts=2026-09-21T13:54:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.601223] nix-grpc-daemon[772]: ts=2026-09-21T13:54:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.738603] nix-grpc-daemon[778]: ts=2026-09-21T13:54:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.743683] nix-grpc-daemon[778]: ts=2026-09-21T13:54:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.802090] nix-grpc-daemon[772]: ts=2026-09-21T13:54:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.807082] nix-grpc-daemon[772]: ts=2026-09-21T13:54:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.944895] nix-grpc-daemon[778]: ts=2026-09-21T13:54:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.949963] nix-grpc-daemon[778]: ts=2026-09-21T13:54:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.007874] nix-grpc-daemon[772]: ts=2026-09-21T13:54:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.013008] nix-grpc-daemon[772]: ts=2026-09-21T13:54:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.151063] nix-grpc-daemon[778]: ts=2026-09-21T13:54:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.160840] nix-grpc-daemon[778]: ts=2026-09-21T13:54:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.214059] nix-grpc-daemon[772]: ts=2026-09-21T13:54:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.219009] nix-grpc-daemon[772]: ts=2026-09-21T13:54:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.361728] nix-grpc-daemon[778]: ts=2026-09-21T13:54:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.366845] nix-grpc-daemon[778]: ts=2026-09-21T13:54:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.422030] nix-grpc-daemon[772]: ts=2026-09-21T13:54:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.427803] nix-grpc-daemon[772]: ts=2026-09-21T13:54:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.569776] nix-grpc-daemon[778]: ts=2026-09-21T13:54:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.573863] nix-grpc-daemon[778]: ts=2026-09-21T13:54:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.622474] nix-grpc-daemon[772]: ts=2026-09-21T13:54:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.627571] nix-grpc-daemon[772]: ts=2026-09-21T13:54:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.770906] nix-grpc-daemon[778]: ts=2026-09-21T13:54:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.776060] nix-grpc-daemon[778]: ts=2026-09-21T13:54:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.828443] nix-grpc-daemon[772]: ts=2026-09-21T13:54:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.833487] nix-grpc-daemon[772]: ts=2026-09-21T13:54:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.977005] nix-grpc-daemon[778]: ts=2026-09-21T13:54:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.981972] nix-grpc-daemon[778]: ts=2026-09-21T13:54:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.034507] nix-grpc-daemon[772]: ts=2026-09-21T13:54:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.039657] nix-grpc-daemon[772]: ts=2026-09-21T13:54:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.183150] nix-grpc-daemon[778]: ts=2026-09-21T13:54:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.188337] nix-grpc-daemon[778]: ts=2026-09-21T13:54:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.240339] nix-grpc-daemon[772]: ts=2026-09-21T13:54:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.245187] nix-grpc-daemon[772]: ts=2026-09-21T13:54:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.389079] nix-grpc-daemon[778]: ts=2026-09-21T13:54:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.393670] nix-grpc-daemon[778]: ts=2026-09-21T13:54:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.447893] nix-grpc-daemon[772]: ts=2026-09-21T13:54:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.452122] nix-grpc-daemon[772]: ts=2026-09-21T13:54:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.596524] nix-grpc-daemon[778]: ts=2026-09-21T13:54:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.600608] nix-grpc-daemon[778]: ts=2026-09-21T13:54:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.648614] nix-grpc-daemon[772]: ts=2026-09-21T13:54:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.653611] nix-grpc-daemon[772]: ts=2026-09-21T13:54:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.797138] nix-grpc-daemon[778]: ts=2026-09-21T13:54:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.801861] nix-grpc-daemon[778]: ts=2026-09-21T13:54:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.854569] nix-grpc-daemon[772]: ts=2026-09-21T13:54:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.859697] nix-grpc-daemon[772]: ts=2026-09-21T13:54:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.002910] nix-grpc-daemon[778]: ts=2026-09-21T13:54:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.007999] nix-grpc-daemon[778]: ts=2026-09-21T13:54:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.060566] nix-grpc-daemon[772]: ts=2026-09-21T13:54:10Z level=info event=scheduler_connected addr=lb:50051 lb # [ 30.088490] rustfs-bucket-start[995]: mb s3://farm worker1 # [ 30.065489] nix-grpc-daemon[772]: ts=2026-09-21T13:54:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.099414] systemd[1]: Finished rustfs-bucket.service. lb # [ 30.102952] systemd[1]: Starting niks3 server... worker2 # [ 30.208920] nix-grpc-daemon[778]: ts=2026-09-21T13:54:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.213929] nix-grpc-daemon[778]: ts=2026-09-21T13:54:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.266453] nix-grpc-daemon[772]: ts=2026-09-21T13:54:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.271326] nix-grpc-daemon[772]: ts=2026-09-21T13:54:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 30.304866] postgres[1019]: [1019] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 30.306156] postgres[1019]: [1019] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 30.338122] niks3-server[1013]: 2026/09/21 13:54:10 OK 20241026095416_initial_model.sql (18.65ms) lb # [ 30.340764] niks3-server[1013]: 2026/09/21 13:54:10 OK 20251210153512_drop_unused_gin_index.sql (3.45ms) lb # [ 30.345935] niks3-server[1013]: 2026/09/21 13:54:10 OK 20251218171726_add_pins.sql (5.14ms) lb # [ 30.350360] niks3-server[1013]: 2026/09/21 13:54:10 OK 20260628120000_add_object_size_and_stats.sql (4.43ms) lb # [ 30.355488] niks3-server[1013]: 2026/09/21 13:54:11 OK 20260905000000_add_claims.sql (3.68ms) lb # [ 30.359866] niks3-server[1013]: 2026/09/21 13:54:11 OK 20260920000000_drop_claims.sql (4.27ms) lb # [ 30.361845] niks3-server[1013]: 2026/09/21 13:54:11 goose: successfully migrated database to version: 20260920000000 lb # [ 30.366084] niks3-server[1013]: 2026/09/21 13:54:11 OK 1_commit_pending_closure.sql (6.19ms) lb # [ 30.369202] niks3-server[1013]: 2026/09/21 13:54:11 OK 2_object_stats_trigger.sql (2.72ms) lb # [ 30.370530] niks3-server[1013]: 2026/09/21 13:54:11 goose: up to current file version: 2 lb # [ 30.374461] niks3-server[1013]: 2026/09/21 13:54:11 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 30.421162] niks3-server[1013]: 2026/09/21 13:54:11 INFO Read proxy enabled — serving cache objects from S3 lb # [ 30.422989] niks3-server[1013]: 2026/09/21 13:54:11 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 30.427311] niks3-server[1013]: 2026/09/21 13:54:11 INFO systemd watchdog enabled interval=15s lb # [ 30.430209] systemd[1]: Started niks3 server. lb # [ 30.431200] niks3-server[1013]: 2026/09/21 13:54:11 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 30.432879] systemd[1]: Reached target Multi-User System. lb # [ 30.433620] systemd[1]: Startup finished in 920ms (kernel) + 5.441s (initrd) + 24.067s (userspace) = 30.429s. worker2 # [ 30.414900] nix-grpc-daemon[778]: ts=2026-09-21T13:54:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.420333] nix-grpc-daemon[778]: ts=2026-09-21T13:54:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.470285] nix-grpc-daemon[772]: ts=2026-09-21T13:54:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.474423] nix-grpc-daemon[772]: ts=2026-09-21T13:54:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.622775] nix-grpc-daemon[778]: ts=2026-09-21T13:54:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.626762] nix-grpc-daemon[778]: ts=2026-09-21T13:54:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.670622] nix-grpc-daemon[772]: ts=2026-09-21T13:54:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.676432] nix-grpc-daemon[772]: ts=2026-09-21T13:54:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.823727] nix-grpc-daemon[778]: ts=2026-09-21T13:54:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.828935] nix-grpc-daemon[778]: ts=2026-09-21T13:54:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.877214] nix-grpc-daemon[772]: ts=2026-09-21T13:54:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.882247] nix-grpc-daemon[772]: ts=2026-09-21T13:54:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.029836] nix-grpc-daemon[778]: ts=2026-09-21T13:54:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.034882] nix-grpc-daemon[778]: ts=2026-09-21T13:54:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.083329] nix-grpc-daemon[772]: ts=2026-09-21T13:54:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.088420] nix-grpc-daemon[772]: ts=2026-09-21T13:54:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 14.75 seconds) lb: waiting for TCP port 5751 on localhost worker2 # [ 31.235980] nix-grpc-daemon[778]: ts=2026-09-21T13:54:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.240995] nix-grpc-daemon[778]: ts=2026-09-21T13:54:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.289162] nix-grpc-daemon[772]: ts=2026-09-21T13:54:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.294397] nix-grpc-daemon[772]: ts=2026-09-21T13:54:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.06 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 31.435167] envoy[903]: conn peer=[::1]:39198 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) worker2 # [ 31.441725] nix-grpc-daemon[778]: ts=2026-09-21T13:54:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.446696] nix-grpc-daemon[778]: ts=2026-09-21T13:54:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.497265] nix-grpc-daemon[772]: ts=2026-09-21T13:54:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.501092] nix-grpc-daemon[772]: ts=2026-09-21T13:54:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.590312] systemd[1]: Starting scheduler-token.service... worker2 # [ 31.647784] nix-grpc-daemon[778]: ts=2026-09-21T13:54:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.649979] nix-grpc-daemon[778]: ts=2026-09-21T13:54:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.679092] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 31.682731] systemd[1]: Finished scheduler-token.service. worker2 # [ 31.683547] systemd[1]: scheduler-token.service: Consumed 27ms CPU time over 91ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 31.700857] nix-grpc-daemon[772]: ts=2026-09-21T13:54:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.706053] nix-grpc-daemon[772]: ts=2026-09-21T13:54:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.13 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.13 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 31.851392] nix-grpc-daemon[778]: ts=2026-09-21T13:54:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.856749] nix-grpc-daemon[778]: ts=2026-09-21T13:54:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 31.907070] nix-grpc-daemon[772]: ts=2026-09-21T13:54:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.912360] nix-grpc-daemon[772]: ts=2026-09-21T13:54:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.057753] nix-grpc-daemon[778]: ts=2026-09-21T13:54:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.062739] nix-grpc-daemon[778]: ts=2026-09-21T13:54:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.113021] nix-grpc-daemon[772]: ts=2026-09-21T13:54:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.119600] nix-grpc-daemon[772]: ts=2026-09-21T13:54:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.263959] nix-grpc-daemon[778]: ts=2026-09-21T13:54:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.269041] nix-grpc-daemon[778]: ts=2026-09-21T13:54:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.319264] nix-grpc-daemon[772]: ts=2026-09-21T13:54:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.324678] nix-grpc-daemon[772]: ts=2026-09-21T13:54:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.469771] nix-grpc-daemon[778]: ts=2026-09-21T13:54:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.474594] nix-grpc-daemon[778]: ts=2026-09-21T13:54:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.527233] nix-grpc-daemon[772]: ts=2026-09-21T13:54:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.531409] nix-grpc-daemon[772]: ts=2026-09-21T13:54:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.677083] nix-grpc-daemon[778]: ts=2026-09-21T13:54:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.681471] nix-grpc-daemon[778]: ts=2026-09-21T13:54:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.728211] nix-grpc-daemon[772]: ts=2026-09-21T13:54:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.733450] nix-grpc-daemon[772]: ts=2026-09-21T13:54:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 32.882551] nix-grpc-daemon[778]: ts=2026-09-21T13:54:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.887600] nix-grpc-daemon[778]: ts=2026-09-21T13:54:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.934187] nix-grpc-daemon[772]: ts=2026-09-21T13:54:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.940134] nix-grpc-daemon[772]: ts=2026-09-21T13:54:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2 # [ 33.088756] nix-grpc-daemon[778]: ts=2026-09-21T13:54:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.093764] nix-grpc-daemon[778]: ts=2026-09-21T13:54:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.140634] nix-grpc-daemon[772]: ts=2026-09-21T13:54:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.146604] nix-grpc-daemon[772]: ts=2026-09-21T13:54:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.294554] nix-grpc-daemon[778]: ts=2026-09-21T13:54:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.299774] nix-grpc-daemon[778]: ts=2026-09-21T13:54:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.347309] nix-grpc-daemon[772]: ts=2026-09-21T13:54:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.352910] nix-grpc-daemon[772]: ts=2026-09-21T13:54:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.500586] nix-grpc-daemon[778]: ts=2026-09-21T13:54:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.505702] nix-grpc-daemon[778]: ts=2026-09-21T13:54:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.555583] nix-grpc-daemon[772]: ts=2026-09-21T13:54:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.559758] nix-grpc-daemon[772]: ts=2026-09-21T13:54:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.708427] nix-grpc-daemon[778]: ts=2026-09-21T13:54:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.712312] nix-grpc-daemon[778]: ts=2026-09-21T13:54:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.756059] nix-grpc-daemon[772]: ts=2026-09-21T13:54:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.761033] nix-grpc-daemon[772]: ts=2026-09-21T13:54:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.909317] nix-grpc-daemon[778]: ts=2026-09-21T13:54:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.914139] nix-grpc-daemon[778]: ts=2026-09-21T13:54:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 33.961763] nix-grpc-daemon[772]: ts=2026-09-21T13:54:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.966833] nix-grpc-daemon[772]: ts=2026-09-21T13:54:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2 # [ 34.115116] nix-grpc-daemon[778]: ts=2026-09-21T13:54:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.119930] nix-grpc-daemon[778]: ts=2026-09-21T13:54:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.167510] nix-grpc-daemon[772]: ts=2026-09-21T13:54:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.172252] nix-grpc-daemon[772]: ts=2026-09-21T13:54:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.321235] nix-grpc-daemon[778]: ts=2026-09-21T13:54:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.326098] nix-grpc-daemon[778]: ts=2026-09-21T13:54:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.373003] nix-grpc-daemon[772]: ts=2026-09-21T13:54:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.378046] nix-grpc-daemon[772]: ts=2026-09-21T13:54:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.527028] nix-grpc-daemon[778]: ts=2026-09-21T13:54:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.532229] nix-grpc-daemon[778]: ts=2026-09-21T13:54:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.580592] nix-grpc-daemon[772]: ts=2026-09-21T13:54:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.584574] nix-grpc-daemon[772]: ts=2026-09-21T13:54:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.734973] nix-grpc-daemon[778]: ts=2026-09-21T13:54:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.738977] nix-grpc-daemon[778]: ts=2026-09-21T13:54:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.781114] nix-grpc-daemon[772]: ts=2026-09-21T13:54:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.785883] nix-grpc-daemon[772]: ts=2026-09-21T13:54:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.935562] nix-grpc-daemon[778]: ts=2026-09-21T13:54:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.939913] nix-grpc-daemon[778]: ts=2026-09-21T13:54:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.986681] nix-grpc-daemon[772]: ts=2026-09-21T13:54:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.991701] nix-grpc-daemon[772]: ts=2026-09-21T13:54:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker2 # [ 35.141102] nix-grpc-daemon[778]: ts=2026-09-21T13:54:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.146020] nix-grpc-daemon[778]: ts=2026-09-21T13:54:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.192581] nix-grpc-daemon[772]: ts=2026-09-21T13:54:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.197050] nix-grpc-daemon[772]: ts=2026-09-21T13:54:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.346928] nix-grpc-daemon[778]: ts=2026-09-21T13:54:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.352960] nix-grpc-daemon[778]: ts=2026-09-21T13:54:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.397673] nix-grpc-daemon[772]: ts=2026-09-21T13:54:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.402538] nix-grpc-daemon[772]: ts=2026-09-21T13:54:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.554085] nix-grpc-daemon[778]: ts=2026-09-21T13:54:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.559069] nix-grpc-daemon[778]: ts=2026-09-21T13:54:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.605099] nix-grpc-daemon[772]: ts=2026-09-21T13:54:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.609026] nix-grpc-daemon[772]: ts=2026-09-21T13:54:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.761783] nix-grpc-daemon[778]: ts=2026-09-21T13:54:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.765863] nix-grpc-daemon[778]: ts=2026-09-21T13:54:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.805467] nix-grpc-daemon[772]: ts=2026-09-21T13:54:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.810234] nix-grpc-daemon[772]: ts=2026-09-21T13:54:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.962644] nix-grpc-daemon[778]: ts=2026-09-21T13:54:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.968220] nix-grpc-daemon[778]: ts=2026-09-21T13:54:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.011182] nix-grpc-daemon[772]: ts=2026-09-21T13:54:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.016282] nix-grpc-daemon[772]: ts=2026-09-21T13:54:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 36.169140] nix-grpc-daemon[778]: ts=2026-09-21T13:54:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.174102] nix-grpc-daemon[778]: ts=2026-09-21T13:54:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1 # [ 36.217003] nix-grpc-daemon[772]: ts=2026-09-21T13:54:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.221993] nix-grpc-daemon[772]: ts=2026-09-21T13:54:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.374966] nix-grpc-daemon[778]: ts=2026-09-21T13:54:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.380101] nix-grpc-daemon[778]: ts=2026-09-21T13:54:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.423093] nix-grpc-daemon[772]: ts=2026-09-21T13:54:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.428643] nix-grpc-daemon[772]: ts=2026-09-21T13:54:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.581090] nix-grpc-daemon[778]: ts=2026-09-21T13:54:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.586115] nix-grpc-daemon[778]: ts=2026-09-21T13:54:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.630755] nix-grpc-daemon[772]: ts=2026-09-21T13:54:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.634877] nix-grpc-daemon[772]: ts=2026-09-21T13:54:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.788988] nix-grpc-daemon[778]: ts=2026-09-21T13:54:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.793041] nix-grpc-daemon[778]: ts=2026-09-21T13:54:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.831282] nix-grpc-daemon[772]: ts=2026-09-21T13:54:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.836499] nix-grpc-daemon[772]: ts=2026-09-21T13:54:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.989545] nix-grpc-daemon[778]: ts=2026-09-21T13:54:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.994541] nix-grpc-daemon[778]: ts=2026-09-21T13:54:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.037226] nix-grpc-daemon[772]: ts=2026-09-21T13:54:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.042167] nix-grpc-daemon[772]: ts=2026-09-21T13:54:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.195729] nix-grpc-daemon[778]: ts=2026-09-21T13:54:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.200951] nix-grpc-daemon[778]: ts=2026-09-21T13:54:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 37.242881] nix-grpc-daemon[772]: ts=2026-09-21T13:54:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.247930] nix-grpc-daemon[772]: ts=2026-09-21T13:54:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2 # [ 37.401775] nix-grpc-daemon[778]: ts=2026-09-21T13:54:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.406729] nix-grpc-daemon[778]: ts=2026-09-21T13:54:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.448711] nix-grpc-daemon[772]: ts=2026-09-21T13:54:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.453745] nix-grpc-daemon[772]: ts=2026-09-21T13:54:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.607742] nix-grpc-daemon[778]: ts=2026-09-21T13:54:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.612804] nix-grpc-daemon[778]: ts=2026-09-21T13:54:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.656310] nix-grpc-daemon[772]: ts=2026-09-21T13:54:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.660315] nix-grpc-daemon[772]: ts=2026-09-21T13:54:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.815490] nix-grpc-daemon[778]: ts=2026-09-21T13:54:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.819649] nix-grpc-daemon[778]: ts=2026-09-21T13:54:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.856558] nix-grpc-daemon[772]: ts=2026-09-21T13:54:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.861635] nix-grpc-daemon[772]: ts=2026-09-21T13:54:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.017327] nix-grpc-daemon[778]: ts=2026-09-21T13:54:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.021449] nix-grpc-daemon[778]: ts=2026-09-21T13:54:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.062322] nix-grpc-daemon[772]: ts=2026-09-21T13:54:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.067555] nix-grpc-daemon[772]: ts=2026-09-21T13:54:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.218298] nix-grpc-daemon[778]: ts=2026-09-21T13:54:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.221108] nix-grpc-daemon[778]: ts=2026-09-21T13:54:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.268203] nix-grpc-daemon[772]: ts=2026-09-21T13:54:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.273070] nix-grpc-daemon[772]: ts=2026-09-21T13:54:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker2 # [ 38.422278] nix-grpc-daemon[778]: ts=2026-09-21T13:54:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.427306] nix-grpc-daemon[778]: ts=2026-09-21T13:54:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.473777] nix-grpc-daemon[772]: ts=2026-09-21T13:54:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.478288] nix-grpc-daemon[772]: ts=2026-09-21T13:54:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.628329] nix-grpc-daemon[778]: ts=2026-09-21T13:54:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.633270] nix-grpc-daemon[778]: ts=2026-09-21T13:54:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.680682] nix-grpc-daemon[772]: ts=2026-09-21T13:54:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.684759] nix-grpc-daemon[772]: ts=2026-09-21T13:54:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.835959] nix-grpc-daemon[778]: ts=2026-09-21T13:54:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.839977] nix-grpc-daemon[778]: ts=2026-09-21T13:54:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.881200] nix-grpc-daemon[772]: ts=2026-09-21T13:54:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.886349] nix-grpc-daemon[772]: ts=2026-09-21T13:54:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.036496] nix-grpc-daemon[778]: ts=2026-09-21T13:54:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.041502] nix-grpc-daemon[778]: ts=2026-09-21T13:54:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.087007] nix-grpc-daemon[772]: ts=2026-09-21T13:54:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.092177] nix-grpc-daemon[772]: ts=2026-09-21T13:54:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.242471] nix-grpc-daemon[778]: ts=2026-09-21T13:54:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.247417] nix-grpc-daemon[778]: ts=2026-09-21T13:54:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.292870] nix-grpc-daemon[772]: ts=2026-09-21T13:54:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.297957] nix-grpc-daemon[772]: ts=2026-09-21T13:54:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 39.448372] nix-grpc-daemon[778]: ts=2026-09-21T13:54:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.453116] nix-grpc-daemon[778]: ts=2026-09-21T13:54:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1 # [ 39.498624] nix-grpc-daemon[772]: ts=2026-09-21T13:54:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.503455] nix-grpc-daemon[772]: ts=2026-09-21T13:54:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.654181] nix-grpc-daemon[778]: ts=2026-09-21T13:54:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.658975] nix-grpc-daemon[778]: ts=2026-09-21T13:54:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.706101] nix-grpc-daemon[772]: ts=2026-09-21T13:54:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.710149] nix-grpc-daemon[772]: ts=2026-09-21T13:54:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.861587] nix-grpc-daemon[778]: ts=2026-09-21T13:54:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.865474] nix-grpc-daemon[778]: ts=2026-09-21T13:54:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.906410] nix-grpc-daemon[772]: ts=2026-09-21T13:54:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.911360] nix-grpc-daemon[772]: ts=2026-09-21T13:54:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.062264] nix-grpc-daemon[778]: ts=2026-09-21T13:54:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.067000] nix-grpc-daemon[778]: ts=2026-09-21T13:54:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.112198] nix-grpc-daemon[772]: ts=2026-09-21T13:54:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.117192] nix-grpc-daemon[772]: ts=2026-09-21T13:54:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.268078] nix-grpc-daemon[778]: ts=2026-09-21T13:54:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.272991] nix-grpc-daemon[778]: ts=2026-09-21T13:54:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.317866] nix-grpc-daemon[772]: ts=2026-09-21T13:54:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.322966] nix-grpc-daemon[772]: ts=2026-09-21T13:54:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.416992] nix-grpc-daemon[778]: ts=2026-09-21T13:54:21Z level=info event=scheduler_take_over lb # [ 40.442156] niks3-server[1013]: 2026/09/21 13:54:21 INFO lead: acquired remote=192.168.1.4:43812 worker2 # [ 40.473866] nix-grpc-daemon[778]: ts=2026-09-21T13:54:21Z level=info event=scheduler_connected addr=lb:50051 lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 40.478727] nix-grpc-daemon[778]: ts=2026-09-21T13:54:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.523856] nix-grpc-daemon[772]: ts=2026-09-21T13:54:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.528988] nix-grpc-daemon[772]: ts=2026-09-21T13:54:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2 # [ 40.679788] nix-grpc-daemon[778]: ts=2026-09-21T13:54:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.684994] nix-grpc-daemon[778]: ts=2026-09-21T13:54:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.731419] nix-grpc-daemon[772]: ts=2026-09-21T13:54:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.735567] nix-grpc-daemon[772]: ts=2026-09-21T13:54:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.887662] nix-grpc-daemon[778]: ts=2026-09-21T13:54:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.891841] nix-grpc-daemon[778]: ts=2026-09-21T13:54:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.931925] nix-grpc-daemon[772]: ts=2026-09-21T13:54:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.937067] nix-grpc-daemon[772]: ts=2026-09-21T13:54:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.088532] nix-grpc-daemon[778]: ts=2026-09-21T13:54:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.093567] nix-grpc-daemon[778]: ts=2026-09-21T13:54:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.137730] nix-grpc-daemon[772]: ts=2026-09-21T13:54:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.142881] nix-grpc-daemon[772]: ts=2026-09-21T13:54:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.294472] nix-grpc-daemon[778]: ts=2026-09-21T13:54:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.299566] nix-grpc-daemon[778]: ts=2026-09-21T13:54:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.343397] nix-grpc-daemon[772]: ts=2026-09-21T13:54:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.348371] nix-grpc-daemon[772]: ts=2026-09-21T13:54:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.500967] nix-grpc-daemon[778]: ts=2026-09-21T13:54:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.524543] nix-grpc-daemon[778]: ts=2026-09-21T13:54:22Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 41.527587] nix-grpc-daemon[778]: ts=2026-09-21T13:54:22Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53172 worker2 # [ 41.532271] nix-grpc-daemon[778]: ts=2026-09-21T13:54:22Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 41.549161] nix-grpc-daemon[778]: ts=2026-09-21T13:54:22Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53172 worker1 # [ 41.549068] nix-grpc-daemon[772]: ts=2026-09-21T13:54:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.551695] nix-grpc-daemon[778]: ts=2026-09-21T13:54:22Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.65 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 42.847948] nix-grpc-daemon[772]: ts=2026-09-21T13:54:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 42.864912] systemd[1]: Started Nix Daemon. worker1 # [ 43.122570] nix-daemon[838]: accepted connection from pid 772, user nix-grpc-daemon (trusted) worker1 # [ 43.145176] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5) worker1 # [ 43.181343] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 125 ms (attempt 2/5) worker1 # [ 43.310076] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 234 ms (attempt 3/5) worker1 # [ 43.551644] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 221 ms (attempt 4/5) worker1 # [ 43.782297] nix-grpc-daemon[772]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 43.788233] nix-grpc-daemon[772]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 43.821323] nix-grpc-daemon[778]: ts=2026-09-21T13:54:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 43.840003] systemd[1]: Started Nix Daemon. worker2 # [ 44.109351] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 44.131279] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 28 ms (attempt 1/5) worker2 # [ 44.161956] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 134 ms (attempt 2/5) worker2 # [ 44.296355] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 383 ms (attempt 3/5) worker2 # [ 44.686894] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 693 ms (attempt 4/5) worker2 # [ 45.390529] nix-grpc-daemon[778]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 45.395888] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 45.413072] nix-grpc-daemon[778]: ts=2026-09-21T13:54:26Z level=debug event=path_info_miss path=5dwn502h5kcmk6n9yvgspbhv8xp80kb2-nixos-system-client-test error="error: path '/nix/store/5dwn502h5kcmk6n9yvgspbhv8xp80kb2-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 45.425141] nix-grpc-daemon[772]: ts=2026-09-21T13:54:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 45.440148] nix-grpc-daemon[772]: ts=2026-09-21T13:54:26Z level=debug event=path_info_miss path=5dwn502h5kcmk6n9yvgspbhv8xp80kb2-nixos-system-client-test error="error: path '/nix/store/5dwn502h5kcmk6n9yvgspbhv8xp80kb2-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.09 seconds) client: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds) worker1 # [ 45.876267] nix-grpc-daemon[772]: ts=2026-09-21T13:54:26Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 45.883571] nix-grpc-daemon[772]: ts=2026-09-21T13:54:26Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:40418 worker2 # [ 45.895006] nix-grpc-daemon[778]: ts=2026-09-21T13:54:26Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:53182 worker2 # [ 45.907434] nix-grpc-daemon[778]: ts=2026-09-21T13:54:26Z level=debug event=path_info_miss path=5dwn502h5kcmk6n9yvgspbhv8xp80kb2-nixos-system-client-test error="error: path '/nix/store/5dwn502h5kcmk6n9yvgspbhv8xp80kb2-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 45.921952] nix-grpc-daemon[778]: ts=2026-09-21T13:54:26Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:53182 worker2 # [ 45.929994] nix-grpc-daemon[778]: ts=2026-09-21T13:54:26Z level=debug event=path_info_miss path=5dwn502h5kcmk6n9yvgspbhv8xp80kb2-nixos-system-client-test error="error: path '/nix/store/5dwn502h5kcmk6n9yvgspbhv8xp80kb2-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds) worker1 # [ 46.231082] nix-grpc-daemon[772]: ts=2026-09-21T13:54:26Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 46.486096] nix-grpc-daemon[772]: ts=2026-09-21T13:54:27Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.04 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker2 # [ 46.739323] nix-grpc-daemon[778]: ts=2026-09-21T13:54:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53182 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 46.753506] nix-grpc-daemon[772]: ts=2026-09-21T13:54:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40418 worker2 # [ 46.787973] nix-grpc-daemon[778]: ts=2026-09-21T13:54:27Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 46.795222] nix-grpc-daemon[778]: ts=2026-09-21T13:54:27Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 46.847371] nix-grpc-daemon[778]: ts=2026-09-21T13:54:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 46.869318] nix-grpc-daemon[778]: ts=2026-09-21T13:54:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 client # copying 1 paths to 'lb:50051'... worker2 # [ 46.884097] nix-grpc-daemon[778]: ts=2026-09-21T13:54:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker2 # [ 46.913946] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 46.945607] nix-grpc-daemon[778]: ts=2026-09-21T13:54:27Z level=info event=niks3_push_started pid=879 worker2 # [ 47.223647] nix-grpc-daemon[879]: time=2026-09-21T13:54:27.860Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 47.430958] nix-daemon[864]: accepted connection from pid 892, user nix-grpc-daemon (trusted) worker2 # [ 47.454552] nix-daemon[864]: reaped child process 895, status = succeeded worker2 # [ 47.691124] nix-daemon[864]: accepted connection from pid 897, user nix-grpc-daemon (trusted) worker2 # [ 47.716099] nix-daemon[864]: reaped child process 900, status = succeeded lb # [ 47.753352] niks3-server[1013]: 2026/09/21 13:54:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.765983] nix-grpc-daemon[879]: time=2026-09-21T13:54:28.404Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 47.770899] nix-grpc-daemon[879]: time=2026-09-21T13:54:28.406Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 47.853458] niks3-server[1013]: 2026/09/21 13:54:28 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 47.866062] niks3-server[1013]: 2026/09/21 13:54:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 47.878463] niks3-server[1013]: 2026/09/21 13:54:28 INFO Signed narinfos id=1 count=1 worker2 # [ 47.858797] nix-grpc-daemon[879]: time=2026-09-21T13:54:28.495Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.927267] niks3-server[1013]: 2026/09/21 13:54:28 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 47.937854] niks3-server[1013]: 2026/09/21 13:54:28 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 47.942690] niks3-server[1013]: 2026/09/21 13:54:28 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo lb # [ 47.950901] niks3-server[1013]: 2026/09/21 13:54:28 INFO Completed upload id=1 worker2 # [ 47.927008] nix-grpc-daemon[879]: time=2026-09-21T13:54:28.565Z level=INFO msg="Upload complete. (695ms)" worker2 # [ 47.943175] nix-grpc-daemon[778]: ts=2026-09-21T13:54:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=1 paths=1 nar_bytes_in=504 worker2 # [ 47.956877] nix-grpc-daemon[778]: ts=2026-09-21T13:54:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 47.974203] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 47.984799] nix-daemon[864]: reaped child process 877, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker2 # [ 48.000421] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker2 # [ 49.447754] nix-daemon[864]: reaped child process 904, status = succeeded worker2 # [ 49.653742] nix-daemon[864]: accepted connection from pid 921, user nix-grpc-daemon (trusted) worker2 # [ 49.671110] nix-daemon[864]: reaped child process 924, status = succeeded lb # [ 49.708789] niks3-server[1013]: 2026/09/21 13:54:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 49.701617] nix-grpc-daemon[879]: time=2026-09-21T13:54:30.338Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 49.703430] nix-grpc-daemon[879]: time=2026-09-21T13:54:30.338Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 49.768692] niks3-server[1013]: 2026/09/21 13:54:30 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 49.778571] niks3-server[1013]: 2026/09/21 13:54:30 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 49.789886] niks3-server[1013]: 2026/09/21 13:54:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 49.797426] niks3-server[1013]: 2026/09/21 13:54:30 INFO Signed narinfos id=2 count=1 worker2 # [ 49.772110] nix-grpc-daemon[879]: time=2026-09-21T13:54:30.409Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.799988] niks3-server[1013]: 2026/09/21 13:54:30 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 49.810537] niks3-server[1013]: 2026/09/21 13:54:30 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 49.817520] niks3-server[1013]: 2026/09/21 13:54:30 INFO Completed upload id=2 worker2 # [ 49.792456] nix-grpc-daemon[879]: time=2026-09-21T13:54:30.430Z level=INFO msg="Upload complete. (376ms)" lb # [ 49.820139] niks3-server[1013]: 2026/09/21 13:54:30 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker2 # [ 49.817374] nix-grpc-daemon[778]: ts=2026-09-21T13:54:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 49.832350] nix-grpc-daemon[778]: ts=2026-09-21T13:54:30Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 49.835540] nix-grpc-daemon[778]: ts=2026-09-21T13:54:30Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 49.839517] nix-daemon[864]: reaped child process 902, status = succeeded worker2 # [ 49.862450] nix-grpc-daemon[778]: ts=2026-09-21T13:54:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 49.878069] nix-grpc-daemon[778]: ts=2026-09-21T13:54:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 49.893847] nix-grpc-daemon[879]: time=2026-09-21T13:54:30.532Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 49.902710] nix-grpc-daemon[778]: ts=2026-09-21T13:54:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker2 # [ 49.926358] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 50.134082] nix-daemon[864]: accepted connection from pid 930, user nix-grpc-daemon (trusted) worker2 # [ 50.150910] nix-daemon[864]: reaped child process 933, status = succeeded worker2 # [ 50.321975] nix-daemon[864]: accepted connection from pid 935, user nix-grpc-daemon (trusted) worker2 # [ 50.338781] nix-daemon[864]: reaped child process 938, status = succeeded lb # [ 50.374484] niks3-server[1013]: 2026/09/21 13:54:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 50.360104] nix-grpc-daemon[879]: time=2026-09-21T13:54:30.998Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 50.362201] nix-grpc-daemon[879]: time=2026-09-21T13:54:31.000Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" worker2 # [ 50.396258] nix-grpc-daemon[879]: time=2026-09-21T13:54:31.034Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.408738] niks3-server[1013]: 2026/09/21 13:54:31 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 50.426442] niks3-server[1013]: 2026/09/21 13:54:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 50.441010] niks3-server[1013]: 2026/09/21 13:54:31 INFO Signed narinfos id=3 count=1 lb # [ 50.456477] niks3-server[1013]: 2026/09/21 13:54:31 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls worker2 # [ 50.439330] nix-grpc-daemon[879]: time=2026-09-21T13:54:31.077Z level=INFO msg="Upload complete. (495ms)" lb # [ 50.464920] niks3-server[1013]: 2026/09/21 13:54:31 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 50.474308] niks3-server[1013]: 2026/09/21 13:54:31 INFO Completed upload id=3 worker2 # [ 50.448605] nix-grpc-daemon[778]: ts=2026-09-21T13:54:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 50.477352] niks3-server[1013]: 2026/09/21 13:54:31 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker2 # [ 50.463431] nix-grpc-daemon[778]: ts=2026-09-21T13:54:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 50.470504] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 50.475678] nix-daemon[864]: reaped child process 928, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker2 # [ 50.490324] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 51.883275] envoy[903]: conn peer=[2001:db8:1::1]:55366 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2655 lb # [ 51.888468] envoy[903]: conn peer=[2001:db8:1::1]:55378 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=77 lb # [ 51.894378] envoy[903]: conn peer=[2001:db8:1::1]:55388 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=13 lb # [ 51.899003] envoy[903]: conn peer=[2001:db8:1::1]:55394 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=9 client # farm-b> LOG-farm-b-t1 worker2 # [ 51.908903] nix-daemon[864]: reaped child process 942, status = succeeded worker2 # [ 52.071197] nix-daemon[864]: accepted connection from pid 958, user nix-grpc-daemon (trusted) worker2 # [ 52.086594] nix-daemon[864]: reaped child process 961, status = succeeded lb # [ 52.127397] niks3-server[1013]: 2026/09/21 13:54:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 52.120463] nix-grpc-daemon[879]: time=2026-09-21T13:54:32.757Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 52.121933] nix-grpc-daemon[879]: time=2026-09-21T13:54:32.757Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 52.176194] niks3-server[1013]: 2026/09/21 13:54:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign worker2 # [ 52.159991] nix-grpc-daemon[879]: time=2026-09-21T13:54:32.798Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.193702] niks3-server[1013]: 2026/09/21 13:54:32 INFO Signed narinfos id=4 count=1 lb # [ 52.205017] niks3-server[1013]: 2026/09/21 13:54:32 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 52.216226] niks3-server[1013]: 2026/09/21 13:54:32 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 52.221414] niks3-server[1013]: 2026/09/21 13:54:32 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 52.225245] niks3-server[1013]: 2026/09/21 13:54:32 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 52.229718] niks3-server[1013]: 2026/09/21 13:54:32 INFO Completed upload id=4 worker2 # [ 52.205578] nix-grpc-daemon[879]: time=2026-09-21T13:54:32.844Z level=INFO msg="Upload complete. (305ms)" lb # [ 52.232463] niks3-server[1013]: 2026/09/21 13:54:32 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker2 # [ 52.222529] nix-grpc-daemon[778]: ts=2026-09-21T13:54:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 52.237925] nix-grpc-daemon[778]: ts=2026-09-21T13:54:32Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 52.242299] nix-grpc-daemon[778]: ts=2026-09-21T13:54:32Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 52.246791] nix-daemon[864]: reaped child process 940, status = succeeded worker2 # [ 52.269232] nix-grpc-daemon[778]: ts=2026-09-21T13:54:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 52.278512] nix-grpc-daemon[778]: ts=2026-09-21T13:54:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 52.290763] nix-grpc-daemon[879]: time=2026-09-21T13:54:32.929Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 52.300094] nix-grpc-daemon[778]: ts=2026-09-21T13:54:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker2 # [ 52.328888] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 52.528673] nix-daemon[864]: accepted connection from pid 967, user nix-grpc-daemon (trusted) worker2 # [ 52.545765] nix-daemon[864]: reaped child process 970, status = succeeded worker2 # [ 52.716610] nix-daemon[864]: accepted connection from pid 972, user nix-grpc-daemon (trusted) worker2 # [ 52.733042] nix-daemon[864]: reaped child process 975, status = succeeded lb # [ 52.769581] niks3-server[1013]: 2026/09/21 13:54:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 52.756736] nix-grpc-daemon[879]: time=2026-09-21T13:54:33.394Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 52.758209] nix-grpc-daemon[879]: time=2026-09-21T13:54:33.395Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" worker2 # [ 52.784448] nix-grpc-daemon[879]: time=2026-09-21T13:54:33.422Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.808463] niks3-server[1013]: 2026/09/21 13:54:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 52.811816] niks3-server[1013]: 2026/09/21 13:54:33 INFO Signed narinfos id=5 count=1 lb # [ 52.821129] niks3-server[1013]: 2026/09/21 13:54:33 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 52.831430] niks3-server[1013]: 2026/09/21 13:54:33 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls worker2 # [ 52.813084] nix-grpc-daemon[879]: time=2026-09-21T13:54:33.451Z level=INFO msg="Upload complete. (466ms)" lb # [ 52.839363] niks3-server[1013]: 2026/09/21 13:54:33 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete worker2 # [ 52.820330] nix-grpc-daemon[778]: ts=2026-09-21T13:54:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 52.847470] niks3-server[1013]: 2026/09/21 13:54:33 INFO Completed upload id=5 lb # [ 52.850301] niks3-server[1013]: 2026/09/21 13:54:33 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker2 # [ 52.828552] nix-grpc-daemon[778]: ts=2026-09-21T13:54:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 52.840161] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 52.842438] nix-daemon[864]: reaped child process 965, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 52.854710] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker2 # [ 54.274604] nix-daemon[864]: reaped child process 979, status = succeeded worker2 # [ 54.428826] nix-daemon[864]: accepted connection from pid 995, user nix-grpc-daemon (trusted) worker2 # [ 54.446432] nix-daemon[864]: reaped child process 998, status = succeeded lb # [ 54.483553] niks3-server[1013]: 2026/09/21 13:54:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 54.470569] nix-grpc-daemon[879]: time=2026-09-21T13:54:35.107Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 54.472086] nix-grpc-daemon[879]: time=2026-09-21T13:54:35.107Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 54.519808] niks3-server[1013]: 2026/09/21 13:54:35 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 54.531342] niks3-server[1013]: 2026/09/21 13:54:35 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 54.543973] niks3-server[1013]: 2026/09/21 13:54:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker2 # [ 54.524779] nix-grpc-daemon[879]: time=2026-09-21T13:54:35.162Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.552030] niks3-server[1013]: 2026/09/21 13:54:35 INFO Signed narinfos id=6 count=1 lb # [ 54.554646] niks3-server[1013]: 2026/09/21 13:54:35 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 54.565823] niks3-server[1013]: 2026/09/21 13:54:35 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete worker2 # [ 54.546823] nix-grpc-daemon[879]: time=2026-09-21T13:54:35.185Z level=INFO msg="Upload complete. (283ms)" lb # [ 54.573147] niks3-server[1013]: 2026/09/21 13:54:35 INFO Completed upload id=6 lb # [ 54.577120] niks3-server[1013]: 2026/09/21 13:54:35 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker2 # [ 54.556949] nix-grpc-daemon[778]: ts=2026-09-21T13:54:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker2 # [ 54.572216] nix-daemon[864]: reaped child process 977, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 8.13 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.81 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.27 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 56.163153] nix-grpc-daemon[772]: ts=2026-09-21T13:54:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40418 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 56.174200] nix-grpc-daemon[778]: ts=2026-09-21T13:54:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 56.185482] nix-grpc-daemon[879]: time=2026-09-21T13:54:36.823Z level=INFO msg="All 2 paths already cached" worker2 # [ 56.202339] nix-grpc-daemon[778]: ts=2026-09-21T13:54:36Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.35 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.47 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 57.237293] nix-grpc-daemon[778]: ts=2026-09-21T13:54:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53182 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 57.253860] nix-grpc-daemon[772]: ts=2026-09-21T13:54:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40418 worker2 # [ 57.282148] nix-grpc-daemon[778]: ts=2026-09-21T13:54:37Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 57.289805] nix-grpc-daemon[778]: ts=2026-09-21T13:54:37Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 57.328131] nix-grpc-daemon[778]: ts=2026-09-21T13:54:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 57.343601] nix-grpc-daemon[778]: ts=2026-09-21T13:54:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 client # copying 1 paths to 'lb:50051'... worker2 # [ 57.359698] nix-grpc-daemon[879]: time=2026-09-21T13:54:37.996Z level=INFO msg="All 2 paths already cached" client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker2 # [ 57.365161] nix-grpc-daemon[778]: ts=2026-09-21T13:54:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 57.383009] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 57.592750] nix-daemon[864]: accepted connection from pid 1027, user nix-grpc-daemon (trusted) worker2 # [ 57.611535] nix-daemon[864]: reaped child process 1030, status = succeeded worker2 # [ 57.784264] nix-daemon[864]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker2 # [ 57.801738] nix-daemon[864]: reaped child process 1035, status = succeeded lb # [ 57.838502] niks3-server[1013]: 2026/09/21 13:54:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 57.823627] nix-grpc-daemon[879]: time=2026-09-21T13:54:38.461Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 57.825293] nix-grpc-daemon[879]: time=2026-09-21T13:54:38.461Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 57.864863] niks3-server[1013]: 2026/09/21 13:54:38 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 57.878628] niks3-server[1013]: 2026/09/21 13:54:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker2 # [ 57.861542] nix-grpc-daemon[879]: time=2026-09-21T13:54:38.499Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.889333] niks3-server[1013]: 2026/09/21 13:54:38 INFO Signed narinfos id=7 count=1 lb # [ 57.896220] niks3-server[1013]: 2026/09/21 13:54:38 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 57.904335] niks3-server[1013]: 2026/09/21 13:54:38 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete worker2 # [ 57.885440] nix-grpc-daemon[879]: time=2026-09-21T13:54:38.523Z level=INFO msg="Upload complete. (484ms)" lb # [ 57.910315] niks3-server[1013]: 2026/09/21 13:54:38 INFO Completed upload id=7 lb # [ 57.912821] niks3-server[1013]: 2026/09/21 13:54:38 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker2 # [ 57.892131] nix-grpc-daemon[778]: ts=2026-09-21T13:54:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 57.900883] nix-grpc-daemon[778]: ts=2026-09-21T13:54:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 57.910807] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 57.915526] nix-daemon[864]: reaped child process 1025, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 57.928657] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker2 # [ 59.347493] nix-daemon[864]: reaped child process 1039, status = succeeded worker2 # [ 59.508425] nix-daemon[864]: accepted connection from pid 1055, user nix-grpc-daemon (trusted) worker2 # [ 59.526510] nix-daemon[864]: reaped child process 1058, status = succeeded lb # [ 59.563488] niks3-server[1013]: 2026/09/21 13:54:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 59.550973] nix-grpc-daemon[879]: time=2026-09-21T13:54:40.186Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 59.552512] nix-grpc-daemon[879]: time=2026-09-21T13:54:40.186Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" worker2 # [ 59.587278] nix-grpc-daemon[879]: time=2026-09-21T13:54:40.225Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.602221] niks3-server[1013]: 2026/09/21 13:54:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 59.616984] niks3-server[1013]: 2026/09/21 13:54:40 INFO Signed narinfos id=8 count=1 lb # [ 59.624833] niks3-server[1013]: 2026/09/21 13:54:40 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 59.635182] niks3-server[1013]: 2026/09/21 13:54:40 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 59.615385] nix-grpc-daemon[879]: time=2026-09-21T13:54:40.253Z level=INFO msg="Upload complete. (277ms)" lb # [ 59.640670] niks3-server[1013]: 2026/09/21 13:54:40 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 59.646861] niks3-server[1013]: 2026/09/21 13:54:40 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 59.651095] niks3-server[1013]: 2026/09/21 13:54:40 INFO Completed upload id=8 worker2 # [ 59.624854] nix-grpc-daemon[778]: ts=2026-09-21T13:54:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 lb # [ 59.654010] niks3-server[1013]: 2026/09/21 13:54:40 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker2 # [ 59.638103] nix-daemon[864]: reaped child process 1037, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.70 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.32 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 60.167607] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # Running as unit: dedup1.service; invocation ID: a170b4f13631493ab9ef27abd12f0006 client # [ 60.431540] nix[938]: don't know how to build these paths: worker2 # [ 60.431911] nix-grpc-daemon[778]: ts=2026-09-21T13:54:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53182 client # [ 60.433713] nix[938]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 60.446769] nix-grpc-daemon[778]: ts=2026-09-21T13:54:41Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 60.452764] nix-grpc-daemon[778]: ts=2026-09-21T13:54:41Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 60.496959] nix-grpc-daemon[772]: ts=2026-09-21T13:54:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 60.515103] nix-grpc-daemon[772]: ts=2026-09-21T13:54:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40418 client # [ 60.524197] nix[938]: copying 1 paths to 'lb:50051'... worker1 # [ 60.529494] nix-grpc-daemon[772]: ts=2026-09-21T13:54:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40418 client # [ 60.526529] nix[938]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker1 # [ 60.543490] nix-daemon[838]: accepted connection from pid 772, user nix-grpc-daemon (trusted) worker1 # [ 60.576552] nix-grpc-daemon[772]: ts=2026-09-21T13:54:41Z level=info event=niks3_push_started pid=865 worker1 # [ 60.840910] nix-grpc-daemon[865]: time=2026-09-21T13:54:41.479Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 61.030058] nix-daemon[838]: accepted connection from pid 878, user nix-grpc-daemon (trusted) worker1 # [ 61.048006] nix-daemon[838]: reaped child process 881, status = succeeded worker1 # [ 61.218071] nix-daemon[838]: accepted connection from pid 883, user nix-grpc-daemon (trusted) worker1 # [ 61.234816] nix-daemon[838]: reaped child process 886, status = succeeded lb # [ 61.271078] niks3-server[1013]: 2026/09/21 13:54:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 61.259613] nix-grpc-daemon[865]: time=2026-09-21T13:54:41.899Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 61.262883] nix-grpc-daemon[865]: time=2026-09-21T13:54:41.901Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 61.309041] niks3-server[1013]: 2026/09/21 13:54:41 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst client # [ 61.282161] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. lb # [ 61.320133] niks3-server[1013]: 2026/09/21 13:54:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign client # Running as unit: dedup2.service; invocation ID: f51f319524c3479c845f4f50a312ab9d worker1 # [ 61.304969] nix-grpc-daemon[865]: time=2026-09-21T13:54:41.944Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.333093] niks3-server[1013]: 2026/09/21 13:54:41 INFO Signed narinfos id=9 count=1 lb # [ 61.340609] niks3-server[1013]: 2026/09/21 13:54:41 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds) lb # [ 61.354281] niks3-server[1013]: 2026/09/21 13:54:41 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 61.360405] niks3-server[1013]: 2026/09/21 13:54:42 INFO Completed upload id=9 worker1 # [ 61.338752] nix-grpc-daemon[865]: time=2026-09-21T13:54:41.977Z level=INFO msg="Upload complete. (489ms)" lb # [ 61.364637] niks3-server[1013]: 2026/09/21 13:54:42 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker1 # [ 61.348072] nix-grpc-daemon[772]: ts=2026-09-21T13:54:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40418 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 61.351471] nix-grpc-daemon[772]: ts=2026-09-21T13:54:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 61.367627] nix-daemon[838]: accepted connection from pid 772, user nix-grpc-daemon (trusted) worker1 # [ 61.373160] nix-daemon[838]: reaped child process 863, status = succeeded client # [ 61.380258] nix[938]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker1 # [ 61.388489] nix-daemon[838]: accepted connection from pid 772, user nix-grpc-daemon (trusted) worker2 # [ 61.667631] nix-grpc-daemon[778]: ts=2026-09-21T13:54:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53182 client # [ 61.672051] nix[954]: don't know how to build these paths: client # [ 61.673020] nix[954]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 61.684142] nix-grpc-daemon[778]: ts=2026-09-21T13:54:42Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker1 # [ 61.693043] nix-grpc-daemon[772]: ts=2026-09-21T13:54:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40418 client # [ 61.694918] nix[954]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... lb # [ 61.886793] envoy[903]: conn peer=[2001:db8:1::1]:55410 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9592 tx=4122 ms=7855 lb # [ 61.892506] envoy[903]: conn peer=[2001:db8:1::1]:51888 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=481 ms=64 lb # [ 61.898181] envoy[903]: conn peer=[2001:db8:1::1]:51898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4215 tx=1827 ms=2403 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.06 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 65.037050] nix-daemon[838]: reaped child process 894, status = succeeded worker1 # [ 65.212747] nix-daemon[838]: accepted connection from pid 920, user nix-grpc-daemon (trusted) worker1 # [ 65.228951] nix-daemon[838]: reaped child process 923, status = succeeded lb # [ 65.266652] niks3-server[1013]: 2026/09/21 13:54:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 65.252553] nix-grpc-daemon[865]: time=2026-09-21T13:54:45.891Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 65.254419] nix-grpc-daemon[865]: time=2026-09-21T13:54:45.891Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 65.317550] niks3-server[1013]: 2026/09/21 13:54:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign worker1 # [ 65.306367] nix-grpc-daemon[865]: time=2026-09-21T13:54:45.945Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.330502] niks3-server[1013]: 2026/09/21 13:54:45 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 65.337990] niks3-server[1013]: 2026/09/21 13:54:45 INFO Signed narinfos id=10 count=1 lb # [ 65.342821] niks3-server[1013]: 2026/09/21 13:54:45 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 65.328485] nix-grpc-daemon[865]: time=2026-09-21T13:54:45.968Z level=INFO msg="Upload complete. (327ms)" lb # [ 65.352782] niks3-server[1013]: 2026/09/21 13:54:45 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 65.358574] niks3-server[1013]: 2026/09/21 13:54:45 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 65.363164] niks3-server[1013]: 2026/09/21 13:54:45 INFO Completed upload id=10 worker1 # [ 65.340803] nix-grpc-daemon[772]: ts=2026-09-21T13:54:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40418 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 lb # [ 65.365958] niks3-server[1013]: 2026/09/21 13:54:46 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker1 # [ 65.351921] nix-grpc-daemon[772]: ts=2026-09-21T13:54:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40418 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 65.357870] nix-daemon[838]: reaped child process 892, status = succeeded client # [ 65.379354] systemd[1]: dedup2.service: Deactivated successfully. client # [ 65.386084] systemd[1]: dedup2.service: Consumed 227ms CPU time over 4.101s wall clock time, 33.2M memory peak, 5.9K incoming IP traffic, 5.7K outgoing IP traffic. client # [ 65.430769] systemd[1]: dedup1.service: Deactivated successfully. client # [ 65.433256] systemd[1]: dedup1.service: Consumed 173ms CPU time over 5.265s wall clock time, 41.4M memory peak, 7.4K incoming IP traffic, 8.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.29 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 66.613049] systemd[1]: Started Nix Daemon. client # [ 66.796565] nix-daemon[996]: accepted connection from pid 993, user root (trusted) worker1 # [ 67.017791] nix-grpc-daemon[772]: ts=2026-09-21T13:54:47Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 67.024821] nix-grpc-daemon[772]: ts=2026-09-21T13:54:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40418 worker2 # [ 67.035837] nix-grpc-daemon[778]: ts=2026-09-21T13:54:47Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 67.038561] nix-grpc-daemon[778]: ts=2026-09-21T13:54:47Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 67.079953] nix-grpc-daemon[778]: ts=2026-09-21T13:54:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 67.095435] nix-grpc-daemon[778]: ts=2026-09-21T13:54:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 67.109836] nix-grpc-daemon[778]: ts=2026-09-21T13:54:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 67.125026] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 67.327999] nix-daemon[864]: accepted connection from pid 1094, user nix-grpc-daemon (trusted) worker2 # [ 67.347558] nix-daemon[864]: reaped child process 1097, status = succeeded worker2 # [ 67.519319] nix-daemon[864]: accepted connection from pid 1099, user nix-grpc-daemon (trusted) worker2 # [ 67.535741] nix-daemon[864]: reaped child process 1102, status = succeeded lb # [ 67.573150] niks3-server[1013]: 2026/09/21 13:54:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 67.558753] nix-grpc-daemon[879]: time=2026-09-21T13:54:48.196Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 67.560569] nix-grpc-daemon[879]: time=2026-09-21T13:54:48.196Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 67.603311] niks3-server[1013]: 2026/09/21 13:54:48 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst worker2 # [ 67.589958] nix-grpc-daemon[879]: time=2026-09-21T13:54:48.228Z level=INFO msg="Uploading 1 narinfos" lb # [ 67.617480] niks3-server[1013]: 2026/09/21 13:54:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 67.627143] niks3-server[1013]: 2026/09/21 13:54:48 INFO Signed narinfos id=11 count=1 lb # [ 67.630653] niks3-server[1013]: 2026/09/21 13:54:48 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 67.637741] niks3-server[1013]: 2026/09/21 13:54:48 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete worker2 # [ 67.618118] nix-grpc-daemon[879]: time=2026-09-21T13:54:48.256Z level=INFO msg="Upload complete. (476ms)" lb # [ 67.643604] niks3-server[1013]: 2026/09/21 13:54:48 INFO Completed upload id=11 lb # [ 67.647482] niks3-server[1013]: 2026/09/21 13:54:48 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker2 # [ 67.624326] nix-grpc-daemon[778]: ts=2026-09-21T13:54:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 67.635881] nix-grpc-daemon[778]: ts=2026-09-21T13:54:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 67.639324] nix-daemon[864]: reaped child process 1092, status = succeeded worker2 # [ 67.647083] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 67.658468] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 68.905270] nix-daemon[864]: reaped child process 1106, status = succeeded worker2 # [ 69.084204] nix-daemon[864]: accepted connection from pid 1122, user nix-grpc-daemon (trusted) worker2 # [ 69.102081] nix-daemon[864]: reaped child process 1125, status = succeeded lb # [ 69.138785] niks3-server[1013]: 2026/09/21 13:54:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 69.124077] nix-grpc-daemon[879]: time=2026-09-21T13:54:49.762Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 69.127062] nix-grpc-daemon[879]: time=2026-09-21T13:54:49.764Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 69.175456] niks3-server[1013]: 2026/09/21 13:54:49 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 69.188951] niks3-server[1013]: 2026/09/21 13:54:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker2 # [ 69.169834] nix-grpc-daemon[879]: time=2026-09-21T13:54:49.808Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.200279] niks3-server[1013]: 2026/09/21 13:54:49 INFO Signed narinfos id=12 count=1 lb # [ 69.202776] niks3-server[1013]: 2026/09/21 13:54:49 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 69.210400] niks3-server[1013]: 2026/09/21 13:54:49 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 69.217199] niks3-server[1013]: 2026/09/21 13:54:49 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete worker2 # [ 69.193973] nix-grpc-daemon[879]: time=2026-09-21T13:54:49.832Z level=INFO msg="Upload complete. (322ms)" lb # [ 69.221779] niks3-server[1013]: 2026/09/21 13:54:49 INFO Completed upload id=12 lb # [ 69.224673] niks3-server[1013]: 2026/09/21 13:54:49 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker2 # [ 69.205718] nix-grpc-daemon[778]: ts=2026-09-21T13:54:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker2 # [ 69.223260] nix-grpc-daemon[778]: ts=2026-09-21T13:54:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 69.227867] nix-daemon[864]: reaped child process 1104, status = succeeded worker2 # [ 69.241950] nix-grpc-daemon[778]: ts=2026-09-21T13:54:49Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 69.247572] nix-grpc-daemon[778]: ts=2026-09-21T13:54:49Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 69.556805] nix-grpc-daemon[778]: ts=2026-09-21T13:54:50Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 69.564094] nix-grpc-daemon[778]: ts=2026-09-21T13:54:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 69.571337] nix-grpc-daemon[879]: time=2026-09-21T13:54:50.208Z level=INFO msg="All 1 paths already cached" worker2 # [ 69.582531] nix-grpc-daemon[778]: ts=2026-09-21T13:54:50Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 69.589488] nix-grpc-daemon[778]: ts=2026-09-21T13:54:50Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 69.598352] nix-grpc-daemon[778]: ts=2026-09-21T13:54:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 69.612588] nix-grpc-daemon[778]: ts=2026-09-21T13:54:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 69.626524] nix-grpc-daemon[879]: time=2026-09-21T13:54:50.264Z level=INFO msg="All 1 paths already cached" worker2 # [ 69.634620] nix-grpc-daemon[778]: ts=2026-09-21T13:54:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 69.648466] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 69.848288] nix-daemon[864]: accepted connection from pid 1131, user nix-grpc-daemon (trusted) worker2 # [ 69.865590] nix-daemon[864]: reaped child process 1134, status = succeeded worker2 # [ 70.033661] nix-daemon[864]: accepted connection from pid 1136, user nix-grpc-daemon (trusted) worker2 # [ 70.048928] nix-daemon[864]: reaped child process 1139, status = succeeded lb # [ 70.084383] niks3-server[1013]: 2026/09/21 13:54:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 70.069357] nix-grpc-daemon[879]: time=2026-09-21T13:54:50.707Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 70.070807] nix-grpc-daemon[879]: time=2026-09-21T13:54:50.707Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 70.113359] niks3-server[1013]: 2026/09/21 13:54:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker2 # [ 70.095701] nix-grpc-daemon[879]: time=2026-09-21T13:54:50.734Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.127485] niks3-server[1013]: 2026/09/21 13:54:50 INFO Signed narinfos id=13 count=1 lb # [ 70.135184] niks3-server[1013]: 2026/09/21 13:54:50 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker2 # [ 70.125296] nix-grpc-daemon[879]: time=2026-09-21T13:54:50.763Z level=INFO msg="Upload complete. (460ms)" lb # [ 70.150540] niks3-server[1013]: 2026/09/21 13:54:50 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 70.155094] niks3-server[1013]: 2026/09/21 13:54:50 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete worker2 # [ 70.131496] nix-grpc-daemon[778]: ts=2026-09-21T13:54:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 70.160246] niks3-server[1013]: 2026/09/21 13:54:50 INFO Completed upload id=13 lb # [ 70.162411] niks3-server[1013]: 2026/09/21 13:54:50 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker2 # [ 70.142637] nix-grpc-daemon[778]: ts=2026-09-21T13:54:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 70.147184] nix-daemon[864]: reaped child process 1129, status = succeeded worker2 # [ 70.153467] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 70.165330] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 71.604774] nix-daemon[864]: reaped child process 1143, status = succeeded worker2 # [ 71.784524] nix-daemon[864]: accepted connection from pid 1159, user nix-grpc-daemon (trusted) worker2 # [ 71.803110] nix-daemon[864]: reaped child process 1162, status = succeeded lb # [ 71.839777] niks3-server[1013]: 2026/09/21 13:54:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.825824] nix-grpc-daemon[879]: time=2026-09-21T13:54:52.463Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 71.827518] nix-grpc-daemon[879]: time=2026-09-21T13:54:52.463Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 71.876785] niks3-server[1013]: 2026/09/21 13:54:52 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 71.890964] niks3-server[1013]: 2026/09/21 13:54:52 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker2 # [ 71.876893] nix-grpc-daemon[879]: time=2026-09-21T13:54:52.514Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.904575] niks3-server[1013]: 2026/09/21 13:54:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 71.911496] niks3-server[1013]: 2026/09/21 13:54:52 INFO Signed narinfos id=14 count=1 lb # [ 71.918315] niks3-server[1013]: 2026/09/21 13:54:52 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls worker2 # [ 71.897614] nix-grpc-daemon[879]: time=2026-09-21T13:54:52.536Z level=INFO msg="Upload complete. (322ms)" lb # [ 71.923700] envoy[903]: conn peer=[2001:db8:1::1]:54402 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1082 ms=3693 lb # [ 71.928206] envoy[903]: conn peer=[2001:db8:1::1]:51908 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3035 tx=1468 ms=4975 lb # [ 71.931873] envoy[903]: conn peer=[2001:db8:1::1]:54414 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3413 tx=1742 ms=2289 worker2 # [ 71.909135] nix-grpc-daemon[778]: ts=2026-09-21T13:54:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 lb # [ 71.936240] envoy[903]: conn peer=[2001:db8:1::1]:54424 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=66 lb # [ 71.941461] niks3-server[1013]: 2026/09/21 13:54:52 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 71.945032] niks3-server[1013]: 2026/09/21 13:54:52 INFO Completed upload id=14 lb # [ 71.947608] niks3-server[1013]: 2026/09/21 13:54:52 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker2 # [ 71.927139] nix-grpc-daemon[778]: ts=2026-09-21T13:54:52Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 71.932616] nix-daemon[864]: reaped child process 1141, status = succeeded worker2 # [ 71.947224] nix-grpc-daemon[778]: ts=2026-09-21T13:54:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 71.951592] nix-grpc-daemon[778]: ts=2026-09-21T13:54:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 72.268853] nix-grpc-daemon[778]: ts=2026-09-21T13:54:52Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53182 worker1 # [ 72.275669] nix-grpc-daemon[772]: ts=2026-09-21T13:54:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40418 worker2 # [ 72.311697] nix-grpc-daemon[778]: ts=2026-09-21T13:54:52Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 72.321100] nix-grpc-daemon[778]: ts=2026-09-21T13:54:52Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 72.329779] nix-grpc-daemon[778]: ts=2026-09-21T13:54:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 72.338666] nix-grpc-daemon[778]: ts=2026-09-21T13:54:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 72.349666] nix-grpc-daemon[879]: time=2026-09-21T13:54:52.988Z level=INFO msg="All 2 paths already cached" worker2 # [ 72.358932] nix-grpc-daemon[778]: ts=2026-09-21T13:54:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 72.373497] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 72.566440] nix-daemon[864]: accepted connection from pid 1168, user nix-grpc-daemon (trusted) worker2 # [ 72.585622] nix-daemon[864]: reaped child process 1171, status = succeeded worker2 # [ 72.758408] nix-daemon[864]: accepted connection from pid 1173, user nix-grpc-daemon (trusted) worker2 # [ 72.774035] nix-daemon[864]: reaped child process 1176, status = succeeded lb # [ 72.814072] niks3-server[1013]: 2026/09/21 13:54:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 72.799084] nix-grpc-daemon[879]: time=2026-09-21T13:54:53.437Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 72.800718] nix-grpc-daemon[879]: time=2026-09-21T13:54:53.437Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 72.841049] niks3-server[1013]: 2026/09/21 13:54:53 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker2 # [ 72.829843] nix-grpc-daemon[879]: time=2026-09-21T13:54:53.467Z level=INFO msg="Uploading 1 narinfos" lb # [ 72.857065] niks3-server[1013]: 2026/09/21 13:54:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 72.868575] niks3-server[1013]: 2026/09/21 13:54:53 INFO Signed narinfos id=15 count=1 lb # [ 72.871323] niks3-server[1013]: 2026/09/21 13:54:53 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 72.878531] niks3-server[1013]: 2026/09/21 13:54:53 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 72.884283] niks3-server[1013]: 2026/09/21 13:54:53 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo lb # [ 72.889288] niks3-server[1013]: 2026/09/21 13:54:53 INFO Completed upload id=15 worker2 # [ 72.865242] nix-grpc-daemon[879]: time=2026-09-21T13:54:53.503Z level=INFO msg="Upload complete. (476ms)" worker2 # [ 72.873009] nix-grpc-daemon[778]: ts=2026-09-21T13:54:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 72.885279] nix-grpc-daemon[778]: ts=2026-09-21T13:54:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 72.891201] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 72.895845] nix-daemon[864]: reaped child process 1166, status = succeeded worker2 # [ 72.908238] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 73.954422] nix-daemon[864]: reaped child process 1180, status = succeeded worker2 # [ 74.135389] nix-daemon[864]: accepted connection from pid 1196, user nix-grpc-daemon (trusted) worker2 # [ 74.151666] nix-daemon[864]: reaped child process 1199, status = succeeded lb # [ 74.191664] niks3-server[1013]: 2026/09/21 13:54:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 74.180445] nix-grpc-daemon[879]: time=2026-09-21T13:54:54.815Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 74.182925] nix-grpc-daemon[879]: time=2026-09-21T13:54:54.815Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 74.228457] niks3-server[1013]: 2026/09/21 13:54:54 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 74.240279] niks3-server[1013]: 2026/09/21 13:54:54 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 74.251703] niks3-server[1013]: 2026/09/21 13:54:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker2 # [ 74.234339] nix-grpc-daemon[879]: time=2026-09-21T13:54:54.872Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.258568] niks3-server[1013]: 2026/09/21 13:54:54 INFO Signed narinfos id=16 count=1 lb # [ 74.263162] niks3-server[1013]: 2026/09/21 13:54:54 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 74.278193] niks3-server[1013]: 2026/09/21 13:54:54 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 74.283331] niks3-server[1013]: 2026/09/21 13:54:54 INFO Completed upload id=16 worker2 # [ 74.259286] nix-grpc-daemon[879]: time=2026-09-21T13:54:54.897Z level=INFO msg="Upload complete. (340ms)" lb # [ 74.286306] niks3-server[1013]: 2026/09/21 13:54:54 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker2 # [ 74.273083] nix-grpc-daemon[778]: ts=2026-09-21T13:54:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker2 # [ 74.287555] nix-daemon[864]: reaped child process 1178, status = succeeded worker1 # [ 74.318853] nix-grpc-daemon[772]: ts=2026-09-21T13:54:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 74.335813] nix-grpc-daemon[772]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 74.356602] nix-grpc-daemon[772]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker1 # [ 74.370845] nix-grpc-daemon[772]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker1 # [ 74.408105] nix-grpc-daemon[772]: ts=2026-09-21T13:54:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 74.414855] nix-grpc-daemon[772]: ts=2026-09-21T13:54:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40418 duration_s=0 paths=1 nar_bytes_out=232 client # [ 74.541073] nix-daemon[996]: reaped child process 998, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.17 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.31 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.43 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 75.824436] nix-daemon[996]: accepted connection from pid 1079, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 76.042201] nix-grpc-daemon[772]: ts=2026-09-21T13:54:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:40418 worker2 # [ 76.044938] nix-grpc-daemon[778]: ts=2026-09-21T13:54:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker1 # [ 76.062383] nix-grpc-daemon[772]: ts=2026-09-21T13:54:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 76.077442] nix-daemon[838]: accepted connection from pid 772, user nix-grpc-daemon (trusted) worker1 # [ 76.283052] nix-daemon[838]: accepted connection from pid 944, user nix-grpc-daemon (trusted) worker1 # [ 76.300535] nix-daemon[838]: reaped child process 947, status = succeeded lb # [ 76.341578] niks3-server[1013]: 2026/09/21 13:54:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.328122] nix-grpc-daemon[865]: time=2026-09-21T13:54:56.968Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 76.330046] nix-grpc-daemon[865]: time=2026-09-21T13:54:56.970Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 76.375439] niks3-server[1013]: 2026/09/21 13:54:57 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 76.388374] niks3-server[1013]: 2026/09/21 13:54:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 76.372539] nix-grpc-daemon[865]: time=2026-09-21T13:54:57.012Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.399634] niks3-server[1013]: 2026/09/21 13:54:57 INFO Signed narinfos id=17 count=1 lb # [ 76.406457] niks3-server[1013]: 2026/09/21 13:54:57 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 76.413837] niks3-server[1013]: 2026/09/21 13:54:57 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete worker1 # [ 76.399577] nix-grpc-daemon[865]: time=2026-09-21T13:54:57.039Z level=INFO msg="Upload complete. (307ms)" lb # [ 76.422305] niks3-server[1013]: 2026/09/21 13:54:57 INFO Completed upload id=17 lb # [ 76.426483] niks3-server[1013]: 2026/09/21 13:54:57 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker1 # [ 76.408338] nix-grpc-daemon[772]: ts=2026-09-21T13:54:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40418 duration_s=0 paths=1 nar_bytes_in=120 worker1 # [ 76.422896] nix-daemon[838]: reaped child process 942, status = succeeded worker2 # [ 76.424430] nix-grpc-daemon[778]: ts=2026-09-21T13:54:57Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 76.430931] nix-grpc-daemon[778]: ts=2026-09-21T13:54:57Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 76.472903] nix-grpc-daemon[772]: ts=2026-09-21T13:54:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 76.488347] nix-grpc-daemon[772]: ts=2026-09-21T13:54:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40418 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 76.507478] nix-grpc-daemon[772]: ts=2026-09-21T13:54:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40418 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 76.521439] nix-daemon[838]: accepted connection from pid 772, user nix-grpc-daemon (trusted) worker1 # [ 76.726733] nix-daemon[838]: accepted connection from pid 951, user nix-grpc-daemon (trusted) worker1 # [ 76.744318] nix-daemon[838]: reaped child process 954, status = succeeded worker1 # [ 76.916172] nix-daemon[838]: accepted connection from pid 956, user nix-grpc-daemon (trusted) worker1 # [ 76.933517] nix-daemon[838]: reaped child process 959, status = succeeded lb # [ 76.968147] niks3-server[1013]: 2026/09/21 13:54:57 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 76.979009] niks3-server[1013]: 2026/09/21 13:54:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.964789] nix-grpc-daemon[865]: time=2026-09-21T13:54:57.604Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 76.966272] nix-grpc-daemon[865]: time=2026-09-21T13:54:57.604Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker1 # [ 76.967959] nix-grpc-daemon[865]: time=2026-09-21T13:54:57.604Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 77.007972] niks3-server[1013]: 2026/09/21 13:54:57 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 77.029288] niks3-server[1013]: 2026/09/21 13:54:57 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 77.039474] niks3-server[1013]: 2026/09/21 13:54:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign worker1 # [ 77.022352] nix-grpc-daemon[865]: time=2026-09-21T13:54:57.661Z level=INFO msg="Uploading 3 narinfos" lb # [ 77.048599] niks3-server[1013]: 2026/09/21 13:54:57 INFO Signed narinfos id=18 count=1 lb # [ 77.050443] niks3-server[1013]: 2026/09/21 13:54:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 77.058834] niks3-server[1013]: 2026/09/21 13:54:57 INFO Signed narinfos id=19 count=2 lb # [ 77.062725] niks3-server[1013]: 2026/09/21 13:54:57 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 77.068258] niks3-server[1013]: 2026/09/21 13:54:57 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 77.076764] niks3-server[1013]: 2026/09/21 13:54:57 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 77.084694] niks3-server[1013]: 2026/09/21 13:54:57 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 77.088806] niks3-server[1013]: 2026/09/21 13:54:57 INFO Completed upload id=18 lb # [ 77.090412] niks3-server[1013]: 2026/09/21 13:54:57 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 77.094115] niks3-server[1013]: 2026/09/21 13:54:57 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 77.097310] niks3-server[1013]: 2026/09/21 13:54:57 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo worker1 # [ 77.074413] nix-grpc-daemon[865]: time=2026-09-21T13:54:57.714Z level=INFO msg="Upload complete. (534ms)" lb # [ 77.099832] niks3-server[1013]: 2026/09/21 13:54:57 INFO Completed upload id=19 worker1 # [ 77.085276] nix-grpc-daemon[772]: ts=2026-09-21T13:54:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40418 duration_s=0 paths=2 nar_bytes_in=984 worker1 # [ 77.100819] nix-grpc-daemon[772]: ts=2026-09-21T13:54:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 77.114208] nix-daemon[838]: accepted connection from pid 772, user nix-grpc-daemon (trusted) worker1 # [ 77.122900] nix-daemon[838]: reaped child process 949, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker1 # [ 77.130998] nix-daemon[838]: accepted connection from pid 772, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 78.767922] nix-daemon[838]: reaped child process 963, status = succeeded worker1 # [ 78.938559] nix-daemon[838]: accepted connection from pid 979, user nix-grpc-daemon (trusted) worker1 # [ 78.954766] nix-daemon[838]: reaped child process 982, status = succeeded lb # [ 78.990792] niks3-server[1013]: 2026/09/21 13:54:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.978636] nix-grpc-daemon[865]: time=2026-09-21T13:54:59.617Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 79.024720] niks3-server[1013]: 2026/09/21 13:54:59 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls worker1 # [ 79.012085] nix-grpc-daemon[865]: time=2026-09-21T13:54:59.652Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.038599] niks3-server[1013]: 2026/09/21 13:54:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 79.048846] niks3-server[1013]: 2026/09/21 13:54:59 INFO Signed narinfos id=20 count=1 worker1 # [ 79.033640] nix-grpc-daemon[865]: time=2026-09-21T13:54:59.673Z level=INFO msg="Upload complete. (292ms)" lb # [ 79.057933] niks3-server[1013]: 2026/09/21 13:54:59 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 79.064507] niks3-server[1013]: 2026/09/21 13:54:59 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 79.068431] niks3-server[1013]: 2026/09/21 13:54:59 INFO Completed upload id=20 worker1 # [ 79.044920] nix-grpc-daemon[772]: ts=2026-09-21T13:54:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40418 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 client # copying 1 paths... lb # [ 79.071154] niks3-server[1013]: 2026/09/21 13:54:59 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker1 # [ 79.058864] nix-grpc-daemon[772]: ts=2026-09-21T13:54:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40418 client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 79.062772] nix-daemon[838]: reaped child process 961, status = succeeded worker2 # [ 79.086242] nix-grpc-daemon[778]: ts=2026-09-21T13:54:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 79.103281] nix-grpc-daemon[778]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... worker2 # [ 79.125972] nix-grpc-daemon[778]: ts=2026-09-21T13:54:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=0 paths=1 nar_bytes_out=120 client # [ 79.256872] nix-daemon[996]: reaped child process 1082, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.66 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 79.470873] nix-daemon[996]: accepted connection from pid 1101, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 79.688814] nix-grpc-daemon[778]: ts=2026-09-21T13:55:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53182 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 79.696316] nix-grpc-daemon[778]: ts=2026-09-21T13:55:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 79.715516] nix-grpc-daemon[778]: ts=2026-09-21T13:55:00Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 79.723220] nix-grpc-daemon[778]: ts=2026-09-21T13:55:00Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 79.732105] nix-grpc-daemon[778]: ts=2026-09-21T13:55:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 79.742580] nix-grpc-daemon[778]: ts=2026-09-21T13:55:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 79.763243] nix-grpc-daemon[778]: ts=2026-09-21T13:55:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 79.778032] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 79.798980] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 1/5) worker2 # [ 79.824456] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 2/5) worker2 # [ 79.858803] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 187 ms (attempt 3/5) worker2 # [ 80.053361] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 4/5) worker2 # [ 80.113477] nix-grpc-daemon[778]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 80.120284] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 80.127537] nix-grpc-daemon[778]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 80.356152] nix-daemon[864]: accepted connection from pid 1216, user nix-grpc-daemon (trusted) worker2 # [ 80.375297] nix-daemon[864]: reaped child process 1219, status = succeeded worker2 # [ 80.547169] nix-daemon[864]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 80.563588] nix-daemon[864]: reaped child process 1224, status = succeeded lb # [ 80.601853] niks3-server[1013]: 2026/09/21 13:55:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 80.586159] nix-grpc-daemon[879]: time=2026-09-21T13:55:01.224Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 80.587609] nix-grpc-daemon[879]: time=2026-09-21T13:55:01.224Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 80.629090] niks3-server[1013]: 2026/09/21 13:55:01 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst worker2 # [ 80.617075] nix-grpc-daemon[879]: time=2026-09-21T13:55:01.255Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.645617] niks3-server[1013]: 2026/09/21 13:55:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 80.656283] niks3-server[1013]: 2026/09/21 13:55:01 INFO Signed narinfos id=21 count=1 lb # [ 80.658783] niks3-server[1013]: 2026/09/21 13:55:01 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 80.666475] niks3-server[1013]: 2026/09/21 13:55:01 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete worker2 # [ 80.647285] nix-grpc-daemon[879]: time=2026-09-21T13:55:01.285Z level=INFO msg="Upload complete. (492ms)" lb # [ 80.671867] niks3-server[1013]: 2026/09/21 13:55:01 INFO Completed upload id=21 lb # [ 80.675499] niks3-server[1013]: 2026/09/21 13:55:01 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker2 # [ 80.656626] nix-grpc-daemon[778]: ts=2026-09-21T13:55:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=0 paths=1 nar_bytes_in=568 worker2 # [ 80.661495] nix-grpc-daemon[778]: ts=2026-09-21T13:55:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 80.672667] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 80.677394] nix-daemon[864]: reaped child process 1209, status = succeeded worker2 # [ 80.685530] nix-grpc-daemon[778]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... worker2 # [ 80.700203] nix-daemon[864]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 81.743454] nix-daemon[864]: reaped child process 1229, status = succeeded lb # [ 81.901443] envoy[903]: conn peer=[2001:db8:1::1]:55760 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=60 lb # [ 81.907219] envoy[903]: conn peer=[2001:db8:1::1]:54428 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3886 tx=1933 ms=2447 lb # [ 81.912277] envoy[903]: conn peer=[2001:db8:1::1]:55764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4369 tx=2321 ms=2206 lb # [ 81.917095] envoy[903]: conn peer=[2001:db8:1::1]:55778 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=68 lb # [ 81.921750] envoy[903]: conn peer=[2001:db8:1::1]:55790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4243 tx=1867 ms=3144 lb # [ 81.926600] envoy[903]: conn peer=[2001:db8:1::1]:55804 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=104 worker2 # [ 81.927852] nix-daemon[864]: accepted connection from pid 1245, user nix-grpc-daemon (trusted) worker2 # [ 81.943171] nix-daemon[864]: reaped child process 1248, status = succeeded lb # [ 81.983403] niks3-server[1013]: 2026/09/21 13:55:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 81.969987] nix-grpc-daemon[879]: time=2026-09-21T13:55:02.607Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 82.012988] niks3-server[1013]: 2026/09/21 13:55:02 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 82.023435] niks3-server[1013]: 2026/09/21 13:55:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker2 # [ 82.005363] nix-grpc-daemon[879]: time=2026-09-21T13:55:02.643Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.033711] niks3-server[1013]: 2026/09/21 13:55:02 INFO Signed narinfos id=22 count=1 lb # [ 82.039690] niks3-server[1013]: 2026/09/21 13:55:02 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 82.048435] niks3-server[1013]: 2026/09/21 13:55:02 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 82.053097] niks3-server[1013]: 2026/09/21 13:55:02 INFO Completed upload id=22 worker2 # [ 82.028921] nix-grpc-daemon[879]: time=2026-09-21T13:55:02.667Z level=INFO msg="Upload complete. (316ms)" lb # [ 82.056145] niks3-server[1013]: 2026/09/21 13:55:02 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo client # copying 1 paths... worker2 # [ 82.039496] nix-grpc-daemon[778]: ts=2026-09-21T13:55:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53182 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker1 # [ 82.047714] nix-grpc-daemon[772]: ts=2026-09-21T13:55:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40418 worker2 # [ 82.052308] nix-daemon[864]: reaped child process 1226, status = succeeded worker1 # [ 82.059961] nix-grpc-daemon[772]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 82.104173] nix-grpc-daemon[772]: ts=2026-09-21T13:55:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 82.111069] nix-grpc-daemon[772]: ts=2026-09-21T13:55:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40418 duration_s=0 paths=1 nar_bytes_out=120 client # [ 82.244434] nix-daemon[996]: reaped child process 1104, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.99 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 82.471314] nix-daemon[996]: accepted connection from pid 1123, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 82.731925] nix-grpc-daemon[778]: ts=2026-09-21T13:55:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53182 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 82.739679] nix-grpc-daemon[778]: ts=2026-09-21T13:55:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53182 worker2 # [ 82.746805] nix-grpc-daemon[879]: time=2026-09-21T13:55:03.384Z level=INFO msg="All 1 paths already cached" worker2 # [ 82.760215] nix-grpc-daemon[778]: ts=2026-09-21T13:55:03Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 82.766698] nix-grpc-daemon[778]: ts=2026-09-21T13:55:03Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 82.815144] nix-grpc-daemon[772]: ts=2026-09-21T13:55:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 82.832986] nix-grpc-daemon[772]: ts=2026-09-21T13:55:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 82.851087] nix-grpc-daemon[865]: time=2026-09-21T13:55:03.490Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 82.862350] nix-grpc-daemon[772]: ts=2026-09-21T13:55:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 82.878233] nix-daemon[838]: accepted connection from pid 772, user nix-grpc-daemon (trusted) worker1 # [ 83.112179] nix-daemon[838]: accepted connection from pid 987, user nix-grpc-daemon (trusted) worker1 # [ 83.132132] nix-daemon[838]: reaped child process 990, status = succeeded worker1 # [ 83.324435] nix-daemon[838]: accepted connection from pid 992, user nix-grpc-daemon (trusted) worker1 # [ 83.345954] nix-daemon[838]: reaped child process 995, status = succeeded lb # [ 83.383046] niks3-server[1013]: 2026/09/21 13:55:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 83.370282] nix-grpc-daemon[865]: time=2026-09-21T13:55:04.009Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 83.371752] nix-grpc-daemon[865]: time=2026-09-21T13:55:04.009Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 83.410229] niks3-server[1013]: 2026/09/21 13:55:04 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 83.427000] niks3-server[1013]: 2026/09/21 13:55:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker1 # [ 83.410048] nix-grpc-daemon[865]: time=2026-09-21T13:55:04.050Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.439149] niks3-server[1013]: 2026/09/21 13:55:04 INFO Signed narinfos id=23 count=1 lb # [ 83.445938] niks3-server[1013]: 2026/09/21 13:55:04 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 83.454953] niks3-server[1013]: 2026/09/21 13:55:04 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 83.460172] niks3-server[1013]: 2026/09/21 13:55:04 INFO Completed upload id=23 worker1 # [ 83.437400] nix-grpc-daemon[865]: time=2026-09-21T13:55:04.077Z level=INFO msg="Upload complete. (539ms)" lb # [ 83.463430] niks3-server[1013]: 2026/09/21 13:55:04 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker1 # [ 83.444815] nix-grpc-daemon[772]: ts=2026-09-21T13:55:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40418 duration_s=0 paths=1 nar_bytes_in=568 worker1 # [ 83.459514] nix-grpc-daemon[772]: ts=2026-09-21T13:55:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 83.467261] nix-daemon[838]: accepted connection from pid 772, user nix-grpc-daemon (trusted) worker1 # [ 83.472872] nix-daemon[838]: reaped child process 985, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker1 # [ 83.486691] nix-daemon[838]: accepted connection from pid 772, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 84.730618] nix-daemon[838]: reaped child process 999, status = succeeded worker1 # [ 84.915972] nix-daemon[838]: accepted connection from pid 1015, user nix-grpc-daemon (trusted) worker1 # [ 84.931577] nix-daemon[838]: reaped child process 1018, status = succeeded lb # [ 84.970262] niks3-server[1013]: 2026/09/21 13:55:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 84.957662] nix-grpc-daemon[865]: time=2026-09-21T13:55:05.596Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 85.005390] niks3-server[1013]: 2026/09/21 13:55:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker1 # [ 84.990021] nix-grpc-daemon[865]: time=2026-09-21T13:55:05.629Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.017539] niks3-server[1013]: 2026/09/21 13:55:05 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 85.028382] niks3-server[1013]: 2026/09/21 13:55:05 INFO Signed narinfos id=24 count=1 lb # [ 85.030815] niks3-server[1013]: 2026/09/21 13:55:05 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 85.039401] niks3-server[1013]: 2026/09/21 13:55:05 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 85.046412] niks3-server[1013]: 2026/09/21 13:55:05 INFO Completed upload id=24 worker1 # [ 85.023191] nix-grpc-daemon[865]: time=2026-09-21T13:55:05.663Z level=INFO msg="Upload complete. (326ms)" lb # [ 85.049025] niks3-server[1013]: 2026/09/21 13:55:05 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo client # copying 1 paths... worker1 # [ 85.035631] nix-grpc-daemon[772]: ts=2026-09-21T13:55:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40418 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker2 # [ 85.038884] nix-grpc-daemon[778]: ts=2026-09-21T13:55:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53182 worker1 # [ 85.051747] nix-daemon[838]: reaped child process 997, status = succeeded worker2 # [ 85.051604] nix-grpc-daemon[778]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 85.097682] nix-grpc-daemon[772]: ts=2026-09-21T13:55:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 85.104289] nix-grpc-daemon[772]: ts=2026-09-21T13:55:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40418 duration_s=0 paths=1 nar_bytes_out=120 client # [ 85.230144] nix-daemon[996]: reaped child process 1126, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.98 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 10.54 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds) worker2 # [ 86.655344] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 87.345653] nix-grpc-daemon[778]: ts=2026-09-21T13:55:07Z level=info event=signal_exit lb # [ 87.434250] niks3-server[1013]: 2026/09/21 13:55:08 INFO lead: released remote=192.168.1.4:43812 worker2 # [ 88.406988] nix-grpc-daemon[778]: ts=2026-09-21T13:55:09Z level=info event=scheduler_restarting worker1 # [ 88.410136] nix-grpc-daemon[772]: ts=2026-09-21T13:55:09Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 88.419023] nix-grpc-daemon[778]: ts=2026-09-21T13:55:09Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53172 worker2 # [ 88.425034] nix-grpc-daemon[778]: ts=2026-09-21T13:55:09Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 88.429513] nix-grpc-daemon[778]: ts=2026-09-21T13:55:09Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 88.434114] nix-grpc-daemon[778]: ts=2026-09-21T13:55:09Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53172 worker2 # [ 88.438911] nix-grpc-daemon[778]: ts=2026-09-21T13:55:09Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 88.451262] nix-grpc-daemon[778]: E0000 00:00:1789998909.089404 823 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 88.472342] nix-grpc-daemon[778]: E0000 00:00:1789998909.110701 823 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker2 # [ 88.480743] nix-daemon[864]: reaped child process 866, status = succeeded worker1 # [ 88.610403] nix-grpc-daemon[772]: ts=2026-09-21T13:55:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.615872] nix-grpc-daemon[772]: ts=2026-09-21T13:55:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.641718] nix-grpc-daemon[778]: ts=2026-09-21T13:55:09Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 88.816421] nix-grpc-daemon[772]: ts=2026-09-21T13:55:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.821763] nix-grpc-daemon[772]: ts=2026-09-21T13:55:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.022617] nix-grpc-daemon[772]: ts=2026-09-21T13:55:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.027879] nix-grpc-daemon[772]: ts=2026-09-21T13:55:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.228711] nix-grpc-daemon[772]: ts=2026-09-21T13:55:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.233762] nix-grpc-daemon[772]: ts=2026-09-21T13:55:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.436302] nix-grpc-daemon[772]: ts=2026-09-21T13:55:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.440445] nix-grpc-daemon[772]: ts=2026-09-21T13:55:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.636817] nix-grpc-daemon[772]: ts=2026-09-21T13:55:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.642029] nix-grpc-daemon[772]: ts=2026-09-21T13:55:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.842853] nix-grpc-daemon[772]: ts=2026-09-21T13:55:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.848205] nix-grpc-daemon[772]: ts=2026-09-21T13:55:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.049030] nix-grpc-daemon[772]: ts=2026-09-21T13:55:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.054253] nix-grpc-daemon[772]: ts=2026-09-21T13:55:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.255110] nix-grpc-daemon[772]: ts=2026-09-21T13:55:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.260744] nix-grpc-daemon[772]: ts=2026-09-21T13:55:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.416761] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=scheduler_take_over lb # [ 90.440571] niks3-server[1013]: 2026/09/21 13:55:11 INFO lead: acquired remote=192.168.1.3:60590 worker2 # [ 90.447639] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 90.453155] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 90.455719] systemd[1]: nix-grpc-daemon.service: Consumed 3.653s CPU time over 1min 8.435s wall clock time, 62.9M memory peak, 99.5K incoming IP traffic, 268.1K outgoing IP traffic. worker1 # [ 90.463224] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.467779] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.479499] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 90.485206] systemd[1]: Closed Nix worker-protocol over gRPC. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 90.489457] systemd[1]: nix-grpc-daemon.socket: Consumed 773us CPU time over 1min 16.609s wall clock time, 256K memory peak, 97.3K incoming IP traffic, 77.7K outgoing IP traffic. lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 90.663923] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.669881] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.834082] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40418 worker1 # [ 90.843225] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40418 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker1 # [ 90.869919] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=scheduler_connected addr=lb:50051 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.31 seconds) worker1 # [ 90.875144] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 90.982800] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 91.062401] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 91.077056] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.081768] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.204618] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=signal_exit worker1 # [ 91.282544] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.287736] nix-grpc-daemon[772]: ts=2026-09-21T13:55:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.433616] systemd[1]: Starting scheduler-token.service... lb # [ 91.500986] niks3-server[1013]: 2026/09/21 13:55:12 INFO lead: released remote=192.168.1.3:60590 worker1 # [ 91.490368] nix-grpc-daemon[772]: ts=2026-09-21T13:55:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.494506] nix-grpc-daemon[772]: ts=2026-09-21T13:55:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.532238] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 91.539936] systemd[1]: Finished scheduler-token.service. worker2 # [ 91.545023] systemd[1]: scheduler-token.service: Consumed 48ms CPU time over 102ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 91.550458] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 91.691054] nix-grpc-daemon[772]: ts=2026-09-21T13:55:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.696196] nix-grpc-daemon[772]: ts=2026-09-21T13:55:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.736481] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:12Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 91.739219] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 91.743364] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 91.752066] nix-grpc-daemon[1275]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 91.753502] nix-grpc-daemon[1275]: E0000 00:00:1789998912.388480 1275 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 91.764964] nix-grpc-daemon[1275]: E0000 00:00:1789998912.394951 1275 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 91.769799] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 91.773109] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 91.774275] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:12Z level=info event=scheduler_take_over lb # [ 91.798407] niks3-server[1013]: 2026/09/21 13:55:12 INFO lead: acquired remote=192.168.1.4:59350 worker2 # [ 91.778527] nix-grpc-daemon[1275]: E0000 00:00:1789998912.416749 1314 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 91.808151] nix-grpc-daemon[1275]: E0000 00:00:1789998912.435558 1314 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 91.810397] nix-grpc-daemon[1275]: E0000 00:00:1789998912.435703 1314 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 91.817271] nix-grpc-daemon[1275]: E0000 00:00:1789998912.455032 1314 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 91.829609] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.837083] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:12Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 91.838389] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:12Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56038 worker2 # [ 91.840254] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:12Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 91.904981] envoy[903]: conn peer=[2001:db8:1::1]:55816 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3739 tx=2015 ms=2479 lb # [ 91.910635] envoy[903]: conn peer=[2001:db8:1::1]:42638 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=70 lb # [ 91.915542] envoy[903]: conn peer=[2001:db8:1::1]:42652 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=71 worker1 # [ 91.897044] nix-grpc-daemon[772]: ts=2026-09-21T13:55:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.897626] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:12Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56038 lb # [ 91.921624] envoy[903]: conn peer=[2001:db8:1::1]:42648 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3755 tx=2005 ms=2433 worker2 # [ 91.900611] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:12Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 91.926563] envoy[903]: conn peer=[2001:db8:1::4]:56962 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=73451 tx=3929 ms=66236 lb # [ 91.931846] envoy[903]: conn peer=[2001:db8:1::1]:42666 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=30 worker1 # [ 92.470405] nix-grpc-daemon[772]: ts=2026-09-21T13:55:13Z level=info event=scheduler_restarting worker2 # [ 92.479655] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56038 worker2 # [ 92.484295] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:13Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 92.513318] nix-grpc-daemon[772]: ts=2026-09-21T13:55:13Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 92.528533] nix-daemon[838]: reaped child process 840, status = succeeded worker1 # [ 93.311175] nix-grpc-daemon[772]: E0000 00:00:1789998913.951098 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 93.340200] nix-grpc-daemon[772]: E0000 00:00:1789998913.980223 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 94.379120] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 94.385611] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 94.390954] systemd[1]: nix-grpc-daemon.service: Consumed 1.996s CPU time over 1min 12.513s wall clock time, 51.8M memory peak, 63.3K incoming IP traffic, 114.8K outgoing IP traffic. worker1 # [ 94.405451] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 94.407379] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 94.409651] systemd[1]: nix-grpc-daemon.socket: Consumed 616us CPU time over 1min 20.458s wall clock time, 256K memory peak, 66.9K incoming IP traffic, 58.6K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 94.762232] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 94.777907] nix-daemon[864]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) worker2 # [ 94.811323] nix-grpc-daemon[1275]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 1/5) worker2 # [ 94.829464] nix-grpc-daemon[1275]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 87 ms (attempt 2/5) worker2 # [ 94.923875] nix-grpc-daemon[1275]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 19 ms (attempt 3/5) worker2 # [ 94.950455] nix-grpc-daemon[1275]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 279 ms (attempt 4/5) worker2 # [ 95.237269] nix-grpc-daemon[1275]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 95.243095] nix-grpc-daemon[1275]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 95.267788] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56052 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 95.284668] nix-daemon[864]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) worker2 # [ 95.314484] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:15Z level=info event=niks3_push_started pid=1335 worker2 # [ 95.528569] nix-grpc-daemon[1335]: time=2026-09-21T13:55:16.166Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 95.699189] nix-daemon[864]: accepted connection from pid 1348, user nix-grpc-daemon (trusted) worker2 # [ 95.715295] nix-daemon[864]: reaped child process 1351, status = succeeded lb # [ 95.757490] niks3-server[1013]: 2026/09/21 13:55:16 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 95.766333] niks3-server[1013]: 2026/09/21 13:55:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.752068] nix-grpc-daemon[1335]: time=2026-09-21T13:55:16.389Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 95.755351] nix-grpc-daemon[1335]: time=2026-09-21T13:55:16.389Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" worker2 # [ 95.757384] nix-grpc-daemon[1335]: time=2026-09-21T13:55:16.389Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" lb # [ 95.819632] niks3-server[1013]: 2026/09/21 13:55:16 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 95.853135] niks3-server[1013]: 2026/09/21 13:55:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 95.862370] niks3-server[1013]: 2026/09/21 13:55:16 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 95.869823] niks3-server[1013]: 2026/09/21 13:55:16 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 95.873650] niks3-server[1013]: 2026/09/21 13:55:16 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 95.878700] niks3-server[1013]: 2026/09/21 13:55:16 INFO Signed narinfos id=26 count=2 worker2 # [ 95.852119] nix-grpc-daemon[1335]: time=2026-09-21T13:55:16.488Z level=INFO msg="Uploading 3 narinfos" lb # [ 95.881386] niks3-server[1013]: 2026/09/21 13:55:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 95.883509] niks3-server[1013]: 2026/09/21 13:55:16 INFO Signed narinfos id=25 count=1 lb # [ 95.903118] niks3-server[1013]: 2026/09/21 13:55:16 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 95.912379] niks3-server[1013]: 2026/09/21 13:55:16 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 95.917140] niks3-server[1013]: 2026/09/21 13:55:16 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 95.920809] niks3-server[1013]: 2026/09/21 13:55:16 INFO Completed upload id=25 lb # [ 95.922113] niks3-server[1013]: 2026/09/21 13:55:16 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 95.925449] niks3-server[1013]: 2026/09/21 13:55:16 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 95.927686] niks3-server[1013]: 2026/09/21 13:55:16 INFO Completed upload id=26 worker2 # [ 95.903740] nix-grpc-daemon[1335]: time=2026-09-21T13:55:16.542Z level=INFO msg="Upload complete. (371ms)" worker2 # [ 95.913158] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56052 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 95.931557] nix-daemon[864]: reaped child process 1333, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.46 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds) worker1 # [ 96.076861] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 96.085133] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 96.287835] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:16Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 96.290514] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 96.294840] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 96.302298] nix-grpc-daemon[1041]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 96.303725] nix-grpc-daemon[1041]: E0000 00:00:1789998916.941916 1041 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 96.315158] nix-grpc-daemon[1041]: E0000 00:00:1789998916.948267 1041 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 96.318250] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 96.322336] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 96.336126] nix-grpc-daemon[1041]: E0000 00:00:1789998916.964941 1083 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 96.355665] nix-grpc-daemon[1041]: E0000 00:00:1789998916.982609 1083 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 96.365059] nix-grpc-daemon[1041]: E0000 00:00:1789998916.982776 1083 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 96.367523] nix-grpc-daemon[1041]: E0000 00:00:1789998917.003251 1083 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 96.396093] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 96.398547] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56038 worker2 # [ 96.404243] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.12 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.12 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.24 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb # [ 96.642890] niks3-server[1013]: 2026/09/21 13:55:17 INFO Shutdown signal received, draining in-flight requests timeout=10s worker1 # [ 96.623888] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:17Z level=info event=scheduler_lock_lost status=200 worker2 # [ 96.623347] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:17Z level=info event=scheduler_lock_lost status=200 lb # [ 96.646857] systemd[1]: Stopping niks3 server... lb # [ 96.647114] niks3-server[1013]: 2026/09/21 13:55:17 INFO lead: released remote=192.168.1.4:59350 lb # [ 96.667860] systemd[1]: niks3.service: Deactivated successfully. lb # [ 96.673250] systemd[1]: Stopped niks3 server. lb # [ 96.673943] systemd[1]: niks3.service: Consumed 507ms CPU time over 1min 6.567s wall clock time, 22.1M memory peak, 74.2K incoming IP traffic, 105.2K outgoing IP traffic. lb # [ 96.682545] systemd[1]: Starting niks3 server... lb # [ 96.756658] niks3-server[1149]: 2026/09/21 13:55:17 goose: no migrations to run. current version: 20260920000000 lb # [ 96.763316] niks3-server[1149]: 2026/09/21 13:55:17 OK 1_commit_pending_closure.sql (7.22ms) lb # [ 96.767057] niks3-server[1149]: 2026/09/21 13:55:17 OK 2_object_stats_trigger.sql (3.39ms) lb # [ 96.768624] niks3-server[1149]: 2026/09/21 13:55:17 goose: up to current file version: 2 lb # [ 96.770475] niks3-server[1149]: 2026/09/21 13:55:17 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 96.782034] niks3-server[1149]: 2026/09/21 13:55:17 INFO Read proxy enabled — serving cache objects from S3 lb # [ 96.783359] niks3-server[1149]: 2026/09/21 13:55:17 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 96.787460] niks3-server[1149]: 2026/09/21 13:55:17 INFO systemd watchdog enabled interval=15s lb # [ 96.788843] niks3-server[1149]: 2026/09/21 13:55:17 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 96.790007] systemd[1]: Started niks3 server. lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart >&2 worker2 # [ 97.373690] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56052 client # don't know how to build these paths: client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker1 # [ 97.390438] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 97.405923] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker1 # [ 97.437401] nix-grpc-daemon[1041]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5) worker1 # [ 97.520039] nix-grpc-daemon[1041]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 178 ms (attempt 2/5) lb # [ 97.653801] niks3-server[1149]: 2026/09/21 13:55:18 INFO lead: acquired remote=192.168.1.4:59396 worker1 # [ 97.705465] nix-grpc-daemon[1041]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 143 ms (attempt 3/5) worker1 # [ 97.855975] nix-grpc-daemon[1041]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 63 ms (attempt 4/5) worker1 # [ 97.926266] nix-grpc-daemon[1041]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 97.932825] nix-grpc-daemon[1041]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 97.977248] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:18Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=0 worker2 # [ 97.985696] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:18Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 98.024858] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 98.042651] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56052 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'... worker2 # [ 98.057323] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 98.073855] nix-daemon[864]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) worker2 # [ 98.277003] nix-daemon[864]: accepted connection from pid 1370, user nix-grpc-daemon (trusted) worker2 # [ 98.295706] nix-daemon[864]: reaped child process 1373, status = succeeded worker2 # [ 98.464535] nix-daemon[864]: accepted connection from pid 1375, user nix-grpc-daemon (trusted) worker2 # [ 98.481936] nix-daemon[864]: reaped child process 1378, status = succeeded lb # [ 98.519470] niks3-server[1149]: 2026/09/21 13:55:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.510070] nix-grpc-daemon[1335]: time=2026-09-21T13:55:19.148Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 98.511697] nix-grpc-daemon[1335]: time=2026-09-21T13:55:19.148Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)" lb # [ 98.563482] niks3-server[1149]: 2026/09/21 13:55:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 98.580147] niks3-server[1149]: 2026/09/21 13:55:19 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst lb # [ 98.605430] niks3-server[1149]: 2026/09/21 13:55:19 INFO Signed narinfos id=27 count=1 worker2 # [ 98.584157] nix-grpc-daemon[1335]: time=2026-09-21T13:55:19.222Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.619729] niks3-server[1149]: 2026/09/21 13:55:19 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 98.625209] niks3-server[1149]: 2026/09/21 13:55:19 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls lb # [ 98.631425] niks3-server[1149]: 2026/09/21 13:55:19 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo lb # [ 98.636404] niks3-server[1149]: 2026/09/21 13:55:19 INFO Completed upload id=27 worker2 # [ 98.612357] nix-grpc-daemon[1335]: time=2026-09-21T13:55:19.250Z level=INFO msg="Upload complete. (523ms)" worker2 # [ 98.625158] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56052 duration_s=0 paths=1 nar_bytes_in=544 worker2 # [ 98.640465] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 98.649034] nix-daemon[864]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) worker2 # [ 98.654543] nix-daemon[864]: reaped child process 1368, status = succeeded client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051... worker2 # [ 98.666720] nix-daemon[864]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) client # farm-a> worker2: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 100.116164] nix-daemon[864]: reaped child process 1382, status = succeeded worker2 # [ 100.288959] nix-daemon[864]: accepted connection from pid 1398, user nix-grpc-daemon (trusted) worker2 # [ 100.305987] nix-daemon[864]: reaped child process 1401, status = succeeded lb # [ 100.342043] niks3-server[1149]: 2026/09/21 13:55:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 100.332438] nix-grpc-daemon[1335]: time=2026-09-21T13:55:20.969Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 100.334278] nix-grpc-daemon[1335]: time=2026-09-21T13:55:20.969Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)" lb # [ 100.384397] niks3-server[1149]: 2026/09/21 13:55:21 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv lb # [ 100.399465] niks3-server[1149]: 2026/09/21 13:55:21 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 100.410647] niks3-server[1149]: 2026/09/21 13:55:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker2 # [ 100.392189] nix-grpc-daemon[1335]: time=2026-09-21T13:55:21.029Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.417823] niks3-server[1149]: 2026/09/21 13:55:21 INFO Signed narinfos id=28 count=1 lb # [ 100.421806] niks3-server[1149]: 2026/09/21 13:55:21 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls lb # [ 100.431387] niks3-server[1149]: 2026/09/21 13:55:21 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 100.444821] niks3-server[1149]: 2026/09/21 13:55:21 INFO Completed upload id=28 worker2 # [ 100.420656] nix-grpc-daemon[1335]: time=2026-09-21T13:55:21.059Z level=INFO msg="Upload complete. (338ms)" lb # [ 100.447609] niks3-server[1149]: 2026/09/21 13:55:21 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo worker2 # [ 100.438968] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56052 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=1 worker2 # [ 100.460812] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:21Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=0 worker2 # [ 100.465748] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:21Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 100.470670] nix-daemon[864]: reaped child process 1380, status = succeeded worker2 # [ 100.500342] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 100.515024] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 100.529354] nix-grpc-daemon[1335]: time=2026-09-21T13:55:21.167Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'... worker2 # [ 100.539381] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 100.553728] nix-daemon[864]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) worker2 # [ 100.753780] nix-daemon[864]: accepted connection from pid 1407, user nix-grpc-daemon (trusted) worker2 # [ 100.773579] nix-daemon[864]: reaped child process 1410, status = succeeded worker2 # [ 100.944082] nix-daemon[864]: accepted connection from pid 1412, user nix-grpc-daemon (trusted) worker2 # [ 100.960805] nix-daemon[864]: reaped child process 1415, status = succeeded lb # [ 100.995898] niks3-server[1149]: 2026/09/21 13:55:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 100.981220] nix-grpc-daemon[1335]: time=2026-09-21T13:55:21.619Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 100.982723] nix-grpc-daemon[1335]: time=2026-09-21T13:55:21.619Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)" lb # [ 101.023192] niks3-server[1149]: 2026/09/21 13:55:21 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst worker2 # [ 101.011440] nix-grpc-daemon[1335]: time=2026-09-21T13:55:21.649Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.038440] niks3-server[1149]: 2026/09/21 13:55:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 101.050337] niks3-server[1149]: 2026/09/21 13:55:21 INFO Signed narinfos id=29 count=1 lb # [ 101.055136] niks3-server[1149]: 2026/09/21 13:55:21 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls lb # [ 101.063521] niks3-server[1149]: 2026/09/21 13:55:21 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 101.068088] niks3-server[1149]: 2026/09/21 13:55:21 INFO Completed upload id=29 worker2 # [ 101.043620] nix-grpc-daemon[1335]: time=2026-09-21T13:55:21.682Z level=INFO msg="Upload complete. (473ms)" lb # [ 101.070733] niks3-server[1149]: 2026/09/21 13:55:21 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo worker2 # [ 101.052351] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56052 duration_s=0 paths=1 nar_bytes_in=656 worker2 # [ 101.063402] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 101.072815] nix-daemon[864]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) worker2 # [ 101.075516] nix-daemon[864]: reaped child process 1405, status = succeeded client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051... worker2 # [ 101.088173] nix-daemon[864]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) client # farm-b> worker2: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 101.709549] nix-daemon[864]: reaped child process 1419, status = succeeded worker2 # [ 101.872096] nix-daemon[864]: accepted connection from pid 1435, user nix-grpc-daemon (trusted) lb # [ 101.905458] envoy[903]: conn peer=[2001:db8:1::3]:33404 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=16114 tx=4120 ms=70235 worker2 # [ 101.890323] nix-daemon[864]: reaped child process 1438, status = succeeded lb # [ 101.911325] envoy[903]: conn peer=[2001:db8:1::1]:40842 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=305 ms=1167 lb # [ 101.927587] niks3-server[1149]: 2026/09/21 13:55:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 101.913438] nix-grpc-daemon[1335]: time=2026-09-21T13:55:22.550Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 101.915146] nix-grpc-daemon[1335]: time=2026-09-21T13:55:22.551Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)" lb # [ 101.967187] niks3-server[1149]: 2026/09/21 13:55:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker2 # [ 101.950327] nix-grpc-daemon[1335]: time=2026-09-21T13:55:22.588Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.983152] niks3-server[1149]: 2026/09/21 13:55:22 INFO Signed narinfos id=30 count=1 lb # [ 101.989035] niks3-server[1149]: 2026/09/21 13:55:22 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst lb # [ 102.001798] niks3-server[1149]: 2026/09/21 13:55:22 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv lb # [ 102.006892] niks3-server[1149]: 2026/09/21 13:55:22 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls worker2 # [ 101.983530] nix-grpc-daemon[1335]: time=2026-09-21T13:55:22.620Z level=INFO msg="Upload complete. (285ms)" lb # [ 102.011540] niks3-server[1149]: 2026/09/21 13:55:22 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 102.015357] niks3-server[1149]: 2026/09/21 13:55:22 INFO Completed upload id=30 lb # [ 102.017239] niks3-server[1149]: 2026/09/21 13:55:22 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo worker2 # [ 101.993846] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56052 duration_s=0 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=1 worker2 # [ 102.009062] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:22Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=0 worker2 # [ 102.014139] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:22Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 102.018436] nix-daemon[864]: reaped child process 1417, status = succeeded worker2 # [ 102.056380] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 102.070451] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 102.085734] nix-grpc-daemon[1335]: time=2026-09-21T13:55:22.724Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'... worker2 # [ 102.095771] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 102.110081] nix-daemon[864]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) worker2 # [ 102.308109] nix-daemon[864]: accepted connection from pid 1444, user nix-grpc-daemon (trusted) worker2 # [ 102.326690] nix-daemon[864]: reaped child process 1447, status = succeeded worker2 # [ 102.493358] nix-daemon[864]: accepted connection from pid 1449, user nix-grpc-daemon (trusted) worker2 # [ 102.510787] nix-daemon[864]: reaped child process 1452, status = succeeded lb # [ 102.546277] niks3-server[1149]: 2026/09/21 13:55:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 102.532621] nix-grpc-daemon[1335]: time=2026-09-21T13:55:23.170Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 102.534761] nix-grpc-daemon[1335]: time=2026-09-21T13:55:23.170Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)" lb # [ 102.577958] niks3-server[1149]: 2026/09/21 13:55:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker2 # [ 102.560466] nix-grpc-daemon[1335]: time=2026-09-21T13:55:23.198Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.592267] niks3-server[1149]: 2026/09/21 13:55:23 INFO Signed narinfos id=31 count=1 lb # [ 102.595415] niks3-server[1149]: 2026/09/21 13:55:23 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst lb # [ 102.610197] niks3-server[1149]: 2026/09/21 13:55:23 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls worker2 # [ 102.590321] nix-grpc-daemon[1335]: time=2026-09-21T13:55:23.228Z level=INFO msg="Upload complete. (462ms)" lb # [ 102.615247] niks3-server[1149]: 2026/09/21 13:55:23 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 102.619796] niks3-server[1149]: 2026/09/21 13:55:23 INFO Completed upload id=31 worker2 # [ 102.596202] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56052 duration_s=0 paths=1 nar_bytes_in=784 lb # [ 102.622974] niks3-server[1149]: 2026/09/21 13:55:23 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo worker2 # [ 102.604643] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56052 worker2 # [ 102.614044] nix-daemon[864]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) worker2 # [ 102.618147] nix-daemon[864]: reaped child process 1442, status = succeeded client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051... worker2 # [ 102.628721] nix-daemon[864]: accepted connection from pid 1275, user nix-grpc-daemon (trusted) client # farm-top> worker2: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 103.877257] nix-daemon[864]: reaped child process 1456, status = succeeded worker2 # [ 104.057524] nix-daemon[864]: accepted connection from pid 1472, user nix-grpc-daemon (trusted) worker2 # [ 104.074142] nix-daemon[864]: reaped child process 1475, status = succeeded lb # [ 104.110925] niks3-server[1149]: 2026/09/21 13:55:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 104.097993] nix-grpc-daemon[1335]: time=2026-09-21T13:55:24.734Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 104.099433] nix-grpc-daemon[1335]: time=2026-09-21T13:55:24.734Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)" lb # [ 104.142809] niks3-server[1149]: 2026/09/21 13:55:24 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst lb # [ 104.158871] niks3-server[1149]: 2026/09/21 13:55:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker2 # [ 104.140810] nix-grpc-daemon[1335]: time=2026-09-21T13:55:24.778Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.169582] niks3-server[1149]: 2026/09/21 13:55:24 INFO Signed narinfos id=32 count=1 lb # [ 104.178056] niks3-server[1149]: 2026/09/21 13:55:24 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv lb # [ 104.184435] niks3-server[1149]: 2026/09/21 13:55:24 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls lb # [ 104.191909] niks3-server[1149]: 2026/09/21 13:55:24 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 104.197746] niks3-server[1149]: 2026/09/21 13:55:24 INFO Completed upload id=32 worker2 # [ 104.172911] nix-grpc-daemon[1335]: time=2026-09-21T13:55:24.811Z level=INFO msg="Upload complete. (332ms)" lb # [ 104.200793] niks3-server[1149]: 2026/09/21 13:55:24 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo worker2 # [ 104.189149] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56052 duration_s=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=1 worker2 # [ 104.203242] nix-daemon[864]: reaped child process 1454, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart >&2, in 7.14 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag after-niks3-restart outPath, in 0.23 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 8.00 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 104.777655] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 105.769343] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:26Z level=info event=signal_exit lb # [ 105.863850] niks3-server[1149]: 2026/09/21 13:55:26 INFO lead: released remote=192.168.1.4:59396 worker1 # [ 106.841898] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:27Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 106.841716] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:27Z level=info event=scheduler_restarting worker2 # [ 106.842145] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:27Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 106.842285] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56038 worker2 # [ 106.842412] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:27Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 106.842537] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56038 worker2 # [ 106.842648] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:27Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 106.892728] nix-daemon[864]: reaped child process 1327, status = succeeded worker1 # [ 107.041616] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.047004] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.060634] nix-grpc-daemon[1275]: ts=2026-09-21T13:55:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 107.247700] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.252674] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.453374] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.458451] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 107.654737] niks3-server[1149]: 2026/09/21 13:55:28 INFO lead: acquired remote=192.168.1.3:50940 worker1 # [ 107.636299] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:28Z level=info event=scheduler_take_over worker1 # [ 107.659134] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.664273] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.808104] nix-grpc-daemon[1275]: E0000 00:00:1789998928.446226 1320 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 107.808516] nix-grpc-daemon[1275]: E0000 00:00:1789998928.446514 1320 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 107.866696] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.870693] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.067433] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.072742] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.273507] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.278370] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 108.479258] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.489057] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:35380 worker1 # [ 108.493952] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 108.983069] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 108.989067] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 108.991613] systemd[1]: nix-grpc-daemon.service: Consumed 1.512s CPU time over 17.437s wall clock time, 36.1M memory peak, 46K incoming IP traffic, 77K outgoing IP traffic. worker2 # [ 109.008533] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 109.010738] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 109.013026] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 18.036s wall clock time, 256K memory peak, 38.9K incoming IP traffic, 28.5K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker1 # [ 109.423522] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33392 client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 109.434171] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 109.461270] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:30Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 109.468250] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:30Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 109.509133] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 109.523087] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33392 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 109.537823] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 109.552564] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker1 # [ 109.577979] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:30Z level=info event=niks3_push_started pid=1114 worker1 # [ 109.799601] nix-grpc-daemon[1114]: time=2026-09-21T13:55:30.439Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 109.972259] nix-daemon[838]: accepted connection from pid 1127, user nix-grpc-daemon (trusted) worker1 # [ 109.991200] nix-daemon[838]: reaped child process 1130, status = succeeded worker1 # [ 110.164264] nix-daemon[838]: accepted connection from pid 1132, user nix-grpc-daemon (trusted) worker1 # [ 110.181798] nix-daemon[838]: reaped child process 1135, status = succeeded lb # [ 110.218258] niks3-server[1149]: 2026/09/21 13:55:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 110.207092] nix-grpc-daemon[1114]: time=2026-09-21T13:55:30.846Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 110.208903] nix-grpc-daemon[1114]: time=2026-09-21T13:55:30.846Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 110.254273] niks3-server[1149]: 2026/09/21 13:55:30 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst worker1 # [ 110.247169] nix-grpc-daemon[1114]: time=2026-09-21T13:55:30.886Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.263568] niks3-server[1149]: 2026/09/21 13:55:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 110.277909] niks3-server[1149]: 2026/09/21 13:55:30 INFO Signed narinfos id=33 count=1 lb # [ 110.284414] niks3-server[1149]: 2026/09/21 13:55:30 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 110.292515] niks3-server[1149]: 2026/09/21 13:55:30 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 110.304308] niks3-server[1149]: 2026/09/21 13:55:30 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo lb # [ 110.309136] niks3-server[1149]: 2026/09/21 13:55:30 INFO Completed upload id=33 worker1 # [ 110.286425] nix-grpc-daemon[1114]: time=2026-09-21T13:55:30.926Z level=INFO msg="Upload complete. (481ms)" worker1 # [ 110.295295] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33392 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 110.308980] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 110.318184] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker1 # [ 110.321238] nix-daemon[838]: reaped child process 1112, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... worker1 # [ 110.332407] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 111.379672] nix-daemon[838]: reaped child process 1139, status = succeeded worker1 # [ 111.557882] nix-daemon[838]: accepted connection from pid 1155, user nix-grpc-daemon (trusted) worker1 # [ 111.574775] nix-daemon[838]: reaped child process 1158, status = succeeded lb # [ 111.614103] niks3-server[1149]: 2026/09/21 13:55:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 111.603203] nix-grpc-daemon[1114]: time=2026-09-21T13:55:32.243Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 111.608815] nix-grpc-daemon[1114]: time=2026-09-21T13:55:32.245Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 111.654450] niks3-server[1149]: 2026/09/21 13:55:32 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 111.669389] niks3-server[1149]: 2026/09/21 13:55:32 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 111.680451] niks3-server[1149]: 2026/09/21 13:55:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker1 # [ 111.665182] nix-grpc-daemon[1114]: time=2026-09-21T13:55:32.304Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.688006] niks3-server[1149]: 2026/09/21 13:55:32 INFO Signed narinfos id=34 count=1 lb # [ 111.696348] niks3-server[1149]: 2026/09/21 13:55:32 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 111.704279] niks3-server[1149]: 2026/09/21 13:55:32 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 111.711807] niks3-server[1149]: 2026/09/21 13:55:32 INFO Completed upload id=34 worker1 # [ 111.688857] nix-grpc-daemon[1114]: time=2026-09-21T13:55:32.329Z level=INFO msg="Upload complete. (343ms)" lb # [ 111.714517] niks3-server[1149]: 2026/09/21 13:55:32 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker1 # [ 111.711378] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 111.727520] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:32Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 111.731255] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:32Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 111.735201] nix-daemon[838]: reaped child process 1137, status = succeeded worker1 # [ 111.754508] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 111.763750] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 111.776993] nix-grpc-daemon[1114]: time=2026-09-21T13:55:32.417Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 111.785464] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 111.798672] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) lb # [ 111.900354] envoy[903]: conn peer=[2001:db8:1::1]:40852 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9740 tx=4180 ms=6826 lb # [ 111.905726] envoy[903]: conn peer=[2001:db8:1::4]:47738 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1691 tx=425 ms=15221 worker1 # [ 111.997344] nix-daemon[838]: accepted connection from pid 1164, user nix-grpc-daemon (trusted) worker1 # [ 112.014078] nix-daemon[838]: reaped child process 1167, status = succeeded worker1 # [ 112.185325] nix-daemon[838]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker1 # [ 112.201382] nix-daemon[838]: reaped child process 1172, status = succeeded lb # [ 112.236079] niks3-server[1149]: 2026/09/21 13:55:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 112.223999] nix-grpc-daemon[1114]: time=2026-09-21T13:55:32.863Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 112.225525] nix-grpc-daemon[1114]: time=2026-09-21T13:55:32.863Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 112.266636] niks3-server[1149]: 2026/09/21 13:55:32 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst worker1 # [ 112.260857] nix-grpc-daemon[1114]: time=2026-09-21T13:55:32.900Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.277376] niks3-server[1149]: 2026/09/21 13:55:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 112.289105] niks3-server[1149]: 2026/09/21 13:55:32 INFO Signed narinfos id=35 count=1 lb # [ 112.292000] niks3-server[1149]: 2026/09/21 13:55:32 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 112.305581] niks3-server[1149]: 2026/09/21 13:55:32 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete worker1 # [ 112.288159] nix-grpc-daemon[1114]: time=2026-09-21T13:55:32.928Z level=INFO msg="Upload complete. (474ms)" lb # [ 112.312108] niks3-server[1149]: 2026/09/21 13:55:32 INFO Completed upload id=35 lb # [ 112.316145] niks3-server[1149]: 2026/09/21 13:55:32 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker1 # [ 112.296305] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33392 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 112.309080] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 112.318569] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker1 # [ 112.321237] nix-daemon[838]: reaped child process 1162, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker1 # [ 112.334095] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 113.778418] nix-daemon[838]: reaped child process 1176, status = succeeded worker1 # [ 113.963662] nix-daemon[838]: accepted connection from pid 1192, user nix-grpc-daemon (trusted) worker1 # [ 113.979599] nix-daemon[838]: reaped child process 1195, status = succeeded lb # [ 114.018478] niks3-server[1149]: 2026/09/21 13:55:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 114.006380] nix-grpc-daemon[1114]: time=2026-09-21T13:55:34.645Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 114.007897] nix-grpc-daemon[1114]: time=2026-09-21T13:55:34.645Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 114.048623] niks3-server[1149]: 2026/09/21 13:55:34 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 114.063442] niks3-server[1149]: 2026/09/21 13:55:34 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 114.074344] niks3-server[1149]: 2026/09/21 13:55:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign worker1 # [ 114.057754] nix-grpc-daemon[1114]: time=2026-09-21T13:55:34.697Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.082919] niks3-server[1149]: 2026/09/21 13:55:34 INFO Signed narinfos id=36 count=1 lb # [ 114.088254] niks3-server[1149]: 2026/09/21 13:55:34 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 114.095637] niks3-server[1149]: 2026/09/21 13:55:34 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 114.102106] niks3-server[1149]: 2026/09/21 13:55:34 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo lb # [ 114.105790] niks3-server[1149]: 2026/09/21 13:55:34 INFO Completed upload id=36 worker1 # [ 114.083053] nix-grpc-daemon[1114]: time=2026-09-21T13:55:34.723Z level=INFO msg="Upload complete. (338ms)" worker1 # [ 114.101103] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 114.113472] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:34Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 114.117020] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:34Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 114.120707] nix-daemon[838]: reaped child process 1174, status = succeeded worker1 # [ 114.141365] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 114.155500] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 114.170065] nix-grpc-daemon[1114]: time=2026-09-21T13:55:34.810Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 114.178953] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 114.193673] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker1 # [ 114.392300] nix-daemon[838]: accepted connection from pid 1201, user nix-grpc-daemon (trusted) worker1 # [ 114.408202] nix-daemon[838]: reaped child process 1204, status = succeeded worker1 # [ 114.584169] nix-daemon[838]: accepted connection from pid 1206, user nix-grpc-daemon (trusted) worker1 # [ 114.599401] nix-daemon[838]: reaped child process 1209, status = succeeded lb # [ 114.637313] niks3-server[1149]: 2026/09/21 13:55:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 114.623977] nix-grpc-daemon[1114]: time=2026-09-21T13:55:35.263Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 114.625618] nix-grpc-daemon[1114]: time=2026-09-21T13:55:35.263Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 114.663425] niks3-server[1149]: 2026/09/21 13:55:35 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker1 # [ 114.653360] nix-grpc-daemon[1114]: time=2026-09-21T13:55:35.293Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.680244] niks3-server[1149]: 2026/09/21 13:55:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 114.690377] niks3-server[1149]: 2026/09/21 13:55:35 INFO Signed narinfos id=37 count=1 lb # [ 114.695306] niks3-server[1149]: 2026/09/21 13:55:35 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls worker1 # [ 114.682041] nix-grpc-daemon[1114]: time=2026-09-21T13:55:35.322Z level=INFO msg="Upload complete. (471ms)" lb # [ 114.704950] niks3-server[1149]: 2026/09/21 13:55:35 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 114.710084] niks3-server[1149]: 2026/09/21 13:55:35 INFO Completed upload id=37 lb # [ 114.713158] niks3-server[1149]: 2026/09/21 13:55:35 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker1 # [ 114.690854] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33392 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 114.701307] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 114.706737] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker1 # [ 114.710745] nix-daemon[838]: reaped child process 1199, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... worker1 # [ 114.723060] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 115.766427] nix-daemon[838]: reaped child process 1213, status = succeeded worker1 # [ 115.944509] nix-daemon[838]: accepted connection from pid 1229, user nix-grpc-daemon (trusted) worker1 # [ 115.962941] nix-daemon[838]: reaped child process 1232, status = succeeded worker1 # [ 115.990078] nix-grpc-daemon[1114]: time=2026-09-21T13:55:36.628Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 115.991703] nix-grpc-daemon[1114]: time=2026-09-21T13:55:36.628Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 115.999914] niks3-server[1149]: 2026/09/21 13:55:36 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 116.036566] niks3-server[1149]: 2026/09/21 13:55:36 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 116.049305] niks3-server[1149]: 2026/09/21 13:55:36 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 116.057812] niks3-server[1149]: 2026/09/21 13:55:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker1 # [ 116.040863] nix-grpc-daemon[1114]: time=2026-09-21T13:55:36.680Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.065476] niks3-server[1149]: 2026/09/21 13:55:36 INFO Signed narinfos id=38 count=1 lb # [ 116.071764] niks3-server[1149]: 2026/09/21 13:55:36 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 116.081199] niks3-server[1149]: 2026/09/21 13:55:36 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 116.089432] niks3-server[1149]: 2026/09/21 13:55:36 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo lb # [ 116.094303] niks3-server[1149]: 2026/09/21 13:55:36 INFO Completed upload id=38 worker1 # [ 116.071609] nix-grpc-daemon[1114]: time=2026-09-21T13:55:36.711Z level=INFO msg="Upload complete. (338ms)" worker1 # [ 116.085144] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 116.101423] nix-daemon[838]: reaped child process 1211, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.98 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds) worker2 # [ 116.461090] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 116.468881] systemd[1]: Starting scheduler-token.service... worker2 # [ 116.559954] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 116.564272] systemd[1]: Finished scheduler-token.service. worker2 # [ 116.565368] systemd[1]: scheduler-token.service: Consumed 38ms CPU time over 94ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 116.571529] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 116.745177] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:37Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 116.747725] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 116.751778] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 116.759280] nix-grpc-daemon[1496]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 116.767428] nix-grpc-daemon[1496]: E0000 00:00:1789998937.396932 1496 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 116.772273] nix-grpc-daemon[1496]: E0000 00:00:1789998937.400538 1496 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 116.776562] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 116.778545] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 116.784533] nix-grpc-daemon[1496]: E0000 00:00:1789998937.418977 1536 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 116.808066] nix-grpc-daemon[1496]: E0000 00:00:1789998937.436940 1536 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 116.810369] nix-grpc-daemon[1496]: E0000 00:00:1789998937.437096 1536 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 116.818901] nix-grpc-daemon[1496]: E0000 00:00:1789998937.456581 1536 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 116.834054] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 116.844153] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:37Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 116.849710] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:37Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:35380 worker1 # [ 116.855060] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:37Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.70 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 117.240245] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 9bb8a5290e6f4a349696d522b933259b client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds) worker2 # [ 117.502198] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 117.517771] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) client # [ 117.531145] nix[1249]: don't know how to build these paths: client # [ 117.532250] nix[1249]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 117.549367] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:38Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 117.556122] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:38Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 117.602934] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 117.619637] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33392 client # [ 117.626986] nix[1249]: copying 1 paths to 'lb:50051'... client # [ 117.632346] nix[1249]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 117.637486] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 117.652917] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker1 # [ 117.860088] nix-daemon[838]: accepted connection from pid 1245, user nix-grpc-daemon (trusted) worker1 # [ 117.880354] nix-daemon[838]: reaped child process 1248, status = succeeded worker1 # [ 118.054987] nix-daemon[838]: accepted connection from pid 1250, user nix-grpc-daemon (trusted) worker1 # [ 118.071057] nix-daemon[838]: reaped child process 1253, status = succeeded lb # [ 118.107263] niks3-server[1149]: 2026/09/21 13:55:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 118.094770] nix-grpc-daemon[1114]: time=2026-09-21T13:55:38.734Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 118.096314] nix-grpc-daemon[1114]: time=2026-09-21T13:55:38.734Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 118.133728] niks3-server[1149]: 2026/09/21 13:55:38 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 118.148120] niks3-server[1149]: 2026/09/21 13:55:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign worker1 # [ 118.131398] nix-grpc-daemon[1114]: time=2026-09-21T13:55:38.771Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.159832] niks3-server[1149]: 2026/09/21 13:55:38 INFO Signed narinfos id=39 count=1 lb # [ 118.165743] niks3-server[1149]: 2026/09/21 13:55:38 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 118.174838] niks3-server[1149]: 2026/09/21 13:55:38 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete worker1 # [ 118.155830] nix-grpc-daemon[1114]: time=2026-09-21T13:55:38.796Z level=INFO msg="Upload complete. (486ms)" lb # [ 118.179181] niks3-server[1149]: 2026/09/21 13:55:38 INFO Completed upload id=39 lb # [ 118.182543] niks3-server[1149]: 2026/09/21 13:55:38 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker1 # [ 118.164533] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33392 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 118.167969] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 worker1 # [ 118.178794] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker1 # [ 118.183201] nix-daemon[838]: reaped child process 1243, status = succeeded worker1 # [ 118.193594] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) client # [ 118.187209] nix[1249]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 120.190272] systemd-journald[274]: Received client request to rotate journal, rotating. worker2 # [ 120.209406] systemd-journald[274]: Vacuuming done, freed 0B of archived journals from /var/log/journal/3e887629c8544a7bb12de2a04edf3aed. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 120.270433] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds) client: must succeed: sleep 5.0 worker1 # [ 120.320122] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:40Z level=info event=draining lb # [ 121.902749] envoy[903]: conn peer=[2001:db8:1::1]:49820 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9606 tx=4072 ms=6671 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1 # [ 125.624703] nix-daemon[838]: reaped child process 1257, status = succeeded worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 125.782273] nix-daemon[838]: accepted connection from pid 1298, user nix-grpc-daemon (trusted) worker1 # [ 125.800486] nix-daemon[838]: reaped child process 1301, status = succeeded lb # [ 125.838022] niks3-server[1149]: 2026/09/21 13:55:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 125.823228] nix-grpc-daemon[1114]: time=2026-09-21T13:55:46.463Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 125.827631] nix-grpc-daemon[1114]: time=2026-09-21T13:55:46.465Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 125.867890] niks3-server[1149]: 2026/09/21 13:55:46 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 125.885465] niks3-server[1149]: 2026/09/21 13:55:46 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 125.900655] niks3-server[1149]: 2026/09/21 13:55:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker1 # [ 125.883474] nix-grpc-daemon[1114]: time=2026-09-21T13:55:46.523Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.911416] niks3-server[1149]: 2026/09/21 13:55:46 INFO Signed narinfos id=40 count=1 lb # [ 125.918232] niks3-server[1149]: 2026/09/21 13:55:46 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 125.927381] niks3-server[1149]: 2026/09/21 13:55:46 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 125.933468] niks3-server[1149]: 2026/09/21 13:55:46 INFO Completed upload id=40 lb # [ 125.936051] niks3-server[1149]: 2026/09/21 13:55:46 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 125.909886] nix-grpc-daemon[1114]: time=2026-09-21T13:55:46.550Z level=INFO msg="Upload complete. (297ms)" worker1 # [ 125.920835] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33392 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 125.936923] nix-daemon[838]: reaped child process 1255, status = succeeded client # [ 125.959013] systemd[1]: rs.service: Deactivated successfully. client # [ 125.964099] systemd[1]: rs.service: Consumed 179ms CPU time over 8.720s wall clock time, 39.2M memory peak, 7.1K incoming IP traffic, 8.3K outgoing IP traffic. worker1 # [ 126.324117] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:46Z level=info event=signal_exit lb # [ 126.885264] niks3-server[1149]: 2026/09/21 13:55:47 INFO lead: released remote=192.168.1.3:50940 worker2 # [ 127.861803] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:48Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 127.867058] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:48Z level=info event=scheduler_restarting worker1 # [ 127.872329] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:48Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 127.876868] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:35380 worker1 # [ 127.882030] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:48Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 127.887336] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:35380 worker1 # [ 127.896534] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:48Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 127.914094] nix-daemon[838]: reaped child process 1093, status = succeeded worker2 # [ 128.061927] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.067349] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.083758] nix-grpc-daemon[1041]: ts=2026-09-21T13:55:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 128.268499] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.273691] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.457176] nix-grpc-daemon[1041]: E0000 00:00:1789998949.097130 1086 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 128.463750] nix-grpc-daemon[1041]: E0000 00:00:1789998949.097348 1086 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 128.474603] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.479739] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 128.680870] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.686000] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 128.891298] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 128.895797] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 3.29 seconds) client: waiting for success: ! systemctl is-active rs worker1 # [ 129.002723] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } worker1 # [ 129.008771] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 129.011130] systemd[1]: nix-grpc-daemon.service: Consumed 1.824s CPU time over 32.913s wall clock time, 37.1M memory peak, 46.2K incoming IP traffic, 87.9K outgoing IP traffic. worker1 # [ 129.025240] systemd[1]: Starting Nix worker-protocol over gRPC... client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' worker2 # [ 129.090624] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:49Z level=info event=scheduler_connected addr=lb:50051 client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 129.095879] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1 # [ 129.219253] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 129.221870] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 129.225958] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 129.235828] nix-grpc-daemon[1308]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 129.241144] nix-grpc-daemon[1308]: E0000 00:00:1789998949.873830 1308 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 129.245789] nix-grpc-daemon[1308]: E0000 00:00:1789998949.875927 1308 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 129.248850] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 129.271256] niks3-server[1149]: 2026/09/21 13:55:49 INFO lead: acquired remote=192.168.1.3:56996 worker1 # [ 129.250795] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:49Z level=info event=scheduler_take_over worker1 # [ 129.252194] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 129.256065] nix-grpc-daemon[1308]: E0000 00:00:1789998949.896019 1348 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 129.288054] nix-grpc-daemon[1308]: E0000 00:00:1789998949.914584 1348 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 129.290389] nix-grpc-daemon[1308]: E0000 00:00:1789998949.914719 1348 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 129.294657] nix-grpc-daemon[1308]: E0000 00:00:1789998949.934001 1348 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 129.297197] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.307001] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.302554] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 129.308660] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 129.504267] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.509985] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.510181] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 129.514939] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 129.711422] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.715666] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.717089] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 129.721102] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 129.920445] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.922007] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.924733] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 129.927028] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 130.121093] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 130.128850] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 130.134582] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:55458 worker1 # [ 130.140940] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 130.150668] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 130.154818] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:55458 worker1 # [ 130.160124] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:50Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.16 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 130.394260] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 3ad05abf839645269151f98505180c6a client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds) worker1 # [ 130.655182] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55474 worker1 # [ 130.669653] nix-daemon[838]: accepted connection from pid 1308, user nix-grpc-daemon (trusted) client # [ 130.682341] nix[1285]: don't know how to build these paths: client # [ 130.683578] nix[1285]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 130.696542] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:51Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 130.703421] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:51Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 130.749609] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55474 worker1 # [ 130.766320] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 1/5) worker1 # [ 130.777591] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 59 ms (attempt 2/5) worker1 # [ 130.843827] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 168 ms (attempt 3/5) worker1 # [ 131.019631] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 579 ms (attempt 4/5) worker1 # [ 131.599999] nix-grpc-daemon[1308]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 131.610632] nix-grpc-daemon[1308]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 131.629747] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55474 client # [ 131.635243] nix[1285]: copying 1 paths to 'lb:50051'... worker1 # [ 131.640710] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55474 client # [ 131.635571] nix[1285]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker1 # [ 131.657063] nix-daemon[838]: accepted connection from pid 1308, user nix-grpc-daemon (trusted) worker1 # [ 131.685657] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:52Z level=info event=niks3_push_started pid=1381 worker1 # [ 131.882830] nix-grpc-daemon[1381]: time=2026-09-21T13:55:52.522Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" lb # [ 131.906014] envoy[903]: conn peer=[2001:db8:1::1]:40278 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1429 ms=8434 lb # [ 131.911040] envoy[903]: conn peer=[2001:db8:1::3]:43734 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2413 tx=836 ms=31697 worker1 # [ 132.060081] nix-daemon[838]: accepted connection from pid 1394, user nix-grpc-daemon (trusted) worker1 # [ 132.075191] nix-daemon[838]: reaped child process 1397, status = succeeded worker1 # [ 132.255178] nix-daemon[838]: accepted connection from pid 1399, user nix-grpc-daemon (trusted) worker1 # [ 132.274100] nix-daemon[838]: reaped child process 1402, status = succeeded lb # [ 132.309535] niks3-server[1149]: 2026/09/21 13:55:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 132.296070] nix-grpc-daemon[1381]: time=2026-09-21T13:55:52.936Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 132.297641] nix-grpc-daemon[1381]: time=2026-09-21T13:55:52.936Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 132.345052] niks3-server[1149]: 2026/09/21 13:55:52 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker1 # [ 132.334175] nix-grpc-daemon[1381]: time=2026-09-21T13:55:52.973Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.356750] niks3-server[1149]: 2026/09/21 13:55:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 132.366797] niks3-server[1149]: 2026/09/21 13:55:53 INFO Signed narinfos id=41 count=1 lb # [ 132.376188] niks3-server[1149]: 2026/09/21 13:55:53 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 132.384096] niks3-server[1149]: 2026/09/21 13:55:53 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete worker1 # [ 132.368533] nix-grpc-daemon[1381]: time=2026-09-21T13:55:53.008Z level=INFO msg="Upload complete. (480ms)" lb # [ 132.392245] niks3-server[1149]: 2026/09/21 13:55:53 INFO Completed upload id=41 worker1 # [ 132.376143] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55474 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 132.386042] nix-grpc-daemon[1308]: ts=2026-09-21T13:55:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55474 worker1 # [ 132.395009] nix-grpc-daemon[1381]: time=2026-09-21T13:55:53.025Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 132.406814] nix-daemon[838]: accepted connection from pid 1308, user nix-grpc-daemon (trusted) worker1 # [ 132.409992] nix-daemon[838]: reaped child process 1379, status = succeeded client # [ 132.407044] nix[1285]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker1 # [ 132.415657] nix-daemon[838]: accepted connection from pid 1308, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 134.458737] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1308 (nix-grpc-daemon) on client request. worker1 # [ 134.460690] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 134.497138] niks3-server[1149]: 2026/09/21 13:55:55 INFO lead: released remote=192.168.1.3:56996 client # [ 134.481661] nix[1285]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker2 # [ 134.485584] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:55Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds) client: must succeed: sleep 5.0 client # [ 134.488456] nix[1285]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 134.503981] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 134.505689] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1 # [ 134.506930] systemd[1]: nix-grpc-daemon.service: Consumed 520ms CPU time over 5.478s wall clock time, 34.5M memory peak, 14.6K incoming IP traffic, 18.7K outgoing IP traffic. worker1 # [ 134.521189] nix-daemon[838]: reaped child process 1404, status = succeeded worker1 # [ 134.522897] nix-daemon[838]: reaped child process 1367, status = succeeded worker1 # [ 134.532646] nix-daemon[1406]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 134.537555] nix-daemon[838]: reaped child process 1406, status = failed with exit code 1 worker2 # [ 134.685677] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 134.692037] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker1 # [ 134.697088] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 134.887453] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 134.890017] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 134.894118] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 134.902662] nix-grpc-daemon[1443]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 134.910391] nix-grpc-daemon[1443]: E0000 00:00:1789998955.540771 1443 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 134.915445] nix-grpc-daemon[1443]: E0000 00:00:1789998955.542768 1443 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 134.918939] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 134.940467] niks3-server[1149]: 2026/09/21 13:55:55 INFO lead: acquired remote=192.168.1.3:38354 worker1 # [ 134.921876] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 134.923307] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=info event=scheduler_take_over worker2 # [ 134.921755] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 134.928075] nix-grpc-daemon[1443]: E0000 00:00:1789998955.565908 1483 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 134.956048] nix-grpc-daemon[1443]: E0000 00:00:1789998955.583358 1483 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 134.961054] nix-grpc-daemon[1443]: E0000 00:00:1789998955.583511 1483 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 134.963828] nix-grpc-daemon[1443]: E0000 00:00:1789998955.600574 1483 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 134.973247] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 134.975190] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:39796 worker1 # [ 134.976849] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 135.000050] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 135.001964] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 135.051346] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 worker1 # [ 135.059465] nix-daemon[838]: accepted connection from pid 1443, user nix-grpc-daemon (trusted) worker1 # [ 135.069699] nix-daemon[838]: accepted connection from pid 1443, user nix-grpc-daemon (trusted) worker1 # [ 135.080610] nix-daemon[838]: accepted connection from pid 1443, user nix-grpc-daemon (trusted) client # [ 135.074752] nix[1285]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 135.123042] nix-grpc-daemon[1496]: ts=2026-09-21T13:55:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 135.131698] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 135.135210] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:39796 worker1 # [ 135.139313] nix-grpc-daemon[1443]: ts=2026-09-21T13:55:55Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 139.902127] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:00Z level=info event=niks3_push_started pid=1526 worker1 # [ 139.942559] nix-daemon[838]: reaped child process 1501, status = succeeded worker1 # [ 140.134421] nix-grpc-daemon[1526]: time=2026-09-21T13:56:00.773Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 140.311795] nix-daemon[838]: accepted connection from pid 1539, user nix-grpc-daemon (trusted) worker1 # [ 140.328570] nix-daemon[838]: reaped child process 1542, status = succeeded lb # [ 140.367240] niks3-server[1149]: 2026/09/21 13:56:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 140.355475] nix-grpc-daemon[1526]: time=2026-09-21T13:56:00.993Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 140.358285] nix-grpc-daemon[1526]: time=2026-09-21T13:56:00.993Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 140.417690] niks3-server[1149]: 2026/09/21 13:56:01 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst worker1 # [ 140.410557] nix-grpc-daemon[1526]: time=2026-09-21T13:56:01.049Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.432621] niks3-server[1149]: 2026/09/21 13:56:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 140.443478] niks3-server[1149]: 2026/09/21 13:56:01 INFO Signed narinfos id=42 count=1 lb # [ 140.458416] niks3-server[1149]: 2026/09/21 13:56:01 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 140.472388] niks3-server[1149]: 2026/09/21 13:56:01 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 140.483849] niks3-server[1149]: 2026/09/21 13:56:01 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 140.461320] nix-grpc-daemon[1526]: time=2026-09-21T13:56:01.101Z level=INFO msg="Upload complete. (323ms)" lb # [ 140.489486] niks3-server[1149]: 2026/09/21 13:56:01 INFO Completed upload id=42 worker1 # [ 140.480367] nix-grpc-daemon[1526]: time=2026-09-21T13:56:01.107Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 140.492310] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 140.499155] nix-daemon[838]: reaped child process 1499, status = succeeded client # [ 140.512905] systemd[1]: mid.service: Deactivated successfully. client # [ 140.518356] systemd[1]: mid.service: Consumed 186ms CPU time over 10.122s wall clock time, 41.2M memory peak, 8.4K incoming IP traffic, 10.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.72 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 141.089819] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 7eb78e3059114f949c83665b73b52eb6 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.05 seconds) worker2 # [ 141.333653] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45808 client # [ 141.339062] nix[1321]: don't know how to build these paths: client # [ 141.340291] nix[1321]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker1 # [ 141.358336] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:01Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker1 # [ 141.364187] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:01Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 141.404221] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 141.421700] nix-grpc-daemon[1496]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 1/5) worker2 # [ 141.431902] nix-grpc-daemon[1496]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 2/5) worker2 # [ 141.523301] nix-grpc-daemon[1496]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 3/5) worker2 # [ 141.621036] nix-grpc-daemon[1496]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 436 ms (attempt 4/5) lb # [ 141.903253] envoy[903]: conn peer=[2001:db8:1::3]:39064 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1015 tx=434 ms=5186 lb # [ 141.908636] envoy[903]: conn peer=[2001:db8:1::1]:60862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3940 tx=1826 ms=9839 worker2 # [ 142.065009] nix-grpc-daemon[1496]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 142.070701] nix-grpc-daemon[1496]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 142.089644] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45808 client # [ 142.100433] nix[1321]: copying 1 paths to 'lb:50051'... worker2 # [ 142.105866] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 client # [ 142.103510] nix[1321]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker2 # [ 142.123790] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 142.150125] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:02Z level=info event=niks3_push_started pid=1644 worker2 # [ 142.376931] nix-grpc-daemon[1644]: time=2026-09-21T13:56:03.013Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 142.557467] nix-daemon[864]: accepted connection from pid 1661, user nix-grpc-daemon (trusted) worker2 # [ 142.576957] nix-daemon[864]: reaped child process 1664, status = succeeded worker2 # [ 142.757402] nix-daemon[864]: accepted connection from pid 1666, user nix-grpc-daemon (trusted) worker2 # [ 142.776234] nix-daemon[864]: reaped child process 1669, status = succeeded lb # [ 142.813207] niks3-server[1149]: 2026/09/21 13:56:03 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 142.806409] nix-grpc-daemon[1644]: time=2026-09-21T13:56:03.443Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 142.807890] nix-grpc-daemon[1644]: time=2026-09-21T13:56:03.443Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 142.867761] niks3-server[1149]: 2026/09/21 13:56:03 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst worker2 # [ 142.855102] nix-grpc-daemon[1644]: time=2026-09-21T13:56:03.493Z level=INFO msg="Uploading 1 narinfos" lb # [ 142.883106] niks3-server[1149]: 2026/09/21 13:56:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 142.893731] niks3-server[1149]: 2026/09/21 13:56:03 INFO Signed narinfos id=43 count=1 lb # [ 142.901805] niks3-server[1149]: 2026/09/21 13:56:03 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 142.909882] niks3-server[1149]: 2026/09/21 13:56:03 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 142.915319] niks3-server[1149]: 2026/09/21 13:56:03 INFO Completed upload id=43 worker2 # [ 142.890365] nix-grpc-daemon[1644]: time=2026-09-21T13:56:03.528Z level=INFO msg="Upload complete. (510ms)" lb # [ 142.918421] niks3-server[1149]: 2026/09/21 13:56:03 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker2 # [ 142.900924] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 142.915859] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 142.923652] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 142.929485] nix-daemon[864]: reaped child process 1642, status = succeeded client # [ 142.937443] nix[1321]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker2 # [ 142.944445] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 144.790591] systemd[1]: intr.service: Sent signal SIGINT to main process 1321 (nix) on client request. worker2 # [ 144.798185] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:05Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds) client # [ 144.797136] nix[1321]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 144.801372] nix[1321]: error: interrupted by the user client # [ 144.841058] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 144.843705] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 144.847453] systemd[1]: intr.service: Consumed 158ms CPU time over 3.756s wall clock time, 41.4M memory peak, 6.5K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 144.975050] nix-daemon[1673]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 144.981019] nix-daemon[864]: reaped child process 1671, status = succeeded worker2 # [ 144.985078] nix-daemon[864]: reaped child process 1673, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 5.06 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 146.180669] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: d14f08d281e14836ba189e1b93ffaaac client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds) client # [ 146.437608] nix[1341]: don't know how to build these paths: client # [ 146.438623] nix[1341]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 146.440921] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45808 worker1 # [ 146.458267] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:07Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker1 # [ 146.458676] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:07Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 146.501960] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 worker1 # [ 146.518521] nix-grpc-daemon[1443]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 1/5) worker1 # [ 146.527964] nix-grpc-daemon[1443]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 157 ms (attempt 2/5) worker1 # [ 146.685543] nix-grpc-daemon[1443]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 155 ms (attempt 3/5) worker1 # [ 146.848201] nix-grpc-daemon[1443]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 161 ms (attempt 4/5) worker1 # [ 147.017006] nix-grpc-daemon[1443]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 147.023495] nix-grpc-daemon[1443]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 147.043293] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39808 client # [ 147.052206] nix[1341]: copying 1 paths to 'lb:50051'... worker1 # [ 147.058648] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 client # [ 147.055596] nix[1341]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 147.074244] nix-daemon[838]: accepted connection from pid 1443, user nix-grpc-daemon (trusted) worker1 # [ 147.286141] nix-daemon[838]: accepted connection from pid 1582, user nix-grpc-daemon (trusted) worker1 # [ 147.302950] nix-daemon[838]: reaped child process 1585, status = succeeded worker1 # [ 147.492145] nix-daemon[838]: accepted connection from pid 1587, user nix-grpc-daemon (trusted) worker1 # [ 147.512606] nix-daemon[838]: reaped child process 1594, status = succeeded lb # [ 147.547153] niks3-server[1149]: 2026/09/21 13:56:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.533634] nix-grpc-daemon[1526]: time=2026-09-21T13:56:08.173Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 147.535127] nix-grpc-daemon[1526]: time=2026-09-21T13:56:08.173Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 147.572543] niks3-server[1149]: 2026/09/21 13:56:08 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst lb # [ 147.591937] niks3-server[1149]: 2026/09/21 13:56:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker1 # [ 147.574268] nix-grpc-daemon[1526]: time=2026-09-21T13:56:08.214Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.602897] niks3-server[1149]: 2026/09/21 13:56:08 INFO Signed narinfos id=44 count=1 lb # [ 147.610083] niks3-server[1149]: 2026/09/21 13:56:08 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 147.621295] niks3-server[1149]: 2026/09/21 13:56:08 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete worker1 # [ 147.603268] nix-grpc-daemon[1526]: time=2026-09-21T13:56:08.243Z level=INFO msg="Upload complete. (508ms)" lb # [ 147.628496] niks3-server[1149]: 2026/09/21 13:56:08 INFO Completed upload id=44 lb # [ 147.631796] niks3-server[1149]: 2026/09/21 13:56:08 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker1 # [ 147.612943] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 147.625144] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 worker1 # [ 147.634522] nix-daemon[838]: accepted connection from pid 1443, user nix-grpc-daemon (trusted) worker1 # [ 147.637846] nix-daemon[838]: reaped child process 1580, status = succeeded client # [ 147.643896] nix[1341]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker1 # [ 147.651738] nix-daemon[838]: accepted connection from pid 1443, user nix-grpc-daemon (trusted) worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 148.867447] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 148.914827] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1 # [ 148.919633] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:09Z level=info event=draining worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.10 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 149.245060] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 149.252151] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45808 worker1 # [ 149.275718] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:09Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker1 # [ 149.278074] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:09Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 149.323817] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 149.338836] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45808 client # copying 1 paths to 'lb:50051'... worker2 # [ 149.354632] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker2 # [ 149.379029] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 149.591992] nix-daemon[864]: accepted connection from pid 1724, user nix-grpc-daemon (trusted) worker2 # [ 149.610389] nix-daemon[864]: reaped child process 1727, status = succeeded worker2 # [ 149.785442] nix-daemon[864]: accepted connection from pid 1729, user nix-grpc-daemon (trusted) worker2 # [ 149.800968] nix-daemon[864]: reaped child process 1732, status = succeeded lb # [ 149.837485] niks3-server[1149]: 2026/09/21 13:56:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 149.822652] nix-grpc-daemon[1644]: time=2026-09-21T13:56:10.460Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 149.824170] nix-grpc-daemon[1644]: time=2026-09-21T13:56:10.460Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 149.866784] niks3-server[1149]: 2026/09/21 13:56:10 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker2 # [ 149.860738] nix-grpc-daemon[1644]: time=2026-09-21T13:56:10.498Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.876904] niks3-server[1149]: 2026/09/21 13:56:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 149.891582] niks3-server[1149]: 2026/09/21 13:56:10 INFO Signed narinfos id=45 count=1 lb # [ 149.898943] niks3-server[1149]: 2026/09/21 13:56:10 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 149.908832] niks3-server[1149]: 2026/09/21 13:56:10 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 149.915652] niks3-server[1149]: 2026/09/21 13:56:10 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo lb # [ 149.921743] niks3-server[1149]: 2026/09/21 13:56:10 INFO Completed upload id=45 worker2 # [ 149.897679] nix-grpc-daemon[1644]: time=2026-09-21T13:56:10.536Z level=INFO msg="Upload complete. (501ms)" worker2 # [ 149.905731] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 149.919920] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 149.926029] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 149.930567] nix-daemon[864]: reaped child process 1722, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker2 # [ 149.942837] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 151.181720] nix-daemon[864]: reaped child process 1736, status = succeeded worker2 # [ 151.365751] nix-daemon[864]: accepted connection from pid 1752, user nix-grpc-daemon (trusted) worker2 # [ 151.382058] nix-daemon[864]: reaped child process 1755, status = succeeded lb # [ 151.418878] niks3-server[1149]: 2026/09/21 13:56:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 151.407782] nix-grpc-daemon[1644]: time=2026-09-21T13:56:12.042Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 151.409963] nix-grpc-daemon[1644]: time=2026-09-21T13:56:12.042Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 151.450745] niks3-server[1149]: 2026/09/21 13:56:12 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 151.472110] niks3-server[1149]: 2026/09/21 13:56:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign worker2 # [ 151.457525] nix-grpc-daemon[1644]: time=2026-09-21T13:56:12.094Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.486325] niks3-server[1149]: 2026/09/21 13:56:12 INFO Signed narinfos id=46 count=1 lb # [ 151.492688] niks3-server[1149]: 2026/09/21 13:56:12 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 151.498444] niks3-server[1149]: 2026/09/21 13:56:12 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 151.508883] niks3-server[1149]: 2026/09/21 13:56:12 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 151.515250] niks3-server[1149]: 2026/09/21 13:56:12 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo lb # [ 151.519560] niks3-server[1149]: 2026/09/21 13:56:12 INFO Completed upload id=46 worker2 # [ 151.495204] nix-grpc-daemon[1644]: time=2026-09-21T13:56:12.133Z level=INFO msg="Upload complete. (342ms)" worker1 # [ 151.510364] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:12Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker1 # [ 151.512285] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:12Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 151.510309] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker2 # [ 151.524720] nix-daemon[864]: reaped child process 1734, status = succeeded worker2 # [ 151.557535] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 151.571445] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 151.586088] nix-grpc-daemon[1644]: time=2026-09-21T13:56:12.224Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 151.596740] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker2 # [ 151.620191] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 151.822959] nix-daemon[864]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker2 # [ 151.842727] nix-daemon[864]: reaped child process 1762, status = succeeded lb # [ 151.906817] envoy[903]: conn peer=[2001:db8:1::1]:51102 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3013 tx=852 ms=3499 worker2 # [ 152.019679] nix-daemon[864]: accepted connection from pid 1764, user nix-grpc-daemon (trusted) worker2 # [ 152.036387] nix-daemon[864]: reaped child process 1767, status = succeeded lb # [ 152.075908] niks3-server[1149]: 2026/09/21 13:56:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 152.064249] nix-grpc-daemon[1644]: time=2026-09-21T13:56:12.702Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 152.066367] nix-grpc-daemon[1644]: time=2026-09-21T13:56:12.702Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 152.117031] niks3-server[1149]: 2026/09/21 13:56:12 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst lb # [ 152.133297] niks3-server[1149]: 2026/09/21 13:56:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker2 # [ 152.115506] nix-grpc-daemon[1644]: time=2026-09-21T13:56:12.753Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.146573] niks3-server[1149]: 2026/09/21 13:56:12 INFO Signed narinfos id=47 count=1 lb # [ 152.152531] niks3-server[1149]: 2026/09/21 13:56:12 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 152.160252] niks3-server[1149]: 2026/09/21 13:56:12 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 152.166903] niks3-server[1149]: 2026/09/21 13:56:12 INFO Completed upload id=47 worker2 # [ 152.142819] nix-grpc-daemon[1644]: time=2026-09-21T13:56:12.781Z level=INFO msg="Upload complete. (505ms)" lb # [ 152.169553] niks3-server[1149]: 2026/09/21 13:56:12 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker2 # [ 152.152430] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 152.167210] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 152.173916] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 152.179753] nix-daemon[864]: reaped child process 1757, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... worker2 # [ 152.193010] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 153.034015] nix-daemon[864]: reaped child process 1771, status = succeeded worker2 # [ 153.217357] nix-daemon[864]: accepted connection from pid 1787, user nix-grpc-daemon (trusted) worker2 # [ 153.235037] nix-daemon[864]: reaped child process 1790, status = succeeded lb # [ 153.271865] niks3-server[1149]: 2026/09/21 13:56:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 153.257898] nix-grpc-daemon[1644]: time=2026-09-21T13:56:13.895Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 153.259618] nix-grpc-daemon[1644]: time=2026-09-21T13:56:13.895Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 153.306041] niks3-server[1149]: 2026/09/21 13:56:13 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 153.320234] niks3-server[1149]: 2026/09/21 13:56:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker2 # [ 153.302296] nix-grpc-daemon[1644]: time=2026-09-21T13:56:13.940Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.331942] niks3-server[1149]: 2026/09/21 13:56:13 INFO Signed narinfos id=48 count=1 lb # [ 153.337788] niks3-server[1149]: 2026/09/21 13:56:13 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 153.342732] niks3-server[1149]: 2026/09/21 13:56:13 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 153.352224] niks3-server[1149]: 2026/09/21 13:56:13 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 153.357552] niks3-server[1149]: 2026/09/21 13:56:14 INFO Completed upload id=48 worker2 # [ 153.333503] nix-grpc-daemon[1644]: time=2026-09-21T13:56:13.971Z level=INFO msg="Upload complete. (327ms)" lb # [ 153.360822] niks3-server[1149]: 2026/09/21 13:56:14 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker1 # [ 153.349694] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:13Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker1 # [ 153.351548] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:13Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 153.345176] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker2 # [ 153.365170] nix-daemon[864]: reaped child process 1769, status = succeeded worker2 # [ 153.396261] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 153.412496] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 153.426938] nix-grpc-daemon[1644]: time=2026-09-21T13:56:14.065Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker2 # [ 153.437230] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 153.455917] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 153.659175] nix-daemon[864]: accepted connection from pid 1794, user nix-grpc-daemon (trusted) worker2 # [ 153.675873] nix-daemon[864]: reaped child process 1797, status = succeeded worker2 # [ 153.846297] nix-daemon[864]: accepted connection from pid 1799, user nix-grpc-daemon (trusted) worker2 # [ 153.861833] nix-daemon[864]: reaped child process 1802, status = succeeded lb # [ 153.897412] niks3-server[1149]: 2026/09/21 13:56:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 153.882637] nix-grpc-daemon[1644]: time=2026-09-21T13:56:14.520Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 153.884113] nix-grpc-daemon[1644]: time=2026-09-21T13:56:14.520Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 153.924597] niks3-server[1149]: 2026/09/21 13:56:14 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst worker2 # [ 153.914831] nix-grpc-daemon[1644]: time=2026-09-21T13:56:14.553Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.939952] niks3-server[1149]: 2026/09/21 13:56:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 153.949437] niks3-server[1149]: 2026/09/21 13:56:14 INFO Signed narinfos id=49 count=1 lb # [ 153.951971] niks3-server[1149]: 2026/09/21 13:56:14 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 153.960501] niks3-server[1149]: 2026/09/21 13:56:14 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 153.967264] niks3-server[1149]: 2026/09/21 13:56:14 INFO Completed upload id=49 worker2 # [ 153.942880] nix-grpc-daemon[1644]: time=2026-09-21T13:56:14.581Z level=INFO msg="Upload complete. (469ms)" lb # [ 153.969748] niks3-server[1149]: 2026/09/21 13:56:14 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker2 # [ 153.952066] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 153.961767] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 153.968154] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 153.972188] nix-daemon[864]: reaped child process 1792, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker2 # [ 153.983875] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 155.003692] nix-daemon[864]: reaped child process 1806, status = succeeded worker2 # [ 155.161329] nix-daemon[864]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker2 # [ 155.180265] nix-daemon[864]: reaped child process 1825, status = succeeded lb # [ 155.217003] niks3-server[1149]: 2026/09/21 13:56:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 155.204382] nix-grpc-daemon[1644]: time=2026-09-21T13:56:15.841Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 155.205876] nix-grpc-daemon[1644]: time=2026-09-21T13:56:15.841Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 155.253769] niks3-server[1149]: 2026/09/21 13:56:15 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 155.266683] niks3-server[1149]: 2026/09/21 13:56:15 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 155.257488] nix-grpc-daemon[1644]: time=2026-09-21T13:56:15.895Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.275775] niks3-server[1149]: 2026/09/21 13:56:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 155.286344] niks3-server[1149]: 2026/09/21 13:56:15 INFO Signed narinfos id=50 count=1 lb # [ 155.292697] niks3-server[1149]: 2026/09/21 13:56:15 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 155.301901] niks3-server[1149]: 2026/09/21 13:56:15 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 155.307552] niks3-server[1149]: 2026/09/21 13:56:15 INFO Completed upload id=50 worker2 # [ 155.283373] nix-grpc-daemon[1644]: time=2026-09-21T13:56:15.921Z level=INFO msg="Upload complete. (290ms)" lb # [ 155.310937] niks3-server[1149]: 2026/09/21 13:56:15 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker2 # [ 155.293052] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker2 # [ 155.310757] nix-daemon[864]: reaped child process 1804, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.37 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 155.677089] nix-daemon[838]: reaped child process 1598, status = succeeded worker1 # [ 155.839843] nix-daemon[838]: accepted connection from pid 1641, user nix-grpc-daemon (trusted) worker1 # [ 155.856206] nix-daemon[838]: reaped child process 1644, status = succeeded lb # [ 155.890337] niks3-server[1149]: 2026/09/21 13:56:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.877397] nix-grpc-daemon[1526]: time=2026-09-21T13:56:16.516Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 155.878855] nix-grpc-daemon[1526]: time=2026-09-21T13:56:16.516Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 155.925893] niks3-server[1149]: 2026/09/21 13:56:16 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst worker1 # [ 155.917873] nix-grpc-daemon[1526]: time=2026-09-21T13:56:16.557Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.943317] niks3-server[1149]: 2026/09/21 13:56:16 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 155.952689] niks3-server[1149]: 2026/09/21 13:56:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 155.957025] niks3-server[1149]: 2026/09/21 13:56:16 INFO Signed narinfos id=51 count=1 lb # [ 155.963715] niks3-server[1149]: 2026/09/21 13:56:16 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls worker1 # [ 155.944578] nix-grpc-daemon[1526]: time=2026-09-21T13:56:16.584Z level=INFO msg="Upload complete. (278ms)" lb # [ 155.967952] niks3-server[1149]: 2026/09/21 13:56:16 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 155.973146] niks3-server[1149]: 2026/09/21 13:56:16 INFO Completed upload id=51 lb # [ 155.975729] niks3-server[1149]: 2026/09/21 13:56:16 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker1 # [ 155.953849] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39808 duration_s=8 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 155.967630] nix-daemon[838]: reaped child process 1596, status = succeeded client # [ 155.993585] systemd[1]: sw.service: Deactivated successfully. client # [ 155.998704] systemd[1]: sw.service: Consumed 178ms CPU time over 9.816s wall clock time, 41.4M memory peak, 7.4K incoming IP traffic, 8.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.07 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 156.921655] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:17Z level=info event=signal_exit lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb # [ 157.169308] niks3-server[1149]: 2026/09/21 13:56:17 INFO lead: released remote=192.168.1.3:38354 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2 # [ 158.144590] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:18Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 158.149145] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:18Z level=info event=scheduler_restarting worker1 # [ 158.155654] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39796 worker1 # [ 158.161060] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:18Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 158.165506] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:18Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 158.170346] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:18Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39796 worker1 # [ 158.175343] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:18Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 158.198856] nix-daemon[838]: reaped child process 1497, status = succeeded worker2 # [ 158.344681] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 158.349930] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 158.367539] nix-grpc-daemon[1443]: ts=2026-09-21T13:56:19Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 158.550949] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 158.555817] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 158.756899] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 158.761792] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 158.956887] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 158.963061] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 158.963173] systemd[1]: nix-grpc-daemon.service: Consumed 876ms CPU time over 24.458s wall clock time, 35.1M memory peak, 25.3K incoming IP traffic, 31.7K outgoing IP traffic. worker2 # [ 158.968353] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 159.062890] systemd[1]: Starting Nix worker-protocol over gRPC... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2 # [ 159.170956] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 159.175031] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 159.271828] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 159.274412] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 159.278574] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 159.287281] nix-grpc-daemon[1656]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 159.298532] nix-grpc-daemon[1656]: E0000 00:00:1789998979.925472 1656 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 159.302299] nix-grpc-daemon[1656]: E0000 00:00:1789998979.927385 1656 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 159.305133] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 159.326060] niks3-server[1149]: 2026/09/21 13:56:19 INFO lead: acquired remote=192.168.1.3:54244 worker1 # [ 159.307687] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:19Z level=info event=scheduler_take_over worker1 # [ 159.309167] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 159.312411] nix-grpc-daemon[1656]: E0000 00:00:1789998979.952480 1697 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 159.340055] nix-grpc-daemon[1656]: E0000 00:00:1789998979.970399 1697 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 159.342333] nix-grpc-daemon[1656]: E0000 00:00:1789998979.970529 1697 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 159.350135] nix-grpc-daemon[1656]: E0000 00:00:1789998979.989658 1697 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 159.362118] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 159.365606] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:20Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56130 worker1 # [ 159.367311] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 159.371846] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 159.378059] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:20Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 159.379540] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:20Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56130 worker1 # [ 159.381339] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:20Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 3.32 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.25 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 160.632554] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 160.640505] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45808 worker1 # [ 160.688189] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:21Z level=debug event=want client=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker1 # [ 160.688527] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:21Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 160.688722] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:21Z level=debug event=want client=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker1 # [ 160.688842] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:21Z level=debug event=want client=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 160.737448] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 160.751835] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 160.775052] nix-grpc-daemon[1656]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 19 ms (attempt 1/5) worker1 # [ 160.800560] nix-grpc-daemon[1656]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 2/5) worker1 # [ 160.882864] nix-grpc-daemon[1656]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 208 ms (attempt 3/5) worker1 # [ 161.098356] nix-grpc-daemon[1656]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 529 ms (attempt 4/5) worker1 # [ 161.635276] nix-grpc-daemon[1656]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 161.640943] nix-grpc-daemon[1656]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 161.659170] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 161.674666] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 161.689823] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 161.724872] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:22Z level=info event=niks3_push_started pid=1721 lb # [ 161.912303] envoy[903]: conn peer=[2001:db8:1::1]:51118 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9651 tx=4135 ms=6069 lb # [ 161.912560] envoy[903]: conn peer=[2001:db8:1::1]:51112 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2995 tx=1471 ms=9530 lb # [ 161.912670] envoy[903]: conn peer=[2001:db8:1::3]:35052 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=894 tx=344 ms=23384 worker1 # [ 161.934395] nix-grpc-daemon[1721]: time=2026-09-21T13:56:22.573Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 162.104075] nix-daemon[838]: accepted connection from pid 1734, user nix-grpc-daemon (trusted) worker1 # [ 162.118712] nix-daemon[838]: reaped child process 1737, status = succeeded worker1 # [ 162.296589] nix-daemon[838]: accepted connection from pid 1739, user nix-grpc-daemon (trusted) worker1 # [ 162.311601] nix-daemon[838]: reaped child process 1742, status = succeeded lb # [ 162.349105] niks3-server[1149]: 2026/09/21 13:56:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.339710] nix-grpc-daemon[1721]: time=2026-09-21T13:56:22.978Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 162.341466] nix-grpc-daemon[1721]: time=2026-09-21T13:56:22.978Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 162.390671] niks3-server[1149]: 2026/09/21 13:56:23 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 162.376516] nix-grpc-daemon[1721]: time=2026-09-21T13:56:23.016Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.405519] niks3-server[1149]: 2026/09/21 13:56:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 162.416300] niks3-server[1149]: 2026/09/21 13:56:23 INFO Signed narinfos id=52 count=1 lb # [ 162.419199] niks3-server[1149]: 2026/09/21 13:56:23 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 162.426983] niks3-server[1149]: 2026/09/21 13:56:23 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 162.434388] niks3-server[1149]: 2026/09/21 13:56:23 INFO Completed upload id=52 worker1 # [ 162.411587] nix-grpc-daemon[1721]: time=2026-09-21T13:56:23.051Z level=INFO msg="Upload complete. (473ms)" lb # [ 162.437311] niks3-server[1149]: 2026/09/21 13:56:23 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 162.420256] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 162.431262] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 162.437717] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 162.442768] nix-daemon[838]: reaped child process 1719, status = succeeded worker1 # [ 162.455573] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 163.892470] nix-daemon[838]: reaped child process 1746, status = succeeded worker1 # [ 164.065234] nix-daemon[838]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 164.082901] nix-daemon[838]: reaped child process 1765, status = succeeded lb # [ 164.117941] niks3-server[1149]: 2026/09/21 13:56:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.108421] nix-grpc-daemon[1721]: time=2026-09-21T13:56:24.746Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 164.109904] nix-grpc-daemon[1721]: time=2026-09-21T13:56:24.746Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 164.156268] niks3-server[1149]: 2026/09/21 13:56:24 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 164.168123] niks3-server[1149]: 2026/09/21 13:56:24 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 164.181432] niks3-server[1149]: 2026/09/21 13:56:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker1 # [ 164.164907] nix-grpc-daemon[1721]: time=2026-09-21T13:56:24.803Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.187375] niks3-server[1149]: 2026/09/21 13:56:24 INFO Signed narinfos id=53 count=1 lb # [ 164.191653] niks3-server[1149]: 2026/09/21 13:56:24 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 164.203372] niks3-server[1149]: 2026/09/21 13:56:24 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 164.210404] niks3-server[1149]: 2026/09/21 13:56:24 INFO Completed upload id=53 worker1 # [ 164.187182] nix-grpc-daemon[1721]: time=2026-09-21T13:56:24.827Z level=INFO msg="Upload complete. (321ms)" lb # [ 164.212870] niks3-server[1149]: 2026/09/21 13:56:24 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 164.209013] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=1 outputs=1 worker1 # [ 164.220724] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:24Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 164.224583] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:24Z level=debug event=want client=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 164.227577] nix-daemon[838]: reaped child process 1744, status = succeeded worker1 # [ 164.246566] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 164.255486] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 164.267585] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 164.281154] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 164.481277] nix-daemon[838]: accepted connection from pid 1771, user nix-grpc-daemon (trusted) worker1 # [ 164.499990] nix-daemon[838]: reaped child process 1774, status = succeeded worker1 # [ 164.673086] nix-daemon[838]: accepted connection from pid 1776, user nix-grpc-daemon (trusted) worker1 # [ 164.688560] nix-daemon[838]: reaped child process 1779, status = succeeded lb # [ 164.725745] niks3-server[1149]: 2026/09/21 13:56:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.712102] nix-grpc-daemon[1721]: time=2026-09-21T13:56:25.351Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 164.713601] nix-grpc-daemon[1721]: time=2026-09-21T13:56:25.351Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 164.751976] niks3-server[1149]: 2026/09/21 13:56:25 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 164.741755] nix-grpc-daemon[1721]: time=2026-09-21T13:56:25.381Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.765745] niks3-server[1149]: 2026/09/21 13:56:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 164.778158] niks3-server[1149]: 2026/09/21 13:56:25 INFO Signed narinfos id=54 count=1 lb # [ 164.784753] niks3-server[1149]: 2026/09/21 13:56:25 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls worker1 # [ 164.770707] nix-grpc-daemon[1721]: time=2026-09-21T13:56:25.410Z level=INFO msg="Upload complete. (475ms)" lb # [ 164.795702] niks3-server[1149]: 2026/09/21 13:56:25 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker1 # [ 164.776195] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 164.802555] niks3-server[1149]: 2026/09/21 13:56:25 INFO Completed upload id=54 worker1 # [ 164.784363] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 lb # [ 164.806813] niks3-server[1149]: 2026/09/21 13:56:25 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 164.796248] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 164.798664] nix-daemon[838]: reaped child process 1769, status = succeeded worker1 # [ 164.808404] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 166.052777] nix-daemon[838]: reaped child process 1783, status = succeeded worker1 # [ 166.239108] nix-daemon[838]: accepted connection from pid 1799, user nix-grpc-daemon (trusted) worker1 # [ 166.255493] nix-daemon[838]: reaped child process 1802, status = succeeded lb # [ 166.290715] niks3-server[1149]: 2026/09/21 13:56:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.278563] nix-grpc-daemon[1721]: time=2026-09-21T13:56:26.917Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 166.280314] nix-grpc-daemon[1721]: time=2026-09-21T13:56:26.917Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 166.324594] niks3-server[1149]: 2026/09/21 13:56:26 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 166.335920] niks3-server[1149]: 2026/09/21 13:56:26 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst worker1 # [ 166.323082] nix-grpc-daemon[1721]: time=2026-09-21T13:56:26.962Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.349330] niks3-server[1149]: 2026/09/21 13:56:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 166.357448] niks3-server[1149]: 2026/09/21 13:56:26 INFO Signed narinfos id=55 count=1 lb # [ 166.359644] niks3-server[1149]: 2026/09/21 13:56:27 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 166.368501] niks3-server[1149]: 2026/09/21 13:56:27 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 166.372413] niks3-server[1149]: 2026/09/21 13:56:27 INFO Completed upload id=55 worker1 # [ 166.349664] nix-grpc-daemon[1721]: time=2026-09-21T13:56:26.989Z level=INFO msg="Upload complete. (330ms)" lb # [ 166.374544] niks3-server[1149]: 2026/09/21 13:56:27 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker1 # [ 166.366619] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=2 outputs=1 worker1 # [ 166.380723] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:26Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 166.387092] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 166.391571] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:27Z level=debug event=want client=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 166.395747] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 166.400516] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 166.413896] nix-daemon[838]: reaped child process 1781, status = succeeded worker1 # [ 166.416970] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 166.591571] nix-daemon[838]: accepted connection from pid 1808, user nix-grpc-daemon (trusted) worker1 # [ 166.610675] nix-daemon[838]: reaped child process 1811, status = succeeded worker1 # [ 166.781715] nix-daemon[838]: accepted connection from pid 1813, user nix-grpc-daemon (trusted) worker1 # [ 166.798970] nix-daemon[838]: reaped child process 1816, status = succeeded lb # [ 166.836629] niks3-server[1149]: 2026/09/21 13:56:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.822524] nix-grpc-daemon[1721]: time=2026-09-21T13:56:27.462Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 166.824111] nix-grpc-daemon[1721]: time=2026-09-21T13:56:27.462Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 166.863213] niks3-server[1149]: 2026/09/21 13:56:27 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 166.876411] niks3-server[1149]: 2026/09/21 13:56:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker1 # [ 166.860321] nix-grpc-daemon[1721]: time=2026-09-21T13:56:27.500Z level=INFO msg="Uploading 1 narinfos" lb # [ 166.888032] niks3-server[1149]: 2026/09/21 13:56:27 INFO Signed narinfos id=56 count=1 lb # [ 166.894101] niks3-server[1149]: 2026/09/21 13:56:27 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 166.900410] niks3-server[1149]: 2026/09/21 13:56:27 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 166.907898] niks3-server[1149]: 2026/09/21 13:56:27 INFO Completed upload id=56 worker1 # [ 166.885034] nix-grpc-daemon[1721]: time=2026-09-21T13:56:27.525Z level=INFO msg="Upload complete. (464ms)" lb # [ 166.910712] niks3-server[1149]: 2026/09/21 13:56:27 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 166.892134] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 166.903751] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 166.911926] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 166.914925] nix-daemon[838]: reaped child process 1806, status = succeeded worker1 # [ 166.927247] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 167.969698] nix-daemon[838]: reaped child process 1820, status = succeeded worker1 # [ 168.161815] nix-daemon[838]: accepted connection from pid 1836, user nix-grpc-daemon (trusted) worker1 # [ 168.177699] nix-daemon[838]: reaped child process 1839, status = succeeded lb # [ 168.214104] niks3-server[1149]: 2026/09/21 13:56:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.200441] nix-grpc-daemon[1721]: time=2026-09-21T13:56:28.840Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 168.201909] nix-grpc-daemon[1721]: time=2026-09-21T13:56:28.840Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 168.260462] niks3-server[1149]: 2026/09/21 13:56:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 168.271100] niks3-server[1149]: 2026/09/21 13:56:28 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 168.283968] niks3-server[1149]: 2026/09/21 13:56:28 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 168.287375] niks3-server[1149]: 2026/09/21 13:56:28 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 168.293679] niks3-server[1149]: 2026/09/21 13:56:28 INFO Signed narinfos id=57 count=1 worker1 # [ 168.271266] nix-grpc-daemon[1721]: time=2026-09-21T13:56:28.910Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.302533] niks3-server[1149]: 2026/09/21 13:56:28 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 168.309894] niks3-server[1149]: 2026/09/21 13:56:28 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo lb # [ 168.321409] niks3-server[1149]: 2026/09/21 13:56:28 INFO Completed upload id=57 worker1 # [ 168.298785] nix-grpc-daemon[1721]: time=2026-09-21T13:56:28.938Z level=INFO msg="Upload complete. (361ms)" worker1 # [ 168.314850] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=3 outputs=1 worker1 # [ 168.340437] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:28Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 168.346836] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 168.352316] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:28Z level=debug event=want client=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 168.357829] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 168.363100] nix-daemon[838]: reaped child process 1818, status = succeeded worker1 # [ 168.365516] nix-grpc-daemon[1721]: time=2026-09-21T13:56:29.002Z level=INFO msg="All 1 paths already cached" worker1 # [ 168.376113] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 168.380936] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 168.570842] nix-daemon[838]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 168.587505] nix-daemon[838]: reaped child process 1848, status = succeeded worker1 # [ 168.761924] nix-daemon[838]: accepted connection from pid 1850, user nix-grpc-daemon (trusted) worker1 # [ 168.778103] nix-daemon[838]: reaped child process 1853, status = succeeded lb # [ 168.812254] niks3-server[1149]: 2026/09/21 13:56:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.800572] nix-grpc-daemon[1721]: time=2026-09-21T13:56:29.440Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 168.802033] nix-grpc-daemon[1721]: time=2026-09-21T13:56:29.440Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 168.848262] niks3-server[1149]: 2026/09/21 13:56:29 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 168.834437] nix-grpc-daemon[1721]: time=2026-09-21T13:56:29.474Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.861555] niks3-server[1149]: 2026/09/21 13:56:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 168.871674] niks3-server[1149]: 2026/09/21 13:56:29 INFO Signed narinfos id=58 count=1 lb # [ 168.879005] niks3-server[1149]: 2026/09/21 13:56:29 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 168.883373] niks3-server[1149]: 2026/09/21 13:56:29 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls worker1 # [ 168.864547] nix-grpc-daemon[1721]: time=2026-09-21T13:56:29.504Z level=INFO msg="Upload complete. (473ms)" lb # [ 168.888105] niks3-server[1149]: 2026/09/21 13:56:29 INFO Completed upload id=58 lb # [ 168.891171] niks3-server[1149]: 2026/09/21 13:56:29 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 168.872177] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 168.885959] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 168.891814] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 168.897005] nix-daemon[838]: reaped child process 1843, status = succeeded worker1 # [ 168.910447] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 169.744878] nix-daemon[838]: reaped child process 1857, status = succeeded worker1 # [ 169.915862] nix-daemon[838]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker1 # [ 169.931176] nix-daemon[838]: reaped child process 1876, status = succeeded lb # [ 169.970438] niks3-server[1149]: 2026/09/21 13:56:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 169.959717] nix-grpc-daemon[1721]: time=2026-09-21T13:56:30.597Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 169.961408] nix-grpc-daemon[1721]: time=2026-09-21T13:56:30.597Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 170.007145] niks3-server[1149]: 2026/09/21 13:56:30 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 170.021380] niks3-server[1149]: 2026/09/21 13:56:30 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 170.030326] niks3-server[1149]: 2026/09/21 13:56:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 170.036522] niks3-server[1149]: 2026/09/21 13:56:30 INFO Signed narinfos id=59 count=1 worker1 # [ 170.013776] nix-grpc-daemon[1721]: time=2026-09-21T13:56:30.653Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.040812] niks3-server[1149]: 2026/09/21 13:56:30 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 170.051922] niks3-server[1149]: 2026/09/21 13:56:30 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 170.058337] niks3-server[1149]: 2026/09/21 13:56:30 INFO Completed upload id=59 worker1 # [ 170.035001] nix-grpc-daemon[1721]: time=2026-09-21T13:56:30.675Z level=INFO msg="Upload complete. (315ms)" lb # [ 170.061467] niks3-server[1149]: 2026/09/21 13:56:30 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker1 # [ 170.051261] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=4 outputs=1 worker1 # [ 170.067508] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:30Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 170.072623] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:30Z level=debug event=want client=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 170.076539] nix-daemon[838]: reaped child process 1855, status = succeeded worker1 # [ 170.093295] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 170.106334] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 170.119419] nix-grpc-daemon[1721]: time=2026-09-21T13:56:30.759Z level=INFO msg="All 1 paths already cached" worker1 # [ 170.127668] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 170.140497] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 170.333688] nix-daemon[838]: accepted connection from pid 1882, user nix-grpc-daemon (trusted) worker1 # [ 170.349951] nix-daemon[838]: reaped child process 1885, status = succeeded worker1 # [ 170.522661] nix-daemon[838]: accepted connection from pid 1887, user nix-grpc-daemon (trusted) worker1 # [ 170.539427] nix-daemon[838]: reaped child process 1890, status = succeeded lb # [ 170.573804] niks3-server[1149]: 2026/09/21 13:56:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.559704] nix-grpc-daemon[1721]: time=2026-09-21T13:56:31.199Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 170.561332] nix-grpc-daemon[1721]: time=2026-09-21T13:56:31.199Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 170.603367] niks3-server[1149]: 2026/09/21 13:56:31 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst worker1 # [ 170.589526] nix-grpc-daemon[1721]: time=2026-09-21T13:56:31.229Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.615548] niks3-server[1149]: 2026/09/21 13:56:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 170.629198] niks3-server[1149]: 2026/09/21 13:56:31 INFO Signed narinfos id=60 count=1 lb # [ 170.631952] niks3-server[1149]: 2026/09/21 13:56:31 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 170.615695] nix-grpc-daemon[1721]: time=2026-09-21T13:56:31.255Z level=INFO msg="Upload complete. (460ms)" lb # [ 170.639174] niks3-server[1149]: 2026/09/21 13:56:31 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 170.644080] niks3-server[1149]: 2026/09/21 13:56:31 INFO Completed upload id=60 worker1 # [ 170.621146] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 170.646856] niks3-server[1149]: 2026/09/21 13:56:31 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 170.633975] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 170.639555] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 170.643784] nix-daemon[838]: reaped child process 1880, status = succeeded worker1 # [ 170.656643] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 171.495766] nix-daemon[838]: reaped child process 1894, status = succeeded worker1 # [ 171.680795] nix-daemon[838]: accepted connection from pid 1910, user nix-grpc-daemon (trusted) worker1 # [ 171.698412] nix-daemon[838]: reaped child process 1913, status = succeeded lb # [ 171.734524] niks3-server[1149]: 2026/09/21 13:56:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 171.722164] nix-grpc-daemon[1721]: time=2026-09-21T13:56:32.360Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 171.723670] nix-grpc-daemon[1721]: time=2026-09-21T13:56:32.360Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 171.772300] niks3-server[1149]: 2026/09/21 13:56:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 171.758471] nix-grpc-daemon[1721]: time=2026-09-21T13:56:32.398Z level=INFO msg="Uploading 1 narinfos" lb # [ 171.786786] niks3-server[1149]: 2026/09/21 13:56:32 INFO Signed narinfos id=61 count=1 lb # [ 171.793612] niks3-server[1149]: 2026/09/21 13:56:32 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 171.801922] niks3-server[1149]: 2026/09/21 13:56:32 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 171.808304] niks3-server[1149]: 2026/09/21 13:56:32 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 171.813571] niks3-server[1149]: 2026/09/21 13:56:32 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 171.817963] niks3-server[1149]: 2026/09/21 13:56:32 INFO Completed upload id=61 worker1 # [ 171.795113] nix-grpc-daemon[1721]: time=2026-09-21T13:56:32.435Z level=INFO msg="Upload complete. (328ms)" lb # [ 171.820503] niks3-server[1149]: 2026/09/21 13:56:32 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 171.813051] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=5 outputs=1 worker1 # [ 171.825228] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:32Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 171.834728] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 171.838642] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:32Z level=debug event=want client=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 171.842655] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 171.847004] nix-daemon[838]: reaped child process 1892, status = succeeded worker1 # [ 171.858890] nix-grpc-daemon[1721]: time=2026-09-21T13:56:32.478Z level=INFO msg="All 1 paths already cached" worker1 # [ 171.862910] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 171.866683] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 172.045986] nix-daemon[838]: accepted connection from pid 1919, user nix-grpc-daemon (trusted) worker1 # [ 172.064189] nix-daemon[838]: reaped child process 1922, status = succeeded worker1 # [ 172.237304] nix-daemon[838]: accepted connection from pid 1924, user nix-grpc-daemon (trusted) worker1 # [ 172.253295] nix-daemon[838]: reaped child process 1927, status = succeeded lb # [ 172.287677] niks3-server[1149]: 2026/09/21 13:56:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 172.273276] nix-grpc-daemon[1721]: time=2026-09-21T13:56:32.913Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 172.274753] nix-grpc-daemon[1721]: time=2026-09-21T13:56:32.913Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 172.312614] niks3-server[1149]: 2026/09/21 13:56:32 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst worker1 # [ 172.303823] nix-grpc-daemon[1721]: time=2026-09-21T13:56:32.943Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.328474] niks3-server[1149]: 2026/09/21 13:56:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 172.338953] niks3-server[1149]: 2026/09/21 13:56:32 INFO Signed narinfos id=62 count=1 lb # [ 172.349821] niks3-server[1149]: 2026/09/21 13:56:32 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls worker1 # [ 172.332246] nix-grpc-daemon[1721]: time=2026-09-21T13:56:32.972Z level=INFO msg="Upload complete. (462ms)" lb # [ 172.355933] niks3-server[1149]: 2026/09/21 13:56:32 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 172.360830] niks3-server[1149]: 2026/09/21 13:56:33 INFO Completed upload id=62 worker1 # [ 172.340253] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 172.363941] niks3-server[1149]: 2026/09/21 13:56:33 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 172.350309] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 172.359497] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 172.362133] nix-daemon[838]: reaped child process 1917, status = succeeded worker1 # [ 172.374428] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 173.813214] nix-daemon[838]: reaped child process 1931, status = succeeded worker1 # [ 173.987418] nix-daemon[838]: accepted connection from pid 1947, user nix-grpc-daemon (trusted) worker1 # [ 174.005361] nix-daemon[838]: reaped child process 1950, status = succeeded lb # [ 174.040863] niks3-server[1149]: 2026/09/21 13:56:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.028390] nix-grpc-daemon[1721]: time=2026-09-21T13:56:34.667Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 174.029848] nix-grpc-daemon[1721]: time=2026-09-21T13:56:34.667Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 174.079706] niks3-server[1149]: 2026/09/21 13:56:34 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 174.092311] niks3-server[1149]: 2026/09/21 13:56:34 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker1 # [ 174.079730] nix-grpc-daemon[1721]: time=2026-09-21T13:56:34.719Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.103980] niks3-server[1149]: 2026/09/21 13:56:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 174.112375] niks3-server[1149]: 2026/09/21 13:56:34 INFO Signed narinfos id=63 count=1 lb # [ 174.114513] niks3-server[1149]: 2026/09/21 13:56:34 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 174.120399] niks3-server[1149]: 2026/09/21 13:56:34 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 174.127687] niks3-server[1149]: 2026/09/21 13:56:34 INFO Completed upload id=63 worker1 # [ 174.104887] nix-grpc-daemon[1721]: time=2026-09-21T13:56:34.745Z level=INFO msg="Upload complete. (320ms)" lb # [ 174.130261] niks3-server[1149]: 2026/09/21 13:56:34 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker1 # [ 174.119243] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=6 outputs=1 worker1 # [ 174.138686] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:34Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 174.142924] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 174.147651] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:34Z level=debug event=want client=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 174.152517] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 174.156995] nix-daemon[838]: reaped child process 1929, status = succeeded worker1 # [ 174.159004] nix-grpc-daemon[1721]: time=2026-09-21T13:56:34.796Z level=INFO msg="All 2 paths already cached" worker1 # [ 174.163384] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 174.173725] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 174.357971] nix-daemon[838]: accepted connection from pid 1956, user nix-grpc-daemon (trusted) worker1 # [ 174.374902] nix-daemon[838]: reaped child process 1959, status = succeeded worker1 # [ 174.545879] nix-daemon[838]: accepted connection from pid 1961, user nix-grpc-daemon (trusted) worker1 # [ 174.561999] nix-daemon[838]: reaped child process 1964, status = succeeded lb # [ 174.596544] niks3-server[1149]: 2026/09/21 13:56:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.581978] nix-grpc-daemon[1721]: time=2026-09-21T13:56:35.221Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 174.583466] nix-grpc-daemon[1721]: time=2026-09-21T13:56:35.222Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 174.621989] niks3-server[1149]: 2026/09/21 13:56:35 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 174.610707] nix-grpc-daemon[1721]: time=2026-09-21T13:56:35.250Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.636181] niks3-server[1149]: 2026/09/21 13:56:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 174.645755] niks3-server[1149]: 2026/09/21 13:56:35 INFO Signed narinfos id=64 count=1 lb # [ 174.655947] niks3-server[1149]: 2026/09/21 13:56:35 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete worker1 # [ 174.641207] nix-grpc-daemon[1721]: time=2026-09-21T13:56:35.281Z level=INFO msg="Upload complete. (459ms)" lb # [ 174.664200] niks3-server[1149]: 2026/09/21 13:56:35 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 174.669217] niks3-server[1149]: 2026/09/21 13:56:35 INFO Completed upload id=64 lb # [ 174.672456] niks3-server[1149]: 2026/09/21 13:56:35 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 174.650217] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 174.661258] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 174.668507] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 174.671443] nix-daemon[838]: reaped child process 1954, status = succeeded worker1 # [ 174.681281] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 176.126968] nix-daemon[838]: reaped child process 1968, status = succeeded worker1 # [ 176.311425] nix-daemon[838]: accepted connection from pid 1984, user nix-grpc-daemon (trusted) worker1 # [ 176.327814] nix-daemon[838]: reaped child process 1987, status = succeeded lb # [ 176.363922] niks3-server[1149]: 2026/09/21 13:56:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 176.351947] nix-grpc-daemon[1721]: time=2026-09-21T13:56:36.990Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 176.354242] nix-grpc-daemon[1721]: time=2026-09-21T13:56:36.990Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 176.404198] niks3-server[1149]: 2026/09/21 13:56:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker1 # [ 176.392916] nix-grpc-daemon[1721]: time=2026-09-21T13:56:37.032Z level=INFO msg="Uploading 1 narinfos" lb # [ 176.418620] niks3-server[1149]: 2026/09/21 13:56:37 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 176.428301] niks3-server[1149]: 2026/09/21 13:56:37 INFO Signed narinfos id=65 count=1 lb # [ 176.434243] niks3-server[1149]: 2026/09/21 13:56:37 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 176.437758] niks3-server[1149]: 2026/09/21 13:56:37 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 176.442110] niks3-server[1149]: 2026/09/21 13:56:37 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 176.446143] niks3-server[1149]: 2026/09/21 13:56:37 INFO Completed upload id=65 lb # [ 176.450245] niks3-server[1149]: 2026/09/21 13:56:37 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker1 # [ 176.418859] nix-grpc-daemon[1721]: time=2026-09-21T13:56:37.059Z level=INFO msg="Upload complete. (325ms)" worker1 # [ 176.433777] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=7 outputs=1 worker1 # [ 176.446008] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:37Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 176.450305] nix-daemon[838]: reaped child process 1966, status = succeeded worker1 # [ 176.477591] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 176.493569] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 176.506641] nix-grpc-daemon[1721]: time=2026-09-21T13:56:37.146Z level=INFO msg="All 2 paths already cached" worker1 # [ 176.515043] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 176.528296] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 176.732166] nix-daemon[838]: accepted connection from pid 1991, user nix-grpc-daemon (trusted) worker1 # [ 176.748487] nix-daemon[838]: reaped child process 1994, status = succeeded worker1 # [ 176.922761] nix-daemon[838]: accepted connection from pid 1996, user nix-grpc-daemon (trusted) worker1 # [ 176.939499] nix-daemon[838]: reaped child process 1999, status = succeeded lb # [ 176.973881] niks3-server[1149]: 2026/09/21 13:56:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 176.960100] nix-grpc-daemon[1721]: time=2026-09-21T13:56:37.600Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 176.961560] nix-grpc-daemon[1721]: time=2026-09-21T13:56:37.600Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 177.000942] niks3-server[1149]: 2026/09/21 13:56:37 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst lb # [ 177.012541] niks3-server[1149]: 2026/09/21 13:56:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker1 # [ 176.995017] nix-grpc-daemon[1721]: time=2026-09-21T13:56:37.635Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.023492] niks3-server[1149]: 2026/09/21 13:56:37 INFO Signed narinfos id=66 count=1 lb # [ 177.030180] niks3-server[1149]: 2026/09/21 13:56:37 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 177.039553] niks3-server[1149]: 2026/09/21 13:56:37 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 177.046258] niks3-server[1149]: 2026/09/21 13:56:37 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo lb # [ 177.051364] niks3-server[1149]: 2026/09/21 13:56:37 INFO Completed upload id=66 worker1 # [ 177.028583] nix-grpc-daemon[1721]: time=2026-09-21T13:56:37.668Z level=INFO msg="Upload complete. (484ms)" worker1 # [ 177.036413] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 177.049591] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 177.055390] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 177.059942] nix-daemon[838]: reaped child process 1989, status = succeeded worker1 # [ 177.072311] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 177.893603] nix-daemon[838]: reaped child process 2003, status = succeeded worker1 # [ 178.053137] nix-daemon[838]: accepted connection from pid 2019, user nix-grpc-daemon (trusted) worker1 # [ 178.070947] nix-daemon[838]: reaped child process 2022, status = succeeded lb # [ 178.106861] niks3-server[1149]: 2026/09/21 13:56:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 178.095210] nix-grpc-daemon[1721]: time=2026-09-21T13:56:38.733Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 178.096860] nix-grpc-daemon[1721]: time=2026-09-21T13:56:38.733Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 178.143343] niks3-server[1149]: 2026/09/21 13:56:38 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 178.153649] niks3-server[1149]: 2026/09/21 13:56:38 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 178.164737] niks3-server[1149]: 2026/09/21 13:56:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker1 # [ 178.147212] nix-grpc-daemon[1721]: time=2026-09-21T13:56:38.787Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.170073] niks3-server[1149]: 2026/09/21 13:56:38 INFO Signed narinfos id=67 count=1 lb # [ 178.174945] niks3-server[1149]: 2026/09/21 13:56:38 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 178.183228] niks3-server[1149]: 2026/09/21 13:56:38 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 178.188582] niks3-server[1149]: 2026/09/21 13:56:38 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo lb # [ 178.193145] niks3-server[1149]: 2026/09/21 13:56:38 INFO Completed upload id=67 worker1 # [ 178.170410] nix-grpc-daemon[1721]: time=2026-09-21T13:56:38.810Z level=INFO msg="Upload complete. (288ms)" worker1 # [ 178.180986] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=8 outputs=1 worker1 # [ 178.195230] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:38Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 178.199400] nix-daemon[838]: reaped child process 2001, status = succeeded worker1 # [ 178.221226] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 178.234991] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 178.248375] nix-grpc-daemon[1721]: time=2026-09-21T13:56:38.888Z level=INFO msg="All 2 paths already cached" worker1 # [ 178.256690] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 178.269117] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 178.464438] nix-daemon[838]: accepted connection from pid 2026, user nix-grpc-daemon (trusted) worker1 # [ 178.483256] nix-daemon[838]: reaped child process 2029, status = succeeded worker1 # [ 178.656921] nix-daemon[838]: accepted connection from pid 2031, user nix-grpc-daemon (trusted) worker1 # [ 178.673710] nix-daemon[838]: reaped child process 2034, status = succeeded lb # [ 178.707962] niks3-server[1149]: 2026/09/21 13:56:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 178.695249] nix-grpc-daemon[1721]: time=2026-09-21T13:56:39.335Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 178.697120] nix-grpc-daemon[1721]: time=2026-09-21T13:56:39.335Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 178.734982] niks3-server[1149]: 2026/09/21 13:56:39 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 178.724809] nix-grpc-daemon[1721]: time=2026-09-21T13:56:39.364Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.749799] niks3-server[1149]: 2026/09/21 13:56:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 178.761261] niks3-server[1149]: 2026/09/21 13:56:39 INFO Signed narinfos id=68 count=1 lb # [ 178.766602] niks3-server[1149]: 2026/09/21 13:56:39 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls worker1 # [ 178.752508] nix-grpc-daemon[1721]: time=2026-09-21T13:56:39.392Z level=INFO msg="Upload complete. (468ms)" lb # [ 178.776064] niks3-server[1149]: 2026/09/21 13:56:39 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 178.781495] niks3-server[1149]: 2026/09/21 13:56:39 INFO Completed upload id=68 worker1 # [ 178.758515] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 178.785138] niks3-server[1149]: 2026/09/21 13:56:39 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 178.771453] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 178.777305] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 178.782186] nix-daemon[838]: reaped child process 2024, status = succeeded worker1 # [ 178.794189] nix-daemon[838]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 180.240918] nix-daemon[838]: reaped child process 2038, status = succeeded worker1 # [ 180.422735] nix-daemon[838]: accepted connection from pid 2054, user nix-grpc-daemon (trusted) worker1 # [ 180.440146] nix-daemon[838]: reaped child process 2057, status = succeeded lb # [ 180.479302] niks3-server[1149]: 2026/09/21 13:56:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 180.465828] nix-grpc-daemon[1721]: time=2026-09-21T13:56:41.105Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 180.471274] nix-grpc-daemon[1721]: time=2026-09-21T13:56:41.107Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 180.516852] niks3-server[1149]: 2026/09/21 13:56:41 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 180.532237] niks3-server[1149]: 2026/09/21 13:56:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker1 # [ 180.514786] nix-grpc-daemon[1721]: time=2026-09-21T13:56:41.154Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.542932] niks3-server[1149]: 2026/09/21 13:56:41 INFO Signed narinfos id=69 count=1 lb # [ 180.549101] niks3-server[1149]: 2026/09/21 13:56:41 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 180.554739] niks3-server[1149]: 2026/09/21 13:56:41 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 180.561852] niks3-server[1149]: 2026/09/21 13:56:41 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 180.565912] niks3-server[1149]: 2026/09/21 13:56:41 INFO Completed upload id=69 worker1 # [ 180.542599] nix-grpc-daemon[1721]: time=2026-09-21T13:56:41.182Z level=INFO msg="Upload complete. (333ms)" lb # [ 180.568373] niks3-server[1149]: 2026/09/21 13:56:41 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 180.557014] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56138 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=9 outputs=1 worker1 # [ 180.570316] nix-daemon[838]: reaped child process 2036, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.26 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 180.773769] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 5e887e46e5ea49569f12dd151d3fcb3d client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker1 # [ 181.023830] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56138 client # [ 181.023985] nix[1421]: don't know how to build these paths: client # [ 181.025111] nix[1421]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker2 # [ 181.033913] nix-grpc-daemon[1496]: ts=2026-09-21T13:56:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45808 client # [ 181.053675] nix[1421]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker worker1 # [ 181.058064] nix-grpc-daemon[1656]: ts=2026-09-21T13:56:41Z level=debug event=want client=2 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 lb # [ 181.910536] envoy[903]: conn peer=[2001:db8:1::1]:37392 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27174 tx=11559 ms=19939 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code client # [ 211.055176] nix[1421]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu} client # [ 211.064749] nix[1421]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 211.112824] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 211.118909] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 211.122254] systemd[1]: gpu.service: Consumed 179ms CPU time over 30.338s wall clock time, 35.5M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.24 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.35 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill lb # [ 211.913621] envoy[903]: conn peer=[2001:db8:1::1]:54794 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=30060 worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.10 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 213.328198] nix-grpc-daemon[1656]: ts=2026-09-21T13:57:13Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 214.200661] nix-grpc-daemon[1656]: ts=2026-09-21T13:57:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 214.207256] nix-grpc-daemon[1656]: ts=2026-09-21T13:57:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56138 worker1 # [ 214.233446] nix-grpc-daemon[1656]: ts=2026-09-21T13:57:14Z level=debug event=want client=3 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker1 # [ 214.239375] nix-grpc-daemon[1656]: ts=2026-09-21T13:57:14Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 214.282177] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 214.298411] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45808 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 214.314291] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 214.330279] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 214.543263] nix-daemon[864]: accepted connection from pid 1829, user nix-grpc-daemon (trusted) worker2 # [ 214.562641] nix-daemon[864]: reaped child process 1832, status = succeeded worker2 # [ 214.736130] nix-daemon[864]: accepted connection from pid 1834, user nix-grpc-daemon (trusted) worker2 # [ 214.753622] nix-daemon[864]: reaped child process 1837, status = succeeded lb # [ 214.790015] niks3-server[1149]: 2026/09/21 13:57:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 214.775542] nix-grpc-daemon[1644]: time=2026-09-21T13:57:15.413Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 214.777158] nix-grpc-daemon[1644]: time=2026-09-21T13:57:15.413Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 214.818759] niks3-server[1149]: 2026/09/21 13:57:15 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 214.838307] niks3-server[1149]: 2026/09/21 13:57:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign worker2 # [ 214.820618] nix-grpc-daemon[1644]: time=2026-09-21T13:57:15.458Z level=INFO msg="Uploading 1 narinfos" lb # [ 214.850440] niks3-server[1149]: 2026/09/21 13:57:15 INFO Signed narinfos id=70 count=1 lb # [ 214.857493] niks3-server[1149]: 2026/09/21 13:57:15 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 214.868541] niks3-server[1149]: 2026/09/21 13:57:15 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete worker2 # [ 214.850254] nix-grpc-daemon[1644]: time=2026-09-21T13:57:15.488Z level=INFO msg="Upload complete. (502ms)" lb # [ 214.873856] niks3-server[1149]: 2026/09/21 13:57:15 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo lb # [ 214.877997] niks3-server[1149]: 2026/09/21 13:57:15 INFO Completed upload id=70 worker2 # [ 214.860073] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 214.871538] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 214.881118] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 214.883992] nix-daemon[864]: reaped child process 1827, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... worker2 # [ 214.895330] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 216.146187] nix-daemon[864]: reaped child process 1841, status = succeeded worker2 # [ 216.324626] nix-daemon[864]: accepted connection from pid 1857, user nix-grpc-daemon (trusted) worker2 # [ 216.341035] nix-daemon[864]: reaped child process 1860, status = succeeded lb # [ 216.379811] niks3-server[1149]: 2026/09/21 13:57:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 216.368264] nix-grpc-daemon[1644]: time=2026-09-21T13:57:17.004Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 216.369742] nix-grpc-daemon[1644]: time=2026-09-21T13:57:17.004Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 216.410723] niks3-server[1149]: 2026/09/21 13:57:17 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 216.422582] niks3-server[1149]: 2026/09/21 13:57:17 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 216.431257] niks3-server[1149]: 2026/09/21 13:57:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign worker2 # [ 216.411382] nix-grpc-daemon[1644]: time=2026-09-21T13:57:17.049Z level=INFO msg="Uploading 1 narinfos" lb # [ 216.438713] niks3-server[1149]: 2026/09/21 13:57:17 INFO Signed narinfos id=71 count=1 lb # [ 216.443603] niks3-server[1149]: 2026/09/21 13:57:17 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 216.450846] niks3-server[1149]: 2026/09/21 13:57:17 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 216.457637] niks3-server[1149]: 2026/09/21 13:57:17 INFO Completed upload id=71 worker2 # [ 216.432092] nix-grpc-daemon[1644]: time=2026-09-21T13:57:17.070Z level=INFO msg="Upload complete. (323ms)" lb # [ 216.460199] niks3-server[1149]: 2026/09/21 13:57:17 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 216.445129] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=10 outputs=1 worker1 # [ 216.450238] nix-grpc-daemon[1656]: ts=2026-09-21T13:57:17Z level=debug event=want client=3 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker1 # [ 216.456186] nix-grpc-daemon[1656]: ts=2026-09-21T13:57:17Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 216.464116] nix-daemon[864]: reaped child process 1839, status = succeeded worker2 # [ 216.495855] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 216.510792] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 216.524833] nix-grpc-daemon[1644]: time=2026-09-21T13:57:17.163Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 216.534917] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 216.549308] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 216.752215] nix-daemon[864]: accepted connection from pid 1864, user nix-grpc-daemon (trusted) worker2 # [ 216.771203] nix-daemon[864]: reaped child process 1867, status = succeeded worker2 # [ 216.943610] nix-daemon[864]: accepted connection from pid 1869, user nix-grpc-daemon (trusted) worker2 # [ 216.959716] nix-daemon[864]: reaped child process 1872, status = succeeded lb # [ 216.995972] niks3-server[1149]: 2026/09/21 13:57:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 216.981917] nix-grpc-daemon[1644]: time=2026-09-21T13:57:17.620Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 216.983427] nix-grpc-daemon[1644]: time=2026-09-21T13:57:17.620Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 217.024828] niks3-server[1149]: 2026/09/21 13:57:17 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 217.012080] nix-grpc-daemon[1644]: time=2026-09-21T13:57:17.650Z level=INFO msg="Uploading 1 narinfos" lb # [ 217.040465] niks3-server[1149]: 2026/09/21 13:57:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 217.051530] niks3-server[1149]: 2026/09/21 13:57:17 INFO Signed narinfos id=72 count=1 lb # [ 217.059659] niks3-server[1149]: 2026/09/21 13:57:17 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls worker2 # [ 217.041313] nix-grpc-daemon[1644]: time=2026-09-21T13:57:17.679Z level=INFO msg="Upload complete. (475ms)" lb # [ 217.066695] niks3-server[1149]: 2026/09/21 13:57:17 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 217.072794] niks3-server[1149]: 2026/09/21 13:57:17 INFO Completed upload id=72 worker2 # [ 217.048204] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=0 paths=1 nar_bytes_in=632 lb # [ 217.076520] niks3-server[1149]: 2026/09/21 13:57:17 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 217.058948] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 217.062073] nix-daemon[864]: reaped child process 1862, status = succeeded worker2 # [ 217.068943] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... worker2 # [ 217.081236] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 218.706908] nix-daemon[864]: reaped child process 1876, status = succeeded worker2 # [ 218.872392] nix-daemon[864]: accepted connection from pid 1892, user nix-grpc-daemon (trusted) worker2 # [ 218.891374] nix-daemon[864]: reaped child process 1895, status = succeeded lb # [ 218.927915] niks3-server[1149]: 2026/09/21 13:57:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 218.916290] nix-grpc-daemon[1644]: time=2026-09-21T13:57:19.551Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 218.917789] nix-grpc-daemon[1644]: time=2026-09-21T13:57:19.551Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 218.958987] niks3-server[1149]: 2026/09/21 13:57:19 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 218.976799] niks3-server[1149]: 2026/09/21 13:57:19 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 218.986664] niks3-server[1149]: 2026/09/21 13:57:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign worker2 # [ 218.968098] nix-grpc-daemon[1644]: time=2026-09-21T13:57:19.606Z level=INFO msg="Uploading 1 narinfos" lb # [ 218.996274] niks3-server[1149]: 2026/09/21 13:57:19 INFO Signed narinfos id=73 count=1 lb # [ 218.999089] niks3-server[1149]: 2026/09/21 13:57:19 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 219.009554] niks3-server[1149]: 2026/09/21 13:57:19 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 219.016874] niks3-server[1149]: 2026/09/21 13:57:19 INFO Completed upload id=73 worker2 # [ 218.992722] nix-grpc-daemon[1644]: time=2026-09-21T13:57:19.631Z level=INFO msg="Upload complete. (301ms)" lb # [ 219.019697] niks3-server[1149]: 2026/09/21 13:57:19 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 219.005029] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=11 outputs=1 worker1 # [ 219.011093] nix-grpc-daemon[1656]: ts=2026-09-21T13:57:19Z level=debug event=want client=3 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker1 # [ 219.016963] nix-grpc-daemon[1656]: ts=2026-09-21T13:57:19Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 219.020710] nix-daemon[864]: reaped child process 1874, status = succeeded worker2 # [ 219.055894] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 219.070727] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 219.085067] nix-grpc-daemon[1644]: time=2026-09-21T13:57:19.723Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 219.095229] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 219.109396] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 219.313790] nix-daemon[864]: accepted connection from pid 1899, user nix-grpc-daemon (trusted) worker2 # [ 219.330531] nix-daemon[864]: reaped child process 1902, status = succeeded worker2 # [ 219.502847] nix-daemon[864]: accepted connection from pid 1904, user nix-grpc-daemon (trusted) worker2 # [ 219.519140] nix-daemon[864]: reaped child process 1907, status = succeeded lb # [ 219.554751] niks3-server[1149]: 2026/09/21 13:57:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 219.539856] nix-grpc-daemon[1644]: time=2026-09-21T13:57:20.178Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 219.541454] nix-grpc-daemon[1644]: time=2026-09-21T13:57:20.178Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 219.581769] niks3-server[1149]: 2026/09/21 13:57:20 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst lb # [ 219.595479] niks3-server[1149]: 2026/09/21 13:57:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign worker2 # [ 219.577559] nix-grpc-daemon[1644]: time=2026-09-21T13:57:20.215Z level=INFO msg="Uploading 1 narinfos" lb # [ 219.606206] niks3-server[1149]: 2026/09/21 13:57:20 INFO Signed narinfos id=74 count=1 lb # [ 219.612795] niks3-server[1149]: 2026/09/21 13:57:20 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 219.620204] niks3-server[1149]: 2026/09/21 13:57:20 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 219.625844] niks3-server[1149]: 2026/09/21 13:57:20 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo lb # [ 219.630557] niks3-server[1149]: 2026/09/21 13:57:20 INFO Completed upload id=74 worker2 # [ 219.606367] nix-grpc-daemon[1644]: time=2026-09-21T13:57:20.244Z level=INFO msg="Upload complete. (480ms)" worker2 # [ 219.613569] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 219.626601] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 worker2 # [ 219.633316] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 219.638310] nix-daemon[864]: reaped child process 1897, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 219.651748] nix-daemon[864]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 220.697355] nix-daemon[864]: reaped child process 1911, status = succeeded worker2 # [ 220.877027] nix-daemon[864]: accepted connection from pid 1927, user nix-grpc-daemon (trusted) worker2 # [ 220.894484] nix-daemon[864]: reaped child process 1930, status = succeeded lb # [ 220.931269] niks3-server[1149]: 2026/09/21 13:57:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 220.919110] nix-grpc-daemon[1644]: time=2026-09-21T13:57:21.556Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 220.920832] nix-grpc-daemon[1644]: time=2026-09-21T13:57:21.556Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 220.970027] niks3-server[1149]: 2026/09/21 13:57:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign worker2 # [ 220.954457] nix-grpc-daemon[1644]: time=2026-09-21T13:57:21.592Z level=INFO msg="Uploading 1 narinfos" lb # [ 220.987563] niks3-server[1149]: 2026/09/21 13:57:21 INFO Signed narinfos id=75 count=1 lb # [ 220.999402] niks3-server[1149]: 2026/09/21 13:57:21 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 221.007841] niks3-server[1149]: 2026/09/21 13:57:21 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 221.016309] niks3-server[1149]: 2026/09/21 13:57:21 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 220.996477] nix-grpc-daemon[1644]: time=2026-09-21T13:57:21.634Z level=INFO msg="Upload complete. (333ms)" lb # [ 221.020746] niks3-server[1149]: 2026/09/21 13:57:21 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 221.024835] niks3-server[1149]: 2026/09/21 13:57:21 INFO Completed upload id=75 lb # [ 221.028675] niks3-server[1149]: 2026/09/21 13:57:21 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 221.008867] nix-grpc-daemon[1496]: ts=2026-09-21T13:57:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45808 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=12 outputs=1 worker2 # [ 221.022331] nix-daemon[864]: reaped child process 1909, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.12 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.22 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.21 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' lb # [ 221.916343] envoy[903]: conn peer=[2001:db8:1::1]:33124 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9549 tx=4086 ms=6826 worker1 # [ 222.336575] nix-grpc-daemon[1656]: ts=2026-09-21T13:57:22Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.19 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 11.07 seconds) (finished: run the VM test script, in 223.69 seconds) test script finished in 224.05s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.06 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh