tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm lb # Disk image does not exist, creating the virtualisation disk image... worker2 # Disk image does not exist, creating the virtualisation disk image... client # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 52) client: QEMU running (pid 49) lb # Formatting '/build/vm-state-lb/tmp.wDJYm77xV3', fmt=raw size=1073741824 lb: QEMU running (pid 50) worker1: QEMU running (pid 51) client # Formatting '/build/vm-state-client/tmp.yrCSPcpXPt', fmt=raw size=1073741824 worker1 # Disk image does not exist, creating the virtualisation disk image... worker2 # Formatting '/build/vm-state-worker2/tmp.MdEG3PCqCw', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) lb # mke2fs 1.47.4 (6-Mar-2025) worker1 # Formatting '/build/vm-state-worker1/tmp.hiTn7oEZ3v', fmt=raw size=1073741824 client # Discarding device blocks: 0/262144 done lb # Discarding device blocks: 0/262144 done worker1 # mke2fs 1.47.4 (6-Mar-2025) client # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Discarding device blocks: 0/262144 done client # Filesystem UUID: 482e7b32-98b3-4298-aeed-cfe3f41a78b7 lb # Filesystem UUID: 7f67a60e-a8b8-4e9f-b907-f8646fb6afc7 worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Superblock backups stored on blocks: lb # Superblock backups stored on blocks: worker1 # Filesystem UUID: 376254bc-797f-4e24-bd30-4d24e02b2968 client # 32768, 98304, 163840, 229376 lb # 32768, 98304, 163840, 229376 worker1 # Superblock backups stored on blocks: client # lb # worker1 # 32768, 98304, 163840, 229376 client # Allocating group tables: 0/8 done lb # Allocating group tables: 0/8 done worker1 # client # Writing inode tables: 0/8 done lb # Writing inode tables: 0/8 done worker1 # Allocating group tables: 0/8 done client # Creating journal (8192 blocks): done lb # Creating journal (8192 blocks): done worker1 # Writing inode tables: 0/8 done client # Writing superblocks and filesystem accounting information: 0/8 done lb # Writing superblocks and filesystem accounting information: 0/82/8 done worker1 # Creating journal (8192 blocks): done client # lb # worker1 # Writing superblocks and filesystem accounting information: 0/8 done client # Virtualisation disk image created. lb # Virtualisation disk image created. worker1 # (finished: start all VMs, in 0.48 seconds) worker1 # Virtualisation disk image created. client: waiting for unit network-addresses-eth1.service client: waiting for the VM to finish booting worker2 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Filesystem UUID: 077b16bd-bcb2-4770-9b57-70bfa82bc1bd worker2 # Superblock backups stored on blocks: worker2 # 32768, 98304, 163840, 229376 worker2 # worker2 # Allocating group tables: 0/8 done worker2 # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # worker2 # Virtualisation disk image created. lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] KASLR enabled lb # [ 0.000000] random: crng init done lb # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Zone ranges: lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA32 empty lb # [ 0.000000] Normal empty lb # [ 0.000000] Device empty lb # [ 0.000000] Movable zone start for each node lb # [ 0.000000] Early memory node ranges lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/px4c3ifawqq4xs8a4zhy519i865fkk09-nixos-system-lb-test/init regInfo=/nix/store/qp69c7d7ks4qa26wilaji9gbrwmdkkah-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qp69c7d7ks4qa26wilaji9gbrwmdkkah-closure-info/registration", will be passed to user space. lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] KASLR enabled lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] random: crng init done worker1 # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] random: crng init done lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] KASLR enabled lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] random: crng init done lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] Zone ranges: lb # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] DMA32 empty client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Normal empty worker2 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] Device empty lb # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] DMA32 empty client # [ 0.000000] Zone ranges: worker2 # [ 0.000000] Normal empty worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] Device empty client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Movable zone start for each node client # [ 0.000000] DMA32 empty lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Early memory node ranges client # [ 0.000000] Normal empty client # [ 0.000000] Device empty worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/q0xpda7nssqkdhnmlkp5q4dxx9dxngjp-nixos-system-worker1-test/init regInfo=/nix/store/fzq8f8i8j8bdnczah2k202f5ss3lk651-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/a4g43incxmb90ykmkdsd5cyqwyy4lipw-nixos-system-worker2-test/init regInfo=/nix/store/wdwfc23551pfjsw81kz0k6mfm1w1gfyj-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/fzq8f8i8j8bdnczah2k202f5ss3lk651-closure-info/registration", will be passed to user space. lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000039] arm-pv: using stolen time PV client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/c59dy5901id87cijqm6p1wgx5fgpmqry-nixos-system-client-test/init regInfo=/nix/store/pmfwpcq6npqfsdnqpnd837cg39b7406m-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/wdwfc23551pfjsw81kz0k6mfm1w1gfyj-closure-info/registration", will be passed to user space. lb # [ 0.000727] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/pmfwpcq6npqfsdnqpnd837cg39b7406m-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000899] Console: colour dummy device 80x25 worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000908] printk: legacy console [tty0] enabled worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.001110] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.001118] pid_max: default: 32768 minimum: 301 client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.001186] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.001379] landlock: Up and running. client # [ 0.000000] software IO TLB: area num 1. lb # [ 0.001381] Yama: becoming mindful. worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.002103] LSM support for eBPF active worker1 # [ 0.000000] Policy zone: DMA client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.002287] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.002320] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.003560] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.004297] rcu: Hierarchical SRCU implementation. client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.004301] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.005501] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.005599] EFI services will not be available. client # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.005682] smp: Bringing up secondary CPUs ... client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.005692] smp: Brought up 1 node, 1 CPU worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.005695] SMP: Total of 1 processors activated. client # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.005700] CPU: All CPU(s) started at EL1 client # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.005712] CPU features: detected: Branch Target Identification client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.005717] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.005720] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.005724] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.005727] CPU features: detected: Common not Private translations client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.005730] CPU features: detected: CRC32 instructions worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.005733] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.005737] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.005740] CPU features: detected: Data independent timing control (DIT) client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.005743] CPU features: detected: E0PD worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.005745] CPU features: detected: Enhanced Counter Virtualization client # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.005748] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.005751] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.005755] CPU features: detected: Fine Grained Traps client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.005759] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.005764] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 lb # [ 0.005767] CPU features: detected: LSE atomic instructions client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 lb # [ 0.005770] CPU features: detected: Privileged Access Never worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.005773] CPU features: detected: PMUv3 client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.005776] CPU features: detected: RAS Extension Support client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.005778] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.005781] CPU features: detected: Random Number Generator worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.005783] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.005787] CPU features: detected: Stage-2 Force Write-Back client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.005789] CPU features: detected: TLB range maintenance instructions client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000034] arm-pv: using stolen time PV worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.005794] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.005834] alternatives: applying system-wide alternatives worker1 # [ 0.000462] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000031] arm-pv: using stolen time PV lb # [ 0.009040] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.000633] Console: colour dummy device 80x25 client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000029] arm-pv: using stolen time PV worker1 # [ 0.000641] printk: legacy console [tty0] enabled worker2 # [ 0.000427] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.009245] Memory: 1406580K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) client # [ 0.000470] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000633] Console: colour dummy device 80x25 worker1 # [ 0.000848] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.009717] devtmpfs: initialized worker2 # [ 0.000641] printk: legacy console [tty0] enabled client # [ 0.000637] Console: colour dummy device 80x25 worker1 # [ 0.000859] pid_max: default: 32768 minimum: 301 client # [ 0.000645] printk: legacy console [tty0] enabled lb # [ 0.011709] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.000943] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.000853] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.001068] landlock: Up and running. lb # [ 0.011733] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.000862] pid_max: default: 32768 minimum: 301 worker1 # [ 0.001070] Yama: becoming mindful. client # [ 0.000837] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.001576] LSM support for eBPF active client # [ 0.000844] pid_max: default: 32768 minimum: 301 lb # [ 0.011940] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.000944] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.001120] landlock: Up and running. client # [ 0.000920] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.001762] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.001126] Yama: becoming mindful. client # [ 0.001065] landlock: Up and running. worker2 # [ 0.001629] LSM support for eBPF active client # [ 0.001068] Yama: becoming mindful. worker1 # [ 0.001804] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.001545] LSM support for eBPF active worker2 # [ 0.001765] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.002959] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.001692] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.003790] rcu: Hierarchical SRCU implementation. worker2 # [ 0.001798] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.003796] rcu: Max phase no-delay instances is 1000. client # [ 0.001725] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.003122] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.005084] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.003865] rcu: Hierarchical SRCU implementation. client # [ 0.002892] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.005170] EFI services will not be available. client # [ 0.003625] rcu: Hierarchical SRCU implementation. worker2 # [ 0.003869] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.005250] smp: Bringing up secondary CPUs ... worker2 # [ 0.005130] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.005259] smp: Brought up 1 node, 1 CPU client # [ 0.003629] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.005220] EFI services will not be available. client # [ 0.004904] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.005262] SMP: Total of 1 processors activated. worker2 # [ 0.005299] smp: Bringing up secondary CPUs ... worker1 # [ 0.005267] CPU: All CPU(s) started at EL1 client # [ 0.004999] EFI services will not be available. worker2 # [ 0.005308] smp: Brought up 1 node, 1 CPU client # [ 0.005121] smp: Bringing up secondary CPUs ... worker1 # [ 0.005277] CPU features: detected: Branch Target Identification worker2 # [ 0.005311] SMP: Total of 1 processors activated. client # [ 0.005131] smp: Brought up 1 node, 1 CPU worker2 # [ 0.005317] CPU: All CPU(s) started at EL1 worker1 # [ 0.005282] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.005134] SMP: Total of 1 processors activated. lb # [ 0.011945] 0 pages in range for non-PLT usage client # [ 0.005142] CPU: All CPU(s) started at EL1 worker2 # [ 0.005329] CPU features: detected: Branch Target Identification worker1 # [ 0.005285] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.011946] 508288 pages in range for PLT usage client # [ 0.005153] CPU features: detected: Branch Target Identification worker2 # [ 0.005333] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.012072] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.005289] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.005158] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.012976] DMI not present or invalid. worker2 # [ 0.005337] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.005293] CPU features: detected: Common not Private translations lb # [ 0.017076] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.005161] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.005296] CPU features: detected: CRC32 instructions worker2 # [ 0.005340] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.019365] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.005165] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.005344] CPU features: detected: Common not Private translations worker1 # [ 0.005298] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.019550] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.005347] CPU features: detected: CRC32 instructions client # [ 0.005168] CPU features: detected: Common not Private translations worker1 # [ 0.005302] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.005171] CPU features: detected: CRC32 instructions lb # [ 0.019759] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.005350] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.005306] CPU features: detected: Data independent timing control (DIT) lb # [ 0.019785] audit: initializing netlink subsys (disabled) client # [ 0.005174] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.005309] CPU features: detected: E0PD worker2 # [ 0.005354] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.020396] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.005311] CPU features: detected: Enhanced Counter Virtualization client # [ 0.005178] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.005357] CPU features: detected: Data independent timing control (DIT) lb # [ 0.020398] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.005360] CPU features: detected: E0PD worker1 # [ 0.005314] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.005182] CPU features: detected: Data independent timing control (DIT) lb # [ 0.020402] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.005184] CPU features: detected: E0PD worker2 # [ 0.005363] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.005318] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.020407] thermal_sys: Registered thermal governor 'user_space' client # [ 0.005187] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.005321] CPU features: detected: Fine Grained Traps worker2 # [ 0.005366] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.020410] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.005190] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.005369] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.005324] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.020434] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.005193] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.005372] CPU features: detected: Fine Grained Traps worker1 # [ 0.005328] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.020445] cpuidle: using governor ladder client # [ 0.005196] CPU features: detected: Fine Grained Traps lb # [ 0.020450] cpuidle: using governor menu worker1 # [ 0.005331] CPU features: detected: LSE atomic instructions worker2 # [ 0.005376] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.005200] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.005334] CPU features: detected: Privileged Access Never worker2 # [ 0.005382] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.020660] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.005337] CPU features: detected: PMUv3 client # [ 0.005204] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.020678] ASID allocator initialised with 65536 entries worker2 # [ 0.005385] CPU features: detected: LSE atomic instructions worker1 # [ 0.005340] CPU features: detected: RAS Extension Support lb # [ 0.022039] Serial: AMBA PL011 UART driver client # [ 0.005207] CPU features: detected: LSE atomic instructions worker2 # [ 0.005388] CPU features: detected: Privileged Access Never worker1 # [ 0.005342] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.005391] CPU features: detected: PMUv3 client # [ 0.005210] CPU features: detected: Privileged Access Never lb # [ 0.027788] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.005213] CPU features: detected: PMUv3 worker1 # [ 0.005345] CPU features: detected: Random Number Generator worker2 # [ 0.005393] CPU features: detected: RAS Extension Support lb # [ 0.027913] printk: console [ttyAMA0] enabled client # [ 0.005215] CPU features: detected: RAS Extension Support worker1 # [ 0.005347] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.005396] CPU features: detected: RASv1p1 Extension Support client # [ 0.005218] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.005350] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.005398] CPU features: detected: Random Number Generator lb # [ 0.149264] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.005221] CPU features: detected: Random Number Generator worker1 # [ 0.005353] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.005401] CPU features: detected: Speculation barrier (SB) lb # [ 0.149284] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.005223] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.005358] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.005404] CPU features: detected: Stage-2 Force Write-Back client # [ 0.005226] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.149289] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.005395] alternatives: applying system-wide alternatives worker2 # [ 0.005407] CPU features: detected: TLB range maintenance instructions lb # [ 0.149294] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.005229] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.008557] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.005412] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.005233] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.149298] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.005449] alternatives: applying system-wide alternatives client # [ 0.005271] alternatives: applying system-wide alternatives lb # [ 0.149302] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.008735] Memory: 1406556K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker2 # [ 0.008488] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.008314] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.149307] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.009261] devtmpfs: initialized lb # [ 0.149311] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.011271] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.008672] Memory: 1406488K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) client # [ 0.008548] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker2 # [ 0.009170] devtmpfs: initialized client # [ 0.009173] devtmpfs: initialized worker2 # [ 0.010999] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.011301] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.011106] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.156537] fbcon: Taking over console worker1 # [ 0.011488] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.156551] ACPI: Interpreter disabled. client # [ 0.011134] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.011494] 0 pages in range for non-PLT usage lb # [ 0.158482] iommu: Default domain type: Translated worker1 # [ 0.011495] 508288 pages in range for PLT usage client # [ 0.011311] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.158492] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.011315] 0 pages in range for non-PLT usage worker1 # [ 0.011615] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.012441] DMI not present or invalid. client # [ 0.011316] 508288 pages in range for PLT usage lb # [ 0.160135] SCSI subsystem initialized client # [ 0.011451] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.015809] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.012199] DMI not present or invalid. worker1 # [ 0.018107] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.015523] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.018288] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.017763] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.018508] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.017969] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.018536] audit: initializing netlink subsys (disabled) client # [ 0.018172] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.019163] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.018195] audit: initializing netlink subsys (disabled) worker1 # [ 0.019166] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.011021] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.018759] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.019170] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.018761] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.011218] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.019175] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.011224] 0 pages in range for non-PLT usage client # [ 0.018764] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.011224] 508288 pages in range for PLT usage worker1 # [ 0.019178] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.018769] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.011355] pinctrl core: initialized pinctrl subsystem lb # [ 0.167891] usbcore: registered new interface driver usbfs worker1 # [ 0.019207] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.018772] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.012127] DMI not present or invalid. worker1 # [ 0.019215] cpuidle: using governor ladder lb # [ 0.167917] usbcore: registered new interface driver hub worker2 # [ 0.015278] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.019221] cpuidle: using governor menu client # [ 0.018796] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.167944] usbcore: registered new device driver usb client # [ 0.018804] cpuidle: using governor ladder worker2 # [ 0.017521] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.168228] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.019412] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.018809] cpuidle: using governor menu worker1 # [ 0.019433] ASID allocator initialised with 65536 entries worker2 # [ 0.017704] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.018990] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.168233] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.020724] Serial: AMBA PL011 UART driver lb # [ 0.168244] PTP clock support registered client # [ 0.019004] ASID allocator initialised with 65536 entries worker2 # [ 0.017902] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.168284] EDAC MC: Ver: 3.0.0 client # [ 0.020235] Serial: AMBA PL011 UART driver worker1 # [ 0.026107] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.017924] audit: initializing netlink subsys (disabled) worker1 # [ 0.026242] printk: console [ttyAMA0] enabled lb # [ 0.172807] scmi_core: SCMI protocol bus registered worker2 # [ 0.018534] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.025643] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.025797] printk: console [ttyAMA0] enabled worker2 # [ 0.018537] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.173804] FPGA manager framework lb # [ 0.174790] vgaarb: loaded worker2 # [ 0.018541] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.018547] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.018550] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.175437] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.176057] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.018578] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.176086] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.018586] cpuidle: using governor ladder worker2 # [ 0.018592] cpuidle: using governor menu lb # [ 0.178523] netfs: FS-Cache loaded lb # [ 0.178647] pnp: PnP ACPI: disabled worker2 # [ 0.018785] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.018801] ASID allocator initialised with 65536 entries worker2 # [ 0.020023] Serial: AMBA PL011 UART driver worker2 # [ 0.025334] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.025492] printk: console [ttyAMA0] enabled worker1 # [ 0.147263] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.145318] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.147285] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.144722] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.145340] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.147290] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.144739] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.145345] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.147295] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.144745] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.145349] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.147299] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.144749] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.145354] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.147303] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.144753] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.145358] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.147307] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.144758] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.184846] NET: Registered PF_INET protocol family worker2 # [ 0.145362] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.147312] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.144762] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.185139] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.145366] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.144766] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.154654] fbcon: Taking over console worker1 # [ 0.154670] ACPI: Interpreter disabled. worker2 # [ 0.152706] fbcon: Taking over console client # [ 0.152125] fbcon: Taking over console worker2 # [ 0.152726] ACPI: Interpreter disabled. worker1 # [ 0.156616] iommu: Default domain type: Translated client # [ 0.152140] ACPI: Interpreter disabled. worker2 # [ 0.154593] iommu: Default domain type: Translated worker1 # [ 0.156627] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.153990] iommu: Default domain type: Translated worker2 # [ 0.154601] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.158403] SCSI subsystem initialized client # [ 0.153999] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.156364] SCSI subsystem initialized client # [ 0.155757] SCSI subsystem initialized worker1 # [ 0.163663] usbcore: registered new interface driver usbfs worker1 # [ 0.163702] usbcore: registered new interface driver hub client # [ 0.161041] usbcore: registered new interface driver usbfs worker1 # [ 0.163720] usbcore: registered new device driver usb client # [ 0.161075] usbcore: registered new interface driver hub worker2 # [ 0.162759] usbcore: registered new interface driver usbfs worker1 # [ 0.163993] pps_core: LinuxPPS API ver. 1 registered client # [ 0.161093] usbcore: registered new device driver usb worker2 # [ 0.162792] usbcore: registered new interface driver hub client # [ 0.161364] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.163999] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.162810] usbcore: registered new device driver usb worker1 # [ 0.164009] PTP clock support registered worker2 # [ 0.163081] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.164066] EDAC MC: Ver: 3.0.0 client # [ 0.161370] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.161379] PTP clock support registered worker2 # [ 0.163086] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.168673] scmi_core: SCMI protocol bus registered client # [ 0.161427] EDAC MC: Ver: 3.0.0 worker2 # [ 0.163096] PTP clock support registered worker2 # [ 0.163142] EDAC MC: Ver: 3.0.0 client # [ 0.165968] scmi_core: SCMI protocol bus registered worker1 # [ 0.169646] FPGA manager framework worker1 # [ 0.170670] vgaarb: loaded worker2 # [ 0.167647] scmi_core: SCMI protocol bus registered client # [ 0.167003] FPGA manager framework client # [ 0.168068] vgaarb: loaded worker1 # [ 0.171374] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.168648] FPGA manager framework worker2 # [ 0.169645] vgaarb: loaded client # [ 0.168738] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.170307] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.173050] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.173086] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.173638] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.177874] VFS: Disk quotas dquot_6.6.0 client # [ 0.173677] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.177918] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.179602] netfs: FS-Cache loaded worker2 # [ 0.177118] netfs: FS-Cache loaded worker1 # [ 0.179708] pnp: PnP ACPI: disabled worker2 # [ 0.177275] pnp: PnP ACPI: disabled client # [ 0.177496] netfs: FS-Cache loaded client # [ 0.177630] pnp: PnP ACPI: disabled worker2 # [ 0.181353] NET: Registered PF_INET protocol family worker2 # [ 0.181637] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.183821] NET: Registered PF_INET protocol family worker1 # [ 0.184111] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.181564] NET: Registered PF_INET protocol family lb # [ 0.214053] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.181868] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.214099] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.214128] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.214199] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.214342] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.214427] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.214464] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.214500] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.214617] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.214657] NET: Registered PF_XDP protocol family lb # [ 0.214674] PCI: CLS 0 bytes, default 64 lb # [ 0.214940] Trying to unpack rootfs image as initramfs... lb # [ 0.233145] kvm [1]: HYP mode not available client # [ 0.212642] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.212696] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.212729] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.210894] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.210950] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.210980] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.214394] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.211061] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.214446] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.211205] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.214479] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.211312] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.214556] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.211355] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.214701] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.211392] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.211500] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.214787] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.215866] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.211548] NET: Registered PF_XDP protocol family worker1 # [ 0.214845] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.211568] PCI: CLS 0 bytes, default 64 client # [ 0.216015] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.211857] Trying to unpack rootfs image as initramfs... worker1 # [ 0.214882] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.216113] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.214995] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.216150] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.215043] NET: Registered PF_XDP protocol family worker1 # [ 0.215064] PCI: CLS 0 bytes, default 64 client # [ 0.216189] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.215324] Trying to unpack rootfs image as initramfs... client # [ 0.216281] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.216303] NET: Registered PF_XDP protocol family client # [ 0.216323] PCI: CLS 0 bytes, default 64 client # [ 0.216595] Trying to unpack rootfs image as initramfs... client # [ 0.231392] kvm [1]: HYP mode not available worker2 # [ 0.228066] kvm [1]: HYP mode not available worker1 # [ 0.233300] kvm [1]: HYP mode not available lb # [ 0.328096] Initialise system trusted keyrings lb # [ 0.328844] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.330130] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.330913] 9p: Installing v9fs 9p2000 file system support lb # [ 0.359657] Key type asymmetric registered lb # [ 0.359689] Asymmetric key parser 'x509' registered worker2 # [ 0.323792] Initialise system trusted keyrings lb # [ 0.359762] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.361921] io scheduler mq-deadline registered worker2 # [ 0.324582] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.361932] io scheduler kyber registered worker2 # [ 0.325929] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.331679] Initialise system trusted keyrings client # [ 0.328588] Initialise system trusted keyrings worker1 # [ 0.332499] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.333858] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.334645] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.326727] 9p: Installing v9fs 9p2000 file system support lb # [ 0.371589] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.336817] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.372993] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.373405] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.338300] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.373425] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.373437] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.373446] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.373470] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.373494] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.373572] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.339086] 9p: Installing v9fs 9p2000 file system support lb # [ 0.373581] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.373587] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.346830] Key type asymmetric registered worker2 # [ 0.346859] Asymmetric key parser 'x509' registered lb # [ 0.373592] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.346931] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.373597] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.373664] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.374105] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.374291] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.374307] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.374337] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.374353] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.374815] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.354385] io scheduler mq-deadline registered worker2 # [ 0.354405] io scheduler kyber registered lb # [ 0.374998] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.375014] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.358672] Key type asymmetric registered lb # [ 0.375043] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.358709] Asymmetric key parser 'x509' registered worker1 # [ 0.358793] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.394671] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.394862] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.394878] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.359056] Key type asymmetric registered lb # [ 0.394909] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.359077] Asymmetric key parser 'x509' registered client # [ 0.359165] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.395380] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.361340] io scheduler mq-deadline registered client # [ 0.361348] io scheduler kyber registered worker2 # [ 0.366493] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.367430] io scheduler mq-deadline registered worker1 # [ 0.367450] io scheduler kyber registered worker2 # [ 0.367891] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.372899] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.368341] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.368365] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.374238] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.368378] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.374681] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.403603] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.372892] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.368385] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.374701] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.403629] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.368407] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.403662] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.374719] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.404146] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.368432] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.374732] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.404329] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.368538] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.374222] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.374753] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.404344] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.368554] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.374618] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.368560] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.404373] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.374774] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.368565] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.404824] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.374635] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.374853] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.405008] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.374870] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.368570] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.374648] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.405024] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.374877] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.368664] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.374656] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.405053] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.374882] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.369105] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.374677] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.374887] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.405509] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.369292] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.405695] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.374946] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.369310] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.374719] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.405710] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.369341] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.374797] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.405739] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.369357] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.374807] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.405755] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.374813] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.369812] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.406214] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.374818] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.369998] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.406400] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.370015] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.374823] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.406430] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.370045] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.374881] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.406887] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.375329] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.407076] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.375533] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.407106] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.389108] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.375551] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.389301] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.407519] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.375581] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.389318] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.407701] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.375597] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.389347] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.407955] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.376082] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.389798] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.408228] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.376272] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.389981] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.408244] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.376288] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.389997] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.408274] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.376319] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.390035] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.408762] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.408947] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.408962] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.408993] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.409583] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.409594] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.409600] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.395471] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.395683] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.409652] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.395701] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.409700] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.395731] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.409748] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.395748] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.409795] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.396259] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.396447] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.409841] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.396463] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.409888] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.396494] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.409935] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.396965] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.409982] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.397156] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.397171] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.410030] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.400842] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.397201] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.401042] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.402614] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.410096] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.402818] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.401059] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.397667] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.410142] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.402836] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.401089] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.397853] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.410163] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.402865] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.397869] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.401594] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.410185] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.403330] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.397901] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.401781] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.410207] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.403513] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.401797] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.398371] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.403530] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.410233] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.401830] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.398561] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.410255] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.403560] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.398578] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.402306] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.410277] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.404021] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.402493] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.398608] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.410299] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.404206] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.402508] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.399076] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.404222] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.410321] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.402538] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.399263] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.404251] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.410344] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.399279] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.403000] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.404267] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.410366] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.403185] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.399309] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.410389] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.404781] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.403201] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.399821] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.410410] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.404970] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.403232] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.400009] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.410431] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.405000] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.400025] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.403701] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.410453] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.403888] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.405462] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.400055] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.410475] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.403910] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.405651] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.400072] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.410496] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.403939] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.405680] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.410518] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.400544] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.403956] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.406069] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.410540] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.400736] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.406251] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.410562] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.404471] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.400766] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.404660] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.410584] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.406536] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.401231] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.410611] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.404691] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.406814] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.401421] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.410620] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.406832] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.405167] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.401451] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.410625] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.406861] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.405356] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.401845] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.407330] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.405386] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.402030] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.407521] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.405792] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.407537] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.402278] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.405974] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.402564] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.407567] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.406227] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.402581] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.408143] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.406491] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.402611] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.408154] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.406509] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.403100] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.408161] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.406540] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.403287] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.408206] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.407020] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.403303] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.407204] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.408254] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.403333] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.407220] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.408302] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.407250] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.408358] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.407835] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.408405] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.407846] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.475883] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.408452] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.407851] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.440585] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.408499] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.407897] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.440605] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.408545] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.407944] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.440611] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.408591] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.407997] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.440657] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.408044] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.408654] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.440706] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.408700] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.408091] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.440754] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.408722] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.408138] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.440801] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.408744] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.408192] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.408765] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.440848] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.408239] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.408790] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.440895] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.408287] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.408811] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.440943] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.408834] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.408359] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.440991] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.408855] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.408405] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.441040] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.408877] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.408427] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.408900] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.441139] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.408448] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.408927] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.441187] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.408470] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.408950] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.408494] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.441209] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.408971] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.408516] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.441231] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.408993] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.408539] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.441253] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.409014] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.408562] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.441278] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.409036] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.408584] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.441300] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.409057] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.408606] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.441323] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.409079] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.441345] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.409107] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.408629] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.409129] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.408652] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.441367] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.409151] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.408674] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.441389] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.409178] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.408696] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.441413] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.409188] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.408717] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.441436] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.497294] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.409193] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.441458] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.441479] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.441501] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.441523] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.441545] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.441567] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.441588] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.441611] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker2 # [ 0.466429] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.441636] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.464764] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.441665] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.464802] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.441675] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.464825] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.441680] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.464849] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.442873] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.464871] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.464895] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.464924] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.464934] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.507587] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.464938] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.466122] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.511045] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker1 # [ 0.479456] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 35728 usecs lb # [ 0.520822] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.525525] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.493035] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.496694] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.531595] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.533968] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.499552] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.506650] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.509796] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.505889] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.543991] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.506503] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.546069] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.508469] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.508128] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.512019] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.514174] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.516020] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.518215] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.520339] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.523479] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.525507] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.556024] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.559146] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.527792] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.529985] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.531756] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.533860] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.572740] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.535535] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.537827] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.534870] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.575471] msm_serial: driver initialized lb # [ 0.575616] SuperH (H)SCI(F) driver initialized lb # [ 0.575669] STM32 USART driver initialized worker2 # [ 0.542148] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.544980] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.547172] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.547987] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.550159] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.550594] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.552019] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.551702] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.554231] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.556972] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.565714] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.568263] msm_serial: driver initialized worker1 # [ 0.572722] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.568447] SuperH (H)SCI(F) driver initialized worker2 # [ 0.568507] STM32 USART driver initialized lb # [ 0.609828] loop: module loaded lb # [ 0.610029] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.610799] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.575437] msm_serial: driver initialized worker1 # [ 0.575651] SuperH (H)SCI(F) driver initialized client # [ 0.575674] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.575705] STM32 USART driver initialized client # [ 0.578328] msm_serial: driver initialized client # [ 0.578465] SuperH (H)SCI(F) driver initialized lb # [ 0.616059] megasas: 07.734.00.00-rc1 client # [ 0.578519] STM32 USART driver initialized lb # [ 0.616793] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.619148] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.619181] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.628592] Using buffer write method lb # [ 0.628663] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.630229] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.630283] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.644116] Using buffer write method lb # [ 0.644151] Concatenating MTD devices: lb # [ 0.644155] (0): "0.flash" lb # [ 0.644159] (1): "0.flash" lb # [ 0.644163] into device "0.flash" worker1 # [ 0.610331] loop: module loaded worker2 # [ 0.607315] loop: module loaded worker1 # [ 0.610540] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.607507] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.607730] loop: module loaded client # [ 0.607926] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.611357] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.608257] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.608731] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.621430] megasas: 07.734.00.00-rc1 worker2 # [ 0.619059] megasas: 07.734.00.00-rc1 client # [ 0.622223] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.619804] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.622121] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.624069] megasas: 07.734.00.00-rc1 worker2 # [ 0.622149] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.623806] Using buffer write method worker1 # [ 0.624851] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.623889] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.626803] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.626831] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.625552] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.628531] Using buffer write method worker2 # [ 0.625582] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.628605] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.630328] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.630384] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.639275] Using buffer write method worker2 # [ 0.639304] Concatenating MTD devices: worker2 # [ 0.639308] (0): "0.flash" client # [ 0.632807] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.639312] (1): "0.flash" worker2 # [ 0.639315] into device "0.flash" client # [ 0.632852] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.643959] Using buffer write method client # [ 0.634661] Using buffer write method worker1 # [ 0.643996] Concatenating MTD devices: worker1 # [ 0.644000] (0): "0.flash" client # [ 0.634737] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.644004] (1): "0.flash" worker1 # [ 0.644008] into device "0.flash" client # [ 0.636637] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.636668] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.638522] Using buffer write method client # [ 0.638578] Concatenating MTD devices: client # [ 0.638591] (0): "0.flash" client # [ 0.638595] (1): "0.flash" client # [ 0.638599] into device "0.flash" lb # [ 0.901719] Freeing initrd memory: 26140K lb # [ 0.908378] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.912302] thunder_xcv, ver 1.0 lb # [ 0.912346] thunder_bgx, ver 1.0 lb # [ 0.912368] nicpf, ver 1.0 lb # [ 0.912983] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.912993] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.913017] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.913024] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.913052] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.913058] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.913083] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.913088] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.913222] sky2: driver version 1.30 lb # [ 0.914948] usbcore: registered new interface driver usb-storage lb # [ 0.915004] usbcore: registered new interface driver usbserial_generic lb # [ 0.915019] usbserial: USB Serial support registered for generic lb # [ 0.916135] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.916170] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 0.916380] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.927999] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.928351] hub 1-0:1.0: USB hub found lb # [ 0.928372] hub 1-0:1.0: 6 ports detected lb # [ 0.930654] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.932315] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.932344] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T14:30:34 UTC (1789914634) lb # [ 0.932670] i2c_dev: i2c /dev entries driver lb # [ 0.937702] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.937716] sdhci: Copyright(c) Pierre Ossman lb # [ 0.937987] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.938359] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.943011] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.943300] usbcore: registered new interface driver usbhid lb # [ 0.943310] usbhid: USB HID core driver worker2 # [ 0.908288] Freeing initrd memory: 26148K client # [ 0.907698] Freeing initrd memory: 26160K lb # [ 0.946284] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.948955] drop_monitor: Initializing network drop monitor service lb # [ 0.949106] NET: Registered PF_INET6 protocol family worker1 # [ 0.916105] Freeing initrd memory: 26148K lb # [ 0.951134] Segment Routing with IPv6 lb # [ 0.951155] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.914537] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.951190] NET: Registered PF_PACKET protocol family client # [ 0.914209] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.953155] 9pnet: Installing 9P2000 support lb # [ 0.955363] Key type dns_resolver registered worker1 # [ 0.922709] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.918156] thunder_xcv, ver 1.0 client # [ 0.918208] thunder_bgx, ver 1.0 client # [ 0.918234] nicpf, ver 1.0 worker2 # [ 0.918409] thunder_xcv, ver 1.0 worker2 # [ 0.918450] thunder_bgx, ver 1.0 client # [ 0.918859] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.918476] nicpf, ver 1.0 client # [ 0.918867] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.926565] thunder_xcv, ver 1.0 worker2 # [ 0.919047] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.926619] thunder_bgx, ver 1.0 client # [ 0.918891] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.919058] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.926643] nicpf, ver 1.0 client # [ 0.918899] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.919094] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.927229] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.962341] registered taskstats version 1 client # [ 0.918932] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.927236] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.919105] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.962510] Loading compiled-in X.509 certificates worker1 # [ 0.927261] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.918946] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.919139] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.919147] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.918981] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.927269] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.918987] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.927297] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.919171] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.919122] sky2: driver version 1.30 worker1 # [ 0.927303] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.919177] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.921400] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.919323] sky2: driver version 1.30 worker1 # [ 0.927338] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.921006] usbcore: registered new interface driver usb-storage client # [ 0.921437] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.927348] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.921650] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.921126] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.921144] usbserial: USB Serial support registered for generic worker2 # [ 0.921759] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.923042] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.930925] usbcore: registered new interface driver usb-storage worker1 # [ 0.934064] sky2: driver version 1.30 worker2 # [ 0.923069] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 0.971127] Demotion targets for Node 0: null client # [ 0.931023] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.936162] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.971245] Key type .fscrypt registered client # [ 0.931038] usbserial: USB Serial support registered for generic worker1 # [ 0.936200] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 0.971251] Key type fscrypt-provisioning registered worker2 # [ 0.923328] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.931676] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.936477] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.971346] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.934707] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.971365] ima: Allocated hash algorithm: sha1 worker2 # [ 0.935049] hub 1-0:1.0: USB hub found client # [ 0.935233] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.935064] hub 1-0:1.0: 6 ports detected lb # [ 0.971389] ima: No architecture policies found client # [ 0.935588] hub 1-0:1.0: USB hub found client # [ 0.935634] hub 1-0:1.0: 6 ports detected worker2 # [ 0.938005] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.975537] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.939633] usbcore: registered new interface driver usb-storage worker1 # [ 0.939757] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.938036] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T14:30:34 UTC (1789914634) client # [ 0.937901] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.939782] usbserial: USB Serial support registered for generic worker1 # [ 0.940414] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.940098] i2c_dev: i2c /dev entries driver client # [ 0.937935] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T14:30:34 UTC (1789914634) client # [ 0.938277] i2c_dev: i2c /dev entries driver worker1 # [ 0.944331] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.944365] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T14:30:34 UTC (1789914634) worker1 # [ 0.944707] i2c_dev: i2c /dev entries driver worker1 # [ 0.947751] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.943283] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.948072] hub 1-0:1.0: USB hub found client # [ 0.943296] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.943388] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.948096] hub 1-0:1.0: 6 ports detected worker2 # [ 0.943399] sdhci: Copyright(c) Pierre Ossman client # [ 0.943564] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.943694] Synopsys Designware Multimedia Card Interface Driver client # [ 0.943938] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.944077] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.945775] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.946014] usbcore: registered new interface driver usbhid client # [ 0.948395] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.946021] usbhid: USB HID core driver client # [ 0.948661] usbcore: registered new interface driver usbhid client # [ 0.948671] usbhid: USB HID core driver worker1 # [ 0.952194] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.952211] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.951657] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.951673] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.952488] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.952885] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.953238] drop_monitor: Initializing network drop monitor service worker1 # [ 0.954664] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.953431] NET: Registered PF_INET6 protocol family client # [ 0.954337] drop_monitor: Initializing network drop monitor service worker1 # [ 0.954925] usbcore: registered new interface driver usbhid worker2 # [ 0.956458] Segment Routing with IPv6 client # [ 0.954522] NET: Registered PF_INET6 protocol family worker1 # [ 0.954932] usbhid: USB HID core driver worker2 # [ 0.956492] In-situ OAM (IOAM) with IPv6 client # [ 0.956530] Segment Routing with IPv6 worker2 # [ 0.956530] NET: Registered PF_PACKET protocol family client # [ 0.956563] In-situ OAM (IOAM) with IPv6 lb # [ 0.993683] clk: Disabling unused clocks worker2 # [ 0.958164] 9pnet: Installing 9P2000 support client # [ 0.956603] NET: Registered PF_PACKET protocol family lb # [ 0.993709] PM: genpd: Disabling unused power domains worker1 # [ 0.960590] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.998001] Freeing unused kernel memory: 4736K worker1 # [ 0.962173] drop_monitor: Initializing network drop monitor service lb # [ 0.998212] Run /init as init process client # [ 0.958466] 9pnet: Installing 9P2000 support worker1 # [ 0.962358] NET: Registered PF_INET6 protocol family client # [ 0.960527] Key type dns_resolver registered worker2 # [ 0.961044] Key type dns_resolver registered worker1 # [ 0.965462] Segment Routing with IPv6 worker1 # [ 0.965494] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.965523] NET: Registered PF_PACKET protocol family worker1 # [ 0.967186] 9pnet: Installing 9P2000 support worker1 # [ 0.969897] Key type dns_resolver registered client # [ 0.967797] registered taskstats version 1 client # [ 0.967987] Loading compiled-in X.509 certificates worker2 # [ 0.967387] registered taskstats version 1 worker2 # [ 0.967556] Loading compiled-in X.509 certificates lb # [ 1.013750] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 0.976420] Demotion targets for Node 0: null worker1 # [ 0.976693] registered taskstats version 1 worker2 # [ 0.976538] Key type .fscrypt registered worker1 # [ 0.976873] Loading compiled-in X.509 certificates client # [ 0.976723] Demotion targets for Node 0: null worker2 # [ 0.976544] Key type fscrypt-provisioning registered worker2 # [ 0.976643] ima: No TPM chip found, activating TPM-bypass! client # [ 0.977562] Key type .fscrypt registered worker2 # [ 0.976664] ima: Allocated hash algorithm: sha1 client # [ 0.977571] Key type fscrypt-provisioning registered worker2 # [ 0.976684] ima: No architecture policies found client # [ 0.977670] ima: No TPM chip found, activating TPM-bypass! client # [ 0.977690] ima: Allocated hash algorithm: sha1 worker2 # [ 0.980720] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.977725] ima: No architecture policies found client # [ 0.981274] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.985414] Demotion targets for Node 0: null worker1 # [ 0.985574] Key type .fscrypt registered worker1 # [ 0.985581] Key type fscrypt-provisioning registered worker1 # [ 0.985690] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.985715] ima: Allocated hash algorithm: sha1 worker1 # [ 0.985742] ima: No architecture policies found worker1 # [ 0.990073] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.999169] clk: Disabling unused clocks client # [ 1.000283] clk: Disabling unused clocks worker2 # [ 0.999206] PM: genpd: Disabling unused power domains client # [ 1.000311] PM: genpd: Disabling unused power domains worker2 # [ 1.003980] Freeing unused kernel memory: 4736K worker2 # [ 1.004196] Run /init as init process client # [ 1.004853] Freeing unused kernel memory: 4736K client # [ 1.005072] Run /init as init process worker1 # [ 1.009648] clk: Disabling unused clocks worker1 # [ 1.009681] PM: genpd: Disabling unused power domains worker1 # [ 1.014520] Freeing unused kernel memory: 4736K worker1 # [ 1.014792] Run /init as init process worker2 # [ 1.020626] systemd[1]: Successfully made /usr/ read-only. client # [ 1.023078] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.029825] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.175540] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.180820] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.182392] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.195517] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.330125] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.348644] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.360825] systemd[1]: Detected virtualization qemu. lb # [ 1.362894] systemd[1]: Detected architecture arm64. lb # [ 1.364911] systemd[1]: Running in initrd. lb # [ 1.367823] systemd[1]: Initializing machine ID from random generator. lb # [ 1.370978] systemd[1]: Hostname set to . client # [ 1.333186] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.336907] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.348080] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.355689] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.368207] systemd[1]: Detected virtualization qemu. client # [ 1.358117] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.370343] systemd[1]: Detected architecture arm64. client # [ 1.370767] systemd[1]: Detected virtualization qemu. worker2 # [ 1.372283] systemd[1]: Running in initrd. worker1 # [ 1.365168] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.373004] systemd[1]: Detected architecture arm64. worker1 # [ 1.377589] systemd[1]: Detected virtualization qemu. client # [ 1.374979] systemd[1]: Running in initrd. worker2 # [ 1.375090] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.379827] systemd[1]: Detected architecture arm64. worker2 # [ 1.378075] systemd[1]: Hostname set to . worker1 # [ 1.381791] systemd[1]: Running in initrd. client # [ 1.378019] systemd[1]: Initializing machine ID from random generator. client # [ 1.381346] systemd[1]: Hostname set to . worker1 # [ 1.384778] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.387912] systemd[1]: Hostname set to . lb # [ 1.423822] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.422699] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.429118] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.435599] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.543493] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.546374] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.555443] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.552824] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.677636] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.652399] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.703636] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.705748] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.699974] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.746009] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.714425] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.753407] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.717301] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.754383] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.755489] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.756331] systemd[1]: Reached target Path Units. lb # [ 1.757034] systemd[1]: Reached target Slice Units. client # [ 1.714413] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.757690] systemd[1]: Reached target Swaps. worker2 # [ 1.716479] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.758279] systemd[1]: Reached target Timer Units. lb # [ 1.759079] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.760128] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.761014] systemd[1]: Listening on Journal Sockets. lb # [ 1.761798] systemd[1]: Listening on udev Control Socket. client # [ 1.719970] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.762595] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.763286] systemd[1]: Reached target Socket Units. worker2 # [ 1.722717] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.765388] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.730897] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.774185] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.775176] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.750346] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.784723] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.762139] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.799355] systemd[1]: Starting Journal Service... worker1 # [ 1.763505] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.763568] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.763605] systemd[1]: Reached target Path Units. worker1 # [ 1.763627] systemd[1]: Reached target Slice Units. lb # [ 1.803603] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.763648] systemd[1]: Reached target Swaps. worker1 # [ 1.763668] systemd[1]: Reached target Timer Units. lb # [ 1.803713] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.763891] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.764093] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.764272] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.764460] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.764620] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.764658] systemd[1]: Reached target Socket Units. worker1 # [ 1.777895] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.819654] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.785055] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.786222] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.823321] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.829081] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.795592] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.803567] systemd[1]: Starting Journal Service... lb # [ 1.843693] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.849122] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.850347] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.814460] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.824900] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.826002] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.827325] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.828333] systemd[1]: Reached target Path Units. worker2 # [ 1.829088] systemd[1]: Reached target Slice Units. worker2 # [ 1.829856] systemd[1]: Reached target Swaps. worker1 # [ 1.831616] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.830592] systemd[1]: Reached target Timer Units. worker1 # [ 1.831744] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.831532] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.834879] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.832685] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.833740] systemd[1]: Listening on Journal Sockets. lb # [ 1.871971] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.834683] systemd[1]: Listening on udev Control Socket. client # [ 1.834959] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.834797] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.834819] systemd[1]: Reached target Socket Units. lb # [ 1.878636] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.842538] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.843110] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.845188] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.844271] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.846232] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.845647] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.845683] systemd[1]: Reached target Path Units. client # [ 1.845701] systemd[1]: Reached target Slice Units. client # [ 1.845720] systemd[1]: Reached target Swaps. client # [ 1.845737] systemd[1]: Reached target Timer Units. client # [ 1.845925] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.846070] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.846202] systemd[1]: Listening on Journal Sockets. lb # [ 1.891559] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.846332] systemd[1]: Listening on udev Control Socket. client # [ 1.846441] systemd[1]: Listening on udev Kernel Socket. client # [ 1.846462] systemd[1]: Reached target Socket Units. worker2 # [ 1.854495] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.854696] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 1.854823] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.856888] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.855813] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.864330] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.862503] systemd[1]: Starting Journal Service... worker1 # [ 1.865713] systemd[1]: Mounted Kernel Configuration File System. client # [ 1.864923] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.866035] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.908224] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 1.908465] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 1.908476] [drm] features: -context_init client # [ 1.872235] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.909185] [drm] number of scanouts: 1 lb # [ 1.909202] [drm] number of cap sets: 0 lb # [ 1.913141] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.879823] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.919810] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.887569] systemd[1]: Starting Load Kernel Modules... client # [ 1.887774] systemd[1]: Starting Journal Service... worker2 # [ 1.890578] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.927723] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 1.927740] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 1.909136] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.906491] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.908016] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.909973] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.908840] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.909149] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.909374] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.912020] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.915216] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 1.916031] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.920045] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.956079] Console: switching to colour frame buffer device 160x50 lb # [ 1.962697] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 1.932709] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.939089] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.939484] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.944077] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.941164] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.944309] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.944319] [drm] features: -context_init worker1 # [ 1.945046] [drm] number of scanouts: 1 worker1 # [ 1.945065] [drm] number of cap sets: 0 lb # [ 1.984054] systemd[1]: Finished Load Kernel Modules. lb # [ 1.987242] systemd[1]: Starting Apply Kernel Variables... client # [ 1.952995] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.953905] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.954222] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.956762] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.959396] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.964063] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.964305] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.964333] systemd[1]: Reached target Local File Systems. worker1 # [ 1.968351] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.007611] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.972736] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.972765] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 1.972901] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 2.009909] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.009954] systemd[1]: Reached target Local File Systems. worker2 # [ 1.981547] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 2.019856] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.988866] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.993436] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.993670] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.993680] [drm] features: -context_init client # [ 1.994447] [drm] number of scanouts: 1 client # [ 1.994467] [drm] number of cap sets: 0 worker2 # [ 1.994730] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.999390] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 2.000951] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.999625] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.999634] [drm] features: -context_init worker2 # [ 2.000375] [drm] number of scanouts: 1 lb # [ 2.039577] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.000393] [drm] number of cap sets: 0 worker1 # [ 2.003842] Console: switching to colour frame buffer device 160x50 client # [ 2.013115] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 2.018925] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.019317] systemd[1]: Reached target Preparation for Local File Systems. client # [ 2.017156] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 2.019347] systemd[1]: Reached target Local File Systems. client # [ 2.017173] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 2.023382] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.027683] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 2.032009] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 2.027704] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 2.067637] systemd[1]: Started Journal Service. lb # [ 2.049661] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.052979] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.040891] systemd[1]: Finished Load Kernel Modules. client # [ 2.038838] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 2.060391] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.061475] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.062447] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.063569] systemd[1]: Starting Create System Files and Directories... client # [ 2.045122] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 2.055836] systemd[1]: Starting Apply Kernel Variables... client # [ 2.053091] Console: switching to colour frame buffer device 160x50 worker2 # [ 2.058611] Console: switching to colour frame buffer device 160x50 worker2 # [ 2.065378] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 2.059671] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.060896] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.062004] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.063061] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.096531] systemd-udevd[81]: Using default interface naming scheme 'v261'. worker1 # [ 2.079664] systemd[1]: Started Journal Service. lb # [ 2.104473] systemd[1]: Finished Create System Files and Directories. client # [ 2.085460] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.089669] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 2.091586] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 2.080984] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.093395] systemd[1]: Reached target Local File Systems. worker1 # [ 2.084625] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 2.098962] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.089301] systemd[1]: Starting Create System Files and Directories... client # [ 2.101283] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.093009] systemd-modules-load[75]: Inserted module 'dm_mod' worker1 # [ 2.096472] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.108685] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.108860] systemd[1]: Started Journal Service. client # [ 2.108973] systemd[1]: Finished Load Kernel Modules. lb # [ 2.130153] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.098351] systemd-modules-load[75]: Module 'virtio_balloon' is built in worker2 # [ 2.099491] systemd-modules-load[75]: Module 'virtio_console' is built in worker2 # [ 2.108426] systemd-modules-load[75]: Inserted module 'virtio_gpu' worker2 # [ 2.109477] systemd-modules-load[75]: Module 'virtio_rng' is built in client # [ 2.128877] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.121357] systemd-udevd[79]: Using default interface naming scheme 'v261'. client # [ 2.126222] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.140090] systemd[1]: Started Journal Service. worker2 # [ 2.129844] systemd[1]: Starting Create System Files and Directories... client # [ 2.132258] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.133427] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.135269] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.144299] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.148337] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.152363] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.159707] systemd[1]: Starting Create System Files and Directories... lb # [ 2.192101] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.162543] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.168535] systemd[1]: Finished Apply Kernel Variables. client # [ 2.184157] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.185439] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.192411] systemd[1]: Starting Virtual Console Setup... client # [ 2.196797] systemd-udevd[80]: Using default interface naming scheme 'v261'. client # [ 2.198828] systemd[1]: Finished Create System Files and Directories. lb # [ 2.240496] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.244087] systemd[1]: Finished Virtual Console Setup. client # [ 2.229763] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.244475] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.244241] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.248058] systemd[1]: Finished Virtual Console Setup. client # [ 2.288168] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.288539] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.292309] systemd[1]: Finished Virtual Console Setup. client # [ 2.340496] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.343975] systemd[1]: Finished Virtual Console Setup. lb # [ 2.830369] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.832136] systemd[1]: Reached target System Initialization. lb # [ 2.836120] systemd[1]: Reached target Basic System. worker1 # [ 2.845631] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.847176] systemd[1]: Reached target System Initialization. worker1 # [ 2.848144] systemd[1]: Reached target Basic System. worker2 # [ 2.913609] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.914597] systemd[1]: Reached target System Initialization. worker2 # [ 2.915416] systemd[1]: Reached target Basic System. client # [ 2.926724] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.927680] systemd[1]: Reached target System Initialization. client # [ 2.932212] systemd[1]: Reached target Basic System. lb # [ 2.979260] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.008061] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.010928] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.999131] (udev-worker)[108]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.033933] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.040386] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.074025] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.079090] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.048235] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.083688] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.084996] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.098359] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.103038] (udev-worker)[102]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.137245] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.108380] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.109995] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.114329] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.116119] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.146823] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.148406] systemd[1]: Mounting /sysroot... client # [ 3.121282] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.207483] EXT4-fs (vda): mounted filesystem 7f67a60e-a8b8-4e9f-b907-f8646fb6afc7 r/w with ordered data mode. Quota mode: none. lb # [ 3.193207] systemd[1]: Mounted /sysroot. worker2 # [ 3.164136] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.166333] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.197337] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.166286] systemd[1]: Reached target Initrd Root Device. lb # [ 3.198692] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.169380] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.173992] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.180167] systemd[1]: Mounting /sysroot... client # [ 3.188412] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.224124] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.230741] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.235337] systemd[1]: Reloading... client # [ 3.204103] systemd[1]: Reached target Initrd Root Device. client # [ 3.209187] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.230767] EXT4-fs (vda): mounted filesystem 376254bc-797f-4e24-bd30-4d24e02b2968 r/w with ordered data mode. Quota mode: none. worker1 # [ 3.220910] systemd[1]: Mounted /sysroot. worker1 # [ 3.222881] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.224177] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.223985] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.232108] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.236238] systemd[1]: Mounting /sysroot... worker1 # [ 3.251509] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.253771] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.260221] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.259899] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.263679] systemd[1]: Reloading... client # [ 3.265203] systemd[1]: Mounting /sysroot... worker2 # [ 3.289626] EXT4-fs (vda): mounted filesystem 077b16bd-bcb2-4770-9b57-70bfa82bc1bd r/w with ordered data mode. Quota mode: none. worker2 # [ 3.279952] systemd[1]: Mounted /sysroot. worker2 # [ 3.281424] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.286389] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.316688] EXT4-fs (vda): mounted filesystem 482e7b32-98b3-4298-aeed-cfe3f41a78b7 r/w with ordered data mode. Quota mode: none. client # [ 3.309115] systemd[1]: Mounted /sysroot. client # [ 3.312420] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.311308] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.316471] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.317198] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.323111] systemd[1]: Reloading... client # [ 3.343978] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.350663] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.355289] systemd[1]: Reloading... lb # [ 3.448095] systemd[1]: Reloading finished in 210 ms. lb # [ 3.477871] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... lb # [ 3.483420] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.486367] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.495539] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.498727] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.501841] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.477127] systemd[1]: Reloading finished in 217 ms. lb # [ 3.520076] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.521712] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.510942] systemd-sysroot-fstab-check[121]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.514961] systemd-sysroot-fstab-check[121]: Requesting swap.target/start/replace... worker1 # [ 3.520906] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.527406] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.531538] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.534608] systemd[1]: Reloading finished in 214 ms. worker1 # [ 3.536343] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.556865] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.559542] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.571370] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.574217] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... worker2 # [ 3.576731] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.578582] systemd[1]: Reloading finished in 224 ms. worker2 # [ 3.586742] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.592114] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.593874] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.613073] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.614247] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.614585] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.620756] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.626031] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.628151] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.633466] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.636863] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.660211] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.661851] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.805096] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.824637] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.828767] systemd[1]: Mounting /sysroot/run... lb # [ 3.841108] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.825484] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.871759] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.843591] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.847758] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.857258] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.907783] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.887866] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.899910] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.941075] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.914624] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.950464] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.953383] systemd[1]: Mounted /sysroot/run. lb # [ 3.955811] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.957586] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.926777] systemd[1]: Mounting /sysroot/run... lb # [ 3.961418] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.965477] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.939000] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.938409] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.948587] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.950185] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.950026] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.956170] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.967512] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.969170] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.970311] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.974437] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.977545] systemd[1]: Mounting /sysroot/run... client # [ 3.990515] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.995495] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.994358] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.997380] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.006555] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 4.017815] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 4.019623] systemd[1]: Mounted /sysroot/run. client # [ 4.022120] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 4.030714] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 4.033126] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 4.046782] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.051524] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 4.057194] systemd[1]: Mounted /sysroot/run. worker2 # [ 4.076134] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.078878] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.081037] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.081974] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.097258] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 4.099712] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 4.102267] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.104941] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.126118] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.128791] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.133426] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.151133] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.177542] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.196289] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.198293] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.202348] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.232093] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.235591] systemd[1]: Stopped target Basic System. worker2 # [ 4.236742] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.237778] systemd[1]: Stopped target Path Units. worker2 # [ 4.240358] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.245283] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.247206] systemd[1]: Stopped target Slice Units. worker2 # [ 4.250578] systemd[1]: Stopped target Socket Units. worker2 # [ 4.256148] systemd[1]: Stopped target System Initialization. worker2 # [ 4.257907] systemd[1]: Stopped target Swaps. worker2 # [ 4.259692] systemd[1]: Stopped target Timer Units. worker2 # [ 4.261293] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.262703] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.273255] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.275205] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.277209] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 4.282531] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.283474] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.290696] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.293285] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.298243] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.305548] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.307679] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.312401] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.316941] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.319996] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.324253] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.325656] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 4.328392] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.331306] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 4.332700] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.335279] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.336232] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 4.337430] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 4.338285] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.339213] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.348266] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.349387] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.350230] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.351997] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.383430] (udev-worker)[96]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker2 # [ 4.353562] systemd[1]: systemd-udevd.service: Consumed 1.107s CPU time over 2.333s wall clock time, 18M memory peak. worker2 # [ 4.354960] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.355942] systemd[1]: Closed udev Control Socket. worker2 # [ 4.356752] systemd[1]: Starting Cleanup udev Database... worker2 # [ 4.357502] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.358570] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.389372] (udev-worker)[96]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.359441] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.364183] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.365232] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 4.366502] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.372540] (udev-worker)[97]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.416926] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.384260] (udev-worker)[97]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory lb # [ 4.421502] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.424164] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.426064] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.395379] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.397280] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.400599] systemd[1]: Reached target Switch Root. worker2 # [ 4.401392] systemd[1]: Starting NixOS Activation... worker1 # [ 4.404876] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.440757] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.411141] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.443256] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.413176] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.444512] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.416161] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.422193] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.423958] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.431813] systemd[1]: Starting Virtual Console Setup... lb # [ 4.465588] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.468949] systemd[1]: Finished Virtual Console Setup. worker1 # [ 4.461014] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.464559] systemd[1]: Finished Virtual Console Setup. client # [ 4.473844] (udev-worker)[94]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.479488] (udev-worker)[94]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.508370] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.510592] systemd[1]: Stopped Virtual Console Setup. client # [ 4.512127] systemd[1]: Stopping Virtual Console Setup... client # [ 4.517156] systemd[1]: Starting Virtual Console Setup... client # [ 4.523864] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.525468] systemd[1]: Stopped Virtual Console Setup. client # [ 4.531378] systemd[1]: Starting Virtual Console Setup... client # [ 4.557162] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.560839] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.568958] initrd-nixos-activation-start[172]: booting system configuration /nix/store/a4g43incxmb90ykmkdsd5cyqwyy4lipw-nixos-system-worker2-test worker2 # [ 4.635715] initrd-nixos-activation-start[172]: running activation script... lb # [ 4.805915] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.827951] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.864792] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.867675] systemd[1]: Reached target Initrd File Systems. lb # [ 4.872754] systemd[1]: Starting Find NixOS closure... lb # [ 4.884323] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.891670] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.926030] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.895310] systemd[1]: Reached target Initrd File Systems. lb # [ 4.930365] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.901096] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.910126] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.944788] systemd[1]: Finished Find NixOS closure. lb # [ 4.947594] systemd[1]: Reached target Initrd Default Target. lb # [ 4.949428] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.940189] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.978579] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.980561] systemd[1]: Stopped target Basic System. lb # [ 4.981968] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.983326] systemd[1]: Stopped target Path Units. lb # [ 4.988514] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.989938] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.991334] systemd[1]: Stopped target Slice Units. worker1 # [ 4.961197] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.993268] systemd[1]: Stopped target Socket Units. lb # [ 4.995491] systemd[1]: Stopped target System Initialization. lb # [ 4.997937] systemd[1]: Stopped target Swaps. worker1 # [ 4.966975] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 5.000163] systemd[1]: Stopped target Timer Units. lb # [ 5.001926] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 5.007871] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.010769] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.011889] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.981748] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.984215] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.986259] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 5.020688] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.021658] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.022677] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 5.023651] systemd[1]: Stopped Apply Kernel Variables. lb # [ 5.033146] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.004484] systemd[1]: Mounted /sysroot/nix/store. lb # [ 5.037625] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.039687] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.007715] systemd[1]: Reached target Initrd File Systems. lb # [ 5.041907] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 5.043028] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 5.044070] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.044931] systemd[1]: Stopped target Local File Systems. lb # [ 5.045689] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.013637] systemd[1]: Starting Find NixOS closure... lb # [ 5.046630] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.047598] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.022787] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.054634] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.022643] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 5.025182] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.029417] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.061352] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 5.062557] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.032180] systemd[1]: Stopped target Basic System. lb # [ 5.063349] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.065110] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.034833] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 5.035991] systemd[1]: Stopped target Path Units. lb # [ 5.068164] systemd[1]: systemd-udevd.service: Consumed 1.426s CPU time over 3.041s wall clock time, 22.4M memory peak. worker1 # [ 5.038696] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 5.070843] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.073633] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 5.074709] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.044233] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.045589] systemd[1]: Stopped target Slice Units. lb # [ 5.076585] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.046451] systemd[1]: Stopped target Socket Units. lb # [ 5.077865] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.047378] systemd[1]: Stopped target System Initialization. lb # [ 5.078904] systemd[1]: Closed udev Control Socket. lb # [ 5.079612] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.053354] systemd[1]: Stopped target Swaps. worker1 # [ 5.054192] systemd[1]: Stopped target Timer Units. lb # [ 5.084823] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.055913] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 5.088206] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.058769] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 5.058669] initrd-nixos-activation-start[195]: setting up /etc... lb # [ 5.092166] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.093334] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.062776] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.094333] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.065442] systemd[1]: Stopped Find NixOS closure. lb # [ 5.096181] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.067162] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.100181] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.101374] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.073885] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.076784] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.077844] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.078222] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 5.084780] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.089005] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.093555] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.125459] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.093882] systemd[1]: Finished Find NixOS closure. worker1 # [ 5.095412] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.096295] systemd[1]: Reached target Initrd Default Target. lb # [ 5.128499] systemd[1]: Finished Cleanup udev Database. lb # [ 5.129297] systemd[1]: Reached target Switch Root. worker1 # [ 5.098999] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.099014] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 5.131354] systemd[1]: Starting NixOS Activation... worker1 # [ 5.102807] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.104256] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.108579] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.109438] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.110410] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.113052] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.113979] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.115038] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.116170] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.116973] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 5.117999] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.118858] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.119875] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.128359] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.129352] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.130479] systemd[1]: systemd-udevd.service: Consumed 1.400s CPU time over 3.147s wall clock time, 25.3M memory peak. worker1 # [ 5.131919] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.132851] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.136224] systemd[1]: Closed udev Control Socket. worker1 # [ 5.136966] systemd[1]: Starting Cleanup udev Database... client # [ 5.136247] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.137748] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.140090] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.139054] systemd[1]: Stopped target Initrd Default Target. client # [ 5.143258] systemd[1]: Stopped target Basic System. worker1 # [ 5.144379] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.144440] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 5.145564] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.145437] systemd[1]: Stopped target Path Units. worker1 # [ 5.146572] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.146390] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.147707] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.152126] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.157115] systemd[1]: Stopped target Slice Units. client # [ 5.157972] systemd[1]: Stopped target Socket Units. client # [ 5.158813] systemd[1]: Stopped target System Initialization. client # [ 5.159706] systemd[1]: Stopped target Swaps. client # [ 5.165087] systemd[1]: Stopped target Timer Units. client # [ 5.170656] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.172139] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.173361] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.175341] systemd[1]: Reached target Switch Root. client # [ 5.174616] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.175553] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.177562] systemd[1]: Stopped Find NixOS closure. client # [ 5.178469] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 5.180224] systemd[1]: Starting NixOS Activation... client # [ 5.179476] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.180570] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.181496] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.182226] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.183227] systemd[1]: Stopped Load Kernel Modules. client # [ 5.183939] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.193118] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.194271] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.195444] systemd[1]: Stopped Create System Files and Directories. client # [ 5.205688] systemd[1]: Stopped target Local File Systems. client # [ 5.208539] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.210372] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 5.212358] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.215242] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.216535] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.218425] systemd[1]: Stopped Virtual Console Setup. client # [ 5.219882] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.221343] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.222351] systemd[1]: systemd-udevd.service: Consumed 1.411s CPU time over 3.109s wall clock time, 22.3M memory peak. client # [ 5.223779] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.232335] systemd[1]: Closed udev Control Socket. client # [ 5.233098] systemd[1]: Starting Cleanup udev Database... client # [ 5.234114] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.236219] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.240165] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.241395] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.242377] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.244193] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.248415] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.249626] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.250474] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.256391] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.301643] initrd-nixos-activation-start[182]: booting system configuration /nix/store/px4c3ifawqq4xs8a4zhy519i865fkk09-nixos-system-lb-test client # [ 5.274034] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.276123] systemd[1]: Finished Cleanup udev Database. client # [ 5.277546] systemd[1]: Reached target Switch Root. client # [ 5.280507] systemd[1]: Starting NixOS Activation... worker2 # [ 5.316127] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.318820] systemd[1]: Finished NixOS Activation. worker2 # [ 5.320126] systemd[1]: Starting Switch Root... worker1 # [ 5.333541] initrd-nixos-activation-start[181]: booting system configuration /nix/store/q0xpda7nssqkdhnmlkp5q4dxx9dxngjp-nixos-system-worker1-test lb # [ 5.366349] initrd-nixos-activation-start[182]: running activation script... worker2 # [ 5.343571] systemd[1]: Switching root. worker1 # [ 5.394820] initrd-nixos-activation-start[181]: running activation script... client # [ 5.442459] initrd-nixos-activation-start[181]: booting system configuration /nix/store/c59dy5901id87cijqm6p1wgx5fgpmqry-nixos-system-client-test client # [ 5.506944] initrd-nixos-activation-start[181]: running activation script... worker2 # [ 5.525747] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 5.781397] initrd-nixos-activation-start[205]: setting up /etc... worker1 # [ 5.794086] initrd-nixos-activation-start[204]: setting up /etc... client # [ 5.929743] initrd-nixos-activation-start[204]: setting up /etc... lb # [ 6.035748] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 6.038692] systemd[1]: Finished NixOS Activation. lb # [ 6.039797] systemd[1]: Starting Switch Root... lb # [ 6.064089] systemd[1]: Switching root. worker1 # [ 6.059128] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.062080] systemd[1]: Finished NixOS Activation. worker1 # [ 6.064121] systemd[1]: Starting Switch Root... worker1 # [ 6.086934] systemd[1]: Switching root. worker2 # [ 6.118989] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.125494] systemd[1]: Detected virtualization qemu. worker2 # [ 6.127513] systemd[1]: Detected architecture arm64. worker2 # [ 6.130265] systemd[1]: Detected first boot. worker2 # [ 6.135228] systemd[1]: Initializing machine ID from random generator. client # [ 6.193892] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.196739] systemd[1]: Finished NixOS Activation. client # [ 6.197935] systemd[1]: Starting Switch Root... lb # [ 6.254017] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 6.220183] systemd[1]: Switching root. worker1 # [ 6.270611] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 6.402556] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.447837] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.628665] systemd[1]: Applying preset policy. lb # [ 6.822219] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.827365] systemd[1]: Detected virtualization qemu. lb # [ 6.829061] systemd[1]: Detected architecture arm64. lb # [ 6.833200] systemd[1]: Detected first boot. lb # [ 6.840455] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.854375] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.862436] systemd[1]: Detected virtualization qemu. worker1 # [ 6.864675] systemd[1]: Detected architecture arm64. worker1 # [ 6.867740] systemd[1]: Detected first boot. worker1 # [ 6.873397] systemd[1]: Initializing machine ID from random generator. lb # [ 7.035001] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 6.998100] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 7.003795] systemd[1]: Detected virtualization qemu. client # [ 7.005579] systemd[1]: Detected architecture arm64. client # [ 7.008015] systemd[1]: Detected first boot. client # [ 7.012415] systemd[1]: Initializing machine ID from random generator. worker2 # [ 7.100826] systemd[1]: Populated /etc with preset unit settings. lb # [ 7.190468] systemd[1]: Applying preset policy. worker1 # [ 7.191575] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.310589] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 7.370787] systemd[1]: Applying preset policy. client # [ 7.498878] systemd[1]: Applying preset policy. worker2 # [ 7.602977] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.604293] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 7.607606] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 7.611602] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.613300] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.615174] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.615274] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.615309] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 7.615323] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.615653] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.615905] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.616148] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.616400] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.616641] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.616888] systemd[1]: Reached target Path Units. lb # [ 7.662472] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.617123] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.617352] systemd[1]: Reached target Slice Units. worker2 # [ 7.617575] systemd[1]: Reached target Swaps. worker2 # [ 7.629532] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.633918] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.637271] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.641215] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.642455] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.648026] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 7.650914] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.655991] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.658584] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.660966] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.663524] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.674454] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.674876] systemd[1]: Listening on udev Control Socket. worker2 # [ 7.675219] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.681381] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.685493] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 7.696928] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.708423] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 7.724067] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 7.733694] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 7.735852] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 7.741403] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.744995] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.751071] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.767252] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 7.771280] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.833010] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.855238] systemd[1]: Starting Journal Service... worker2 # [ 7.874187] systemd[1]: Starting Load Kernel Modules... worker2 # [ 7.894791] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.901369] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.903781] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.915041] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 7.920718] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 7.926610] systemd[1]: Mounted Huge Pages File System. worker2 # [ 7.928927] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 7.931502] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 7.933939] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 7.936886] systemd[1]: Mounted Kernel Configuration File System. client # [ 7.959229] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.978985] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 7.984582] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 8.047590] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 8.049611] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 8.051979] EXT4-fs (vda): re-mounted 077b16bd-bcb2-4770-9b57-70bfa82bc1bd. worker2 # [ 8.066410] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.068084] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.071439] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.079150] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 8.081046] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.084822] systemd[1]: Finished Load Kernel Modules. worker2 # [ 8.101620] systemd[1]: Starting Firewall... worker2 # [ 8.108191] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.132874] fuse: init (API version 7.45) worker2 # [ 8.143148] systemd-journald[267]: Collecting audit messages is enabled. lb # [ 8.194435] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 8.195979] systemd[1]: Stopped initrd-switch-root.service. lb # [ 8.199068] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 8.202921] systemd[1]: Created slice Slice /system/getty. lb # [ 8.205069] systemd[1]: Created slice User and Session Slice. lb # [ 8.206377] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 8.208503] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 8.210215] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.211810] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 8.213396] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.215077] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 8.177770] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 8.216737] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.218352] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.180857] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.220095] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.222639] systemd[1]: Reached target Path Units. lb # [ 8.224667] systemd[1]: Reached target Remote File Systems. lb # [ 8.226633] systemd[1]: Reached target Slice Units. worker2 # [ 8.177675] systemd[1]: Queued start job for default target Multi-User System. lb # [ 8.228576] systemd[1]: Reached target Swaps. worker2 # [ 8.193114] systemd[1]: Started Journal Service. lb # [ 8.232726] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 8.237726] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.241917] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.192474] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.246014] systemd[1]: Listening on Factory Reset Management. lb # [ 8.247236] systemd[1]: Listening on Hostname Service Socket. lb # [ 8.253079] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.255181] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 8.205287] systemd-modules-load[268]: Module 'atkbd' is built in lb # [ 8.259726] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.262520] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 8.265308] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.213527] systemd-modules-load[268]: Module 'loop' is built in lb # [ 8.266964] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.224293] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.278742] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.280233] systemd[1]: Listening on udev Control Socket. worker2 # [ 8.228750] systemd-oomd[269]: No swap; memory pressure usage will be degraded lb # [ 8.281862] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.286251] systemd[1]: Mounting Huge Pages File System... lb # [ 8.290681] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 8.241282] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 8.248365] systemd[1]: Reached target First Boot Complete. lb # [ 8.299708] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 8.257018] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 8.309137] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 8.269747] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.321528] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 8.277181] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 8.339179] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 8.288649] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 8.340928] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.310453] systemd-journald[267]: Received client request to flush runtime journal. lb # [ 8.352591] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.354785] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 8.358083] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 8.367935] systemd[1]: Starting Load Kernel Module fuse... lb # [ 8.369635] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.340370] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 8.341616] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.344659] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 8.348537] systemd[1]: Created slice Slice /system/getty. worker1 # [ 8.350200] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.351117] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 8.353729] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.353780] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 8.353797] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.354135] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 8.354392] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 8.354638] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.354878] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 8.355140] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.361234] systemd[1]: Reached target Path Units. worker1 # [ 8.363480] systemd[1]: Reached target Remote File Systems. worker1 # [ 8.365316] systemd[1]: Reached target Slice Units. worker1 # [ 8.367070] systemd[1]: Reached target Swaps. worker1 # [ 8.371147] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.376196] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.380200] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 8.384205] systemd[1]: Listening on Factory Reset Management. worker1 # [ 8.386169] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.392327] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 8.375190] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.394007] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.398604] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 8.400265] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.402783] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.404538] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.445614] systemd[1]: Starting Journal Service... worker1 # [ 8.414599] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.415056] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.416994] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.420964] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.425163] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 8.410931] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 8.412271] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 8.432765] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 8.415090] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.444664] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.456112] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.491105] systemd[1]: Starting Load Kernel Modules... lb # [ 8.500652] fuse: init (API version 7.45) client # [ 8.466234] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.467585] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.470470] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.471024] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 8.473442] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.474784] systemd[1]: Created slice Slice /system/getty. client # [ 8.477443] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.482563] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.517680] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 8.479625] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.482106] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.485623] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.484301] systemd[1]: Expecting device /dev/hvc0... client # [ 8.486289] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.487356] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 8.490585] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 8.489007] systemd[1]: Stopped target initrd-fs.target. client # [ 8.491287] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.492424] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.494120] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.496567] systemd[1]: Reached target Path Units. client # [ 8.498449] systemd[1]: Reached target Remote File Systems. lb # [ 8.536687] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 8.499544] systemd[1]: Reached target Slice Units. worker1 # [ 8.504051] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.501051] systemd[1]: Reached target Swaps. lb # [ 8.538962] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.505776] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.507593] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.510438] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.513703] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.517225] systemd[1]: Listening on Factory Reset Management. client # [ 8.519012] systemd[1]: Listening on Hostname Service Socket. client # [ 8.524616] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.564100] systemd[1]: Starting Coldplug All udev Devices... client # [ 8.527621] systemd[1]: Listening on Journal Audit Socket. client # [ 8.532222] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.534843] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.537459] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.539930] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.579172] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.585661] systemd[1]: Mounted Huge Pages File System. client # [ 8.551452] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.588869] systemd-journald[276]: Collecting audit messages is enabled. client # [ 8.553551] systemd[1]: Listening on udev Control Socket. client # [ 8.555398] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.593883] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 8.597040] systemd[1]: Mounted Kernel Debug File System. client # [ 8.559769] systemd[1]: Mounting Huge Pages File System... lb # [ 8.600005] systemd[1]: Mounted Kernel Trace File System. client # [ 8.564647] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 8.605272] systemd[1]: Finished Create List of Static Device Nodes. client # [ 8.571677] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.611851] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.615375] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 8.598557] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.581161] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.623680] systemd[1]: Started Journal Service. worker1 # [ 8.592464] systemd[1]: Starting Journal Service... lb # [ 8.606560] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.616671] systemd-modules-load[277]: Module 'atkbd' is built in client # [ 8.599397] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 8.606561] systemd[1]: Starting Load Kernel Modules... lb # [ 8.624240] systemd-modules-load[277]: Module 'loop' is built in worker2 # [ 8.595089] systemd[1]: Mounting /run/wrappers... worker2 # [ 8.597321] systemd[1]: Mounting FUSE Control File System... client # [ 8.610927] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.629943] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.612821] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.637324] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 8.646081] systemd[1]: Finished Load Kernel Module fuse. worker1 # [ 8.634046] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 8.631500] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.647351] systemd[1]: Finished Load Kernel Modules. lb # [ 8.653388] systemd[1]: Mounting FUSE Control File System... client # [ 8.635831] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 8.660283] systemd[1]: Starting Firewall... client # [ 8.642259] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.648957] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.652420] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.669617] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.637763] systemd[1]: Mounted FUSE Control File System. worker1 # [ 8.667218] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.703495] EXT4-fs (vda): re-mounted 7f67a60e-a8b8-4e9f-b907-f8646fb6afc7. worker1 # [ 8.673991] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 8.677629] systemd[1]: Mounted Huge Pages File System. worker1 # [ 8.683362] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 8.683935] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 8.684343] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 8.684740] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 8.673922] systemd[1]: Mounted /run/wrappers. worker2 # [ 8.675528] systemd[1]: Reached target Local File Systems. worker2 # [ 8.678700] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 8.712110] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 8.684932] systemd[1]: Starting register-nix-paths.service... worker1 # [ 8.711578] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 8.697175] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 8.698975] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 8.713060] systemd[1]: Starting Load Kernel Module fuse... lb # [ 8.732409] systemd-oomd[278]: No swap; memory pressure usage will be degraded worker1 # [ 8.718304] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 8.707474] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 8.745140] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 8.725237] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.722741] systemd[1]: Starting Create System Files and Directories... lb # [ 8.756145] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.737200] systemd-udevd[303]: Using default interface naming scheme 'v261'. client # [ 8.751152] systemd[1]: Starting Journal Service... client # [ 8.780127] systemd[1]: Starting Load Kernel Modules... lb # [ 8.806426] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 8.798723] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 8.802405] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 8.805170] EXT4-fs (vda): re-mounted 376254bc-797f-4e24-bd30-4d24e02b2968. client # [ 8.807129] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.827177] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.828363] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 8.832654] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 8.820065] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 8.837839] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.806512] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 8.822458] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 8.824684] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 8.824970] fuse: init (API version 7.45) lb # [ 8.844676] systemd[1]: Finished Apply Kernel Variables. client # [ 8.828738] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.832277] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 8.816341] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.830484] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.834473] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.845834] systemd[1]: Finished Load Kernel Modules. client # [ 8.849720] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 8.853683] systemd-journald[275]: Collecting audit messages is enabled. worker1 # [ 8.856506] systemd[1]: Starting Firewall... worker1 # [ 8.872522] systemd[1]: Starting Apply Kernel Variables... lb # [ 8.891606] systemd[1]: Mounted FUSE Control File System. client # [ 8.880695] systemd[1]: Listening on Journal Log Access Socket. client # [ 8.887653] systemd[1]: Mounted Huge Pages File System. worker1 # [ 8.893384] fuse: init (API version 7.45) client # [ 8.894899] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 8.919733] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 8.889448] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 8.905924] systemd[1]: Started Journal Service. client # [ 8.903186] systemd[1]: Mounted Kernel Debug File System. client # [ 8.907678] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.930753] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 8.914117] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 8.893986] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 8.919470] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.964922] systemd-journald[276]: Received client request to flush runtime journal. worker1 # [ 8.916467] systemd-modules-load[276]: Module 'atkbd' is built in client # [ 8.925440] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.926118] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.926682] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.927201] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.927897] systemd[1]: Finished Load Kernel Modules. worker1 # [ 8.929897] systemd-modules-load[276]: Module 'loop' is built in client # [ 8.938679] systemd-journald[275]: Collecting audit messages is enabled. worker2 # [ 8.934676] systemd[1]: Finished Create System Files and Directories. client # [ 8.949124] systemd[1]: Mounting FUSE Control File System... worker1 # [ 8.940423] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 8.944529] systemd[1]: Starting Rebuild Journal Catalog... client # [ 8.945582] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 8.950956] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.961726] EXT4-fs (vda): re-mounted 482e7b32-98b3-4298-aeed-cfe3f41a78b7. client # [ 8.952678] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.952927] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.969446] systemd[1]: Starting Apply Kernel Variables... client # [ 8.959712] systemd-modules-load[276]: Module 'atkbd' is built in worker1 # [ 8.960717] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.965398] systemd-modules-load[276]: Module 'loop' is built in worker1 # [ 8.971722] systemd-oomd[277]: No swap; memory pressure usage will be degraded lb # [ 9.014407] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 8.985615] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.001144] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 9.022105] systemd[1]: Reached target First Boot Complete. client # [ 9.002481] systemd[1]: Started Journal Service. worker1 # [ 8.993364] systemd[1]: Reached target First Boot Complete. lb # [ 9.029026] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.999214] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 9.011350] systemd-oomd[277]: No swap; memory pressure usage will be degraded worker1 # [ 9.016237] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 9.020300] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 9.025215] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 9.029947] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 9.067296] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.051116] systemd-journald[275]: Received client request to flush runtime journal. lb # [ 9.068440] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 9.076500] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 9.052226] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 9.076918] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.081777] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 9.093707] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 9.097583] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 9.108490] systemd[1]: Finished Apply Kernel Variables. client # [ 9.114021] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 9.117692] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 9.120972] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 9.139126] systemd[1]: Mounted FUSE Control File System. client # [ 9.141052] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 9.149322] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 9.182685] systemd[1]: Mounting /run/wrappers... worker2 # [ 9.152279] systemd[1]: Starting Update is Completed... worker1 # [ 9.161862] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.165612] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 9.168573] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.202351] systemd-udevd[319]: Using default interface naming scheme 'v261'. client # [ 9.187542] systemd-journald[275]: Received client request to flush runtime journal. lb # [ 9.239980] systemd[1]: Mounted /run/wrappers. lb # [ 9.243929] systemd[1]: Reached target Local File Systems. lb # [ 9.250833] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.255911] systemd[1]: Starting register-nix-paths.service... client # [ 9.237252] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 9.242275] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.267294] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.275614] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.248709] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.251474] systemd[1]: Reached target First Boot Complete. client # [ 9.253609] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 9.257830] systemd[1]: Finished Update is Completed. lb # [ 9.311434] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.288252] systemd-udevd[312]: Using default interface naming scheme 'v261'. lb # [ 9.334455] systemd[1]: Starting Create System Files and Directories... client # [ 9.310649] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.311723] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.314340] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 9.329498] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.336392] systemd[1]: Mounting FUSE Control File System... worker1 # [ 9.373796] systemd[1]: Mounted FUSE Control File System. worker1 # [ 9.401152] systemd[1]: Mounted /run/wrappers. worker1 # [ 9.403293] systemd[1]: Reached target Local File Systems. worker1 # [ 9.412195] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.447786] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.422297] systemd-udevd[307]: Using default interface naming scheme 'v261'. worker1 # [ 9.424879] systemd[1]: Starting register-nix-paths.service... worker1 # [ 9.426355] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.460227] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.432831] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.448644] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.457214] systemd[1]: Starting Create System Files and Directories... client # [ 9.461837] systemd[1]: Mounting /run/wrappers... lb # [ 9.526405] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.531271] systemd[1]: Finished Create System Files and Directories. client # [ 9.513750] systemd[1]: Mounted /run/wrappers. client # [ 9.515132] systemd[1]: Reached target Local File Systems. lb # [ 9.549324] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.520253] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.526861] systemd[1]: Starting register-nix-paths.service... client # [ 9.528993] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.565074] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 9.536225] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.547400] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.546714] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.554413] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.560236] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.640284] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.657733] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.670525] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 9.711894] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.690656] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.705521] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.707402] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 9.719932] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.755593] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 9.770419] systemd[1]: Starting Update is Completed... client # [ 9.763707] systemd[1]: Finished Create System Files and Directories. client # [ 9.776977] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 9.777913] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 9.781266] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 9.789243] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.842451] systemd[1]: Finished Update is Completed. worker1 # [ 9.840394] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.894600] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.900699] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 9.903616] systemd[1]: Starting Update is Completed... client # [ 9.937392] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.946248] systemd[1]: Starting Update is Completed... worker1 # [ 9.984422] systemd[1]: Finished Update is Completed. client # [ 10.015861] systemd[1]: Finished Update is Completed. lb # [ 10.281778] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 10.283481] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.260974] systemd[1]: Finished Firewall. worker1 # [ 10.393758] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 10.396492] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.474105] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.477143] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.509392] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.627310] systemd[1]: Finished register-nix-paths.service. client # [ 10.653664] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 10.666281] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 10.709036] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 10.792185] systemd[1]: Finished register-nix-paths.service. worker2 # [ 10.794560] systemd[1]: Reached target System Initialization. worker2 # [ 10.795429] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 10.802282] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 10.803252] systemd[1]: Reached target Timer Units. worker2 # [ 10.804109] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 10.808832] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 10.820446] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 10.821424] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 10.832827] systemd[1]: Reached target Socket Units. lb # [ 10.868531] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.869516] systemd[1]: Reached target System Initialization. lb # [ 10.872601] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 10.842374] systemd[1]: Reached target Basic System. lb # [ 10.875056] systemd[1]: Started niks3 garbage collection timer. worker2 # [ 10.849331] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 10.879888] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 10.886183] systemd[1]: Reached target Timer Units. lb # [ 10.887194] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 10.858662] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 10.892741] systemd[1]: Listening on niks3 server socket. lb # [ 10.896782] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 10.865707] systemd[1]: Starting Post-Boot Actions... lb # [ 10.898309] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 10.873697] systemd[1]: Finished Firewall. worker2 # [ 10.873633] systemd[1]: Started Reset console on configuration changes. lb # [ 10.903740] systemd[1]: Reached target Socket Units. lb # [ 10.908768] systemd[1]: Reached target Basic System. lb # [ 10.912302] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 10.884612] systemd[1]: Starting resolvconf update... lb # [ 10.918275] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 10.925170] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.893114] systemd[1]: Starting D-Bus System Message Bus... client # [ 10.900774] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 10.955728] systemd[1]: Started Reset console on configuration changes. worker2 # [ 10.939225] systemd[1]: Finished Post-Boot Actions. lb # [ 10.983446] systemd[1]: Starting resolvconf update... client # [ 10.963789] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 11.002657] systemd[1]: Started rustfs.service. worker2 # [ 10.989750] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.993116] nsncd[490]: Sep 20 14:30:44.564 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.005568] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.006758] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.041013] nsncd[497]: Sep 20 14:30:44.627 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.013419] systemd[1]: Starting User Login Management... lb # [ 11.049874] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 11.022719] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 11.029901] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.063894] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.066560] systemd[1]: Finished Firewall. lb # [ 11.074594] systemd[1]: Finished Post-Boot Actions. lb # [ 11.116648] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.087312] dbus-broker-launch[495]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 11.090689] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 11.126181] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.133467] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.138062] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 11.107501] dbus-broker-launch[495]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.108928] dbus-broker-launch[495]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.163463] systemd[1]: Starting User Login Management... worker2 # [ 11.149759] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.184899] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 11.172715] systemd-logind[502]: New seat seat0. client # [ 11.179367] systemd[1]: Finished register-nix-paths.service. client # [ 11.180546] systemd[1]: Reached target System Initialization. client # [ 11.184761] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 11.184671] systemd[1]: Started User Login Management. client # [ 11.187168] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.189282] systemd[1]: Reached target Timer Units. worker2 # [ 11.191539] systemd[1]: Starting linger-users.service... client # [ 11.194185] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.195121] systemd[1]: Listening on Nix Daemon Socket. client # [ 11.195879] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.204292] systemd[1]: Reached target Socket Units. client # [ 11.205057] systemd[1]: Reached target Basic System. client # [ 11.205768] systemd[1]: Started backdoor.service. client # [ 11.206447] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.212706] systemd[1]: Starting nftables firewall... worker2 # [ 11.212234] dbus-broker-launch[495]: Ready worker2 # [ 11.219295] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 11.224741] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.223972] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 11.234392] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 11.238646] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.244852] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 11.248703] systemd[1]: nscd.service: Deactivated successfully. client # [ 11.250019] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.254336] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 11.260709] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.264589] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.282579] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 11.296772] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.299940] systemd[1]: Finished linger-users.service. client # [ 11.310617] systemd[1]: Starting resolvconf update... client # [ 11.322461] (udev-worker)[325]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.323022] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.326025] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.329322] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 11.329560] nsncd[559]: Sep 20 14:30:44.900 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.333157] (udev-worker)[378]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 11.335539] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.347551] (udev-worker)[378]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 11.356223] systemd[1]: Finished register-nix-paths.service. worker1 # [ 11.359074] systemd[1]: Reached target System Initialization. worker1 # [ 11.360884] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 11.362912] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 11.365772] systemd[1]: Reached target Timer Units. worker2 # [ 11.366689] systemd[1]: Finished resolvconf update. worker1 # [ 11.369593] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 11.370301] systemd[1]: Reached target Preparation for Network. client # [ 11.371906] nsncd[398]: Sep 20 14:30:44.945 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.371499] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.406599] dbus-broker-launch[525]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 11.374765] systemd[1]: Starting DHCP Client... worker2 # [ 11.378413] systemd[1]: Starting Extra networking commands.... client # connecting to host... client # [ 11.382513] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.380725] systemd[1]: Listening on Nix worker-protocol over gRPC. lb # [ 11.417130] dbus-broker-launch[525]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.392221] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.394661] systemd[1]: Reached target Socket Units. lb # [ 11.428722] dbus-broker-launch[525]: Invalid user-name in /nix/store/r3k08synkldj3yxnxmc97ljig0y68d44-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 11.402533] systemd[1]: Reached target Basic System. worker1 # [ 11.409378] systemd[1]: Started backdoor.service. lb # [ 11.442889] systemd-logind[528]: New seat seat0. worker1 # [ 11.418186] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.415741] systemd[1]: Finished Post-Boot Actions. lb # [ 11.450919] systemd[1]: Started User Login Management. lb # [ 11.453421] systemd[1]: Starting linger-users.service... client: Guest shell says: b'Spawning backdoor root shell...\n' worker1 # [ 11.428554] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.436896] systemd[1]: Starting Post-Boot Actions... lb # [ 11.473568] systemd[1]: Started D-Bus System Message Bus. client # [ 11.451636] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.455610] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.442342] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.456171] systemd[1]: Starting resolvconf update... client # [ 11.467831] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 11.467209] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 11.500762] systemd[1]: Starting Virtual Console Setup... lb # [ 11.505814] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 11.476263] systemd[1]: Starting User Login Management... lb # [ 11.510497] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.488781] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 11.517585] systemd[1]: Stopped target User and Group Name Lookups. client: connected to guest root shell lb # [ 11.526752] systemd[1]: Stopping User and Group Name Lookups... client: (connecting took 11.99 seconds) lb # [ 11.535581] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client: (finished: waiting for the VM to finish booting, in 11.99 seconds) lb # [ 11.543701] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.528329] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 11.553942] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.559877] dbus-broker-launch[525]: Ready worker2 # [ 11.530242] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 11.532979] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.539219] systemd[1]: Starting Virtual Console Setup... lb # [ 11.571492] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 11.575728] systemd[1]: Finished linger-users.service. lb # [ 11.597579] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.576007] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.581810] systemd[1]: Reached target Host and Network Name Lookups. worker1 # connecting to host... worker1 # [ 11.592306] nsncd[498]: Sep 20 14:30:45.148 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.594344] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.595193] systemd[1]: Starting User Login Management... worker2 # [ 11.613875] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 11.620625] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 11.651172] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 11.651165] dhcpcd[594]: dhcpcd-10.3.2 starting lb # [ 11.697633] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.666068] dhcpcd[632]: dev: loaded udev lb # [ 11.701924] systemd[1]: Finished resolvconf update. worker2 # [ 11.674797] dhcpcd[632]: no valid interfaces found worker2 # [ 11.678241] dhcpcd[632]: no valid interfaces found worker2 # [ 11.681338] dhcpcd[632]: libudev: received NULL device lb # [ 11.707371] nsncd[591]: Sep 20 14:30:45.285 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 11.716566] systemd[1]: Reached target Preparation for Network. worker2 # [ 11.684761] dhcpcd[632]: libudev: received NULL device lb # [ 11.721516] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.726270] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.698310] dbus-broker-launch[502]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.730175] systemd[1]: Starting DHCP Client... lb # [ 11.735486] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.716206] dbus-broker-launch[502]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.721195] dbus-broker-launch[502]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.727235] dbus-broker-launch[428]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 11.736271] systemd[1]: Finished Extra networking commands.. worker2 # [ 11.737818] systemd[1]: Reached target Network. client # [ 11.739582] systemd-logind[430]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 11.741244] systemd[1]: Starting Permit User Sessions... client # [ 11.749607] systemd-logind[430]: New seat seat0. client # [ 11.753145] systemd[1]: Started User Login Management. client # [ 11.760487] systemd[1]: Starting linger-users.service... worker1 # [ 11.767221] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.798171] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client # [ 11.769435] dbus-broker-launch[428]: NSS returned no entry for 'systemd-timesync' client # [ 11.770466] dbus-broker-launch[428]: Invalid user-name in /nix/store/i87y3v12qnxz4jgnndbs0w0ih92vmmjw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.806255] systemd[1]: Started backdoor.service. worker2 # [ 11.783682] systemd[1]: Finished Permit User Sessions. worker2 # [ 11.788596] systemd[1]: Started Getty on tty1. worker2 # [ 11.790570] systemd[1]: Reached target Login Prompts. worker1 # [ 11.790484] systemd-logind[512]: New seat seat0. client # [ 11.798212] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 11.800356] systemd[1]: Started User Login Management. client # [ 11.803909] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 11.808261] systemd[1]: Starting linger-users.service... client # [ 11.810984] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.812001] systemd[1]: Stopping User and Group Name Lookups... client # [ 11.824825] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 11.832368] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 11.833351] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 11.834160] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.833515] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 11.834986] systemd[1]: Stopping User and Group Name Lookups... client # [ 11.834364] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 11.835783] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.846618] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 11.857794] dbus-broker-launch[502]: Ready worker1 # [ 11.861289] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 11.868822] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 11.872100] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.885789] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.886778] systemd[1]: linger-users.service: Deactivated successfully. client # [ 11.895416] systemd[1]: Finished linger-users.service. client # [ 11.901012] dbus-broker-launch[428]: Ready worker1 # [ 11.910956] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 11.913172] systemd[1]: Finished linger-users.service. client # [ 11.912725] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # connecting to host... worker1 # [ 11.946695] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.948741] nsncd[572]: Sep 20 14:30:45.517 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.950649] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.951532] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.960212] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 11.979314] (udev-worker)[372]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 11.985049] systemd[1]: Finished resolvconf update. worker1 # [ 11.985782] systemd[1]: Reached target Preparation for Network. worker1 # [ 11.992413] systemd[1]: Starting DHCP Client... client # [ 11.986515] nsncd[500]: Sep 20 14:30:45.558 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.996708] systemd[1]: Starting Extra networking commands.... client # [ 11.996261] systemd[1]: Finished resolvconf update. client # [ 11.996992] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.997812] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.998696] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 12.001463] (udev-worker)[361]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 12.005579] systemd[1]: Starting DHCP Client... worker2 # [ 12.008082] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 12.014311] (udev-worker)[361]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.013772] systemd[1]: Started backdoor.service. client # [ 12.045055] mousedev: PS/2 mouse device common for all mice lb # [ 12.076846] dhcpcd[620]: dhcpcd-10.3.2 starting lb # [ 12.093181] dhcpcd[664]: dev: loaded udev worker2 # [ 12.080863] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.167041] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.172380] systemd[1]: Finished Extra networking commands.. worker1 # [ 12.146766] systemd-logind[512]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 12.178736] systemd[1]: Reached target Network. lb # [ 12.189443] systemd[1]: Starting PostgreSQL Server... worker2 # [ 12.172795] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # connecting to host... lb # [ 12.199325] systemd[1]: Starting Permit User Sessions... lb # [ 12.222687] (udev-worker)[379]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 12.204981] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.205476] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.210587] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.210929] cfg80211: failed to load regulatory.db lb # [ 12.231411] (udev-worker)[379]: Network interface NamePolicy= disabled on kernel command line. client # [ 12.219248] dhcpcd[531]: dhcpcd-10.3.2 starting worker2 # [ 12.226621] (udev-worker)[652]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 12.233059] (udev-worker)[656]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.236295] dhcpcd[605]: dhcpcd-10.3.2 starting client # [ 12.236688] dhcpcd[542]: dev: loaded udev worker2 # [ 12.235658] (udev-worker)[652]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.245655] systemd-vconsole-setup[601]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 12.251382] dhcpcd[645]: dev: loaded udev worker2 # [ 12.253387] systemd[1]: Finished Virtual Console Setup. lb # [ 12.329640] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.293074] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.283870] systemd[1]: Finished nftables firewall. worker1 # [ 12.302494] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.287728] systemd[1]: Reached target Preparation for Network. client # [ 12.293284] systemd[1]: Starting Address configuration of eth1... lb # [ 12.326780] systemd[1]: Finished Permit User Sessions. client # [ 12.302325] systemd[1]: Starting Extra networking commands.... worker1 # [ 12.308525] systemd[1]: Finished Extra networking commands.. lb # [ 12.340395] systemd[1]: Started Getty on tty1. worker1 # [ 12.313085] systemd[1]: Reached target Network. worker1 # [ 12.315947] systemd[1]: Starting Permit User Sessions... lb # [ 12.347582] systemd[1]: Reached target Login Prompts. worker1 # [ 12.332641] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 12.331167] systemd-logind[430]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 12.338151] systemd[1]: Starting Address configuration of eth1... lb # [ 12.372475] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 12.398503] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 12.399003] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 12.404015] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 12.404323] cfg80211: failed to load regulatory.db lb # [ 12.392599] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.379911] mousedev: PS/2 mouse device common for all mice lb # [ 12.398969] dhcpcd[664]: no valid interfaces found lb # [ 12.402809] dhcpcd[664]: no valid interfaces found worker2 # [ 12.380431] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.384117] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.410267] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.421832] systemd[1]: Finished Permit User Sessions. client # [ 12.432425] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.426367] systemd[1]: Started Getty on tty1. worker2 # [ 12.425748] systemd-logind[502]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 12.430173] systemd[1]: Reached target Login Prompts. worker1 # [ 12.453656] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.454174] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.459441] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 12.459769] cfg80211: failed to load regulatory.db client # [ 12.457276] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 12.475605] network-addresses-eth1-start[547]: adding address 192.168.1.1/24... done lb # [ 12.525612] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 12.497698] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.497887] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.498380] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.487449] dhcpcd[632]: eth0: waiting for carrier worker2 # [ 12.489727] dhcpcd[632]: eth0: carrier acquired client # [ 12.503516] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.503854] cfg80211: failed to load regulatory.db client # [ 12.501421] network-addresses-eth1-start[547]: adding address 2001:db8:1::1/64... done worker2 # [ 12.514517] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 12.520687] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 12.537899] network-addresses-eth1-start[697]: adding address 192.168.1.2/24... done worker2 # [ 12.509797] dhcpcd[632]: DUID 00:01:00:01:32:42:aa:96:52:54:00:12:34:56 worker2 # [ 12.512258] dhcpcd[632]: eth0: IAID 00:12:34:56 worker2 # [ 12.513784] dhcpcd[632]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.525710] network-addresses-eth1-start[678]: adding address 192.168.1.4/24... done worker1 # [ 12.529830] network-addresses-eth1-start[660]: adding address 192.168.1.3/24... done lb # [ 12.559579] network-addresses-eth1-start[697]: adding address 2001:db8:1::2/64... done client # [ 12.533091] systemd[1]: Finished Address configuration of eth1. worker1 # [ 12.552901] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 12.540312] dhcpcd[645]: eth0: waiting for carrier worker2 # [ 12.539271] network-addresses-eth1-start[678]: adding address 2001:db8:1::4/64... done worker1 # [ 12.543622] dhcpcd[645]: eth0: waiting for carrier worker1 # [ 12.547129] dhcpcd[645]: eth0: carrier acquired lb # [ 12.581723] (udev-worker)[703]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.554852] network-addresses-eth1-start[660]: adding address 2001:db8:1::3/64... done worker2 # [ 12.560185] systemd[1]: Finished Address configuration of eth1. lb # [ 12.595532] systemd[1]: Finished Address configuration of eth1. worker1 # [ 12.565829] dhcpcd[645]: DUID 00:01:00:01:32:42:aa:96:52:54:00:12:34:56 worker1 # [ 12.567973] dhcpcd[645]: eth0: IAID 00:12:34:56 worker1 # [ 12.570345] dhcpcd[645]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 12.580305] systemd[1]: Finished Address configuration of eth1. client # [ 12.579701] dhcpcd[588]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (552) - Operation not permitted client # [ 12.585779] dhcpcd[588]: .resolvconf-wrapped: clearing stale lock pid 552 worker2 # [ 12.602434] mousedev: PS/2 mouse device common for all mice worker2 # [ 12.621430] dhcpcd[632]: eth0: soliciting a DHCP lease worker2 # [ 12.628490] dhcpcd[632]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 12.642430] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.632903] dhcpcd[542]: eth0: waiting for carrier worker1 # [ 12.633923] systemd-logind[512]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 12.636520] dhcpcd[632]: eth0: probing address 10.0.2.15/24 client # [ 12.635715] dhcpcd[542]: libudev: received NULL device client # [ 12.638903] dhcpcd[542]: libudev: received NULL device client # [ 12.641820] dhcpcd[542]: eth0: carrier acquired lb # [ 12.674227] postgresql-pre-start[699]: The files belonging to this database system will be owned by user "postgres". lb # [ 12.678272] postgresql-pre-start[699]: This user must also own the server process. client # [ 12.655764] systemd[1]: Finished Extra networking commands.. lb # [ 12.688956] postgresql-pre-start[699]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 12.690247] postgresql-pre-start[699]: The default database encoding has accordingly been set to "UTF8". client # [ 12.660370] systemd[1]: Reached target Network. lb # [ 12.691457] postgresql-pre-start[699]: The default text search configuration will be set to "english". client # [ 12.662469] dhcpcd[542]: DUID 00:01:00:01:32:42:aa:96:52:54:00:12:34:56 client # [ 12.663392] dhcpcd[542]: eth0: IAID 00:12:34:56 lb # [ 12.698033] postgresql-pre-start[699]: Data page checksums are enabled. client # [ 12.666961] dhcpcd[542]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 12.669491] systemd[1]: Starting Permit User Sessions... lb # [ 12.700743] postgresql-pre-start[699]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.704296] postgresql-pre-start[699]: creating subdirectories ... ok lb # [ 12.707793] postgresql-pre-start[699]: selecting dynamic shared memory implementation ... posix worker2 # [ 12.716712] systemd-logind[502]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 12.720342] systemd[1]: Finished Permit User Sessions. client # [ 12.728252] systemd[1]: Started Getty on tty1. client # [ 12.728958] systemd[1]: Reached target Login Prompts. lb # [ 12.842880] systemd-logind[528]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 12.906511] postgresql-pre-start[699]: selecting default "max_connections" ... 100 worker1 # [ 12.961408] dhcpcd[645]: eth0: soliciting a DHCP lease worker1 # [ 12.964560] dhcpcd[645]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 12.972205] dhcpcd[645]: eth0: probing address 10.0.2.15/24 lb # [ 13.027131] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 13.012350] dhcpcd[664]: eth0: waiting for carrier lb # [ 13.020759] dhcpcd[664]: eth0: carrier acquired client: (finished: waiting for unit network-addresses-eth1.service, in 13.45 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 13.044219] dhcpcd[664]: DUID 00:01:00:01:32:42:aa:96:52:54:00:12:34:56 lb # [ 13.045189] dhcpcd[664]: eth0: IAID 00:12:34:56 lb # [ 13.045817] dhcpcd[664]: eth0: adding address fe80::5054:ff:fe12:3456 client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 13.130435] postgresql-pre-start[699]: selecting default "shared_buffers" ... 128MB lb # [ 13.162498] mousedev: PS/2 mouse device common for all mice lb: (finished: waiting for unit network-addresses-eth1.service, in 0.14 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.06 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 13.307905] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 13.325890] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } lb # [ 13.393896] systemd-logind[528]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit niks3.service client # [ 13.631079] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.639958] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 13.661293] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 13.673253] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.674554] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 13.680934] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.684208] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.688242] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 13.690499] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.695857] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.699125] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 13.701475] systemd[1]: Starting Virtual Console Setup... client # [ 13.712492] systemd-logind[430]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 13.735000] systemd-logind[512]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 13.742561] systemd-logind[502]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 13.975972] dhcpcd[664]: eth0: soliciting a DHCP lease lb # [ 13.980559] dhcpcd[664]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 13.988204] dhcpcd[664]: eth0: probing address 10.0.2.15/24 worker2 # [ 14.015512] systemd-vconsole-setup[710]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.020401] systemd[1]: Finished Virtual Console Setup. client # [ 14.054815] systemd-vconsole-setup[649]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 14.058050] systemd[1]: Finished Virtual Console Setup. worker1 # [ 14.111095] systemd-vconsole-setup[710]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.116094] systemd[1]: Finished Virtual Console Setup. worker2 # [ 14.286169] dhcpcd[632]: eth0: soliciting an IPv6 router worker2 # [ 14.289674] dhcpcd[632]: eth0: Router Advertisement from fe80::2 worker2 # [ 14.292635] dhcpcd[632]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 14.295316] dhcpcd[632]: eth0: adding route to fec0::/64 worker2 # [ 14.297660] dhcpcd[632]: eth0: adding default route via fe80::2 lb # [ 14.389493] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 14.502349] dhcpcd[542]: eth0: soliciting a DHCP lease client # [ 14.509116] dhcpcd[542]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 14.512509] dhcpcd[542]: eth0: probing address 10.0.2.15/24 worker1 # [ 14.730322] dhcpcd[645]: eth0: soliciting an IPv6 router worker1 # [ 14.733647] dhcpcd[645]: eth0: Router Advertisement from fe80::2 worker1 # [ 14.736374] dhcpcd[645]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 14.739048] dhcpcd[645]: eth0: adding route to fec0::/64 worker1 # [ 14.741372] dhcpcd[645]: eth0: adding default route via fe80::2 lb # [ 14.830781] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 14.868075] systemd[1]: Starting Virtual Console Setup... lb # [ 14.954373] systemd-logind[528]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 15.004761] dhcpcd[664]: eth0: soliciting an IPv6 router lb # [ 15.007426] dhcpcd[664]: eth0: Router Advertisement from fe80::2 lb # [ 15.012292] dhcpcd[664]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 15.013184] dhcpcd[664]: eth0: adding route to fec0::/64 lb # [ 15.013896] dhcpcd[664]: eth0: adding default route via fe80::2 client # [ 15.066624] dhcpcd[542]: eth0: soliciting an IPv6 router client # [ 15.070552] dhcpcd[542]: eth0: Router Advertisement from fe80::2 client # [ 15.073228] dhcpcd[542]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 15.075923] dhcpcd[542]: eth0: adding route to fec0::/64 client # [ 15.078265] dhcpcd[542]: eth0: adding default route via fe80::2 lb # [ 15.346199] systemd-vconsole-setup[772]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 15.350432] systemd[1]: Finished Virtual Console Setup. lb # [ 15.655236] postgresql-pre-start[699]: selecting default time zone ... UTC lb # [ 15.662137] postgresql-pre-start[699]: creating configuration files ... ok lb # [ 15.958817] postgresql-pre-start[699]: running bootstrap script ... ok lb # [ 16.605838] postgresql-pre-start[699]: performing post-bootstrap initialization ... ok lb # [ 16.747590] postgresql-pre-start[699]: syncing data to disk ... ok lb # [ 16.749747] postgresql-pre-start[699]: initdb: warning: enabling "trust" authentication for local connections lb # [ 16.751035] postgresql-pre-start[699]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 16.753155] postgresql-pre-start[699]: Success. You can now start the database server using: lb # [ 16.754350] postgresql-pre-start[699]: pg_ctl -D /var/lib/postgresql/18 -l logfile start worker2 # [ 16.828800] dhcpcd[632]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 16.833487] dhcpcd[632]: eth0: adding route to 10.0.2.0/24 worker2 # [ 16.838508] dhcpcd[632]: eth0: adding default route via 10.0.2.2 lb # [ 16.879617] postgres[797]: [797] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 16.883863] postgres[797]: [797] LOG: listening on IPv6 address "::1", port 5432 lb # [ 16.885258] postgres[797]: [797] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 16.887820] postgres[797]: [797] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 16.899489] postgres[806]: [806] LOG: database system was shut down at 2026-09-20 14:30:50 GMT lb # [ 16.906290] postgres[797]: [797] LOG: database system is ready to accept connections lb # [ 16.911685] systemd[1]: Started PostgreSQL Server. lb # [ 16.917548] systemd[1]: Starting PostgreSQL Setup Scripts... worker2 # [ 17.013446] systemd[1]: Started DHCP Client. worker2 # [ 17.015289] systemd[1]: Reached target Multi-User System. worker2 # [ 17.016455] systemd[1]: Startup finished in 994ms (kernel) + 4.643s (initrd) + 11.376s (userspace) = 17.015s. lb # [ 17.177483] postgresql-setup-start[821]: CREATE DATABASE lb # [ 17.229000] postgresql-setup-start[831]: CREATE ROLE lb # [ 17.253301] postgresql-setup-start[833]: ALTER DATABASE lb # [ 17.260165] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 17.261886] systemd[1]: Reached target PostgreSQL. worker1 # [ 18.058045] dhcpcd[645]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 18.061605] dhcpcd[645]: eth0: adding route to 10.0.2.0/24 worker1 # [ 18.064642] dhcpcd[645]: eth0: adding default route via 10.0.2.2 worker1 # [ 18.232284] systemd[1]: Started DHCP Client. worker1 # [ 18.234317] systemd[1]: Reached target Multi-User System. worker1 # [ 18.235177] systemd[1]: Startup finished in 1.004s (kernel) + 5.371s (initrd) + 11.858s (userspace) = 18.234s. lb # [ 18.945010] dhcpcd[664]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 18.949310] dhcpcd[664]: eth0: adding route to 10.0.2.0/24 lb # [ 18.951615] dhcpcd[664]: eth0: adding default route via 10.0.2.2 lb # [ 19.125864] systemd[1]: Started DHCP Client. lb # [ 19.127677] systemd[1]: Reached target Network is Online. lb # [ 19.132946] systemd[1]: Started Envoy reverse proxy. lb # [ 19.140565] systemd[1]: Started mock-oidc.service. lb # [ 19.245807] mock-oidc-server[902]: Mock OIDC Server running lb # [ 19.246678] mock-oidc-server[902]: OIDC Address: 192.168.1.2:8080 lb # [ 19.247495] mock-oidc-server[902]: Issue Address: 0.0.0.0:8081 lb # [ 19.249676] mock-oidc-server[902]: Issuer: http://192.168.1.2:8080/oidc lb # [ 19.253454] mock-oidc-server[902]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 19.256505] mock-oidc-server[902]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 19.260367] mock-oidc-server[902]: Issue tokens: http://0.0.0.0:8081/issue?sub=... client # [ 19.372511] dhcpcd[542]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 19.376520] dhcpcd[542]: eth0: adding route to 10.0.2.0/24 client # [ 19.378830] dhcpcd[542]: eth0: adding default route via 10.0.2.2 client # [ 19.535202] systemd[1]: Started DHCP Client. client # [ 19.537440] systemd[1]: Reached target Multi-User System. client # [ 19.538712] systemd[1]: Startup finished in 997ms (kernel) + 5.518s (initrd) + 13.023s (userspace) = 19.538s. lb # [ 19.807574] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 19.809614] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 19.811406] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 19.813965] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 19.831410] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 19.836372] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 19.841244] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 19.844942] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 19.847050] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 19.849380] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 19.852219] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 19.883859] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 19.886912] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 19.896737] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 19.899014] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 19.901314] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 19.904097] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 19.910416] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 19.912719] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 19.915353] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 19.922949] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 19.926761] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 19.929872] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 19.935329] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 19.937574] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 19.942627] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 19.945362] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 19.948139] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 19.951234] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 19.953187] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 19.955905] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 19.959138] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 19.963147] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 19.970235] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 19.976940] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 19.978903] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 19.985899] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 19.988682] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 19.991844] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 19.993838] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 20.001380] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 20.004618] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 20.007268] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.009840] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 20.012699] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 20.015516] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 20.017777] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 20.022527] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 20.031040] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 20.033803] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 20.035715] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 20.038870] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 20.041552] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 20.045965] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 20.048061] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 20.049748] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 20.053526] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 20.055699] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 20.058543] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 20.060518] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 20.063037] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 20.067943] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 20.070237] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 20.072273] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 20.077273] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.080158] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 20.081911] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 20.083787] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 20.086680] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 20.088612] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 20.090355] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 20.093916] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 20.095829] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 20.099629] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 20.102078] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 20.105314] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 20.111018] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 20.113356] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 20.115303] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 20.119486] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 20.124625] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 20.126862] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 20.129018] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 20.143038] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 20.144986] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 20.147790] envoy[901]: [2026-09-20 14:30:53.393][901][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 20.149983] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 20.151764] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 20.154756] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 20.157182] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 20.159069] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 20.163278] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 20.166486] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.168992] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 20.171500] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 20.174841] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 20.176706] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 20.180123] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 20.182422] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 20.184520] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 20.186714] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 20.198126] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 20.199852] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.202835] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 20.205099] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 20.207015] envoy[901]: [2026-09-20 14:30:53.394][901][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 20.209209] envoy[901]: [2026-09-20 14:30:53.414][901][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 20.210674] envoy[901]: [2026-09-20 14:30:53.416][901][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 20.226596] envoy[901]: [2026-09-20 14:30:53.416][901][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 20.228614] envoy[901]: [2026-09-20 14:30:53.416][901][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 20.237485] envoy[901]: [2026-09-20 14:30:53.416][901][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 20.239483] envoy[901]: [2026-09-20 14:30:53.667][901][info][main] [source/server/server.cc:968] runtime: {} lb # [ 20.240986] envoy[901]: [2026-09-20 14:30:53.691][901][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 20.242715] envoy[901]: [2026-09-20 14:30:53.691][901][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 20.244584] envoy[901]: [2026-09-20 14:30:53.692][901][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 20.246316] envoy[901]: [2026-09-20 14:30:53.702][901][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 20.247914] envoy[901]: [2026-09-20 14:30:53.702][901][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 20.249786] envoy[901]: [2026-09-20 14:30:53.702][901][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 20.271472] envoy[901]: [2026-09-20 14:30:53.858][901][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 20.243973] systemd[1]: Reached target Network is Online. lb # [ 20.282035] envoy[901]: [2026-09-20 14:30:53.869][901][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 20.284839] envoy[901]: [2026-09-20 14:30:53.871][901][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. worker1 # [ 20.253973] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 20.288199] envoy[901]: [2026-09-20 14:30:53.871][901][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 20.255119] systemd[1]: Starting scheduler-token.service... worker2 # [ 20.376781] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 20.383329] systemd[1]: Finished scheduler-token.service. worker2 # [ 20.385554] systemd[1]: scheduler-token.service: Consumed 53ms CPU time over 124ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 20.391036] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 20.503311] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 20.515528] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 20.518137] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 20.568805] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 20.570524] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 20.607250] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb # [ 20.638820] envoy[901]: [2026-09-20 14:30:54.225][901][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 20.645844] envoy[901]: [2026-09-20 14:30:54.225][901][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker2 # [ 20.620521] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc lb # [ 20.651396] envoy[901]: [2026-09-20 14:30:54.225][901][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker2 # [ 20.622896] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 20.656906] envoy[901]: [2026-09-20 14:30:54.225][901][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 20.643291] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.647684] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.666020] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 20.667695] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 20.729053] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.730873] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.848863] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.853927] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.932393] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.937280] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.054762] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.059878] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.138411] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.143421] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.260717] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.265827] nix-grpc-daemon[775]: ts=2026-09-20T14:30:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.344691] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.349544] nix-grpc-daemon[778]: ts=2026-09-20T14:30:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.466597] nix-grpc-daemon[775]: ts=2026-09-20T14:30:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.471635] nix-grpc-daemon[775]: ts=2026-09-20T14:30:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.550708] nix-grpc-daemon[778]: ts=2026-09-20T14:30:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.555669] nix-grpc-daemon[778]: ts=2026-09-20T14:30:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.674137] nix-grpc-daemon[775]: ts=2026-09-20T14:30:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.678264] nix-grpc-daemon[775]: ts=2026-09-20T14:30:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.758385] nix-grpc-daemon[778]: ts=2026-09-20T14:30:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.762439] nix-grpc-daemon[778]: ts=2026-09-20T14:30:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.874582] nix-grpc-daemon[775]: ts=2026-09-20T14:30:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.879696] nix-grpc-daemon[775]: ts=2026-09-20T14:30:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.959042] nix-grpc-daemon[778]: ts=2026-09-20T14:30:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.964178] nix-grpc-daemon[778]: ts=2026-09-20T14:30:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.080592] nix-grpc-daemon[775]: ts=2026-09-20T14:30:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.085535] nix-grpc-daemon[775]: ts=2026-09-20T14:30:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.165291] nix-grpc-daemon[778]: ts=2026-09-20T14:30:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.170781] nix-grpc-daemon[778]: ts=2026-09-20T14:30:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.286406] nix-grpc-daemon[775]: ts=2026-09-20T14:30:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.291496] nix-grpc-daemon[775]: ts=2026-09-20T14:30:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.371916] nix-grpc-daemon[778]: ts=2026-09-20T14:30:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.376695] nix-grpc-daemon[778]: ts=2026-09-20T14:30:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.492323] nix-grpc-daemon[775]: ts=2026-09-20T14:30:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.501331] nix-grpc-daemon[775]: ts=2026-09-20T14:30:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.578079] nix-grpc-daemon[778]: ts=2026-09-20T14:30:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.583326] nix-grpc-daemon[778]: ts=2026-09-20T14:30:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.699963] nix-grpc-daemon[775]: ts=2026-09-20T14:30:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.703760] nix-grpc-daemon[775]: ts=2026-09-20T14:30:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.786040] nix-grpc-daemon[778]: ts=2026-09-20T14:30:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.790173] nix-grpc-daemon[778]: ts=2026-09-20T14:30:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.900756] nix-grpc-daemon[775]: ts=2026-09-20T14:30:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.906280] nix-grpc-daemon[775]: ts=2026-09-20T14:30:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.987008] nix-grpc-daemon[778]: ts=2026-09-20T14:30:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.992387] nix-grpc-daemon[778]: ts=2026-09-20T14:30:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.107145] nix-grpc-daemon[775]: ts=2026-09-20T14:30:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.112402] nix-grpc-daemon[775]: ts=2026-09-20T14:30:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.193521] nix-grpc-daemon[778]: ts=2026-09-20T14:30:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.198818] nix-grpc-daemon[778]: ts=2026-09-20T14:30:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.313111] nix-grpc-daemon[775]: ts=2026-09-20T14:30:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.318111] nix-grpc-daemon[775]: ts=2026-09-20T14:30:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.399884] nix-grpc-daemon[778]: ts=2026-09-20T14:30:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.405169] nix-grpc-daemon[778]: ts=2026-09-20T14:30:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.518931] nix-grpc-daemon[775]: ts=2026-09-20T14:30:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.524146] nix-grpc-daemon[775]: ts=2026-09-20T14:30:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.606196] nix-grpc-daemon[778]: ts=2026-09-20T14:30:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.611486] nix-grpc-daemon[778]: ts=2026-09-20T14:30:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.726008] nix-grpc-daemon[775]: ts=2026-09-20T14:30:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.730692] nix-grpc-daemon[775]: ts=2026-09-20T14:30:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.814267] nix-grpc-daemon[778]: ts=2026-09-20T14:30:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.818385] nix-grpc-daemon[778]: ts=2026-09-20T14:30:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.927675] nix-grpc-daemon[775]: ts=2026-09-20T14:30:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.932863] nix-grpc-daemon[775]: ts=2026-09-20T14:30:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.015169] nix-grpc-daemon[778]: ts=2026-09-20T14:30:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.020448] nix-grpc-daemon[778]: ts=2026-09-20T14:30:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.133731] nix-grpc-daemon[775]: ts=2026-09-20T14:30:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.138887] nix-grpc-daemon[775]: ts=2026-09-20T14:30:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.221643] nix-grpc-daemon[778]: ts=2026-09-20T14:30:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.226875] nix-grpc-daemon[778]: ts=2026-09-20T14:30:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.339749] nix-grpc-daemon[775]: ts=2026-09-20T14:30:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.344826] nix-grpc-daemon[775]: ts=2026-09-20T14:30:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.427938] nix-grpc-daemon[778]: ts=2026-09-20T14:30:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.433044] nix-grpc-daemon[778]: ts=2026-09-20T14:30:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.545625] nix-grpc-daemon[775]: ts=2026-09-20T14:30:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.550651] nix-grpc-daemon[775]: ts=2026-09-20T14:30:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.634480] nix-grpc-daemon[778]: ts=2026-09-20T14:30:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.639669] nix-grpc-daemon[778]: ts=2026-09-20T14:30:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.752836] nix-grpc-daemon[775]: ts=2026-09-20T14:30:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.757464] nix-grpc-daemon[775]: ts=2026-09-20T14:30:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.842751] nix-grpc-daemon[778]: ts=2026-09-20T14:30:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.846910] nix-grpc-daemon[778]: ts=2026-09-20T14:30:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.958233] nix-grpc-daemon[775]: ts=2026-09-20T14:30:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.963383] nix-grpc-daemon[775]: ts=2026-09-20T14:30:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.043613] nix-grpc-daemon[778]: ts=2026-09-20T14:30:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.049073] nix-grpc-daemon[778]: ts=2026-09-20T14:30:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.164105] nix-grpc-daemon[775]: ts=2026-09-20T14:30:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.169160] nix-grpc-daemon[775]: ts=2026-09-20T14:30:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.250137] nix-grpc-daemon[778]: ts=2026-09-20T14:30:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.255497] nix-grpc-daemon[778]: ts=2026-09-20T14:30:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.369967] nix-grpc-daemon[775]: ts=2026-09-20T14:30:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.374890] nix-grpc-daemon[775]: ts=2026-09-20T14:30:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.456699] nix-grpc-daemon[778]: ts=2026-09-20T14:30:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.461615] nix-grpc-daemon[778]: ts=2026-09-20T14:30:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.575663] nix-grpc-daemon[775]: ts=2026-09-20T14:30:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.580801] nix-grpc-daemon[775]: ts=2026-09-20T14:30:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.662564] nix-grpc-daemon[778]: ts=2026-09-20T14:30:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.666532] nix-grpc-daemon[778]: ts=2026-09-20T14:30:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.783320] nix-grpc-daemon[775]: ts=2026-09-20T14:30:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.787698] nix-grpc-daemon[775]: ts=2026-09-20T14:30:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.869075] nix-grpc-daemon[778]: ts=2026-09-20T14:30:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.873089] nix-grpc-daemon[778]: ts=2026-09-20T14:30:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.983848] nix-grpc-daemon[775]: ts=2026-09-20T14:30:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.989178] nix-grpc-daemon[775]: ts=2026-09-20T14:30:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.069855] nix-grpc-daemon[778]: ts=2026-09-20T14:30:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.074930] nix-grpc-daemon[778]: ts=2026-09-20T14:30:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.190085] nix-grpc-daemon[775]: ts=2026-09-20T14:30:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.195230] nix-grpc-daemon[775]: ts=2026-09-20T14:30:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.276199] nix-grpc-daemon[778]: ts=2026-09-20T14:30:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.281282] nix-grpc-daemon[778]: ts=2026-09-20T14:30:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.396120] nix-grpc-daemon[775]: ts=2026-09-20T14:30:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.401279] nix-grpc-daemon[775]: ts=2026-09-20T14:30:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.482536] nix-grpc-daemon[778]: ts=2026-09-20T14:31:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.487743] nix-grpc-daemon[778]: ts=2026-09-20T14:31:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.602192] nix-grpc-daemon[775]: ts=2026-09-20T14:31:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.607538] nix-grpc-daemon[775]: ts=2026-09-20T14:31:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.688869] nix-grpc-daemon[778]: ts=2026-09-20T14:31:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.693954] nix-grpc-daemon[778]: ts=2026-09-20T14:31:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.810318] nix-grpc-daemon[775]: ts=2026-09-20T14:31:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.814486] nix-grpc-daemon[775]: ts=2026-09-20T14:31:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.896866] nix-grpc-daemon[778]: ts=2026-09-20T14:31:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.900945] nix-grpc-daemon[778]: ts=2026-09-20T14:31:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.010980] nix-grpc-daemon[775]: ts=2026-09-20T14:31:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.016379] nix-grpc-daemon[775]: ts=2026-09-20T14:31:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.098035] nix-grpc-daemon[778]: ts=2026-09-20T14:31:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.103129] nix-grpc-daemon[778]: ts=2026-09-20T14:31:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.217108] nix-grpc-daemon[775]: ts=2026-09-20T14:31:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.222163] nix-grpc-daemon[775]: ts=2026-09-20T14:31:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.304122] nix-grpc-daemon[778]: ts=2026-09-20T14:31:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.309063] nix-grpc-daemon[778]: ts=2026-09-20T14:31:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.422933] nix-grpc-daemon[775]: ts=2026-09-20T14:31:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.428153] nix-grpc-daemon[775]: ts=2026-09-20T14:31:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.510259] nix-grpc-daemon[778]: ts=2026-09-20T14:31:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.515320] nix-grpc-daemon[778]: ts=2026-09-20T14:31:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.628911] nix-grpc-daemon[775]: ts=2026-09-20T14:31:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.635519] nix-grpc-daemon[775]: ts=2026-09-20T14:31:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.716384] nix-grpc-daemon[778]: ts=2026-09-20T14:31:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.721346] nix-grpc-daemon[778]: ts=2026-09-20T14:31:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.837905] nix-grpc-daemon[775]: ts=2026-09-20T14:31:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.842010] nix-grpc-daemon[775]: ts=2026-09-20T14:31:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.924480] nix-grpc-daemon[778]: ts=2026-09-20T14:31:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.928536] nix-grpc-daemon[778]: ts=2026-09-20T14:31:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.038693] nix-grpc-daemon[775]: ts=2026-09-20T14:31:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.043832] nix-grpc-daemon[775]: ts=2026-09-20T14:31:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.125337] nix-grpc-daemon[778]: ts=2026-09-20T14:31:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.130621] nix-grpc-daemon[778]: ts=2026-09-20T14:31:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.244661] nix-grpc-daemon[775]: ts=2026-09-20T14:31:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.249708] nix-grpc-daemon[775]: ts=2026-09-20T14:31:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.332193] nix-grpc-daemon[778]: ts=2026-09-20T14:31:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.337262] nix-grpc-daemon[778]: ts=2026-09-20T14:31:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.450625] nix-grpc-daemon[775]: ts=2026-09-20T14:31:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.455790] nix-grpc-daemon[775]: ts=2026-09-20T14:31:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.538437] nix-grpc-daemon[778]: ts=2026-09-20T14:31:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.543729] nix-grpc-daemon[778]: ts=2026-09-20T14:31:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.656642] nix-grpc-daemon[775]: ts=2026-09-20T14:31:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.661882] nix-grpc-daemon[775]: ts=2026-09-20T14:31:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.744881] nix-grpc-daemon[778]: ts=2026-09-20T14:31:02Z level=info event=scheduler_connected addr=lb:50051 lb # [ 28.782045] rustfs-bucket-start[1000]: mb s3://farm worker2 # [ 28.750074] nix-grpc-daemon[778]: ts=2026-09-20T14:31:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 28.792758] systemd[1]: Finished rustfs-bucket.service. lb # [ 28.803977] systemd[1]: Starting niks3 server... worker1 # [ 28.864528] nix-grpc-daemon[775]: ts=2026-09-20T14:31:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.868999] nix-grpc-daemon[775]: ts=2026-09-20T14:31:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.953061] nix-grpc-daemon[778]: ts=2026-09-20T14:31:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.964187] nix-grpc-daemon[778]: ts=2026-09-20T14:31:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.060799] postgres[1017]: [1017] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 29.062082] postgres[1017]: [1017] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 29.096971] niks3-server[1010]: 2026/09/20 14:31:02 OK 20241026095416_initial_model.sql (21.43ms) worker1 # [ 29.064755] nix-grpc-daemon[775]: ts=2026-09-20T14:31:02Z level=info event=scheduler_connected addr=lb:50051 lb # [ 29.100406] niks3-server[1010]: 2026/09/20 14:31:02 OK 20251210153512_drop_unused_gin_index.sql (1.85ms) worker1 # [ 29.069867] nix-grpc-daemon[775]: ts=2026-09-20T14:31:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.106017] niks3-server[1010]: 2026/09/20 14:31:02 OK 20251218171726_add_pins.sql (5.54ms) lb # [ 29.110680] niks3-server[1010]: 2026/09/20 14:31:02 OK 20260628120000_add_object_size_and_stats.sql (4.63ms) lb # [ 29.115533] niks3-server[1010]: 2026/09/20 14:31:02 OK 20260905000000_add_claims.sql (4.82ms) lb # [ 29.120053] niks3-server[1010]: 2026/09/20 14:31:02 OK 20260920000000_drop_claims.sql (4.37ms) lb # [ 29.121292] niks3-server[1010]: 2026/09/20 14:31:02 goose: successfully migrated database to version: 20260920000000 lb # [ 29.126510] niks3-server[1010]: 2026/09/20 14:31:02 OK 1_commit_pending_closure.sql (6.46ms) lb # [ 29.129141] niks3-server[1010]: 2026/09/20 14:31:02 OK 2_object_stats_trigger.sql (2.51ms) lb # [ 29.130552] niks3-server[1010]: 2026/09/20 14:31:02 goose: up to current file version: 2 lb # [ 29.134378] niks3-server[1010]: 2026/09/20 14:31:02 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 29.179157] niks3-server[1010]: 2026/09/20 14:31:02 INFO Read proxy enabled — serving cache objects from S3 lb # [ 29.181143] niks3-server[1010]: 2026/09/20 14:31:02 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 29.185846] niks3-server[1010]: 2026/09/20 14:31:02 INFO systemd watchdog enabled interval=15s worker2 # [ 29.153773] nix-grpc-daemon[778]: ts=2026-09-20T14:31:02Z level=info event=scheduler_connected addr=lb:50051 lb # [ 29.189176] niks3-server[1010]: 2026/09/20 14:31:02 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 29.190817] systemd[1]: Started niks3 server. lb # [ 29.191501] systemd[1]: Reached target Multi-User System. lb # [ 29.192931] systemd[1]: Startup finished in 983ms (kernel) + 5.347s (initrd) + 22.856s (userspace) = 29.187s. worker2 # [ 29.159036] nix-grpc-daemon[778]: ts=2026-09-20T14:31:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 29.200130] niks3-server[1010]: 2026/09/20 14:31:02 INFO lead: acquired remote=192.168.1.4:38922 worker2 # [ 29.172610] nix-grpc-daemon[778]: ts=2026-09-20T14:31:02Z level=info event=scheduler_take_over worker1 # [ 29.270521] nix-grpc-daemon[775]: ts=2026-09-20T14:31:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.273802] nix-grpc-daemon[775]: ts=2026-09-20T14:31:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 15.76 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! worker2 # [ 29.360249] nix-grpc-daemon[778]: ts=2026-09-20T14:31:02Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds) lb: waiting for unit envoy.service worker2 # [ 29.365245] nix-grpc-daemon[778]: ts=2026-09-20T14:31:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit envoy.service, in 0.06 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 29.498058] envoy[901]: conn peer=[::1]:58792 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) worker1 # [ 29.475693] nix-grpc-daemon[775]: ts=2026-09-20T14:31:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.482115] nix-grpc-daemon[775]: ts=2026-09-20T14:31:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.566482] nix-grpc-daemon[778]: ts=2026-09-20T14:31:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.576169] nix-grpc-daemon[778]: ts=2026-09-20T14:31:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.654728] systemd[1]: Starting scheduler-token.service... worker1 # [ 29.676555] nix-grpc-daemon[775]: ts=2026-09-20T14:31:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.681864] nix-grpc-daemon[775]: ts=2026-09-20T14:31:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.746351] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 29.750199] systemd[1]: Finished scheduler-token.service. worker2 # [ 29.751326] systemd[1]: scheduler-token.service: Consumed 35ms CPU time over 94ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 29.772792] nix-grpc-daemon[778]: ts=2026-09-20T14:31:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.792100] nix-grpc-daemon[778]: ts=2026-09-20T14:31:03Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 29.795472] nix-grpc-daemon[778]: ts=2026-09-20T14:31:03Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:34550 worker2 # [ 29.799336] nix-grpc-daemon[778]: ts=2026-09-20T14:31:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 29.883889] nix-grpc-daemon[775]: ts=2026-09-20T14:31:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.882805] nix-grpc-daemon[778]: ts=2026-09-20T14:31:03Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:34550 worker2 # [ 29.888405] nix-grpc-daemon[778]: ts=2026-09-20T14:31:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.83 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 31.049555] nix-grpc-daemon[778]: ts=2026-09-20T14:31:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 31.066687] systemd[1]: Started Nix Daemon. worker2 # [ 31.323980] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 31.361674] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 1/5) worker2 # [ 31.408644] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 2/5) worker2 # [ 31.449993] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 169 ms (attempt 3/5) worker2 # [ 31.626740] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 4/5) worker2 # [ 31.691526] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 31.731002] nix-grpc-daemon[775]: ts=2026-09-20T14:31:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 31.749150] systemd[1]: Started Nix Daemon. worker1 # [ 32.031988] nix-daemon[835]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 32.060504] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 1/5) worker1 # [ 32.118991] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 2/5) worker1 # [ 32.264090] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 295 ms (attempt 3/5) worker1 # [ 32.566593] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 634 ms (attempt 4/5) worker1 # [ 33.205593] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 33.217215] nix-grpc-daemon[775]: ts=2026-09-20T14:31:06Z level=debug event=path_info_miss path=c59dy5901id87cijqm6p1wgx5fgpmqry-nixos-system-client-test error="error: path '/nix/store/c59dy5901id87cijqm6p1wgx5fgpmqry-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 33.229496] nix-grpc-daemon[778]: ts=2026-09-20T14:31:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 33.245140] nix-grpc-daemon[778]: ts=2026-09-20T14:31:06Z level=debug event=path_info_miss path=c59dy5901id87cijqm6p1wgx5fgpmqry-nixos-system-client-test error="error: path '/nix/store/c59dy5901id87cijqm6p1wgx5fgpmqry-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds) client: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds) worker2 # [ 33.675969] nix-grpc-daemon[778]: ts=2026-09-20T14:31:07Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:48684 worker2 # [ 33.692575] nix-grpc-daemon[778]: ts=2026-09-20T14:31:07Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:48684 worker2 # [ 33.704844] nix-grpc-daemon[778]: ts=2026-09-20T14:31:07Z level=debug event=path_info_miss path=c59dy5901id87cijqm6p1wgx5fgpmqry-nixos-system-client-test error="error: path '/nix/store/c59dy5901id87cijqm6p1wgx5fgpmqry-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 33.719032] nix-grpc-daemon[778]: ts=2026-09-20T14:31:07Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:48684 worker2 # [ 33.726918] nix-grpc-daemon[778]: ts=2026-09-20T14:31:07Z level=debug event=path_info_miss path=c59dy5901id87cijqm6p1wgx5fgpmqry-nixos-system-client-test error="error: path '/nix/store/c59dy5901id87cijqm6p1wgx5fgpmqry-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds) worker2 # [ 34.025647] nix-grpc-daemon[778]: ts=2026-09-20T14:31:07Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 34.286124] nix-grpc-daemon[775]: ts=2026-09-20T14:31:07Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.61 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 34.574238] nix-grpc-daemon[778]: ts=2026-09-20T14:31:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 34.581736] nix-grpc-daemon[778]: ts=2026-09-20T14:31:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 34.634110] nix-grpc-daemon[778]: ts=2026-09-20T14:31:08Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 34.641251] nix-grpc-daemon[778]: ts=2026-09-20T14:31:08Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 34.701091] nix-grpc-daemon[778]: ts=2026-09-20T14:31:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 34.724402] nix-grpc-daemon[778]: ts=2026-09-20T14:31:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48684 client # copying 1 paths to 'lb:50051'... worker2 # [ 34.744167] nix-grpc-daemon[778]: ts=2026-09-20T14:31:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker2 # [ 34.781883] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 34.820204] nix-grpc-daemon[778]: ts=2026-09-20T14:31:08Z level=info event=niks3_push_started pid=870 worker2 # [ 35.162705] nix-grpc-daemon[870]: time=2026-09-20T14:31:08.736Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 35.380135] nix-daemon[858]: accepted connection from pid 883, user nix-grpc-daemon (trusted) worker2 # [ 35.399702] nix-daemon[858]: reaped child process 886, status = succeeded worker2 # [ 35.624738] nix-daemon[858]: accepted connection from pid 888, user nix-grpc-daemon (trusted) worker2 # [ 35.671675] nix-daemon[858]: reaped child process 891, status = succeeded lb # [ 35.714529] niks3-server[1010]: 2026/09/20 14:31:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 35.706408] nix-grpc-daemon[870]: time=2026-09-20T14:31:09.282Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 35.711081] nix-grpc-daemon[870]: time=2026-09-20T14:31:09.282Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 35.784723] niks3-server[1010]: 2026/09/20 14:31:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 35.789507] niks3-server[1010]: 2026/09/20 14:31:09 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 35.816435] niks3-server[1010]: 2026/09/20 14:31:09 INFO Signed narinfos id=1 count=1 worker2 # [ 35.786788] nix-grpc-daemon[870]: time=2026-09-20T14:31:09.362Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.835149] niks3-server[1010]: 2026/09/20 14:31:09 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 35.844951] niks3-server[1010]: 2026/09/20 14:31:09 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 35.852414] niks3-server[1010]: 2026/09/20 14:31:09 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo lb # [ 35.858974] niks3-server[1010]: 2026/09/20 14:31:09 INFO Completed upload id=1 worker2 # [ 35.827389] nix-grpc-daemon[870]: time=2026-09-20T14:31:09.403Z level=INFO msg="Upload complete. (656ms)" worker2 # [ 35.843491] nix-grpc-daemon[778]: ts=2026-09-20T14:31:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=1 paths=1 nar_bytes_in=504 worker2 # [ 35.860407] nix-grpc-daemon[778]: ts=2026-09-20T14:31:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 35.870586] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 35.876970] nix-daemon[858]: reaped child process 868, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker2 # [ 35.893682] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-t1 worker2 # [ 37.354504] nix-daemon[858]: reaped child process 896, status = succeeded worker2 # [ 37.570743] nix-daemon[858]: accepted connection from pid 911, user nix-grpc-daemon (trusted) worker2 # [ 37.590634] nix-daemon[858]: reaped child process 914, status = succeeded lb # [ 37.638015] niks3-server[1010]: 2026/09/20 14:31:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 37.626738] nix-grpc-daemon[870]: time=2026-09-20T14:31:11.201Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 37.628878] nix-grpc-daemon[870]: time=2026-09-20T14:31:11.201Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 37.715203] niks3-server[1010]: 2026/09/20 14:31:11 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 37.732380] niks3-server[1010]: 2026/09/20 14:31:11 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 37.743599] niks3-server[1010]: 2026/09/20 14:31:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 37.751067] niks3-server[1010]: 2026/09/20 14:31:11 INFO Signed narinfos id=2 count=1 worker2 # [ 37.718557] nix-grpc-daemon[870]: time=2026-09-20T14:31:11.292Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.754250] niks3-server[1010]: 2026/09/20 14:31:11 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 37.772106] niks3-server[1010]: 2026/09/20 14:31:11 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 37.781673] niks3-server[1010]: 2026/09/20 14:31:11 INFO Completed upload id=2 worker2 # [ 37.750082] nix-grpc-daemon[870]: time=2026-09-20T14:31:11.326Z level=INFO msg="Upload complete. (442ms)" lb # [ 37.786440] niks3-server[1010]: 2026/09/20 14:31:11 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker2 # [ 37.788939] nix-grpc-daemon[778]: ts=2026-09-20T14:31:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 37.804240] nix-grpc-daemon[778]: ts=2026-09-20T14:31:11Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 37.807438] nix-grpc-daemon[778]: ts=2026-09-20T14:31:11Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 37.811174] nix-daemon[858]: reaped child process 894, status = succeeded worker2 # [ 37.830869] nix-grpc-daemon[778]: ts=2026-09-20T14:31:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 37.853227] nix-grpc-daemon[778]: ts=2026-09-20T14:31:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 37.876527] nix-grpc-daemon[870]: time=2026-09-20T14:31:11.452Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 37.889271] nix-grpc-daemon[778]: ts=2026-09-20T14:31:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker2 # [ 37.913581] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 38.193994] nix-daemon[858]: accepted connection from pid 920, user nix-grpc-daemon (trusted) worker2 # [ 38.217205] nix-daemon[858]: reaped child process 923, status = succeeded worker2 # [ 38.435681] nix-daemon[858]: accepted connection from pid 925, user nix-grpc-daemon (trusted) worker2 # [ 38.457012] nix-daemon[858]: reaped child process 928, status = succeeded lb # [ 38.502423] niks3-server[1010]: 2026/09/20 14:31:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 38.492459] nix-grpc-daemon[870]: time=2026-09-20T14:31:12.067Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 38.493987] nix-grpc-daemon[870]: time=2026-09-20T14:31:12.068Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 38.575758] niks3-server[1010]: 2026/09/20 14:31:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker2 # [ 38.553993] nix-grpc-daemon[870]: time=2026-09-20T14:31:12.129Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.590383] niks3-server[1010]: 2026/09/20 14:31:12 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 38.599307] niks3-server[1010]: 2026/09/20 14:31:12 INFO Signed narinfos id=3 count=1 lb # [ 38.603524] niks3-server[1010]: 2026/09/20 14:31:12 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 38.613125] niks3-server[1010]: 2026/09/20 14:31:12 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 38.620174] niks3-server[1010]: 2026/09/20 14:31:12 INFO Completed upload id=3 worker2 # [ 38.588305] nix-grpc-daemon[870]: time=2026-09-20T14:31:12.164Z level=INFO msg="Upload complete. (642ms)" lb # [ 38.622629] niks3-server[1010]: 2026/09/20 14:31:12 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker2 # [ 38.600575] nix-grpc-daemon[778]: ts=2026-09-20T14:31:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 38.615591] nix-grpc-daemon[778]: ts=2026-09-20T14:31:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 38.632431] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 38.640730] nix-daemon[858]: reaped child process 918, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker2 # [ 38.658723] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-t1 worker2 # [ 39.704368] nix-daemon[858]: reaped child process 932, status = succeeded worker2 # [ 39.870246] nix-daemon[858]: accepted connection from pid 948, user nix-grpc-daemon (trusted) worker2 # [ 39.888882] nix-daemon[858]: reaped child process 951, status = succeeded lb # [ 39.938931] niks3-server[1010]: 2026/09/20 14:31:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 39.914965] nix-grpc-daemon[870]: time=2026-09-20T14:31:13.490Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 39.916549] nix-grpc-daemon[870]: time=2026-09-20T14:31:13.490Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 39.975635] niks3-server[1010]: 2026/09/20 14:31:13 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker2 # [ 39.957599] nix-grpc-daemon[870]: time=2026-09-20T14:31:13.533Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.991761] niks3-server[1010]: 2026/09/20 14:31:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 40.000953] niks3-server[1010]: 2026/09/20 14:31:13 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 40.009590] niks3-server[1010]: 2026/09/20 14:31:13 INFO Signed narinfos id=4 count=1 lb # [ 40.020362] niks3-server[1010]: 2026/09/20 14:31:13 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 40.026946] niks3-server[1010]: 2026/09/20 14:31:13 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 40.030899] niks3-server[1010]: 2026/09/20 14:31:13 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo lb # [ 40.034974] niks3-server[1010]: 2026/09/20 14:31:13 INFO Completed upload id=4 worker2 # [ 40.002985] nix-grpc-daemon[870]: time=2026-09-20T14:31:13.579Z level=INFO msg="Upload complete. (328ms)" worker2 # [ 40.025112] nix-grpc-daemon[778]: ts=2026-09-20T14:31:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 40.040075] nix-grpc-daemon[778]: ts=2026-09-20T14:31:13Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 40.044467] nix-grpc-daemon[778]: ts=2026-09-20T14:31:13Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 40.048977] nix-daemon[858]: reaped child process 930, status = succeeded worker2 # [ 40.066022] nix-grpc-daemon[778]: ts=2026-09-20T14:31:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 40.080647] nix-grpc-daemon[778]: ts=2026-09-20T14:31:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 40.095790] nix-grpc-daemon[870]: time=2026-09-20T14:31:13.671Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 40.106203] nix-grpc-daemon[778]: ts=2026-09-20T14:31:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker2 # [ 40.128410] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) lb # [ 40.279250] envoy[901]: conn peer=[2001:db8:1::1]:43238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2240 lb # [ 40.284154] envoy[901]: conn peer=[2001:db8:1::1]:43246 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=65 lb # [ 40.289534] envoy[901]: conn peer=[2001:db8:1::1]:43248 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=11 lb # [ 40.293644] envoy[901]: conn peer=[2001:db8:1::1]:43252 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=13 worker2 # [ 40.336449] nix-daemon[858]: accepted connection from pid 957, user nix-grpc-daemon (trusted) worker2 # [ 40.352755] nix-daemon[858]: reaped child process 960, status = succeeded worker2 # [ 40.526215] nix-daemon[858]: accepted connection from pid 962, user nix-grpc-daemon (trusted) worker2 # [ 40.542397] nix-daemon[858]: reaped child process 965, status = succeeded lb # [ 40.586049] niks3-server[1010]: 2026/09/20 14:31:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 40.569088] nix-grpc-daemon[870]: time=2026-09-20T14:31:14.144Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 40.570586] nix-grpc-daemon[870]: time=2026-09-20T14:31:14.145Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" worker2 # [ 40.594725] nix-grpc-daemon[870]: time=2026-09-20T14:31:14.170Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.621698] niks3-server[1010]: 2026/09/20 14:31:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 40.631490] niks3-server[1010]: 2026/09/20 14:31:14 INFO Signed narinfos id=5 count=1 lb # [ 40.637088] niks3-server[1010]: 2026/09/20 14:31:14 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 40.644704] niks3-server[1010]: 2026/09/20 14:31:14 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 40.656959] niks3-server[1010]: 2026/09/20 14:31:14 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete worker2 # [ 40.630686] nix-grpc-daemon[870]: time=2026-09-20T14:31:14.206Z level=INFO msg="Upload complete. (484ms)" lb # [ 40.663758] niks3-server[1010]: 2026/09/20 14:31:14 INFO Completed upload id=5 lb # [ 40.669000] niks3-server[1010]: 2026/09/20 14:31:14 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker2 # [ 40.640288] nix-grpc-daemon[778]: ts=2026-09-20T14:31:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 40.651853] nix-grpc-daemon[778]: ts=2026-09-20T14:31:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 40.660389] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 40.664469] nix-daemon[858]: reaped child process 955, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... worker2 # [ 40.675811] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv client # farm-top> LOG-farm-top-t1 worker2 # [ 41.903785] nix-daemon[858]: reaped child process 969, status = succeeded worker2 # [ 42.067061] nix-daemon[858]: accepted connection from pid 984, user nix-grpc-daemon (trusted) worker2 # [ 42.082971] nix-daemon[858]: reaped child process 987, status = succeeded lb # [ 42.130037] niks3-server[1010]: 2026/09/20 14:31:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 42.108261] nix-grpc-daemon[870]: time=2026-09-20T14:31:15.682Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 42.109896] nix-grpc-daemon[870]: time=2026-09-20T14:31:15.682Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 42.172352] niks3-server[1010]: 2026/09/20 14:31:15 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst worker2 # [ 42.149254] nix-grpc-daemon[870]: time=2026-09-20T14:31:15.725Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.184814] niks3-server[1010]: 2026/09/20 14:31:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 42.193144] niks3-server[1010]: 2026/09/20 14:31:15 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 42.197801] niks3-server[1010]: 2026/09/20 14:31:15 INFO Signed narinfos id=6 count=1 lb # [ 42.206050] niks3-server[1010]: 2026/09/20 14:31:15 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 42.209644] niks3-server[1010]: 2026/09/20 14:31:15 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 42.213428] niks3-server[1010]: 2026/09/20 14:31:15 INFO Completed upload id=6 worker2 # [ 42.180915] nix-grpc-daemon[870]: time=2026-09-20T14:31:15.757Z level=INFO msg="Upload complete. (292ms)" lb # [ 42.215865] niks3-server[1010]: 2026/09/20 14:31:15 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker2 # [ 42.190200] nix-grpc-daemon[778]: ts=2026-09-20T14:31:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker2 # [ 42.203688] nix-daemon[858]: reaped child process 967, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.95 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.26 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.02 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.66 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.27 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker2 # [ 43.806297] nix-grpc-daemon[778]: ts=2026-09-20T14:31:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48684 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # [ 43.827183] nix-grpc-daemon[778]: ts=2026-09-20T14:31:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 43.838248] nix-grpc-daemon[870]: time=2026-09-20T14:31:17.413Z level=INFO msg="All 2 paths already cached" worker2 # [ 43.855916] nix-grpc-daemon[778]: ts=2026-09-20T14:31:17Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.35 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.45 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 44.870817] nix-grpc-daemon[778]: ts=2026-09-20T14:31:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48684 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 44.886318] nix-grpc-daemon[775]: ts=2026-09-20T14:31:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33966 worker2 # [ 44.914115] nix-grpc-daemon[778]: ts=2026-09-20T14:31:18Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 44.922011] nix-grpc-daemon[778]: ts=2026-09-20T14:31:18Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 44.962891] nix-grpc-daemon[778]: ts=2026-09-20T14:31:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 44.978102] nix-grpc-daemon[778]: ts=2026-09-20T14:31:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48684 client # copying 1 paths to 'lb:50051'... worker2 # [ 44.994240] nix-grpc-daemon[870]: time=2026-09-20T14:31:18.568Z level=INFO msg="All 2 paths already cached" client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker2 # [ 44.999591] nix-grpc-daemon[778]: ts=2026-09-20T14:31:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 45.015230] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 45.225981] nix-daemon[858]: accepted connection from pid 1017, user nix-grpc-daemon (trusted) worker2 # [ 45.246972] nix-daemon[858]: reaped child process 1020, status = succeeded worker2 # [ 45.424577] nix-daemon[858]: accepted connection from pid 1022, user nix-grpc-daemon (trusted) worker2 # [ 45.443438] nix-daemon[858]: reaped child process 1025, status = succeeded lb # [ 45.489959] niks3-server[1010]: 2026/09/20 14:31:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.465551] nix-grpc-daemon[870]: time=2026-09-20T14:31:19.041Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 45.467017] nix-grpc-daemon[870]: time=2026-09-20T14:31:19.041Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 45.517551] niks3-server[1010]: 2026/09/20 14:31:19 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 45.529292] niks3-server[1010]: 2026/09/20 14:31:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker2 # [ 45.503767] nix-grpc-daemon[870]: time=2026-09-20T14:31:19.079Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.540992] niks3-server[1010]: 2026/09/20 14:31:19 INFO Signed narinfos id=7 count=1 lb # [ 45.543759] niks3-server[1010]: 2026/09/20 14:31:19 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 45.560241] niks3-server[1010]: 2026/09/20 14:31:19 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete worker2 # [ 45.531795] nix-grpc-daemon[870]: time=2026-09-20T14:31:19.107Z level=INFO msg="Upload complete. (499ms)" lb # [ 45.564472] niks3-server[1010]: 2026/09/20 14:31:19 INFO Completed upload id=7 lb # [ 45.571966] niks3-server[1010]: 2026/09/20 14:31:19 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker2 # [ 45.539172] nix-grpc-daemon[778]: ts=2026-09-20T14:31:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 45.553363] nix-grpc-daemon[778]: ts=2026-09-20T14:31:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 45.556919] nix-daemon[858]: reaped child process 1015, status = succeeded worker2 # [ 45.569133] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 45.598760] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1b worker2 # [ 46.847563] nix-daemon[858]: reaped child process 1029, status = succeeded worker2 # [ 47.026721] nix-daemon[858]: accepted connection from pid 1045, user nix-grpc-daemon (trusted) worker2 # [ 47.043668] nix-daemon[858]: reaped child process 1048, status = succeeded lb # [ 47.089950] niks3-server[1010]: 2026/09/20 14:31:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.068332] nix-grpc-daemon[870]: time=2026-09-20T14:31:20.641Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 47.069841] nix-grpc-daemon[870]: time=2026-09-20T14:31:20.641Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 47.127831] niks3-server[1010]: 2026/09/20 14:31:20 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 47.109521] nix-grpc-daemon[870]: time=2026-09-20T14:31:20.685Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.142627] niks3-server[1010]: 2026/09/20 14:31:20 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 47.151426] niks3-server[1010]: 2026/09/20 14:31:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 47.161033] niks3-server[1010]: 2026/09/20 14:31:20 INFO Signed narinfos id=8 count=1 lb # [ 47.164216] niks3-server[1010]: 2026/09/20 14:31:20 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 47.167321] niks3-server[1010]: 2026/09/20 14:31:20 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 47.171485] niks3-server[1010]: 2026/09/20 14:31:20 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo lb # [ 47.175272] niks3-server[1010]: 2026/09/20 14:31:20 INFO Completed upload id=8 worker2 # [ 47.143187] nix-grpc-daemon[870]: time=2026-09-20T14:31:20.719Z level=INFO msg="Upload complete. (332ms)" worker2 # [ 47.157200] nix-grpc-daemon[778]: ts=2026-09-20T14:31:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker2 # [ 47.172288] nix-daemon[858]: reaped child process 1027, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.60 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.20 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 47.701066] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 4690987ad9c24e48b8d37e70d41d7d41 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 47.964001] nix[879]: don't know how to build these paths: client # [ 47.965140] nix[879]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 47.962098] nix-grpc-daemon[778]: ts=2026-09-20T14:31:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 47.976451] nix-grpc-daemon[778]: ts=2026-09-20T14:31:21Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker1 # [ 47.984944] nix-grpc-daemon[775]: ts=2026-09-20T14:31:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33966 worker2 # [ 47.982551] nix-grpc-daemon[778]: ts=2026-09-20T14:31:21Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 48.002093] nix-grpc-daemon[775]: ts=2026-09-20T14:31:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33966 client # [ 48.014576] nix[879]: copying 1 paths to 'lb:50051'... client # [ 48.016286] nix[879]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker1 # [ 48.016105] nix-grpc-daemon[775]: ts=2026-09-20T14:31:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 48.032302] nix-daemon[835]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 48.063402] nix-grpc-daemon[775]: ts=2026-09-20T14:31:21Z level=info event=niks3_push_started pid=862 worker1 # [ 48.331861] nix-grpc-daemon[862]: time=2026-09-20T14:31:21.900Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 48.520292] nix-daemon[835]: accepted connection from pid 875, user nix-grpc-daemon (trusted) worker1 # [ 48.541192] nix-daemon[835]: reaped child process 878, status = succeeded worker1 # [ 48.716496] nix-daemon[835]: accepted connection from pid 880, user nix-grpc-daemon (trusted) worker1 # [ 48.732274] nix-daemon[835]: reaped child process 883, status = succeeded lb # [ 48.778294] niks3-server[1010]: 2026/09/20 14:31:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.760314] nix-grpc-daemon[862]: time=2026-09-20T14:31:22.331Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 48.763550] nix-grpc-daemon[862]: time=2026-09-20T14:31:22.332Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 48.819967] niks3-server[1010]: 2026/09/20 14:31:22 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst worker1 # [ 48.805901] nix-grpc-daemon[862]: time=2026-09-20T14:31:22.376Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.829535] niks3-server[1010]: 2026/09/20 14:31:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 48.843560] niks3-server[1010]: 2026/09/20 14:31:22 INFO Signed narinfos id=9 count=1 lb # [ 48.850938] niks3-server[1010]: 2026/09/20 14:31:22 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls client # [ 48.818121] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. lb # [ 48.858605] niks3-server[1010]: 2026/09/20 14:31:22 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete client # Running as unit: dedup2.service; invocation ID: 138869ea6001497da071d6d2acdd0bd9 lb # [ 48.867769] niks3-server[1010]: 2026/09/20 14:31:22 INFO Completed upload id=9 worker1 # [ 48.837447] nix-grpc-daemon[862]: time=2026-09-20T14:31:22.408Z level=INFO msg="Upload complete. (498ms)" lb # [ 48.870680] niks3-server[1010]: 2026/09/20 14:31:22 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds) worker1 # [ 48.844258] nix-grpc-daemon[775]: ts=2026-09-20T14:31:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33966 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 48.858987] nix-grpc-daemon[775]: ts=2026-09-20T14:31:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 48.869637] nix-daemon[835]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 48.875877] nix-daemon[835]: reaped child process 860, status = succeeded client # [ 48.889547] nix[879]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker1 # [ 48.894815] nix-daemon[835]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # [ 49.171871] nix[895]: don't know how to build these paths: worker2 # [ 49.170852] nix-grpc-daemon[778]: ts=2026-09-20T14:31:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48684 client # [ 49.175623] nix[895]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 49.184285] nix-grpc-daemon[778]: ts=2026-09-20T14:31:22Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker1 # [ 49.190269] nix-grpc-daemon[775]: ts=2026-09-20T14:31:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33966 client # [ 49.196054] nix[895]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 lb # [ 50.274889] envoy[901]: conn peer=[2001:db8:1::1]:43262 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9562 tx=3820 ms=7650 lb # [ 50.279960] envoy[901]: conn peer=[2001:db8:1::1]:54886 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=72 lb # [ 50.285214] envoy[901]: conn peer=[2001:db8:1::1]:54888 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1706 ms=2295 client: (finished: must succeed: sleep 2, in 2.06 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 52.547107] nix-daemon[835]: reaped child process 890, status = succeeded worker1 # [ 52.738120] nix-daemon[835]: accepted connection from pid 916, user nix-grpc-daemon (trusted) worker1 # [ 52.755522] nix-daemon[835]: reaped child process 919, status = succeeded lb # [ 52.799534] niks3-server[1010]: 2026/09/20 14:31:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.779441] nix-grpc-daemon[862]: time=2026-09-20T14:31:26.349Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.781741] nix-grpc-daemon[862]: time=2026-09-20T14:31:26.349Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 52.841680] niks3-server[1010]: 2026/09/20 14:31:26 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 52.855082] niks3-server[1010]: 2026/09/20 14:31:26 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 52.868108] niks3-server[1010]: 2026/09/20 14:31:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign worker1 # [ 52.844325] nix-grpc-daemon[862]: time=2026-09-20T14:31:26.413Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.874842] niks3-server[1010]: 2026/09/20 14:31:26 INFO Signed narinfos id=10 count=1 lb # [ 52.880296] niks3-server[1010]: 2026/09/20 14:31:26 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 52.891350] niks3-server[1010]: 2026/09/20 14:31:26 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 52.898290] niks3-server[1010]: 2026/09/20 14:31:26 INFO Completed upload id=10 worker1 # [ 52.868058] nix-grpc-daemon[862]: time=2026-09-20T14:31:26.438Z level=INFO msg="Upload complete. (357ms)" lb # [ 52.901343] niks3-server[1010]: 2026/09/20 14:31:26 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker1 # [ 52.881128] nix-grpc-daemon[775]: ts=2026-09-20T14:31:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33966 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 52.896354] nix-grpc-daemon[775]: ts=2026-09-20T14:31:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33966 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 52.903188] nix-daemon[835]: reaped child process 888, status = succeeded client # [ 52.945088] systemd[1]: dedup1.service: Deactivated successfully. client # [ 52.949761] systemd[1]: dedup1.service: Consumed 170ms CPU time over 5.247s wall clock time, 43.4M memory peak, 7K incoming IP traffic, 8.3K outgoing IP traffic. client # [ 52.958334] systemd[1]: dedup2.service: Deactivated successfully. client # [ 52.962936] systemd[1]: dedup2.service: Consumed 209ms CPU time over 4.143s wall clock time, 35.2M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.29 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 54.130577] systemd[1]: Started Nix Daemon. client # [ 54.318885] nix-daemon[937]: accepted connection from pid 934, user root (trusted) worker2 # [ 54.532597] nix-grpc-daemon[778]: ts=2026-09-20T14:31:28Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48684 worker1 # [ 54.538249] nix-grpc-daemon[775]: ts=2026-09-20T14:31:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33966 worker2 # [ 54.556140] nix-grpc-daemon[778]: ts=2026-09-20T14:31:28Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 54.562714] nix-grpc-daemon[778]: ts=2026-09-20T14:31:28Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 54.608082] nix-grpc-daemon[778]: ts=2026-09-20T14:31:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 54.623858] nix-grpc-daemon[778]: ts=2026-09-20T14:31:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 54.639034] nix-grpc-daemon[778]: ts=2026-09-20T14:31:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 54.653930] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 54.858821] nix-daemon[858]: accepted connection from pid 1084, user nix-grpc-daemon (trusted) worker2 # [ 54.879290] nix-daemon[858]: reaped child process 1087, status = succeeded worker2 # [ 55.051561] nix-daemon[858]: accepted connection from pid 1089, user nix-grpc-daemon (trusted) worker2 # [ 55.069259] nix-daemon[858]: reaped child process 1092, status = succeeded lb # [ 55.115354] niks3-server[1010]: 2026/09/20 14:31:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 55.093009] nix-grpc-daemon[870]: time=2026-09-20T14:31:28.668Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 55.094463] nix-grpc-daemon[870]: time=2026-09-20T14:31:28.668Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 55.142336] niks3-server[1010]: 2026/09/20 14:31:28 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst worker2 # [ 55.123061] nix-grpc-daemon[870]: time=2026-09-20T14:31:28.699Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.156168] niks3-server[1010]: 2026/09/20 14:31:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 55.167045] niks3-server[1010]: 2026/09/20 14:31:28 INFO Signed narinfos id=11 count=1 lb # [ 55.174081] niks3-server[1010]: 2026/09/20 14:31:28 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 55.180265] niks3-server[1010]: 2026/09/20 14:31:28 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 55.188109] niks3-server[1010]: 2026/09/20 14:31:28 INFO Completed upload id=11 worker2 # [ 55.156192] nix-grpc-daemon[870]: time=2026-09-20T14:31:28.732Z level=INFO msg="Upload complete. (485ms)" lb # [ 55.192660] niks3-server[1010]: 2026/09/20 14:31:28 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker2 # [ 55.164160] nix-grpc-daemon[778]: ts=2026-09-20T14:31:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 55.179394] nix-grpc-daemon[778]: ts=2026-09-20T14:31:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 55.183598] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 55.189178] nix-daemon[858]: reaped child process 1082, status = succeeded worker2 # [ 55.200883] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 56.243401] nix-daemon[858]: reaped child process 1096, status = succeeded worker2 # [ 56.421467] nix-daemon[858]: accepted connection from pid 1111, user nix-grpc-daemon (trusted) worker2 # [ 56.438369] nix-daemon[858]: reaped child process 1114, status = succeeded lb # [ 56.482686] niks3-server[1010]: 2026/09/20 14:31:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 56.464188] nix-grpc-daemon[870]: time=2026-09-20T14:31:30.036Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 56.465843] nix-grpc-daemon[870]: time=2026-09-20T14:31:30.036Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 56.524864] niks3-server[1010]: 2026/09/20 14:31:30 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst worker2 # [ 56.506572] nix-grpc-daemon[870]: time=2026-09-20T14:31:30.082Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.535675] niks3-server[1010]: 2026/09/20 14:31:30 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 56.549335] niks3-server[1010]: 2026/09/20 14:31:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 56.554437] niks3-server[1010]: 2026/09/20 14:31:30 INFO Signed narinfos id=12 count=1 lb # [ 56.560816] niks3-server[1010]: 2026/09/20 14:31:30 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 56.565024] niks3-server[1010]: 2026/09/20 14:31:30 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete worker2 # [ 56.532956] nix-grpc-daemon[870]: time=2026-09-20T14:31:30.109Z level=INFO msg="Upload complete. (322ms)" lb # [ 56.568608] niks3-server[1010]: 2026/09/20 14:31:30 INFO Completed upload id=12 lb # [ 56.571524] niks3-server[1010]: 2026/09/20 14:31:30 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker1 # [ 56.551690] nix-grpc-daemon[775]: ts=2026-09-20T14:31:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:33966 worker2 # [ 56.545041] nix-grpc-daemon[778]: ts=2026-09-20T14:31:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker2 # [ 56.564327] nix-daemon[858]: reaped child process 1094, status = succeeded worker1 # [ 56.567999] nix-grpc-daemon[775]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 56.616196] nix-grpc-daemon[775]: ts=2026-09-20T14:31:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 56.623020] nix-grpc-daemon[775]: ts=2026-09-20T14:31:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33966 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 56.938166] nix-grpc-daemon[775]: ts=2026-09-20T14:31:30Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 56.945930] nix-grpc-daemon[775]: ts=2026-09-20T14:31:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 56.953525] nix-grpc-daemon[862]: time=2026-09-20T14:31:30.522Z level=INFO msg="All 1 paths already cached" worker2 # [ 56.963626] nix-grpc-daemon[778]: ts=2026-09-20T14:31:30Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 56.970841] nix-grpc-daemon[778]: ts=2026-09-20T14:31:30Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 56.979793] nix-grpc-daemon[778]: ts=2026-09-20T14:31:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 56.990823] nix-grpc-daemon[778]: ts=2026-09-20T14:31:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 57.004477] nix-grpc-daemon[870]: time=2026-09-20T14:31:30.580Z level=INFO msg="All 1 paths already cached" worker2 # [ 57.013225] nix-grpc-daemon[778]: ts=2026-09-20T14:31:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 57.026803] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 57.226539] nix-daemon[858]: accepted connection from pid 1120, user nix-grpc-daemon (trusted) worker2 # [ 57.245682] nix-daemon[858]: reaped child process 1123, status = succeeded worker2 # [ 57.413527] nix-daemon[858]: accepted connection from pid 1125, user nix-grpc-daemon (trusted) worker2 # [ 57.429342] nix-daemon[858]: reaped child process 1128, status = succeeded lb # [ 57.472218] niks3-server[1010]: 2026/09/20 14:31:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 57.449204] nix-grpc-daemon[870]: time=2026-09-20T14:31:31.025Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 57.450673] nix-grpc-daemon[870]: time=2026-09-20T14:31:31.025Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 57.501094] niks3-server[1010]: 2026/09/20 14:31:31 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker2 # [ 57.482727] nix-grpc-daemon[870]: time=2026-09-20T14:31:31.058Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.518499] niks3-server[1010]: 2026/09/20 14:31:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 57.527857] niks3-server[1010]: 2026/09/20 14:31:31 INFO Signed narinfos id=13 count=1 lb # [ 57.531075] niks3-server[1010]: 2026/09/20 14:31:31 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 57.539308] niks3-server[1010]: 2026/09/20 14:31:31 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 57.544446] niks3-server[1010]: 2026/09/20 14:31:31 INFO Completed upload id=13 worker2 # [ 57.512545] nix-grpc-daemon[870]: time=2026-09-20T14:31:31.088Z level=INFO msg="Upload complete. (470ms)" lb # [ 57.547321] niks3-server[1010]: 2026/09/20 14:31:31 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker2 # [ 57.520138] nix-grpc-daemon[778]: ts=2026-09-20T14:31:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 57.532304] nix-grpc-daemon[778]: ts=2026-09-20T14:31:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 57.540350] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 57.545149] nix-daemon[858]: reaped child process 1118, status = succeeded worker2 # [ 57.556200] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 58.982377] nix-daemon[858]: reaped child process 1132, status = succeeded worker2 # [ 59.141507] nix-daemon[858]: accepted connection from pid 1147, user nix-grpc-daemon (trusted) worker2 # [ 59.160205] nix-daemon[858]: reaped child process 1150, status = succeeded lb # [ 59.205473] niks3-server[1010]: 2026/09/20 14:31:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 59.184071] nix-grpc-daemon[870]: time=2026-09-20T14:31:32.759Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 59.185509] nix-grpc-daemon[870]: time=2026-09-20T14:31:32.759Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 59.246330] niks3-server[1010]: 2026/09/20 14:31:32 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst worker2 # [ 59.233833] nix-grpc-daemon[870]: time=2026-09-20T14:31:32.809Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.258326] niks3-server[1010]: 2026/09/20 14:31:32 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 59.271706] niks3-server[1010]: 2026/09/20 14:31:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 59.277850] niks3-server[1010]: 2026/09/20 14:31:32 INFO Signed narinfos id=14 count=1 lb # [ 59.279883] niks3-server[1010]: 2026/09/20 14:31:32 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 59.286488] niks3-server[1010]: 2026/09/20 14:31:32 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 59.293368] niks3-server[1010]: 2026/09/20 14:31:32 INFO Completed upload id=14 lb # [ 59.296047] niks3-server[1010]: 2026/09/20 14:31:32 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker2 # [ 59.261420] nix-grpc-daemon[870]: time=2026-09-20T14:31:32.837Z level=INFO msg="Upload complete. (292ms)" worker2 # [ 59.273058] nix-grpc-daemon[778]: ts=2026-09-20T14:31:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker2 # [ 59.285638] nix-daemon[858]: reaped child process 1130, status = succeeded worker2 # [ 59.315824] nix-grpc-daemon[778]: ts=2026-09-20T14:31:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48684 worker1 # [ 59.342782] nix-grpc-daemon[775]: ts=2026-09-20T14:31:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 59.355798] nix-grpc-daemon[775]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker1 # [ 59.373038] nix-grpc-daemon[775]: ts=2026-09-20T14:31:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33966 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 59.691754] nix-grpc-daemon[778]: ts=2026-09-20T14:31:33Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48684 worker1 # [ 59.698345] nix-grpc-daemon[775]: ts=2026-09-20T14:31:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 59.708898] nix-grpc-daemon[862]: time=2026-09-20T14:31:33.278Z level=INFO msg="All 2 paths already cached" worker2 # [ 59.724849] nix-grpc-daemon[778]: ts=2026-09-20T14:31:33Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 59.731937] nix-grpc-daemon[778]: ts=2026-09-20T14:31:33Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 59.740793] nix-grpc-daemon[778]: ts=2026-09-20T14:31:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 59.751670] nix-grpc-daemon[778]: ts=2026-09-20T14:31:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 59.765380] nix-grpc-daemon[870]: time=2026-09-20T14:31:33.341Z level=INFO msg="All 2 paths already cached" worker2 # [ 59.775397] nix-grpc-daemon[778]: ts=2026-09-20T14:31:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 59.789274] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 59.987386] nix-daemon[858]: accepted connection from pid 1156, user nix-grpc-daemon (trusted) worker2 # [ 60.007852] nix-daemon[858]: reaped child process 1159, status = succeeded worker2 # [ 60.183706] nix-daemon[858]: accepted connection from pid 1161, user nix-grpc-daemon (trusted) worker2 # [ 60.199862] nix-daemon[858]: reaped child process 1164, status = succeeded lb # [ 60.247286] niks3-server[1010]: 2026/09/20 14:31:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 60.225089] nix-grpc-daemon[870]: time=2026-09-20T14:31:33.800Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 60.226517] nix-grpc-daemon[870]: time=2026-09-20T14:31:33.800Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 60.273389] niks3-server[1010]: 2026/09/20 14:31:33 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst lb # [ 60.285221] envoy[901]: conn peer=[2001:db8:1::1]:54890 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2992 tx=1372 ms=4933 worker2 # [ 60.262920] nix-grpc-daemon[870]: time=2026-09-20T14:31:33.838Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.300080] envoy[901]: conn peer=[2001:db8:1::1]:54902 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=3738 lb # [ 60.311661] envoy[901]: conn peer=[2001:db8:1::1]:58440 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=333 ms=70 lb # [ 60.317494] envoy[901]: conn peer=[2001:db8:1::1]:58432 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3406 tx=1777 ms=2149 worker2 # [ 60.294563] nix-grpc-daemon[870]: time=2026-09-20T14:31:33.870Z level=INFO msg="Upload complete. (489ms)" lb # [ 60.327202] envoy[901]: conn peer=[2001:db8:1::1]:58452 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3862 tx=1852 ms=2492 lb # [ 60.332371] envoy[901]: conn peer=[2001:db8:1::1]:58458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=93 lb # [ 60.337341] niks3-server[1010]: 2026/09/20 14:31:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker2 # [ 60.305801] nix-grpc-daemon[778]: ts=2026-09-20T14:31:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 60.341182] niks3-server[1010]: 2026/09/20 14:31:33 INFO Signed narinfos id=15 count=1 lb # [ 60.343653] niks3-server[1010]: 2026/09/20 14:31:33 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 60.347385] niks3-server[1010]: 2026/09/20 14:31:33 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 60.351177] niks3-server[1010]: 2026/09/20 14:31:33 INFO Completed upload id=15 worker2 # [ 60.317944] nix-grpc-daemon[778]: ts=2026-09-20T14:31:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 lb # [ 60.353402] niks3-server[1010]: 2026/09/20 14:31:33 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker2 # [ 60.325857] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 60.328384] nix-daemon[858]: reaped child process 1154, status = succeeded worker2 # [ 60.341707] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 61.166363] nix-daemon[858]: reaped child process 1168, status = succeeded worker2 # [ 61.321905] nix-daemon[858]: accepted connection from pid 1183, user nix-grpc-daemon (trusted) worker2 # [ 61.338661] nix-daemon[858]: reaped child process 1186, status = succeeded lb # [ 61.387008] niks3-server[1010]: 2026/09/20 14:31:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 61.364380] nix-grpc-daemon[870]: time=2026-09-20T14:31:34.939Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 61.365839] nix-grpc-daemon[870]: time=2026-09-20T14:31:34.939Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 61.423299] niks3-server[1010]: 2026/09/20 14:31:35 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 61.437256] niks3-server[1010]: 2026/09/20 14:31:35 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 61.451673] niks3-server[1010]: 2026/09/20 14:31:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker2 # [ 61.425252] nix-grpc-daemon[870]: time=2026-09-20T14:31:35.001Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.463368] niks3-server[1010]: 2026/09/20 14:31:35 INFO Signed narinfos id=16 count=1 lb # [ 61.470371] niks3-server[1010]: 2026/09/20 14:31:35 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls worker2 # [ 61.448571] nix-grpc-daemon[870]: time=2026-09-20T14:31:35.024Z level=INFO msg="Upload complete. (297ms)" lb # [ 61.479362] niks3-server[1010]: 2026/09/20 14:31:35 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 61.485279] niks3-server[1010]: 2026/09/20 14:31:35 INFO Completed upload id=16 lb # [ 61.489037] niks3-server[1010]: 2026/09/20 14:31:35 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker2 # [ 61.461151] nix-grpc-daemon[778]: ts=2026-09-20T14:31:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker2 # [ 61.478546] nix-daemon[858]: reaped child process 1166, status = succeeded worker1 # [ 61.481190] nix-grpc-daemon[775]: ts=2026-09-20T14:31:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 61.494464] nix-grpc-daemon[775]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker2 # [ 61.532100] nix-grpc-daemon[778]: ts=2026-09-20T14:31:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 61.540082] nix-grpc-daemon[778]: ts=2026-09-20T14:31:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=0 paths=1 nar_bytes_out=232 client # [ 61.633521] nix-daemon[937]: reaped child process 939, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.74 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.87 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 62.936138] nix-daemon[937]: accepted connection from pid 1020, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 63.147006] nix-grpc-daemon[778]: ts=2026-09-20T14:31:36Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:48684 worker1 # [ 63.153980] nix-grpc-daemon[775]: ts=2026-09-20T14:31:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 63.368221] nix-daemon[835]: accepted connection from pid 938, user nix-grpc-daemon (trusted) worker1 # [ 63.385406] nix-daemon[835]: reaped child process 941, status = succeeded lb # [ 63.431711] niks3-server[1010]: 2026/09/20 14:31:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 63.410870] nix-grpc-daemon[862]: time=2026-09-20T14:31:36.981Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 63.412805] nix-grpc-daemon[862]: time=2026-09-20T14:31:36.981Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 63.467130] niks3-server[1010]: 2026/09/20 14:31:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 63.445529] nix-grpc-daemon[862]: time=2026-09-20T14:31:37.016Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.477122] niks3-server[1010]: 2026/09/20 14:31:37 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 63.491211] niks3-server[1010]: 2026/09/20 14:31:37 INFO Signed narinfos id=17 count=1 lb # [ 63.496851] niks3-server[1010]: 2026/09/20 14:31:37 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls worker1 # [ 63.475317] nix-grpc-daemon[862]: time=2026-09-20T14:31:37.046Z level=INFO msg="Upload complete. (315ms)" lb # [ 63.504617] niks3-server[1010]: 2026/09/20 14:31:37 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 63.510428] niks3-server[1010]: 2026/09/20 14:31:37 INFO Completed upload id=17 lb # [ 63.513134] niks3-server[1010]: 2026/09/20 14:31:37 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker2 # [ 63.495444] nix-grpc-daemon[778]: ts=2026-09-20T14:31:37Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 63.502080] nix-grpc-daemon[778]: ts=2026-09-20T14:31:37Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 63.507469] nix-grpc-daemon[775]: ts=2026-09-20T14:31:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 63.523903] nix-grpc-daemon[775]: ts=2026-09-20T14:31:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33966 client # copying 2 paths to 'lb:50051'... worker1 # [ 63.542566] nix-grpc-daemon[775]: ts=2026-09-20T14:31:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33966 client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 63.567492] nix-daemon[835]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 63.786909] nix-daemon[835]: accepted connection from pid 945, user nix-grpc-daemon (trusted) worker1 # [ 63.804843] nix-daemon[835]: reaped child process 948, status = succeeded worker1 # [ 63.979387] nix-daemon[835]: accepted connection from pid 950, user nix-grpc-daemon (trusted) worker1 # [ 63.995606] nix-daemon[835]: reaped child process 953, status = succeeded lb # [ 64.037628] niks3-server[1010]: 2026/09/20 14:31:37 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 64.046816] niks3-server[1010]: 2026/09/20 14:31:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 64.025077] nix-grpc-daemon[862]: time=2026-09-20T14:31:37.595Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 64.026585] nix-grpc-daemon[862]: time=2026-09-20T14:31:37.595Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker1 # [ 64.028355] nix-grpc-daemon[862]: time=2026-09-20T14:31:37.595Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 64.078828] niks3-server[1010]: 2026/09/20 14:31:37 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 64.092591] niks3-server[1010]: 2026/09/20 14:31:37 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 64.104970] niks3-server[1010]: 2026/09/20 14:31:37 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 64.113918] niks3-server[1010]: 2026/09/20 14:31:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign worker1 # [ 64.089838] nix-grpc-daemon[862]: time=2026-09-20T14:31:37.659Z level=INFO msg="Uploading 3 narinfos" lb # [ 64.121384] niks3-server[1010]: 2026/09/20 14:31:37 INFO Signed narinfos id=18 count=1 lb # [ 64.123640] niks3-server[1010]: 2026/09/20 14:31:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 64.134433] niks3-server[1010]: 2026/09/20 14:31:37 INFO Signed narinfos id=19 count=2 lb # [ 64.140251] niks3-server[1010]: 2026/09/20 14:31:37 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 64.151884] niks3-server[1010]: 2026/09/20 14:31:37 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 64.161208] niks3-server[1010]: 2026/09/20 14:31:37 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 64.166614] niks3-server[1010]: 2026/09/20 14:31:37 INFO Completed upload id=18 lb # [ 64.168740] niks3-server[1010]: 2026/09/20 14:31:37 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 64.172589] niks3-server[1010]: 2026/09/20 14:31:37 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete worker1 # [ 64.142234] nix-grpc-daemon[862]: time=2026-09-20T14:31:37.713Z level=INFO msg="Upload complete. (554ms)" lb # [ 64.176056] niks3-server[1010]: 2026/09/20 14:31:37 INFO Completed upload id=19 lb # [ 64.177974] niks3-server[1010]: 2026/09/20 14:31:37 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo worker1 # [ 64.152510] nix-grpc-daemon[775]: ts=2026-09-20T14:31:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33966 duration_s=0 paths=2 nar_bytes_in=984 worker1 # [ 64.173385] nix-grpc-daemon[775]: ts=2026-09-20T14:31:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 64.184431] nix-daemon[835]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 64.188710] nix-daemon[835]: reaped child process 943, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker1 # [ 64.201035] nix-daemon[835]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker1 # [ 65.626808] nix-daemon[835]: reaped child process 957, status = succeeded worker1 # [ 65.792507] nix-daemon[835]: accepted connection from pid 972, user nix-grpc-daemon (trusted) worker1 # [ 65.809410] nix-daemon[835]: reaped child process 975, status = succeeded lb # [ 65.853226] niks3-server[1010]: 2026/09/20 14:31:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 65.832578] nix-grpc-daemon[862]: time=2026-09-20T14:31:39.403Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 65.885903] niks3-server[1010]: 2026/09/20 14:31:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker1 # [ 65.868210] nix-grpc-daemon[862]: time=2026-09-20T14:31:39.438Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.900776] niks3-server[1010]: 2026/09/20 14:31:39 INFO Signed narinfos id=20 count=1 lb # [ 65.903951] niks3-server[1010]: 2026/09/20 14:31:39 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 65.917453] niks3-server[1010]: 2026/09/20 14:31:39 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 65.926030] niks3-server[1010]: 2026/09/20 14:31:39 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete worker1 # [ 65.903478] nix-grpc-daemon[862]: time=2026-09-20T14:31:39.474Z level=INFO msg="Upload complete. (287ms)" lb # [ 65.933764] niks3-server[1010]: 2026/09/20 14:31:39 INFO Completed upload id=20 lb # [ 65.937395] niks3-server[1010]: 2026/09/20 14:31:39 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker1 # [ 65.912871] nix-grpc-daemon[775]: ts=2026-09-20T14:31:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33966 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker1 # [ 65.925811] nix-daemon[835]: reaped child process 955, status = succeeded client # copying 1 paths... worker2 # [ 65.961716] nix-grpc-daemon[778]: ts=2026-09-20T14:31:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 65.978365] nix-grpc-daemon[778]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 66.031053] nix-grpc-daemon[775]: ts=2026-09-20T14:31:39Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 66.037855] nix-grpc-daemon[775]: ts=2026-09-20T14:31:39Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:33966 duration_s=0 paths=1 nar_bytes_out=120 client # [ 66.168105] nix-daemon[937]: reaped child process 1023, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.47 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 66.382322] nix-daemon[937]: accepted connection from pid 1042, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 66.597425] nix-grpc-daemon[775]: ts=2026-09-20T14:31:40Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:33966 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 66.600388] nix-grpc-daemon[778]: ts=2026-09-20T14:31:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 66.626171] nix-grpc-daemon[778]: ts=2026-09-20T14:31:40Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 66.633675] nix-grpc-daemon[778]: ts=2026-09-20T14:31:40Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 66.642901] nix-grpc-daemon[778]: ts=2026-09-20T14:31:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 66.653539] nix-grpc-daemon[778]: ts=2026-09-20T14:31:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48684 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 66.672500] nix-grpc-daemon[778]: ts=2026-09-20T14:31:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 66.687619] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 66.709275] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 1/5) worker2 # [ 66.788349] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 2/5) worker2 # [ 66.820610] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 112 ms (attempt 3/5) worker2 # [ 66.940190] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 458 ms (attempt 4/5) worker2 # [ 67.401417] nix-grpc-daemon[778]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 67.408371] nix-grpc-daemon[778]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 67.659287] nix-daemon[858]: accepted connection from pid 1202, user nix-grpc-daemon (trusted) worker2 # [ 67.677477] nix-daemon[858]: reaped child process 1205, status = succeeded worker2 # [ 67.854109] nix-daemon[858]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker2 # [ 67.870215] nix-daemon[858]: reaped child process 1210, status = succeeded lb # [ 67.918893] niks3-server[1010]: 2026/09/20 14:31:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 67.897341] nix-grpc-daemon[870]: time=2026-09-20T14:31:41.472Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 67.898834] nix-grpc-daemon[870]: time=2026-09-20T14:31:41.473Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 67.949050] niks3-server[1010]: 2026/09/20 14:31:41 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst lb # [ 67.964818] niks3-server[1010]: 2026/09/20 14:31:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker2 # [ 67.939127] nix-grpc-daemon[870]: time=2026-09-20T14:31:41.515Z level=INFO msg="Uploading 1 narinfos" lb # [ 67.977649] niks3-server[1010]: 2026/09/20 14:31:41 INFO Signed narinfos id=21 count=1 lb # [ 67.985002] niks3-server[1010]: 2026/09/20 14:31:41 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 67.996153] niks3-server[1010]: 2026/09/20 14:31:41 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 68.001180] niks3-server[1010]: 2026/09/20 14:31:41 INFO Completed upload id=21 worker2 # [ 67.969171] nix-grpc-daemon[870]: time=2026-09-20T14:31:41.545Z level=INFO msg="Upload complete. (527ms)" lb # [ 68.003995] niks3-server[1010]: 2026/09/20 14:31:41 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker2 # [ 67.976251] nix-grpc-daemon[778]: ts=2026-09-20T14:31:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=1 paths=1 nar_bytes_in=568 worker2 # [ 67.988832] nix-grpc-daemon[778]: ts=2026-09-20T14:31:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 68.000557] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) worker2 # [ 68.005473] nix-daemon[858]: reaped child process 1196, status = succeeded worker2 # [ 68.014269] nix-grpc-daemon[778]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker2 # [ 68.030555] nix-daemon[858]: accepted connection from pid 778, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 69.057524] nix-daemon[858]: reaped child process 1215, status = succeeded worker2 # [ 69.215050] nix-daemon[858]: accepted connection from pid 1230, user nix-grpc-daemon (trusted) worker2 # [ 69.232670] nix-daemon[858]: reaped child process 1233, status = succeeded lb # [ 69.278753] niks3-server[1010]: 2026/09/20 14:31:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 69.257094] nix-grpc-daemon[870]: time=2026-09-20T14:31:42.832Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 69.307853] niks3-server[1010]: 2026/09/20 14:31:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker2 # [ 69.287234] nix-grpc-daemon[870]: time=2026-09-20T14:31:42.863Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.322696] niks3-server[1010]: 2026/09/20 14:31:42 INFO Signed narinfos id=22 count=1 lb # [ 69.329240] niks3-server[1010]: 2026/09/20 14:31:42 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 69.337139] niks3-server[1010]: 2026/09/20 14:31:42 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 69.344411] niks3-server[1010]: 2026/09/20 14:31:42 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 69.348453] niks3-server[1010]: 2026/09/20 14:31:42 INFO Completed upload id=22 worker2 # [ 69.316067] nix-grpc-daemon[870]: time=2026-09-20T14:31:42.892Z level=INFO msg="Upload complete. (272ms)" lb # [ 69.351184] niks3-server[1010]: 2026/09/20 14:31:42 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker2 # [ 69.324219] nix-grpc-daemon[778]: ts=2026-09-20T14:31:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 client # copying 1 paths... worker2 # [ 69.336755] nix-daemon[858]: reaped child process 1212, status = succeeded worker2 # [ 69.339609] nix-grpc-daemon[778]: ts=2026-09-20T14:31:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:48684 client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 69.368149] nix-grpc-daemon[778]: ts=2026-09-20T14:31:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 69.372910] nix-grpc-daemon[778]: ts=2026-09-20T14:31:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=0 paths=1 nar_bytes_out=120 client # [ 69.507602] nix-daemon[937]: reaped child process 1045, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.34 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 69.729497] nix-daemon[937]: accepted connection from pid 1064, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 69.943229] nix-grpc-daemon[775]: ts=2026-09-20T14:31:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 69.950823] nix-grpc-daemon[775]: ts=2026-09-20T14:31:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 69.958544] nix-grpc-daemon[862]: time=2026-09-20T14:31:43.527Z level=INFO msg="All 1 paths already cached" worker2 # [ 69.968154] nix-grpc-daemon[778]: ts=2026-09-20T14:31:43Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 69.974446] nix-grpc-daemon[778]: ts=2026-09-20T14:31:43Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 70.021794] nix-grpc-daemon[775]: ts=2026-09-20T14:31:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 70.037393] nix-grpc-daemon[775]: ts=2026-09-20T14:31:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 70.052688] nix-grpc-daemon[862]: time=2026-09-20T14:31:43.623Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 70.063526] nix-grpc-daemon[775]: ts=2026-09-20T14:31:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 70.078898] nix-daemon[835]: accepted connection from pid 775, user nix-grpc-daemon (trusted) lb # [ 70.282424] envoy[901]: conn peer=[2001:db8:1::1]:58464 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4312 tx=2222 ms=1865 lb # [ 70.287541] envoy[901]: conn peer=[2001:db8:1::1]:47904 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=28 lb # [ 70.294385] envoy[901]: conn peer=[2001:db8:1::1]:47914 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3852 tx=1878 ms=2946 lb # [ 70.299247] envoy[901]: conn peer=[2001:db8:1::1]:47922 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=68 lb # [ 70.303933] envoy[901]: conn peer=[2001:db8:1::1]:47926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3700 tx=1800 ms=2836 lb # [ 70.308748] envoy[901]: conn peer=[2001:db8:1::1]:47942 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=69 worker1 # [ 70.289486] nix-daemon[835]: accepted connection from pid 979, user nix-grpc-daemon (trusted) worker1 # [ 70.308424] nix-daemon[835]: reaped child process 982, status = succeeded worker1 # [ 70.487869] nix-daemon[835]: accepted connection from pid 984, user nix-grpc-daemon (trusted) worker1 # [ 70.505963] nix-daemon[835]: reaped child process 987, status = succeeded lb # [ 70.550677] niks3-server[1010]: 2026/09/20 14:31:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 70.529106] nix-grpc-daemon[862]: time=2026-09-20T14:31:44.099Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 70.530663] nix-grpc-daemon[862]: time=2026-09-20T14:31:44.099Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 70.576728] niks3-server[1010]: 2026/09/20 14:31:44 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 70.590399] niks3-server[1010]: 2026/09/20 14:31:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker1 # [ 70.567485] nix-grpc-daemon[862]: time=2026-09-20T14:31:44.138Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.603719] niks3-server[1010]: 2026/09/20 14:31:44 INFO Signed narinfos id=23 count=1 lb # [ 70.609313] niks3-server[1010]: 2026/09/20 14:31:44 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls worker1 # [ 70.587085] nix-grpc-daemon[862]: time=2026-09-20T14:31:44.157Z level=INFO msg="Upload complete. (490ms)" lb # [ 70.617821] niks3-server[1010]: 2026/09/20 14:31:44 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 70.622906] niks3-server[1010]: 2026/09/20 14:31:44 INFO Completed upload id=23 worker1 # [ 70.594399] nix-grpc-daemon[775]: ts=2026-09-20T14:31:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33966 duration_s=0 paths=1 nar_bytes_in=568 lb # [ 70.626337] niks3-server[1010]: 2026/09/20 14:31:44 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker1 # [ 70.606588] nix-grpc-daemon[775]: ts=2026-09-20T14:31:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33966 worker1 # [ 70.612859] nix-daemon[835]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker1 # [ 70.617365] nix-daemon[835]: reaped child process 977, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker1 # [ 70.629831] nix-daemon[835]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 71.257483] nix-daemon[835]: reaped child process 991, status = succeeded worker1 # [ 71.417926] nix-daemon[835]: accepted connection from pid 1006, user nix-grpc-daemon (trusted) worker1 # [ 71.434671] nix-daemon[835]: reaped child process 1009, status = succeeded lb # [ 71.476890] niks3-server[1010]: 2026/09/20 14:31:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 71.457388] nix-grpc-daemon[862]: time=2026-09-20T14:31:45.026Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 71.506752] niks3-server[1010]: 2026/09/20 14:31:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker1 # [ 71.485122] nix-grpc-daemon[862]: time=2026-09-20T14:31:45.055Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.521928] niks3-server[1010]: 2026/09/20 14:31:45 INFO Signed narinfos id=24 count=1 lb # [ 71.527633] niks3-server[1010]: 2026/09/20 14:31:45 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 71.532984] niks3-server[1010]: 2026/09/20 14:31:45 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 71.510906] nix-grpc-daemon[862]: time=2026-09-20T14:31:45.081Z level=INFO msg="Upload complete. (269ms)" lb # [ 71.542100] niks3-server[1010]: 2026/09/20 14:31:45 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 71.546499] niks3-server[1010]: 2026/09/20 14:31:45 INFO Completed upload id=24 lb # [ 71.549213] niks3-server[1010]: 2026/09/20 14:31:45 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker1 # [ 71.520735] nix-grpc-daemon[775]: ts=2026-09-20T14:31:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33966 duration_s=0 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker1 # [ 71.529919] nix-daemon[835]: reaped child process 989, status = succeeded client # copying 1 paths... worker1 # [ 71.567200] nix-grpc-daemon[775]: ts=2026-09-20T14:31:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:33966 client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 71.595315] nix-grpc-daemon[778]: ts=2026-09-20T14:31:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48684 worker2 # [ 71.608913] nix-grpc-daemon[778]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... worker2 # [ 71.627070] nix-grpc-daemon[778]: ts=2026-09-20T14:31:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:48684 duration_s=0 paths=1 nar_bytes_out=120 client # [ 71.758588] nix-daemon[937]: reaped child process 1067, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.25 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 9.99 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds) worker2 # [ 73.173879] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 73.706185] nix-grpc-daemon[778]: ts=2026-09-20T14:31:47Z level=info event=signal_exit worker2 # [ 73.938358] nix-grpc-daemon[778]: ts=2026-09-20T14:31:47Z level=info event=scheduler_yield worker1 # [ 73.944934] nix-grpc-daemon[775]: ts=2026-09-20T14:31:47Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 73.974909] niks3-server[1010]: 2026/09/20 14:31:47 INFO lead: released remote=192.168.1.4:38922 worker2 # [ 73.954153] nix-grpc-daemon[778]: ts=2026-09-20T14:31:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34550 worker2 # [ 73.961711] nix-grpc-daemon[778]: ts=2026-09-20T14:31:47Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 73.965913] nix-grpc-daemon[778]: ts=2026-09-20T14:31:47Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 73.969833] nix-grpc-daemon[778]: ts=2026-09-20T14:31:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34550 worker2 # [ 73.974227] nix-grpc-daemon[778]: ts=2026-09-20T14:31:47Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 74.145438] nix-grpc-daemon[775]: ts=2026-09-20T14:31:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.150577] nix-grpc-daemon[775]: ts=2026-09-20T14:31:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 74.194233] niks3-server[1010]: 2026/09/20 14:31:47 INFO lead: acquired remote=192.168.1.3:46066 worker2 # [ 74.162362] nix-grpc-daemon[778]: ts=2026-09-20T14:31:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.169916] nix-grpc-daemon[775]: ts=2026-09-20T14:31:47Z level=info event=scheduler_take_over worker2 # [ 74.167763] nix-grpc-daemon[778]: ts=2026-09-20T14:31:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 74.351518] nix-grpc-daemon[775]: ts=2026-09-20T14:31:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.356890] nix-grpc-daemon[775]: ts=2026-09-20T14:31:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.369132] nix-grpc-daemon[778]: ts=2026-09-20T14:31:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 74.374190] nix-grpc-daemon[778]: ts=2026-09-20T14:31:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 74.557786] nix-grpc-daemon[775]: ts=2026-09-20T14:31:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.563144] nix-grpc-daemon[775]: ts=2026-09-20T14:31:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.575380] nix-grpc-daemon[778]: ts=2026-09-20T14:31:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 74.581370] nix-grpc-daemon[778]: ts=2026-09-20T14:31:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 74.764371] nix-grpc-daemon[775]: ts=2026-09-20T14:31:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.769719] nix-grpc-daemon[775]: ts=2026-09-20T14:31:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.784146] nix-grpc-daemon[778]: ts=2026-09-20T14:31:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 74.788243] nix-grpc-daemon[778]: ts=2026-09-20T14:31:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.943141] nix-grpc-daemon[778]: ts=2026-09-20T14:31:48Z level=info event=scheduler_restarting worker1 # [ 74.968948] nix-grpc-daemon[775]: ts=2026-09-20T14:31:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 74.973191] nix-grpc-daemon[775]: ts=2026-09-20T14:31:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 74.976908] nix-daemon[858]: reaped child process 860, status = succeeded worker2 # [ 75.012310] nix-grpc-daemon[778]: ts=2026-09-20T14:31:48Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 75.175459] nix-grpc-daemon[775]: ts=2026-09-20T14:31:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.180520] nix-grpc-daemon[775]: ts=2026-09-20T14:31:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.383758] nix-grpc-daemon[775]: ts=2026-09-20T14:31:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.389375] nix-grpc-daemon[775]: ts=2026-09-20T14:31:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.592618] nix-grpc-daemon[775]: ts=2026-09-20T14:31:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.602394] nix-grpc-daemon[775]: ts=2026-09-20T14:31:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 75.795975] nix-grpc-daemon[775]: ts=2026-09-20T14:31:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 75.824876] nix-grpc-daemon[775]: ts=2026-09-20T14:31:49Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:47468 worker1 # [ 75.832866] nix-grpc-daemon[775]: ts=2026-09-20T14:31:49Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 75.843368] nix-grpc-daemon[778]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 75.848507] nix-grpc-daemon[778]: E0000 00:00:1789914709.416221 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 75.855681] nix-grpc-daemon[778]: E0000 00:00:1789914709.416954 821 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 75.970229] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 75.980516] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 75.982842] systemd[1]: nix-grpc-daemon.service: Consumed 3.706s CPU time over 55.578s wall clock time, 66M memory peak, 90.3K incoming IP traffic, 222.1K outgoing IP traffic. worker2 # [ 76.002348] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 76.007462] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 76.010131] systemd[1]: nix-grpc-daemon.socket: Consumed 553us CPU time over 1min 5.202s wall clock time, 256K memory peak, 90.8K incoming IP traffic, 69.2K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 76.382387] nix-grpc-daemon[775]: ts=2026-09-20T14:31:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33966 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker1 # [ 76.389881] nix-grpc-daemon[775]: ts=2026-09-20T14:31:49Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:33966 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.31 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 76.522238] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 76.607775] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 76.956161] systemd[1]: Starting scheduler-token.service... worker2 # [ 77.060704] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 77.064168] systemd[1]: Finished scheduler-token.service. worker2 # [ 77.068571] systemd[1]: scheduler-token.service: Consumed 53ms CPU time over 107ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 77.078337] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 77.266694] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 77.269152] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 77.273215] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 77.282044] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 77.283719] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 77.327165] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.342203] nix-grpc-daemon[775]: ts=2026-09-20T14:31:50Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 77.342660] nix-grpc-daemon[775]: ts=2026-09-20T14:31:50Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:47468 worker1 # [ 77.351962] nix-grpc-daemon[775]: ts=2026-09-20T14:31:50Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 77.606037] nix-grpc-daemon[775]: ts=2026-09-20T14:31:51Z level=info event=signal_exit worker1 # [ 77.851615] nix-grpc-daemon[775]: ts=2026-09-20T14:31:51Z level=info event=scheduler_yield lb # [ 77.885627] niks3-server[1010]: 2026/09/20 14:31:51 INFO lead: released remote=192.168.1.3:46066 worker2 # [ 77.855770] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:51Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 77.867665] nix-grpc-daemon[775]: ts=2026-09-20T14:31:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47468 worker1 # [ 77.874667] nix-grpc-daemon[775]: ts=2026-09-20T14:31:51Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 77.878715] nix-grpc-daemon[775]: ts=2026-09-20T14:31:51Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 77.882696] nix-grpc-daemon[775]: ts=2026-09-20T14:31:51Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:47468 worker1 # [ 77.888277] nix-grpc-daemon[775]: ts=2026-09-20T14:31:51Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 78.057131] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.062363] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.074357] nix-grpc-daemon[775]: ts=2026-09-20T14:31:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.079591] nix-grpc-daemon[775]: ts=2026-09-20T14:31:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.263450] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.269696] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.280428] nix-grpc-daemon[775]: ts=2026-09-20T14:31:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.285448] nix-grpc-daemon[775]: ts=2026-09-20T14:31:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.469577] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.474548] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.486149] nix-grpc-daemon[775]: ts=2026-09-20T14:31:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.490926] nix-grpc-daemon[775]: ts=2026-09-20T14:31:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.675524] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.680587] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.693097] nix-grpc-daemon[775]: ts=2026-09-20T14:31:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.698001] nix-grpc-daemon[775]: ts=2026-09-20T14:31:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.857143] nix-grpc-daemon[775]: ts=2026-09-20T14:31:52Z level=info event=scheduler_restarting worker2 # [ 78.882415] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.887377] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.893801] nix-daemon[835]: reaped child process 837, status = succeeded worker1 # [ 78.921768] nix-grpc-daemon[775]: ts=2026-09-20T14:31:52Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 79.088573] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.093673] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 79.296369] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.300416] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 79.497157] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.502343] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 79.703303] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.708475] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.737063] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 79.742174] nix-grpc-daemon[775]: E0000 00:00:1789914713.306562 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 79.748640] nix-grpc-daemon[775]: E0000 00:00:1789914713.312938 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 79.897566] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 79.905160] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 79.907640] systemd[1]: nix-grpc-daemon.service: Consumed 1.882s CPU time over 59.642s wall clock time, 50.2M memory peak, 54.1K incoming IP traffic, 95K outgoing IP traffic. worker2 # [ 79.909539] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.914576] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.926854] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 79.931192] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 79.934462] systemd[1]: nix-grpc-daemon.socket: Consumed 555us CPU time over 1min 8.563s wall clock time, 256K memory peak, 63.5K incoming IP traffic, 57.4K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 80.115701] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.120994] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 80.284327] envoy[901]: conn peer=[2001:db8:1::1]:47952 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3731 tx=1791 ms=1743 lb # [ 80.284701] envoy[901]: conn peer=[2001:db8:1::1]:53618 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=95 lb # [ 80.284865] envoy[901]: conn peer=[2001:db8:1::4]:42650 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=39206 tx=2485 ms=54267 lb # [ 80.284983] envoy[901]: conn peer=[2001:db8:1::1]:53620 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=24 lb # [ 80.285104] envoy[901]: conn peer=[2001:db8:1::3]:37652 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8976 tx=2432 ms=58266 worker2 # [ 80.294537] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 80.313077] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 80.328875] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.334613] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.355230] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 1/5) worker2 # [ 80.462293] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 2/5) worker2 # [ 80.505743] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 3/5) worker2 # [ 80.524165] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.529230] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.539193] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 292 ms (attempt 4/5) worker2 # [ 80.730189] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.735351] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.839319] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 80.865775] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51210 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 80.883245] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 80.917566] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=info event=niks3_push_started pid=1316 worker2 # [ 80.938300] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.943628] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.140135] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.142200] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.152882] nix-grpc-daemon[1316]: time=2026-09-20T14:31:54.728Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 81.330079] nix-daemon[858]: accepted connection from pid 1329, user nix-grpc-daemon (trusted) worker2 # [ 81.343153] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.346170] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.352499] nix-daemon[858]: reaped child process 1332, status = succeeded lb # [ 81.398289] niks3-server[1010]: 2026/09/20 14:31:54 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 81.407702] niks3-server[1010]: 2026/09/20 14:31:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 81.386729] nix-grpc-daemon[1316]: time=2026-09-20T14:31:54.960Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 81.389185] nix-grpc-daemon[1316]: time=2026-09-20T14:31:54.960Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 81.391009] nix-grpc-daemon[1316]: time=2026-09-20T14:31:54.961Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 81.456746] niks3-server[1010]: 2026/09/20 14:31:55 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 81.471138] niks3-server[1010]: 2026/09/20 14:31:55 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 81.479048] niks3-server[1010]: 2026/09/20 14:31:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign worker2 # [ 81.452258] nix-grpc-daemon[1316]: time=2026-09-20T14:31:55.028Z level=INFO msg="Uploading 3 narinfos" lb # [ 81.486922] niks3-server[1010]: 2026/09/20 14:31:55 INFO Signed narinfos id=25 count=1 lb # [ 81.492344] niks3-server[1010]: 2026/09/20 14:31:55 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 81.499714] niks3-server[1010]: 2026/09/20 14:31:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 81.507431] niks3-server[1010]: 2026/09/20 14:31:55 INFO Signed narinfos id=26 count=2 lb # [ 81.511948] niks3-server[1010]: 2026/09/20 14:31:55 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 81.520421] niks3-server[1010]: 2026/09/20 14:31:55 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 81.530601] niks3-server[1010]: 2026/09/20 14:31:55 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 81.536610] niks3-server[1010]: 2026/09/20 14:31:55 INFO Completed upload id=25 worker2 # [ 81.504666] nix-grpc-daemon[1316]: time=2026-09-20T14:31:55.080Z level=INFO msg="Upload complete. (347ms)" lb # [ 81.539220] niks3-server[1010]: 2026/09/20 14:31:55 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 81.544250] niks3-server[1010]: 2026/09/20 14:31:55 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 81.550016] niks3-server[1010]: 2026/09/20 14:31:55 INFO Completed upload id=26 worker2 # [ 81.516442] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51210 duration_s=0 paths=2 nar_bytes_in=312 lb # [ 81.557347] niks3-server[1010]: 2026/09/20 14:31:55 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo worker2 # [ 81.531809] nix-daemon[858]: reaped child process 1314, status = succeeded worker2 # [ 81.546051] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.550713] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.54 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds) worker1 # [ 81.677214] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 81.687551] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 81.752106] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.757227] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.892519] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:55Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 81.895155] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:55Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 81.899560] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:55Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 81.908838] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:55Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 81.910537] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 81.957518] niks3-server[1010]: 2026/09/20 14:31:55 INFO lead: acquired remote=192.168.1.3:33176 lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 81.932285] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:55Z level=info event=scheduler_take_over worker1 # [ 81.956272] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.959449] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:55Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:32780 worker2 # [ 81.958336] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.961615] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:55Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 81.969045] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:55Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 81.970324] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:55Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:32780 worker1 # [ 81.972594] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:55Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.07 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.23 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1 # [ 82.256597] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 82.916893] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:56Z level=info event=signal_exit worker1 # [ 83.126313] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:56Z level=info event=scheduler_yield lb # [ 83.166760] niks3-server[1010]: 2026/09/20 14:31:56 INFO lead: released remote=192.168.1.3:33176 worker2 # [ 83.135688] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:56Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 83.137973] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:32780 worker1 # [ 83.145454] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:56Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 83.149661] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:56Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 83.153975] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:56Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:32780 worker1 # [ 83.158426] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:56Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 83.335850] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.341201] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.344907] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.349847] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.542236] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.547499] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.550811] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.556328] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.748705] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.753966] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.757146] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.762109] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.955177] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.960651] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.964707] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.968855] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.131488] nix-grpc-daemon[1032]: ts=2026-09-20T14:31:57Z level=info event=scheduler_restarting worker2 # [ 84.163770] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.168141] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.364431] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.369680] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.570845] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.576224] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 84.777309] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.782390] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 84.947319] nix-grpc-daemon[1032]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 84.947771] nix-grpc-daemon[1032]: E0000 00:00:1789914718.517928 1075 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 84.947924] nix-grpc-daemon[1032]: E0000 00:00:1789914718.518167 1075 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 84.983575] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.988766] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.191636] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.195845] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.392348] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.397313] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.598465] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.603605] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.804660] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.809621] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.944908] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 85.947953] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 85.953640] systemd[1]: nix-grpc-daemon.service: Consumed 198ms CPU time over 4.254s wall clock time, 13.6M memory peak, 9.2K incoming IP traffic, 7.9K outgoing IP traffic. worker1 # [ 85.970881] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 85.973270] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 85.976471] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 4.302s wall clock time, 256K memory peak, 13.4K incoming IP traffic, 10.2K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 86.011400] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.018729] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2 # [ 86.219552] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.223593] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.420204] nix-grpc-daemon[1260]: ts=2026-09-20T14:31:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.425190] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.626309] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.631527] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.832619] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.837662] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.038789] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.043909] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2 # [ 87.246697] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.250631] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 87.333311] niks3-server[1010]: 2026/09/20 14:32:00 INFO lead: acquired remote=192.168.1.4:57732 worker2 # [ 87.302053] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:00Z level=info event=scheduler_take_over worker2 # [ 87.447464] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.474213] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:01Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 87.478711] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:01Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:44382 worker2 # [ 87.484000] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker2 # [ 88.552600] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:51210 client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 88.563325] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 88.587782] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:02Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker2 # [ 88.594845] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:02Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 88.631718] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 88.646947] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51210 client # copying 1 paths to 'lb:50051'... worker2 # [ 88.662254] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51210 client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker2 # [ 88.680535] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 88.891599] nix-daemon[858]: accepted connection from pid 1356, user nix-grpc-daemon (trusted) worker2 # [ 88.908791] nix-daemon[858]: reaped child process 1359, status = succeeded worker2 # [ 89.082197] nix-daemon[858]: accepted connection from pid 1361, user nix-grpc-daemon (trusted) worker2 # [ 89.097821] nix-daemon[858]: reaped child process 1364, status = succeeded lb # [ 89.141676] niks3-server[1010]: 2026/09/20 14:32:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 89.120208] nix-grpc-daemon[1316]: time=2026-09-20T14:32:02.695Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 89.121686] nix-grpc-daemon[1316]: time=2026-09-20T14:32:02.695Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 89.167899] niks3-server[1010]: 2026/09/20 14:32:02 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 89.182471] niks3-server[1010]: 2026/09/20 14:32:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker2 # [ 89.155690] nix-grpc-daemon[1316]: time=2026-09-20T14:32:02.731Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.197556] niks3-server[1010]: 2026/09/20 14:32:02 INFO Signed narinfos id=27 count=1 lb # [ 89.214393] niks3-server[1010]: 2026/09/20 14:32:02 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete worker2 # [ 89.188504] nix-grpc-daemon[1316]: time=2026-09-20T14:32:02.764Z level=INFO msg="Upload complete. (490ms)" lb # [ 89.224893] niks3-server[1010]: 2026/09/20 14:32:02 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 89.227719] niks3-server[1010]: 2026/09/20 14:32:02 INFO Completed upload id=27 worker2 # [ 89.196164] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51210 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 89.211632] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 89.215660] nix-grpc-daemon[1316]: time=2026-09-20T14:32:02.781Z level=WARN msg="Failed to register uploaded object" key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 89.225214] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 89.228603] nix-daemon[858]: reaped child process 1354, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker2 # [ 89.240183] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-on-standby lb # [ 90.286203] envoy[901]: conn peer=[2001:db8:1::1]:53624 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1011 tx=282 ms=1238 worker2 # [ 90.271573] nix-daemon[858]: reaped child process 1368, status = succeeded worker2 # [ 90.468796] nix-daemon[858]: accepted connection from pid 1383, user nix-grpc-daemon (trusted) worker2 # [ 90.486938] nix-daemon[858]: reaped child process 1386, status = succeeded lb # [ 90.293799] envoy[901]: conn peer=[2001:db8:1::3]:39630 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1028 tx=349 ms=2217 lb # [ 90.530706] niks3-server[1010]: 2026/09/20 14:32:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 90.520210] nix-grpc-daemon[1316]: time=2026-09-20T14:32:04.093Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 90.522315] nix-grpc-daemon[1316]: time=2026-09-20T14:32:04.093Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" worker2 # [ 90.565834] nix-grpc-daemon[1316]: time=2026-09-20T14:32:04.140Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.589255] niks3-server[1010]: 2026/09/20 14:32:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 90.605049] niks3-server[1010]: 2026/09/20 14:32:04 INFO Signed narinfos id=28 count=1 lb # [ 90.607721] niks3-server[1010]: 2026/09/20 14:32:04 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 90.618482] niks3-server[1010]: 2026/09/20 14:32:04 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 90.632445] niks3-server[1010]: 2026/09/20 14:32:04 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 90.638501] niks3-server[1010]: 2026/09/20 14:32:04 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 90.642093] niks3-server[1010]: 2026/09/20 14:32:04 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo lb # [ 90.645830] niks3-server[1010]: 2026/09/20 14:32:04 INFO Completed upload id=28 worker2 # [ 90.613797] nix-grpc-daemon[1316]: time=2026-09-20T14:32:04.189Z level=INFO msg="Upload complete. (362ms)" worker2 # [ 90.636223] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker2 # [ 90.652357] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:04Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker2 # [ 90.656901] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:04Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 90.661242] nix-daemon[858]: reaped child process 1366, status = succeeded worker2 # [ 90.680998] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 90.696428] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 90.709971] nix-grpc-daemon[1316]: time=2026-09-20T14:32:04.286Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker2 # [ 90.719633] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 90.734058] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 90.938592] nix-daemon[858]: accepted connection from pid 1392, user nix-grpc-daemon (trusted) worker2 # [ 90.956256] nix-daemon[858]: reaped child process 1395, status = succeeded worker2 # [ 91.128667] nix-daemon[858]: accepted connection from pid 1397, user nix-grpc-daemon (trusted) worker2 # [ 91.145404] nix-daemon[858]: reaped child process 1400, status = succeeded lb # [ 91.190237] niks3-server[1010]: 2026/09/20 14:32:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 91.167880] nix-grpc-daemon[1316]: time=2026-09-20T14:32:04.743Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 91.169564] nix-grpc-daemon[1316]: time=2026-09-20T14:32:04.743Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 91.217875] niks3-server[1010]: 2026/09/20 14:32:04 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst worker2 # [ 91.198007] nix-grpc-daemon[1316]: time=2026-09-20T14:32:04.773Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.234465] niks3-server[1010]: 2026/09/20 14:32:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 91.245681] niks3-server[1010]: 2026/09/20 14:32:04 INFO Signed narinfos id=29 count=1 worker2 # [ 91.224779] nix-grpc-daemon[1316]: time=2026-09-20T14:32:04.800Z level=INFO msg="Upload complete. (473ms)" lb # [ 91.255957] niks3-server[1010]: 2026/09/20 14:32:04 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls worker2 # [ 91.230692] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51210 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 91.263088] niks3-server[1010]: 2026/09/20 14:32:04 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 91.269001] niks3-server[1010]: 2026/09/20 14:32:04 INFO Completed upload id=29 worker2 # [ 91.240447] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 lb # [ 91.271713] niks3-server[1010]: 2026/09/20 14:32:04 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker2 # [ 91.249464] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 91.251877] nix-daemon[858]: reaped child process 1390, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... worker2 # [ 91.263230] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv client # farm-b> LOG-farm-b-on-standby worker2 # [ 92.308344] nix-daemon[858]: reaped child process 1404, status = succeeded worker2 # [ 92.479110] nix-daemon[858]: accepted connection from pid 1419, user nix-grpc-daemon (trusted) worker2 # [ 92.495705] nix-daemon[858]: reaped child process 1422, status = succeeded lb # [ 92.540651] niks3-server[1010]: 2026/09/20 14:32:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 92.519871] nix-grpc-daemon[1316]: time=2026-09-20T14:32:06.095Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 92.521504] nix-grpc-daemon[1316]: time=2026-09-20T14:32:06.095Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 92.580800] niks3-server[1010]: 2026/09/20 14:32:06 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker2 # [ 92.561649] nix-grpc-daemon[1316]: time=2026-09-20T14:32:06.137Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.594000] niks3-server[1010]: 2026/09/20 14:32:06 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 92.605295] niks3-server[1010]: 2026/09/20 14:32:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 92.610600] niks3-server[1010]: 2026/09/20 14:32:06 INFO Signed narinfos id=30 count=1 worker2 # [ 92.585414] nix-grpc-daemon[1316]: time=2026-09-20T14:32:06.161Z level=INFO msg="Upload complete. (313ms)" lb # [ 92.617543] niks3-server[1010]: 2026/09/20 14:32:06 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 92.621205] niks3-server[1010]: 2026/09/20 14:32:06 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 92.625590] niks3-server[1010]: 2026/09/20 14:32:06 INFO Completed upload id=30 lb # [ 92.628260] niks3-server[1010]: 2026/09/20 14:32:06 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker2 # [ 92.594744] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker2 # [ 92.615488] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:06Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker2 # [ 92.619150] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:06Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 92.623175] nix-daemon[858]: reaped child process 1402, status = succeeded worker2 # [ 92.655885] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 92.670965] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 92.685336] nix-grpc-daemon[1316]: time=2026-09-20T14:32:06.261Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker2 # [ 92.695141] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 92.711920] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 92.911025] nix-daemon[858]: accepted connection from pid 1428, user nix-grpc-daemon (trusted) worker2 # [ 92.929861] nix-daemon[858]: reaped child process 1431, status = succeeded worker2 # [ 93.099531] nix-daemon[858]: accepted connection from pid 1433, user nix-grpc-daemon (trusted) worker2 # [ 93.114654] nix-daemon[858]: reaped child process 1436, status = succeeded lb # [ 93.161886] niks3-server[1010]: 2026/09/20 14:32:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 93.141577] nix-grpc-daemon[1316]: time=2026-09-20T14:32:06.717Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 93.143047] nix-grpc-daemon[1316]: time=2026-09-20T14:32:06.717Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 93.191327] niks3-server[1010]: 2026/09/20 14:32:06 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker2 # [ 93.173035] nix-grpc-daemon[1316]: time=2026-09-20T14:32:06.748Z level=INFO msg="Uploading 1 narinfos" lb # [ 93.208304] niks3-server[1010]: 2026/09/20 14:32:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 93.218790] niks3-server[1010]: 2026/09/20 14:32:06 INFO Signed narinfos id=31 count=1 lb # [ 93.224701] niks3-server[1010]: 2026/09/20 14:32:06 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 93.234670] niks3-server[1010]: 2026/09/20 14:32:06 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 93.241371] niks3-server[1010]: 2026/09/20 14:32:06 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo lb # [ 93.246235] niks3-server[1010]: 2026/09/20 14:32:06 INFO Completed upload id=31 worker2 # [ 93.214265] nix-grpc-daemon[1316]: time=2026-09-20T14:32:06.790Z level=INFO msg="Upload complete. (486ms)" worker2 # [ 93.222134] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51210 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 93.236405] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 93.246933] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 93.249527] nix-daemon[858]: reaped child process 1426, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 93.264366] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-on-standby worker2 # [ 94.910928] nix-daemon[858]: reaped child process 1440, status = succeeded worker2 # [ 95.085557] nix-daemon[858]: accepted connection from pid 1455, user nix-grpc-daemon (trusted) worker2 # [ 95.102444] nix-daemon[858]: reaped child process 1458, status = succeeded lb # [ 95.147125] niks3-server[1010]: 2026/09/20 14:32:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.126909] nix-grpc-daemon[1316]: time=2026-09-20T14:32:08.701Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 95.128904] nix-grpc-daemon[1316]: time=2026-09-20T14:32:08.701Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 95.182733] niks3-server[1010]: 2026/09/20 14:32:08 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 95.164879] nix-grpc-daemon[1316]: time=2026-09-20T14:32:08.740Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.197174] niks3-server[1010]: 2026/09/20 14:32:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 95.205642] niks3-server[1010]: 2026/09/20 14:32:08 INFO Signed narinfos id=32 count=1 lb # [ 95.211568] niks3-server[1010]: 2026/09/20 14:32:08 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 95.224140] niks3-server[1010]: 2026/09/20 14:32:08 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 95.227611] niks3-server[1010]: 2026/09/20 14:32:08 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 95.232540] niks3-server[1010]: 2026/09/20 14:32:08 INFO Completed upload id=32 worker2 # [ 95.200696] nix-grpc-daemon[1316]: time=2026-09-20T14:32:08.776Z level=INFO msg="Upload complete. (324ms)" lb # [ 95.236512] niks3-server[1010]: 2026/09/20 14:32:08 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker2 # [ 95.213086] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker2 # [ 95.232362] nix-daemon[858]: reaped child process 1438, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.98 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds) worker1 # [ 95.576854] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 95.583438] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 95.775990] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:09Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 95.778574] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 95.782595] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 95.790080] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:09Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 95.791832] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 95.832855] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 95.833928] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:09Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:44382 worker2 # [ 95.840138] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:09Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.18 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 96.248734] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 7c72fe4936d54ac59fc95d11a6b33aec client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds) worker1 # [ 96.499384] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59120 worker1 # [ 96.514700] nix-daemon[835]: accepted connection from pid 1096, user nix-grpc-daemon (trusted) client # [ 96.530631] nix[1168]: don't know how to build these paths: client # [ 96.531860] nix[1168]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 96.545150] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:10Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker2 # [ 96.545489] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:10Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 96.591578] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 96.606853] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51210 client # [ 96.620374] nix[1168]: copying 1 paths to 'lb:50051'... worker2 # [ 96.621070] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51210 client # [ 96.624153] nix[1168]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker2 # [ 96.637911] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 96.862768] nix-daemon[858]: accepted connection from pid 1471, user nix-grpc-daemon (trusted) worker2 # [ 96.881464] nix-daemon[858]: reaped child process 1474, status = succeeded worker2 # [ 97.055465] nix-daemon[858]: accepted connection from pid 1476, user nix-grpc-daemon (trusted) worker2 # [ 97.071925] nix-daemon[858]: reaped child process 1479, status = succeeded lb # [ 97.116691] niks3-server[1010]: 2026/09/20 14:32:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 97.098193] nix-grpc-daemon[1316]: time=2026-09-20T14:32:10.673Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 97.099632] nix-grpc-daemon[1316]: time=2026-09-20T14:32:10.673Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 97.148520] niks3-server[1010]: 2026/09/20 14:32:10 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst worker2 # [ 97.131144] nix-grpc-daemon[1316]: time=2026-09-20T14:32:10.707Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.165339] niks3-server[1010]: 2026/09/20 14:32:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 97.175060] niks3-server[1010]: 2026/09/20 14:32:10 INFO Signed narinfos id=33 count=1 lb # [ 97.179603] niks3-server[1010]: 2026/09/20 14:32:10 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 97.187897] niks3-server[1010]: 2026/09/20 14:32:10 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 97.193764] niks3-server[1010]: 2026/09/20 14:32:10 INFO Completed upload id=33 worker2 # [ 97.161518] nix-grpc-daemon[1316]: time=2026-09-20T14:32:10.737Z level=INFO msg="Upload complete. (507ms)" lb # [ 97.196550] niks3-server[1010]: 2026/09/20 14:32:10 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker2 # [ 97.168243] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51210 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 97.180328] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 worker2 # [ 97.190096] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 97.194601] nix-daemon[858]: reaped child process 1469, status = succeeded client # [ 97.203892] nix[1168]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker2 # [ 97.206585] nix-daemon[858]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 99.190409] systemd-journald[275]: Received client request to rotate journal, rotating. worker1 # [ 99.214092] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/52fb374f0fb2438e8f37f413c929ec86. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 99.267406] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds) client: must succeed: sleep 5.0 worker2 # [ 99.295907] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:12Z level=info event=draining lb # [ 100.289073] envoy[901]: conn peer=[2001:db8:1::1]:59490 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9649 tx=3886 ms=6676 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 104.856670] nix-daemon[858]: reaped child process 1483, status = succeeded worker2 # [ 105.038652] nix-daemon[858]: accepted connection from pid 1523, user nix-grpc-daemon (trusted) worker2 # [ 105.055213] nix-daemon[858]: reaped child process 1526, status = succeeded lb # [ 105.099739] niks3-server[1010]: 2026/09/20 14:32:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 105.083293] nix-grpc-daemon[1316]: time=2026-09-20T14:32:18.655Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 105.085682] nix-grpc-daemon[1316]: time=2026-09-20T14:32:18.655Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 105.143476] niks3-server[1010]: 2026/09/20 14:32:18 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 105.154482] niks3-server[1010]: 2026/09/20 14:32:18 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 105.163393] niks3-server[1010]: 2026/09/20 14:32:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker2 # [ 105.136553] nix-grpc-daemon[1316]: time=2026-09-20T14:32:18.712Z level=INFO msg="Uploading 1 narinfos" lb # [ 105.170911] niks3-server[1010]: 2026/09/20 14:32:18 INFO Signed narinfos id=34 count=1 lb # [ 105.175209] niks3-server[1010]: 2026/09/20 14:32:18 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 105.183630] niks3-server[1010]: 2026/09/20 14:32:18 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 105.187369] niks3-server[1010]: 2026/09/20 14:32:18 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo lb # [ 105.191602] niks3-server[1010]: 2026/09/20 14:32:18 INFO Completed upload id=34 worker2 # [ 105.159784] nix-grpc-daemon[1316]: time=2026-09-20T14:32:18.735Z level=INFO msg="Upload complete. (334ms)" worker2 # [ 105.173224] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51210 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 105.191463] nix-daemon[858]: reaped child process 1481, status = succeeded client # [ 105.212901] systemd[1]: rs.service: Deactivated successfully. client # [ 105.217267] systemd[1]: rs.service: Consumed 175ms CPU time over 8.968s wall clock time, 43.2M memory peak, 6.9K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 105.298305] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:18Z level=info event=signal_exit worker2 # [ 105.523792] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=scheduler_yield lb # [ 105.564383] niks3-server[1010]: 2026/09/20 14:32:19 INFO lead: released remote=192.168.1.4:57732 worker2 # [ 105.537742] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 105.541330] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:19Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 105.544135] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:44382 worker2 # [ 105.548436] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 105.552313] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:44382 worker2 # [ 105.556640] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 105.739281] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.740971] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.744696] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.746885] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.16 seconds) client: waiting for success: ! systemctl is-active rs lb # [ 105.833301] niks3-server[1010]: 2026/09/20 14:32:19 INFO lead: acquired remote=192.168.1.3:51254 worker1 # [ 105.806948] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:19Z level=info event=scheduler_take_over client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' worker2 # [ 105.945692] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.947385] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.950847] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) worker1 # [ 105.952913] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2 # [ 106.151846] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.153915] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.157078] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.159218] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.359776] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.359488] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.365095] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.363748] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.529340] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:20Z level=info event=scheduler_restarting worker1 # [ 106.567584] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.571796] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.581991] nix-daemon[858]: reaped child process 1309, status = succeeded worker2 # [ 106.584841] nix-grpc-daemon[1260]: ts=2026-09-20T14:32:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 106.767922] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.773023] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.973595] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.982841] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:20Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:51662 worker1 # [ 106.988225] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2 # [ 107.359983] nix-grpc-daemon[1260]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 107.360364] nix-grpc-daemon[1260]: E0000 00:00:1789914740.934607 1303 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 107.360487] nix-grpc-daemon[1260]: E0000 00:00:1789914740.935013 1303 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 108.024899] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 108.028871] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 108.031401] systemd[1]: nix-grpc-daemon.service: Consumed 2.037s CPU time over 30.942s wall clock time, 36.8M memory peak, 63.1K incoming IP traffic, 161.2K outgoing IP traffic. worker2 # [ 108.049832] systemd[1]: Starting scheduler-token.service... worker2 # [ 108.146023] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 108.152878] systemd[1]: Finished scheduler-token.service. worker2 # [ 108.156422] systemd[1]: scheduler-token.service: Consumed 42ms CPU time over 99ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 108.161303] systemd[1]: Starting Nix worker-protocol over gRPC... lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 108.343723] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:21Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 108.346367] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 108.350305] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 108.358186] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 108.359908] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 108.394566] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 108.408660] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:21Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 108.412645] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:21Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:51662 worker1 # [ 108.417862] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:21Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.27 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 108.514483] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds) worker1 # [ 108.775606] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59120 client # Running as unit: mid.service; invocation ID: b536d2a53ef34343a26d68d1117e124d client # [ 108.783333] nix[1204]: don't know how to build these paths: client # [ 108.785406] nix[1204]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 108.793678] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:22Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 108.801428] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:22Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 108.841733] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59120 worker1 # [ 108.862700] nix-grpc-daemon[1096]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 1/5) worker1 # [ 108.924390] nix-grpc-daemon[1096]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 144 ms (attempt 2/5) worker1 # [ 109.068974] nix-grpc-daemon[1096]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 195 ms (attempt 3/5) worker1 # [ 109.264327] nix-grpc-daemon[1096]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 715 ms (attempt 4/5) worker1 # [ 109.981502] nix-grpc-daemon[1096]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 110.001532] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59120 client # [ 110.016854] nix[1204]: copying 1 paths to 'lb:50051'... worker1 # [ 110.016329] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59120 client # [ 110.017099] nix[1204]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker1 # [ 110.031396] nix-daemon[835]: accepted connection from pid 1096, user nix-grpc-daemon (trusted) worker1 # [ 110.057751] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:23Z level=info event=niks3_push_started pid=1215 lb # [ 110.289003] envoy[901]: conn peer=[2001:db8:1::1]:53546 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1328 ms=8688 lb # [ 110.293986] envoy[901]: conn peer=[2001:db8:1::4]:45346 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=36252 tx=2077 ms=29242 worker1 # [ 110.281750] nix-grpc-daemon[1215]: time=2026-09-20T14:32:23.852Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 110.453858] nix-daemon[835]: accepted connection from pid 1228, user nix-grpc-daemon (trusted) worker1 # [ 110.470343] nix-daemon[835]: reaped child process 1231, status = succeeded worker1 # [ 110.643620] nix-daemon[835]: accepted connection from pid 1233, user nix-grpc-daemon (trusted) worker1 # [ 110.657952] nix-daemon[835]: reaped child process 1236, status = succeeded lb # [ 110.704909] niks3-server[1010]: 2026/09/20 14:32:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 110.685495] nix-grpc-daemon[1215]: time=2026-09-20T14:32:24.255Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 110.686968] nix-grpc-daemon[1215]: time=2026-09-20T14:32:24.255Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 110.738165] niks3-server[1010]: 2026/09/20 14:32:24 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker1 # [ 110.720761] nix-grpc-daemon[1215]: time=2026-09-20T14:32:24.291Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.750810] niks3-server[1010]: 2026/09/20 14:32:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 110.758163] niks3-server[1010]: 2026/09/20 14:32:24 INFO Signed narinfos id=35 count=1 lb # [ 110.770951] niks3-server[1010]: 2026/09/20 14:32:24 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 110.785699] niks3-server[1010]: 2026/09/20 14:32:24 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls worker1 # [ 110.760078] nix-grpc-daemon[1215]: time=2026-09-20T14:32:24.330Z level=INFO msg="Upload complete. (473ms)" lb # [ 110.790706] niks3-server[1010]: 2026/09/20 14:32:24 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo lb # [ 110.795903] niks3-server[1010]: 2026/09/20 14:32:24 INFO Completed upload id=35 worker1 # [ 110.768137] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59120 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 110.781489] nix-grpc-daemon[1096]: ts=2026-09-20T14:32:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59120 worker1 # [ 110.787622] nix-daemon[835]: accepted connection from pid 1096, user nix-grpc-daemon (trusted) worker1 # [ 110.792651] nix-daemon[835]: reaped child process 1213, status = succeeded worker1 # [ 110.803794] nix-daemon[835]: accepted connection from pid 1096, user nix-grpc-daemon (trusted) client # [ 110.801180] nix[1204]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 112.485916] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1096 (nix-grpc-daemon) on client request. worker1 # [ 112.488778] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 112.522055] niks3-server[1010]: 2026/09/20 14:32:26 INFO lead: released remote=192.168.1.3:51254 client # [ 112.503418] nix[1204]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker2 # [ 112.502494] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds) client: must succeed: sleep 5.0 client # [ 112.509682] nix[1204]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 112.524257] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker1 # [ 112.525741] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1 # [ 112.526958] systemd[1]: nix-grpc-daemon.service: Consumed 569ms CPU time over 16.939s wall clock time, 34M memory peak, 17K incoming IP traffic, 27.5K outgoing IP traffic. worker1 # [ 112.539256] nix-daemon[835]: reaped child process 1238, status = succeeded worker1 # [ 112.540944] nix-daemon[835]: reaped child process 1152, status = succeeded worker1 # [ 112.548532] nix-daemon[1240]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 112.555260] nix-daemon[835]: reaped child process 1240, status = failed with exit code 1 worker1 # [ 112.675514] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker1 # [ 112.680345] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 112.712071] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.881677] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 112.884252] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 112.888262] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 112.895644] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 112.903593] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 112.939996] niks3-server[1010]: 2026/09/20 14:32:26 INFO lead: acquired remote=192.168.1.3:38554 worker1 # [ 112.914246] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=info event=scheduler_take_over worker1 # [ 112.927151] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 112.928756] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53690 worker1 # [ 112.930836] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 112.943863] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.945815] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53690 worker1 # [ 112.947363] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 113.012980] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 113.016832] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:26Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 113.069543] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37722 worker2 # [ 113.084272] nix-daemon[858]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker2 # [ 113.107665] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 1/5) worker2 # [ 113.146260] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 138 ms (attempt 2/5) worker2 # [ 113.291799] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 314 ms (attempt 3/5) worker2 # [ 113.614453] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 139 ms (attempt 4/5) worker2 # [ 113.761630] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 113.778896] nix-grpc-daemon[1536]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'... worker2 # [ 113.806429] nix-daemon[858]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) client # [ 113.824598] nix[1204]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 113.824522] nix-daemon[858]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 118.055358] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:31Z level=info event=niks3_push_started pid=1637 worker2 # [ 118.101518] nix-daemon[858]: reaped child process 1613, status = succeeded worker2 # [ 118.309349] nix-grpc-daemon[1637]: time=2026-09-20T14:32:31.884Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 118.480178] nix-daemon[858]: accepted connection from pid 1650, user nix-grpc-daemon (trusted) worker2 # [ 118.496481] nix-daemon[858]: reaped child process 1653, status = succeeded lb # [ 118.543913] niks3-server[1010]: 2026/09/20 14:32:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 118.522970] nix-grpc-daemon[1637]: time=2026-09-20T14:32:32.097Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 118.525750] nix-grpc-daemon[1637]: time=2026-09-20T14:32:32.097Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 118.588792] niks3-server[1010]: 2026/09/20 14:32:32 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 118.602058] niks3-server[1010]: 2026/09/20 14:32:32 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 118.614062] niks3-server[1010]: 2026/09/20 14:32:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 118.623147] niks3-server[1010]: 2026/09/20 14:32:32 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 118.634260] niks3-server[1010]: 2026/09/20 14:32:32 INFO Signed narinfos id=36 count=1 worker2 # [ 118.604189] nix-grpc-daemon[1637]: time=2026-09-20T14:32:32.178Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.648086] niks3-server[1010]: 2026/09/20 14:32:32 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 118.656851] niks3-server[1010]: 2026/09/20 14:32:32 INFO Completed upload id=36 worker2 # [ 118.623717] nix-grpc-daemon[1637]: time=2026-09-20T14:32:32.199Z level=INFO msg="Upload complete. (310ms)" lb # [ 118.659490] niks3-server[1010]: 2026/09/20 14:32:32 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo worker2 # [ 118.636337] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37722 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker2 # [ 118.652536] nix-daemon[858]: reaped child process 1611, status = succeeded client # [ 118.685227] systemd[1]: mid.service: Deactivated successfully. client # [ 118.691211] systemd[1]: mid.service: Consumed 187ms CPU time over 10.174s wall clock time, 39.2M memory peak, 8.2K incoming IP traffic, 9.9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.62 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 119.106490] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: cd11dba5baa7420699e3b7e9dd81d580 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.05 seconds) client # [ 119.349467] nix[1240]: don't know how to build these paths: client # [ 119.351218] nix[1240]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 119.348400] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37722 worker1 # [ 119.363902] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:32Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker1 # [ 119.369037] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:32Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 119.424121] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 119.438648] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 119.461709] nix-grpc-daemon[1276]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5) worker1 # [ 119.544686] nix-grpc-daemon[1276]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 2/5) worker1 # [ 119.589015] nix-grpc-daemon[1276]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 129 ms (attempt 3/5) worker1 # [ 119.725446] nix-grpc-daemon[1276]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 561 ms (attempt 4/5) lb # [ 120.291761] envoy[901]: conn peer=[2001:db8:1::3]:50080 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1476 tx=539 ms=16681 lb # [ 120.296955] envoy[901]: conn peer=[2001:db8:1::1]:43652 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3871 tx=1700 ms=9882 worker1 # [ 120.295356] nix-grpc-daemon[1276]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 120.316209] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 client # [ 120.324259] nix[1240]: copying 1 paths to 'lb:50051'... client # [ 120.329438] nix[1240]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker1 # [ 120.331215] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 120.349201] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 120.381856] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:33Z level=info event=niks3_push_started pid=1352 worker1 # [ 120.588089] nix-grpc-daemon[1352]: time=2026-09-20T14:32:34.158Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 120.760727] nix-daemon[835]: accepted connection from pid 1365, user nix-grpc-daemon (trusted) worker1 # [ 120.777131] nix-daemon[835]: reaped child process 1368, status = succeeded worker1 # [ 120.948563] nix-daemon[835]: accepted connection from pid 1370, user nix-grpc-daemon (trusted) worker1 # [ 120.966829] nix-daemon[835]: reaped child process 1373, status = succeeded lb # [ 121.010480] niks3-server[1010]: 2026/09/20 14:32:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 120.990608] nix-grpc-daemon[1352]: time=2026-09-20T14:32:34.560Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 120.992550] nix-grpc-daemon[1352]: time=2026-09-20T14:32:34.560Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 121.044911] niks3-server[1010]: 2026/09/20 14:32:34 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst worker1 # [ 121.033981] nix-grpc-daemon[1352]: time=2026-09-20T14:32:34.604Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.057893] niks3-server[1010]: 2026/09/20 14:32:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 121.067434] niks3-server[1010]: 2026/09/20 14:32:34 INFO Signed narinfos id=37 count=1 lb # [ 121.077062] niks3-server[1010]: 2026/09/20 14:32:34 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 121.086431] niks3-server[1010]: 2026/09/20 14:32:34 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete worker1 # [ 121.064578] nix-grpc-daemon[1352]: time=2026-09-20T14:32:34.635Z level=INFO msg="Upload complete. (473ms)" lb # [ 121.097104] niks3-server[1010]: 2026/09/20 14:32:34 INFO Completed upload id=37 lb # [ 121.101319] niks3-server[1010]: 2026/09/20 14:32:34 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker1 # [ 121.072140] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 121.080686] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 121.091126] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 121.095690] nix-daemon[835]: reaped child process 1349, status = succeeded client # [ 121.105271] nix[1240]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker1 # [ 121.108584] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 122.886598] systemd[1]: intr.service: Sent signal SIGINT to main process 1240 (nix) on client request. worker1 # [ 122.889993] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:36Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 122.892884] nix[1240]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 122.904133] nix[1240]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) worker1 # [ 122.944920] nix-daemon[1377]: unexpected Nix daemon error: error: interrupted by the user client # [ 122.945354] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 122.947943] systemd[1]: intr.service: Failed with result 'exit-code'. worker1 # [ 122.950670] nix-daemon[835]: reaped child process 1375, status = succeeded client # [ 122.951985] systemd[1]: intr.service: Consumed 161ms CPU time over 3.838s wall clock time, 41.4M memory peak, 6.2K incoming IP traffic, 7.9K outgoing IP traffic. worker1 # [ 122.955600] nix-daemon[835]: reaped child process 1377, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 4.00 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 123.127272] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: e74945243083463c967fb52f663d32a0 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds) client # [ 123.389182] nix[1260]: don't know how to build these paths: client # [ 123.390970] nix[1260]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 123.388613] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37722 worker1 # [ 123.400783] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:36Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker1 # [ 123.407398] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:36Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 123.452107] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37722 worker2 # [ 123.467745] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37722 client # [ 123.482958] nix[1260]: copying 1 paths to 'lb:50051'... worker2 # [ 123.482194] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37722 client # [ 123.485566] nix[1260]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker2 # [ 123.497109] nix-daemon[858]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker2 # [ 123.699560] nix-daemon[858]: accepted connection from pid 1681, user nix-grpc-daemon (trusted) worker2 # [ 123.714875] nix-daemon[858]: reaped child process 1684, status = succeeded worker2 # [ 123.888085] nix-daemon[858]: accepted connection from pid 1686, user nix-grpc-daemon (trusted) worker2 # [ 123.905964] nix-daemon[858]: reaped child process 1689, status = succeeded lb # [ 123.950191] niks3-server[1010]: 2026/09/20 14:32:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 123.929204] nix-grpc-daemon[1637]: time=2026-09-20T14:32:37.504Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 123.930689] nix-grpc-daemon[1637]: time=2026-09-20T14:32:37.504Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 123.979607] niks3-server[1010]: 2026/09/20 14:32:37 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker2 # [ 123.961729] nix-grpc-daemon[1637]: time=2026-09-20T14:32:37.537Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.993488] niks3-server[1010]: 2026/09/20 14:32:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 124.007060] niks3-server[1010]: 2026/09/20 14:32:37 INFO Signed narinfos id=38 count=1 lb # [ 124.017868] niks3-server[1010]: 2026/09/20 14:32:37 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 124.033013] niks3-server[1010]: 2026/09/20 14:32:37 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls worker2 # [ 124.007488] nix-grpc-daemon[1637]: time=2026-09-20T14:32:37.583Z level=INFO msg="Upload complete. (493ms)" lb # [ 124.043408] niks3-server[1010]: 2026/09/20 14:32:37 INFO Completed upload id=38 worker2 # [ 124.016322] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37722 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 124.032782] nix-grpc-daemon[1637]: time=2026-09-20T14:32:37.598Z level=WARN msg="Failed to register uploaded object" key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 124.044819] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37722 worker2 # [ 124.056314] nix-daemon[858]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker2 # [ 124.061138] nix-daemon[858]: reaped child process 1679, status = succeeded client # [ 124.062312] nix[1260]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker2 # [ 124.065296] nix-daemon[858]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done worker2 # [ 126.578704] nixos[1724]: switching to system configuration /nix/store/lipj73azsya8lp370bv5zwh9743lgssg-nixos-system-worker2-test worker2 # [ 126.585148] systemd[1]: Stopped target Local File Systems. worker2 # [ 126.585942] systemd[1]: Stopped target Remote File Systems. worker2 # activating the configuration... worker2 # setting up /etc... worker2 # [ 127.345123] systemd[1]: Reload requested from client PID 1724 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 127.346910] systemd[1]: Reloading... worker2 # [ 128.224485] systemd[1]: Reloading finished in 872 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 128.302154] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 128.449150] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 128.456552] systemd[1]: Reached target Reactivate sysinit units. worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 128.461489] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 128.463844] dbus-broker-launch[495]: Caught SIGHUP, trigger reload. worker2 # [ 128.472944] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 128.492956] dbus-broker-launch[495]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 128.502561] dbus-broker-launch[495]: NSS returned no entry for 'systemd-timesync' worker2 # [ 128.504788] dbus-broker-launch[495]: Invalid user-name in /nix/store/c8a4kacp5lnfwrcxrjmwczbl8ba32m4a-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 128.517827] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 128.548478] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 128.553424] systemd[1]: Reached target Local File Systems. worker2 # [ 128.557176] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 128.562760] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 128.568285] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 128.571618] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 128.574709] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 128.575913] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 128.588692] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 128.592986] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 128.596209] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 128.600560] systemd[1]: Reached target Remote File Systems. worker2 # [ 129.083748] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 129.088076] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 129.089180] systemd[1]: Starting linger-users.service... worker2 # [ 129.144672] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 129.152158] systemd[1]: Finished linger-users.service. worker2 # [ 129.370933] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:42Z level=info event=draining worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 129.402486] nixos[1724]: finished switching to system configuration /nix/store/lipj73azsya8lp370bv5zwh9743lgssg-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.65 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 129.756491] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 129.762926] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 129.790808] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:43Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker1 # [ 129.797658] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:43Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 129.841750] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 129.856660] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 client # copying 1 paths to 'lb:50051'... worker1 # [ 129.872473] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker1 # [ 129.896147] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 130.105641] nix-daemon[835]: accepted connection from pid 1427, user nix-grpc-daemon (trusted) worker1 # [ 130.122851] nix-daemon[835]: reaped child process 1430, status = succeeded lb # [ 130.297415] envoy[901]: conn peer=[2001:db8:1::1]:57458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=753 ms=3568 worker1 # [ 130.293206] nix-daemon[835]: accepted connection from pid 1432, user nix-grpc-daemon (trusted) worker1 # [ 130.309204] nix-daemon[835]: reaped child process 1435, status = succeeded lb # [ 130.352959] niks3-server[1010]: 2026/09/20 14:32:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 130.337437] nix-grpc-daemon[1352]: time=2026-09-20T14:32:43.907Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 130.338888] nix-grpc-daemon[1352]: time=2026-09-20T14:32:43.907Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 130.401993] niks3-server[1010]: 2026/09/20 14:32:43 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker1 # [ 130.386663] nix-grpc-daemon[1352]: time=2026-09-20T14:32:43.957Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.411991] niks3-server[1010]: 2026/09/20 14:32:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 130.421277] niks3-server[1010]: 2026/09/20 14:32:44 INFO Signed narinfos id=39 count=1 lb # [ 130.423265] niks3-server[1010]: 2026/09/20 14:32:44 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 130.431257] niks3-server[1010]: 2026/09/20 14:32:44 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 130.436962] niks3-server[1010]: 2026/09/20 14:32:44 INFO Completed upload id=39 worker1 # [ 130.406778] nix-grpc-daemon[1352]: time=2026-09-20T14:32:43.977Z level=INFO msg="Upload complete. (492ms)" lb # [ 130.440117] niks3-server[1010]: 2026/09/20 14:32:44 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker1 # [ 130.416623] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=528 worker1 # [ 130.430291] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 130.436874] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 130.441837] nix-daemon[835]: reaped child process 1425, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... worker1 # [ 130.452838] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv client # farm-a> LOG-farm-a-during-drain worker1 # [ 131.292007] nix-daemon[835]: reaped child process 1439, status = succeeded worker1 # [ 131.473809] nix-daemon[835]: accepted connection from pid 1454, user nix-grpc-daemon (trusted) worker1 # [ 131.491228] nix-daemon[835]: reaped child process 1457, status = succeeded lb # [ 131.533948] niks3-server[1010]: 2026/09/20 14:32:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 131.514658] nix-grpc-daemon[1352]: time=2026-09-20T14:32:45.085Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 131.519751] nix-grpc-daemon[1352]: time=2026-09-20T14:32:45.087Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 131.574616] niks3-server[1010]: 2026/09/20 14:32:45 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 131.585793] niks3-server[1010]: 2026/09/20 14:32:45 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 131.600654] niks3-server[1010]: 2026/09/20 14:32:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker1 # [ 131.577347] nix-grpc-daemon[1352]: time=2026-09-20T14:32:45.147Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.612827] niks3-server[1010]: 2026/09/20 14:32:45 INFO Signed narinfos id=40 count=1 lb # [ 131.615588] niks3-server[1010]: 2026/09/20 14:32:45 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 131.623956] niks3-server[1010]: 2026/09/20 14:32:45 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 131.634715] niks3-server[1010]: 2026/09/20 14:32:45 INFO Completed upload id=40 worker1 # [ 131.604441] nix-grpc-daemon[1352]: time=2026-09-20T14:32:45.175Z level=INFO msg="Upload complete. (339ms)" lb # [ 131.637291] niks3-server[1010]: 2026/09/20 14:32:45 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker1 # [ 131.620980] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker1 # [ 131.636354] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:45Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker1 # [ 131.639944] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:45Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 131.644715] nix-daemon[835]: reaped child process 1437, status = succeeded worker1 # [ 131.665722] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 131.685983] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 client # copying 1 paths to 'lb:50051'... worker1 # [ 131.701528] nix-grpc-daemon[1352]: time=2026-09-20T14:32:45.271Z level=INFO msg="All 1 paths already cached" worker1 # [ 131.706882] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker1 # [ 131.729615] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 131.932782] nix-daemon[835]: accepted connection from pid 1463, user nix-grpc-daemon (trusted) worker1 # [ 131.952630] nix-daemon[835]: reaped child process 1466, status = succeeded worker1 # [ 132.127869] nix-daemon[835]: accepted connection from pid 1468, user nix-grpc-daemon (trusted) worker1 # [ 132.147091] nix-daemon[835]: reaped child process 1471, status = succeeded lb # [ 132.190199] niks3-server[1010]: 2026/09/20 14:32:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 132.169442] nix-grpc-daemon[1352]: time=2026-09-20T14:32:45.739Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 132.170980] nix-grpc-daemon[1352]: time=2026-09-20T14:32:45.739Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 132.217007] niks3-server[1010]: 2026/09/20 14:32:45 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst worker1 # [ 132.199598] nix-grpc-daemon[1352]: time=2026-09-20T14:32:45.770Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.233331] niks3-server[1010]: 2026/09/20 14:32:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 132.244167] niks3-server[1010]: 2026/09/20 14:32:45 INFO Signed narinfos id=41 count=1 lb # [ 132.250530] niks3-server[1010]: 2026/09/20 14:32:45 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls worker1 # [ 132.230932] nix-grpc-daemon[1352]: time=2026-09-20T14:32:45.801Z level=INFO msg="Upload complete. (483ms)" lb # [ 132.260690] niks3-server[1010]: 2026/09/20 14:32:45 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 132.267310] niks3-server[1010]: 2026/09/20 14:32:45 INFO Completed upload id=41 worker1 # [ 132.237044] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 132.270693] niks3-server[1010]: 2026/09/20 14:32:45 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker1 # [ 132.249363] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 132.256304] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 132.261160] nix-daemon[835]: reaped child process 1461, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker1 # [ 132.274426] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-during-drain worker1 # [ 133.514788] nix-daemon[835]: reaped child process 1475, status = succeeded worker1 # [ 133.700473] nix-daemon[835]: accepted connection from pid 1490, user nix-grpc-daemon (trusted) worker1 # [ 133.716418] nix-daemon[835]: reaped child process 1493, status = succeeded lb # [ 133.761799] niks3-server[1010]: 2026/09/20 14:32:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.742102] nix-grpc-daemon[1352]: time=2026-09-20T14:32:47.312Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 133.743580] nix-grpc-daemon[1352]: time=2026-09-20T14:32:47.312Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 133.792733] niks3-server[1010]: 2026/09/20 14:32:47 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 133.809251] niks3-server[1010]: 2026/09/20 14:32:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker1 # [ 133.785212] nix-grpc-daemon[1352]: time=2026-09-20T14:32:47.355Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.822811] niks3-server[1010]: 2026/09/20 14:32:47 INFO Signed narinfos id=42 count=1 lb # [ 133.830404] niks3-server[1010]: 2026/09/20 14:32:47 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 133.843006] niks3-server[1010]: 2026/09/20 14:32:47 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls worker1 # [ 133.816831] nix-grpc-daemon[1352]: time=2026-09-20T14:32:47.387Z level=INFO msg="Upload complete. (332ms)" lb # [ 133.847715] niks3-server[1010]: 2026/09/20 14:32:47 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 133.851864] niks3-server[1010]: 2026/09/20 14:32:47 INFO Completed upload id=42 lb # [ 133.855133] niks3-server[1010]: 2026/09/20 14:32:47 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker1 # [ 133.832133] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker1 # [ 133.848900] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:47Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker1 # [ 133.853983] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:47Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 133.858455] nix-daemon[835]: reaped child process 1473, status = succeeded worker1 # [ 133.885982] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 133.900991] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 133.915979] nix-grpc-daemon[1352]: time=2026-09-20T14:32:47.486Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 133.926107] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker1 # [ 133.948874] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 134.161440] nix-daemon[835]: accepted connection from pid 1499, user nix-grpc-daemon (trusted) worker1 # [ 134.178499] nix-daemon[835]: reaped child process 1502, status = succeeded worker1 # [ 134.351014] nix-daemon[835]: accepted connection from pid 1504, user nix-grpc-daemon (trusted) worker1 # [ 134.367494] nix-daemon[835]: reaped child process 1507, status = succeeded lb # [ 134.409554] niks3-server[1010]: 2026/09/20 14:32:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 134.388704] nix-grpc-daemon[1352]: time=2026-09-20T14:32:47.959Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 134.390181] nix-grpc-daemon[1352]: time=2026-09-20T14:32:47.959Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 134.436911] niks3-server[1010]: 2026/09/20 14:32:48 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst worker1 # [ 134.418920] nix-grpc-daemon[1352]: time=2026-09-20T14:32:47.989Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.452879] niks3-server[1010]: 2026/09/20 14:32:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 134.463421] niks3-server[1010]: 2026/09/20 14:32:48 INFO Signed narinfos id=43 count=1 lb # [ 134.467591] niks3-server[1010]: 2026/09/20 14:32:48 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 134.475722] niks3-server[1010]: 2026/09/20 14:32:48 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete worker1 # [ 134.449350] nix-grpc-daemon[1352]: time=2026-09-20T14:32:48.020Z level=INFO msg="Upload complete. (483ms)" lb # [ 134.480362] niks3-server[1010]: 2026/09/20 14:32:48 INFO Completed upload id=43 lb # [ 134.483724] niks3-server[1010]: 2026/09/20 14:32:48 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker1 # [ 134.456286] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 134.466096] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 134.471353] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 134.475631] nix-daemon[835]: reaped child process 1497, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker1 # [ 134.487374] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> LOG-farm-top-during-drain worker1 # [ 135.534044] nix-daemon[835]: reaped child process 1511, status = succeeded worker1 # [ 135.711676] nix-daemon[835]: accepted connection from pid 1526, user nix-grpc-daemon (trusted) worker1 # [ 135.730980] nix-daemon[835]: reaped child process 1529, status = succeeded lb # [ 135.773892] niks3-server[1010]: 2026/09/20 14:32:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 135.754696] nix-grpc-daemon[1352]: time=2026-09-20T14:32:49.323Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 135.756356] nix-grpc-daemon[1352]: time=2026-09-20T14:32:49.323Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 135.805036] niks3-server[1010]: 2026/09/20 14:32:49 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 135.818449] niks3-server[1010]: 2026/09/20 14:32:49 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 135.831347] niks3-server[1010]: 2026/09/20 14:32:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker1 # [ 135.806453] nix-grpc-daemon[1352]: time=2026-09-20T14:32:49.376Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.841869] niks3-server[1010]: 2026/09/20 14:32:49 INFO Signed narinfos id=44 count=1 lb # [ 135.847453] niks3-server[1010]: 2026/09/20 14:32:49 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 135.856687] niks3-server[1010]: 2026/09/20 14:32:49 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 135.861819] niks3-server[1010]: 2026/09/20 14:32:49 INFO Completed upload id=44 worker1 # [ 135.831213] nix-grpc-daemon[1352]: time=2026-09-20T14:32:49.402Z level=INFO msg="Upload complete. (334ms)" lb # [ 135.864969] niks3-server[1010]: 2026/09/20 14:32:49 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker1 # [ 135.845191] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker1 # [ 135.862031] nix-daemon[835]: reaped child process 1509, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.42 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 136.325756] nix-daemon[858]: reaped child process 1693, status = succeeded worker2 # [ 136.501277] nix-daemon[858]: accepted connection from pid 1864, user nix-grpc-daemon (trusted) worker2 # [ 136.519122] nix-daemon[858]: reaped child process 1867, status = succeeded lb # [ 136.563415] niks3-server[1010]: 2026/09/20 14:32:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 136.542043] nix-grpc-daemon[1637]: time=2026-09-20T14:32:50.117Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 136.543604] nix-grpc-daemon[1637]: time=2026-09-20T14:32:50.117Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 136.599644] niks3-server[1010]: 2026/09/20 14:32:50 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 136.609951] niks3-server[1010]: 2026/09/20 14:32:50 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst worker2 # [ 136.590350] nix-grpc-daemon[1637]: time=2026-09-20T14:32:50.165Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.621928] niks3-server[1010]: 2026/09/20 14:32:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 136.626924] niks3-server[1010]: 2026/09/20 14:32:50 INFO Signed narinfos id=45 count=1 lb # [ 136.631486] niks3-server[1010]: 2026/09/20 14:32:50 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 136.639491] niks3-server[1010]: 2026/09/20 14:32:50 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 136.647627] niks3-server[1010]: 2026/09/20 14:32:50 INFO Completed upload id=45 worker2 # [ 136.615358] nix-grpc-daemon[1637]: time=2026-09-20T14:32:50.191Z level=INFO msg="Upload complete. (323ms)" lb # [ 136.650497] niks3-server[1010]: 2026/09/20 14:32:50 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker2 # [ 136.629122] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37722 duration_s=12 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker2 # [ 136.642238] nix-daemon[858]: reaped child process 1691, status = succeeded client # [ 136.674067] systemd[1]: sw.service: Deactivated successfully. client # [ 136.678634] systemd[1]: sw.service: Consumed 181ms CPU time over 13.549s wall clock time, 39.2M memory peak, 6.8K incoming IP traffic, 8.2K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.11 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 137.378006] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:50Z level=info event=signal_exit worker2 # [ 137.439426] systemd[1]: Starting scheduler-token.service... worker2 # [ 137.526190] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 137.529616] systemd[1]: Finished scheduler-token.service. worker2 # [ 137.530936] systemd[1]: scheduler-token.service: Consumed 31ms CPU time over 87ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker1 # [ 138.610774] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:52Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53690 worker2 # [ 138.612884] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:52Z level=info event=scheduler_restarting worker1 # [ 138.615349] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:52Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 138.631258] nix-grpc-daemon[1536]: ts=2026-09-20T14:32:52Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 138.654080] nix-daemon[858]: reaped child process 1605, status = succeeded worker2 # [ 139.085422] nix-grpc-daemon[1536]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 139.089845] nix-grpc-daemon[1536]: E0000 00:00:1789914772.661368 1579 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker2 # [ 139.114493] nix-grpc-daemon[1536]: E0000 00:00:1789914772.690540 1579 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true lb # [ 140.294042] envoy[901]: conn peer=[2001:db8:1::1]:41332 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9625 tx=3866 ms=6106 lb # [ 140.299138] envoy[901]: conn peer=[2001:db8:1::1]:41322 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2935 tx=1335 ms=13254 lb # [ 140.304483] envoy[901]: conn peer=[2001:db8:1::4]:36872 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2238 tx=425 ms=30231 worker2 # [ 140.425518] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 140.428409] systemd[1]: nix-grpc-daemon.service: Consumed 885ms CPU time over 32.266s wall clock time, 33.3M memory peak, 20.9K incoming IP traffic, 28.4K outgoing IP traffic. worker2 # [ 140.449849] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 140.642052] nix-grpc-daemon[1884]: ts=2026-09-20T14:32:54Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 140.644857] nix-grpc-daemon[1884]: ts=2026-09-20T14:32:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 140.648990] nix-grpc-daemon[1884]: ts=2026-09-20T14:32:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 140.656861] nix-grpc-daemon[1884]: ts=2026-09-20T14:32:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 140.658609] systemd[1]: Started Nix worker-protocol over gRPC. worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.33 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 140.702013] nix-grpc-daemon[1884]: ts=2026-09-20T14:32:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 140.707863] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:54Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53690 worker1 # [ 140.713918] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:54Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 18.93 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 142.255699] nix-grpc-daemon[1884]: ts=2026-09-20T14:32:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 142.269961] nix-daemon[858]: accepted connection from pid 1884, user nix-grpc-daemon (trusted) worker2 # [ 142.291546] nix-grpc-daemon[1884]: ts=2026-09-20T14:32:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 142.307217] nix-grpc-daemon[1884]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 1/5) worker2 # [ 142.381939] nix-grpc-daemon[1884]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 141 ms (attempt 2/5) worker2 # [ 142.530639] nix-grpc-daemon[1884]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 344 ms (attempt 3/5) worker2 # [ 142.882487] nix-grpc-daemon[1884]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 4/5) worker2 # [ 143.023539] nix-grpc-daemon[1884]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 143.084676] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:56Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker1 # [ 143.090039] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:56Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 143.095905] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:56Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker1 # [ 143.101287] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:56Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 143.130683] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 143.147470] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 143.163517] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 143.179598] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 143.386662] nix-daemon[835]: accepted connection from pid 1538, user nix-grpc-daemon (trusted) worker1 # [ 143.404884] nix-daemon[835]: reaped child process 1541, status = succeeded worker1 # [ 143.576899] nix-daemon[835]: accepted connection from pid 1543, user nix-grpc-daemon (trusted) worker1 # [ 143.594565] nix-daemon[835]: reaped child process 1546, status = succeeded lb # [ 143.637754] niks3-server[1010]: 2026/09/20 14:32:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 143.617262] nix-grpc-daemon[1352]: time=2026-09-20T14:32:57.187Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 143.618729] nix-grpc-daemon[1352]: time=2026-09-20T14:32:57.187Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 143.668439] niks3-server[1010]: 2026/09/20 14:32:57 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 143.652362] nix-grpc-daemon[1352]: time=2026-09-20T14:32:57.222Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.682810] niks3-server[1010]: 2026/09/20 14:32:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 143.693469] niks3-server[1010]: 2026/09/20 14:32:57 INFO Signed narinfos id=46 count=1 lb # [ 143.698185] niks3-server[1010]: 2026/09/20 14:32:57 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls worker1 # [ 143.675480] nix-grpc-daemon[1352]: time=2026-09-20T14:32:57.246Z level=INFO msg="Upload complete. (479ms)" lb # [ 143.706516] niks3-server[1010]: 2026/09/20 14:32:57 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 143.711337] niks3-server[1010]: 2026/09/20 14:32:57 INFO Completed upload id=46 lb # [ 143.714523] niks3-server[1010]: 2026/09/20 14:32:57 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 143.684673] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 143.693639] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 143.699551] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 143.703657] nix-daemon[835]: reaped child process 1536, status = succeeded worker1 # [ 143.715790] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 145.147861] nix-daemon[835]: reaped child process 1550, status = succeeded worker1 # [ 145.331504] nix-daemon[835]: accepted connection from pid 1565, user nix-grpc-daemon (trusted) worker1 # [ 145.346289] nix-daemon[835]: reaped child process 1568, status = succeeded lb # [ 145.393571] niks3-server[1010]: 2026/09/20 14:32:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 145.372523] nix-grpc-daemon[1352]: time=2026-09-20T14:32:58.943Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 145.377152] nix-grpc-daemon[1352]: time=2026-09-20T14:32:58.945Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" worker1 # [ 145.411194] nix-grpc-daemon[1352]: time=2026-09-20T14:32:58.981Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.434945] niks3-server[1010]: 2026/09/20 14:32:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 145.451888] niks3-server[1010]: 2026/09/20 14:32:59 INFO Signed narinfos id=47 count=1 lb # [ 145.462504] niks3-server[1010]: 2026/09/20 14:32:59 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 145.470405] niks3-server[1010]: 2026/09/20 14:32:59 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 145.479153] niks3-server[1010]: 2026/09/20 14:32:59 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls worker1 # [ 145.453156] nix-grpc-daemon[1352]: time=2026-09-20T14:32:59.024Z level=INFO msg="Upload complete. (326ms)" lb # [ 145.484249] niks3-server[1010]: 2026/09/20 14:32:59 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 145.489881] niks3-server[1010]: 2026/09/20 14:32:59 INFO Completed upload id=47 lb # [ 145.493195] niks3-server[1010]: 2026/09/20 14:32:59 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 145.470640] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=1 worker1 # [ 145.484493] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:59Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 145.495017] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 145.499515] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:59Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 145.504247] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 145.508502] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 145.513109] nix-daemon[835]: reaped child process 1548, status = succeeded worker1 # [ 145.524277] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 145.705153] nix-daemon[835]: accepted connection from pid 1574, user nix-grpc-daemon (trusted) worker1 # [ 145.722985] nix-daemon[835]: reaped child process 1577, status = succeeded worker1 # [ 145.896116] nix-daemon[835]: accepted connection from pid 1579, user nix-grpc-daemon (trusted) worker1 # [ 145.913040] nix-daemon[835]: reaped child process 1582, status = succeeded lb # [ 145.954773] niks3-server[1010]: 2026/09/20 14:32:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 145.932725] nix-grpc-daemon[1352]: time=2026-09-20T14:32:59.503Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 145.934317] nix-grpc-daemon[1352]: time=2026-09-20T14:32:59.503Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 145.979606] niks3-server[1010]: 2026/09/20 14:32:59 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 145.962072] nix-grpc-daemon[1352]: time=2026-09-20T14:32:59.532Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.994905] niks3-server[1010]: 2026/09/20 14:32:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 146.006086] niks3-server[1010]: 2026/09/20 14:32:59 INFO Signed narinfos id=48 count=1 lb # [ 146.010530] niks3-server[1010]: 2026/09/20 14:32:59 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls worker1 # [ 145.989767] nix-grpc-daemon[1352]: time=2026-09-20T14:32:59.560Z level=INFO msg="Upload complete. (460ms)" lb # [ 146.020742] niks3-server[1010]: 2026/09/20 14:32:59 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 146.025769] niks3-server[1010]: 2026/09/20 14:32:59 INFO Completed upload id=48 worker1 # [ 145.995048] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 146.028966] niks3-server[1010]: 2026/09/20 14:32:59 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 146.006146] nix-grpc-daemon[1276]: ts=2026-09-20T14:32:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 146.011242] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 146.015545] nix-daemon[835]: reaped child process 1572, status = succeeded worker1 # [ 146.026891] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 146.854056] nix-daemon[835]: reaped child process 1586, status = succeeded worker1 # [ 147.018890] nix-daemon[835]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 147.037061] nix-daemon[835]: reaped child process 1604, status = succeeded lb # [ 147.085086] niks3-server[1010]: 2026/09/20 14:33:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.064390] nix-grpc-daemon[1352]: time=2026-09-20T14:33:00.634Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 147.065910] nix-grpc-daemon[1352]: time=2026-09-20T14:33:00.634Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 147.131266] niks3-server[1010]: 2026/09/20 14:33:00 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst worker1 # [ 147.112070] nix-grpc-daemon[1352]: time=2026-09-20T14:33:00.682Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.144181] niks3-server[1010]: 2026/09/20 14:33:00 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 147.153147] niks3-server[1010]: 2026/09/20 14:33:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 147.162943] niks3-server[1010]: 2026/09/20 14:33:00 INFO Signed narinfos id=49 count=1 worker1 # [ 147.136146] nix-grpc-daemon[1352]: time=2026-09-20T14:33:00.707Z level=INFO msg="Upload complete. (299ms)" lb # [ 147.166813] niks3-server[1010]: 2026/09/20 14:33:00 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 147.171809] niks3-server[1010]: 2026/09/20 14:33:00 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 147.176476] niks3-server[1010]: 2026/09/20 14:33:00 INFO Completed upload id=49 lb # [ 147.180411] niks3-server[1010]: 2026/09/20 14:33:00 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker1 # [ 147.149475] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=1 worker1 # [ 147.166711] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:00Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 147.171470] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 147.176686] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:00Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 147.181797] nix-daemon[835]: reaped child process 1584, status = succeeded worker1 # [ 147.183620] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 147.191896] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 147.201136] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 147.392268] nix-daemon[835]: accepted connection from pid 1610, user nix-grpc-daemon (trusted) worker1 # [ 147.410568] nix-daemon[835]: reaped child process 1613, status = succeeded worker1 # [ 147.581552] nix-daemon[835]: accepted connection from pid 1615, user nix-grpc-daemon (trusted) worker1 # [ 147.597884] nix-daemon[835]: reaped child process 1618, status = succeeded lb # [ 147.639556] niks3-server[1010]: 2026/09/20 14:33:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.618109] nix-grpc-daemon[1352]: time=2026-09-20T14:33:01.188Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 147.619577] nix-grpc-daemon[1352]: time=2026-09-20T14:33:01.188Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 147.666808] niks3-server[1010]: 2026/09/20 14:33:01 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 147.679799] niks3-server[1010]: 2026/09/20 14:33:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker1 # [ 147.656291] nix-grpc-daemon[1352]: time=2026-09-20T14:33:01.227Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.692258] niks3-server[1010]: 2026/09/20 14:33:01 INFO Signed narinfos id=50 count=1 lb # [ 147.697633] niks3-server[1010]: 2026/09/20 14:33:01 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 147.704576] niks3-server[1010]: 2026/09/20 14:33:01 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete worker1 # [ 147.678522] nix-grpc-daemon[1352]: time=2026-09-20T14:33:01.249Z level=INFO msg="Upload complete. (466ms)" lb # [ 147.710457] niks3-server[1010]: 2026/09/20 14:33:01 INFO Completed upload id=50 lb # [ 147.714338] niks3-server[1010]: 2026/09/20 14:33:01 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 147.691190] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 147.695895] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 147.699961] nix-daemon[835]: reaped child process 1608, status = succeeded worker1 # [ 147.706068] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 147.716225] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 148.942713] nix-daemon[835]: reaped child process 1622, status = succeeded worker1 # [ 149.106263] nix-daemon[835]: accepted connection from pid 1637, user nix-grpc-daemon (trusted) worker1 # [ 149.124832] nix-daemon[835]: reaped child process 1640, status = succeeded lb # [ 149.169894] niks3-server[1010]: 2026/09/20 14:33:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.158358] nix-grpc-daemon[1352]: time=2026-09-20T14:33:02.727Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 149.160105] nix-grpc-daemon[1352]: time=2026-09-20T14:33:02.728Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 149.214190] niks3-server[1010]: 2026/09/20 14:33:02 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst worker1 # [ 149.196292] nix-grpc-daemon[1352]: time=2026-09-20T14:33:02.766Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.227771] niks3-server[1010]: 2026/09/20 14:33:02 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 149.237506] niks3-server[1010]: 2026/09/20 14:33:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 149.242991] niks3-server[1010]: 2026/09/20 14:33:02 INFO Signed narinfos id=51 count=1 lb # [ 149.248708] niks3-server[1010]: 2026/09/20 14:33:02 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 149.251916] niks3-server[1010]: 2026/09/20 14:33:02 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 149.256258] niks3-server[1010]: 2026/09/20 14:33:02 INFO Completed upload id=51 lb # [ 149.258775] niks3-server[1010]: 2026/09/20 14:33:02 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker1 # [ 149.225180] nix-grpc-daemon[1352]: time=2026-09-20T14:33:02.796Z level=INFO msg="Upload complete. (298ms)" worker1 # [ 149.244671] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=1 worker1 # [ 149.256362] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:02Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 149.265324] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 149.270080] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:02Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 149.275181] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 149.279893] nix-daemon[835]: reaped child process 1620, status = succeeded worker1 # [ 149.281995] nix-grpc-daemon[1352]: time=2026-09-20T14:33:02.850Z level=INFO msg="All 1 paths already cached" worker1 # [ 149.285602] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 149.296734] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 149.479450] nix-daemon[835]: accepted connection from pid 1646, user nix-grpc-daemon (trusted) worker1 # [ 149.494739] nix-daemon[835]: reaped child process 1649, status = succeeded worker1 # [ 149.671308] nix-daemon[835]: accepted connection from pid 1651, user nix-grpc-daemon (trusted) worker1 # [ 149.687603] nix-daemon[835]: reaped child process 1654, status = succeeded lb # [ 149.729296] niks3-server[1010]: 2026/09/20 14:33:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.707971] nix-grpc-daemon[1352]: time=2026-09-20T14:33:03.278Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 149.709649] nix-grpc-daemon[1352]: time=2026-09-20T14:33:03.278Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 149.755437] niks3-server[1010]: 2026/09/20 14:33:03 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 149.738584] nix-grpc-daemon[1352]: time=2026-09-20T14:33:03.309Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.771253] niks3-server[1010]: 2026/09/20 14:33:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 149.781093] niks3-server[1010]: 2026/09/20 14:33:03 INFO Signed narinfos id=52 count=1 lb # [ 149.790030] niks3-server[1010]: 2026/09/20 14:33:03 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 149.796928] niks3-server[1010]: 2026/09/20 14:33:03 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 149.802019] niks3-server[1010]: 2026/09/20 14:33:03 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo lb # [ 149.806463] niks3-server[1010]: 2026/09/20 14:33:03 INFO Completed upload id=52 worker1 # [ 149.775792] nix-grpc-daemon[1352]: time=2026-09-20T14:33:03.346Z level=INFO msg="Upload complete. (468ms)" worker1 # [ 149.783320] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 149.796924] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 149.802809] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 149.807257] nix-daemon[835]: reaped child process 1644, status = succeeded worker1 # [ 149.818026] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 150.463144] nix-daemon[835]: reaped child process 1658, status = succeeded worker1 # [ 150.642284] nix-daemon[835]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker1 # [ 150.658988] nix-daemon[835]: reaped child process 1676, status = succeeded lb # [ 150.702350] niks3-server[1010]: 2026/09/20 14:33:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.684393] nix-grpc-daemon[1352]: time=2026-09-20T14:33:04.252Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 150.685926] nix-grpc-daemon[1352]: time=2026-09-20T14:33:04.252Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 150.748237] niks3-server[1010]: 2026/09/20 14:33:04 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker1 # [ 150.727638] nix-grpc-daemon[1352]: time=2026-09-20T14:33:04.298Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.762118] niks3-server[1010]: 2026/09/20 14:33:04 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 150.772211] niks3-server[1010]: 2026/09/20 14:33:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 150.775861] niks3-server[1010]: 2026/09/20 14:33:04 INFO Signed narinfos id=53 count=1 lb # [ 150.781762] niks3-server[1010]: 2026/09/20 14:33:04 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 150.785787] niks3-server[1010]: 2026/09/20 14:33:04 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete worker1 # [ 150.755492] nix-grpc-daemon[1352]: time=2026-09-20T14:33:04.326Z level=INFO msg="Upload complete. (323ms)" lb # [ 150.789727] niks3-server[1010]: 2026/09/20 14:33:04 INFO Completed upload id=53 lb # [ 150.792369] niks3-server[1010]: 2026/09/20 14:33:04 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker1 # [ 150.768845] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=1 worker1 # [ 150.781287] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:04Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 150.785527] nix-daemon[835]: reaped child process 1656, status = succeeded worker1 # [ 150.809235] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 150.816673] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:04Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 150.827243] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 150.840640] nix-grpc-daemon[1352]: time=2026-09-20T14:33:04.411Z level=INFO msg="All 1 paths already cached" worker1 # [ 150.848790] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 150.861267] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 151.060169] nix-daemon[835]: accepted connection from pid 1682, user nix-grpc-daemon (trusted) worker1 # [ 151.077275] nix-daemon[835]: reaped child process 1685, status = succeeded worker1 # [ 151.255574] nix-daemon[835]: accepted connection from pid 1687, user nix-grpc-daemon (trusted) worker1 # [ 151.271930] nix-daemon[835]: reaped child process 1690, status = succeeded lb # [ 151.313787] niks3-server[1010]: 2026/09/20 14:33:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.294075] nix-grpc-daemon[1352]: time=2026-09-20T14:33:04.864Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 151.295536] nix-grpc-daemon[1352]: time=2026-09-20T14:33:04.864Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 151.349465] niks3-server[1010]: 2026/09/20 14:33:04 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst worker1 # [ 151.328604] nix-grpc-daemon[1352]: time=2026-09-20T14:33:04.899Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.362173] niks3-server[1010]: 2026/09/20 14:33:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 151.372281] niks3-server[1010]: 2026/09/20 14:33:04 INFO Signed narinfos id=54 count=1 lb # [ 151.380045] niks3-server[1010]: 2026/09/20 14:33:04 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 151.383454] niks3-server[1010]: 2026/09/20 14:33:04 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker1 # [ 151.357284] nix-grpc-daemon[1352]: time=2026-09-20T14:33:04.928Z level=INFO msg="Upload complete. (482ms)" lb # [ 151.388446] niks3-server[1010]: 2026/09/20 14:33:04 INFO Completed upload id=54 lb # [ 151.390865] niks3-server[1010]: 2026/09/20 14:33:04 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 151.364119] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 151.374710] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 151.382901] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 151.385312] nix-daemon[835]: reaped child process 1680, status = succeeded worker1 # [ 151.398236] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 152.217688] nix-daemon[835]: reaped child process 1694, status = succeeded worker1 # [ 152.373629] nix-daemon[835]: accepted connection from pid 1709, user nix-grpc-daemon (trusted) worker1 # [ 152.390895] nix-daemon[835]: reaped child process 1712, status = succeeded lb # [ 152.433884] niks3-server[1010]: 2026/09/20 14:33:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.413450] nix-grpc-daemon[1352]: time=2026-09-20T14:33:05.983Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 152.414907] nix-grpc-daemon[1352]: time=2026-09-20T14:33:05.983Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 152.466031] niks3-server[1010]: 2026/09/20 14:33:06 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 152.482164] niks3-server[1010]: 2026/09/20 14:33:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 152.456712] nix-grpc-daemon[1352]: time=2026-09-20T14:33:06.027Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.492835] niks3-server[1010]: 2026/09/20 14:33:06 INFO Signed narinfos id=55 count=1 lb # [ 152.495167] niks3-server[1010]: 2026/09/20 14:33:06 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 152.503283] niks3-server[1010]: 2026/09/20 14:33:06 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 152.509780] niks3-server[1010]: 2026/09/20 14:33:06 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 152.513960] niks3-server[1010]: 2026/09/20 14:33:06 INFO Completed upload id=55 worker1 # [ 152.483714] nix-grpc-daemon[1352]: time=2026-09-20T14:33:06.054Z level=INFO msg="Upload complete. (276ms)" lb # [ 152.516354] niks3-server[1010]: 2026/09/20 14:33:06 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 152.498358] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=1 worker1 # [ 152.511788] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:06Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 152.516982] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 152.520541] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:06Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 152.524828] nix-daemon[835]: reaped child process 1692, status = succeeded worker1 # [ 152.528170] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 152.537805] nix-grpc-daemon[1352]: time=2026-09-20T14:33:06.108Z level=INFO msg="All 1 paths already cached" worker1 # [ 152.544153] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 152.554104] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 152.735045] nix-daemon[835]: accepted connection from pid 1718, user nix-grpc-daemon (trusted) worker1 # [ 152.751831] nix-daemon[835]: reaped child process 1721, status = succeeded worker1 # [ 152.926892] nix-daemon[835]: accepted connection from pid 1723, user nix-grpc-daemon (trusted) worker1 # [ 152.942897] nix-daemon[835]: reaped child process 1726, status = succeeded lb # [ 152.984223] niks3-server[1010]: 2026/09/20 14:33:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.962963] nix-grpc-daemon[1352]: time=2026-09-20T14:33:06.533Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 152.964589] nix-grpc-daemon[1352]: time=2026-09-20T14:33:06.533Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 153.009130] niks3-server[1010]: 2026/09/20 14:33:06 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 153.021297] niks3-server[1010]: 2026/09/20 14:33:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker1 # [ 152.998177] nix-grpc-daemon[1352]: time=2026-09-20T14:33:06.568Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.031461] niks3-server[1010]: 2026/09/20 14:33:06 INFO Signed narinfos id=56 count=1 lb # [ 153.038665] niks3-server[1010]: 2026/09/20 14:33:06 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 153.046478] niks3-server[1010]: 2026/09/20 14:33:06 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 153.053899] niks3-server[1010]: 2026/09/20 14:33:06 INFO Completed upload id=56 worker1 # [ 153.023553] nix-grpc-daemon[1352]: time=2026-09-20T14:33:06.594Z level=INFO msg="Upload complete. (458ms)" lb # [ 153.056689] niks3-server[1010]: 2026/09/20 14:33:06 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 153.032972] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 153.043244] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 153.051617] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 153.053872] nix-daemon[835]: reaped child process 1716, status = succeeded worker1 # [ 153.067334] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 153.896955] nix-daemon[835]: reaped child process 1730, status = succeeded worker1 # [ 154.068291] nix-daemon[835]: accepted connection from pid 1745, user nix-grpc-daemon (trusted) worker1 # [ 154.087296] nix-daemon[835]: reaped child process 1748, status = succeeded lb # [ 154.130210] niks3-server[1010]: 2026/09/20 14:33:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.110174] nix-grpc-daemon[1352]: time=2026-09-20T14:33:07.679Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 154.111643] nix-grpc-daemon[1352]: time=2026-09-20T14:33:07.679Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 154.165708] niks3-server[1010]: 2026/09/20 14:33:07 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 154.178048] niks3-server[1010]: 2026/09/20 14:33:07 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker1 # [ 154.159112] nix-grpc-daemon[1352]: time=2026-09-20T14:33:07.729Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.190645] niks3-server[1010]: 2026/09/20 14:33:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 154.199673] niks3-server[1010]: 2026/09/20 14:33:07 INFO Signed narinfos id=57 count=1 lb # [ 154.203964] niks3-server[1010]: 2026/09/20 14:33:07 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls worker1 # [ 154.181712] nix-grpc-daemon[1352]: time=2026-09-20T14:33:07.752Z level=INFO msg="Upload complete. (305ms)" lb # [ 154.212255] niks3-server[1010]: 2026/09/20 14:33:07 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 154.215993] niks3-server[1010]: 2026/09/20 14:33:07 INFO Completed upload id=57 lb # [ 154.221174] niks3-server[1010]: 2026/09/20 14:33:07 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker1 # [ 154.197656] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=1 worker1 # [ 154.212730] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:07Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 154.216495] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 154.219266] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:07Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 154.223355] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 154.227210] nix-daemon[835]: reaped child process 1728, status = succeeded worker1 # [ 154.230265] nix-grpc-daemon[1352]: time=2026-09-20T14:33:07.801Z level=INFO msg="All 2 paths already cached" worker1 # [ 154.236932] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 154.245899] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 154.425156] nix-daemon[835]: accepted connection from pid 1754, user nix-grpc-daemon (trusted) worker1 # [ 154.443898] nix-daemon[835]: reaped child process 1757, status = succeeded worker1 # [ 154.613773] nix-daemon[835]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker1 # [ 154.629485] nix-daemon[835]: reaped child process 1762, status = succeeded lb # [ 154.671393] niks3-server[1010]: 2026/09/20 14:33:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.649511] nix-grpc-daemon[1352]: time=2026-09-20T14:33:08.220Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 154.651001] nix-grpc-daemon[1352]: time=2026-09-20T14:33:08.220Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 154.696072] niks3-server[1010]: 2026/09/20 14:33:08 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 154.680451] nix-grpc-daemon[1352]: time=2026-09-20T14:33:08.251Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.709687] niks3-server[1010]: 2026/09/20 14:33:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 154.723254] niks3-server[1010]: 2026/09/20 14:33:08 INFO Signed narinfos id=58 count=1 lb # [ 154.732630] niks3-server[1010]: 2026/09/20 14:33:08 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls worker1 # [ 154.708788] nix-grpc-daemon[1352]: time=2026-09-20T14:33:08.279Z level=INFO msg="Upload complete. (452ms)" lb # [ 154.739971] niks3-server[1010]: 2026/09/20 14:33:08 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 154.745706] niks3-server[1010]: 2026/09/20 14:33:08 INFO Completed upload id=58 worker1 # [ 154.715031] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 154.749216] niks3-server[1010]: 2026/09/20 14:33:08 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 154.727177] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 154.733101] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 154.737255] nix-daemon[835]: reaped child process 1752, status = succeeded worker1 # [ 154.749772] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 155.969775] nix-daemon[835]: reaped child process 1766, status = succeeded worker1 # [ 156.131837] nix-daemon[835]: accepted connection from pid 1781, user nix-grpc-daemon (trusted) worker1 # [ 156.150817] nix-daemon[835]: reaped child process 1784, status = succeeded lb # [ 156.194052] niks3-server[1010]: 2026/09/20 14:33:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.174908] nix-grpc-daemon[1352]: time=2026-09-20T14:33:09.744Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 156.176409] nix-grpc-daemon[1352]: time=2026-09-20T14:33:09.744Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 156.224999] niks3-server[1010]: 2026/09/20 14:33:09 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 156.238628] niks3-server[1010]: 2026/09/20 14:33:09 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 156.251051] niks3-server[1010]: 2026/09/20 14:33:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker1 # [ 156.226654] nix-grpc-daemon[1352]: time=2026-09-20T14:33:09.797Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.261411] niks3-server[1010]: 2026/09/20 14:33:09 INFO Signed narinfos id=59 count=1 lb # [ 156.266949] niks3-server[1010]: 2026/09/20 14:33:09 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 156.274294] niks3-server[1010]: 2026/09/20 14:33:09 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 156.280332] niks3-server[1010]: 2026/09/20 14:33:09 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo lb # [ 156.285253] niks3-server[1010]: 2026/09/20 14:33:09 INFO Completed upload id=59 worker1 # [ 156.255012] nix-grpc-daemon[1352]: time=2026-09-20T14:33:09.825Z level=INFO msg="Upload complete. (296ms)" worker1 # [ 156.269012] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=1 worker1 # [ 156.280279] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:09Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 156.286330] nix-daemon[835]: reaped child process 1764, status = succeeded worker1 # [ 156.309593] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 156.323978] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 156.337278] nix-grpc-daemon[1352]: time=2026-09-20T14:33:09.908Z level=INFO msg="All 2 paths already cached" worker1 # [ 156.345758] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 156.359634] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 156.569377] nix-daemon[835]: accepted connection from pid 1788, user nix-grpc-daemon (trusted) worker1 # [ 156.587858] nix-daemon[835]: reaped child process 1791, status = succeeded worker1 # [ 156.760118] nix-daemon[835]: accepted connection from pid 1793, user nix-grpc-daemon (trusted) worker1 # [ 156.776587] nix-daemon[835]: reaped child process 1796, status = succeeded lb # [ 156.818172] niks3-server[1010]: 2026/09/20 14:33:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.796573] nix-grpc-daemon[1352]: time=2026-09-20T14:33:10.367Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 156.798034] nix-grpc-daemon[1352]: time=2026-09-20T14:33:10.367Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 156.845804] niks3-server[1010]: 2026/09/20 14:33:10 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 156.826276] nix-grpc-daemon[1352]: time=2026-09-20T14:33:10.397Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.860628] niks3-server[1010]: 2026/09/20 14:33:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 156.871714] niks3-server[1010]: 2026/09/20 14:33:10 INFO Signed narinfos id=60 count=1 worker1 # [ 156.850321] nix-grpc-daemon[1352]: time=2026-09-20T14:33:10.421Z level=INFO msg="Upload complete. (474ms)" lb # [ 156.880762] niks3-server[1010]: 2026/09/20 14:33:10 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 156.886079] niks3-server[1010]: 2026/09/20 14:33:10 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 156.856239] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 156.890954] niks3-server[1010]: 2026/09/20 14:33:10 INFO Completed upload id=60 lb # [ 156.893622] niks3-server[1010]: 2026/09/20 14:33:10 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 156.868159] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 156.871163] nix-daemon[835]: reaped child process 1786, status = succeeded worker1 # [ 156.875695] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 156.889094] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 158.129585] nix-daemon[835]: reaped child process 1800, status = succeeded worker1 # [ 158.306915] nix-daemon[835]: accepted connection from pid 1815, user nix-grpc-daemon (trusted) worker1 # [ 158.324274] nix-daemon[835]: reaped child process 1818, status = succeeded lb # [ 158.370538] niks3-server[1010]: 2026/09/20 14:33:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.352472] nix-grpc-daemon[1352]: time=2026-09-20T14:33:11.922Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 158.354384] nix-grpc-daemon[1352]: time=2026-09-20T14:33:11.922Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 158.416580] niks3-server[1010]: 2026/09/20 14:33:12 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 158.429428] niks3-server[1010]: 2026/09/20 14:33:12 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker1 # [ 158.406703] nix-grpc-daemon[1352]: time=2026-09-20T14:33:11.977Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.439228] niks3-server[1010]: 2026/09/20 14:33:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 158.449891] niks3-server[1010]: 2026/09/20 14:33:12 INFO Signed narinfos id=61 count=1 lb # [ 158.454576] niks3-server[1010]: 2026/09/20 14:33:12 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 158.464518] niks3-server[1010]: 2026/09/20 14:33:12 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 158.469794] niks3-server[1010]: 2026/09/20 14:33:12 INFO Completed upload id=61 worker1 # [ 158.438936] nix-grpc-daemon[1352]: time=2026-09-20T14:33:12.009Z level=INFO msg="Upload complete. (337ms)" lb # [ 158.472773] niks3-server[1010]: 2026/09/20 14:33:12 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker1 # [ 158.453106] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=1 worker1 # [ 158.470450] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:12Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 158.477675] nix-daemon[835]: reaped child process 1798, status = succeeded worker1 # [ 158.494187] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 158.508457] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 158.523000] nix-grpc-daemon[1352]: time=2026-09-20T14:33:12.093Z level=INFO msg="All 2 paths already cached" worker1 # [ 158.531776] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 158.545095] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 158.744511] nix-daemon[835]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 158.761655] nix-daemon[835]: reaped child process 1825, status = succeeded worker1 # [ 158.934819] nix-daemon[835]: accepted connection from pid 1827, user nix-grpc-daemon (trusted) worker1 # [ 158.950727] nix-daemon[835]: reaped child process 1830, status = succeeded lb # [ 158.992774] niks3-server[1010]: 2026/09/20 14:33:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.972070] nix-grpc-daemon[1352]: time=2026-09-20T14:33:12.543Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 158.973987] nix-grpc-daemon[1352]: time=2026-09-20T14:33:12.544Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 159.023934] niks3-server[1010]: 2026/09/20 14:33:12 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst lb # [ 159.035873] niks3-server[1010]: 2026/09/20 14:33:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 159.012775] nix-grpc-daemon[1352]: time=2026-09-20T14:33:12.583Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.044721] niks3-server[1010]: 2026/09/20 14:33:12 INFO Signed narinfos id=62 count=1 lb # [ 159.047969] niks3-server[1010]: 2026/09/20 14:33:12 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 159.063263] niks3-server[1010]: 2026/09/20 14:33:12 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete worker1 # [ 159.039326] nix-grpc-daemon[1352]: time=2026-09-20T14:33:12.610Z level=INFO msg="Upload complete. (479ms)" lb # [ 159.069622] niks3-server[1010]: 2026/09/20 14:33:12 INFO Completed upload id=62 lb # [ 159.074472] niks3-server[1010]: 2026/09/20 14:33:12 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 159.048295] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 159.061728] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 159.071413] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 159.073879] nix-daemon[835]: reaped child process 1820, status = succeeded worker1 # [ 159.088330] nix-daemon[835]: accepted connection from pid 1276, user nix-grpc-daemon (trusted) worker1 # [ 160.333958] nix-daemon[835]: reaped child process 1834, status = succeeded worker1 # [ 160.512839] nix-daemon[835]: accepted connection from pid 1849, user nix-grpc-daemon (trusted) worker1 # [ 160.531682] nix-daemon[835]: reaped child process 1852, status = succeeded lb # [ 160.574875] niks3-server[1010]: 2026/09/20 14:33:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.554801] nix-grpc-daemon[1352]: time=2026-09-20T14:33:14.124Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 160.556607] nix-grpc-daemon[1352]: time=2026-09-20T14:33:14.124Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 160.611065] niks3-server[1010]: 2026/09/20 14:33:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign worker1 # [ 160.592615] nix-grpc-daemon[1352]: time=2026-09-20T14:33:14.163Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.627665] niks3-server[1010]: 2026/09/20 14:33:14 INFO Signed narinfos id=63 count=1 lb # [ 160.634122] niks3-server[1010]: 2026/09/20 14:33:14 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 160.642153] niks3-server[1010]: 2026/09/20 14:33:14 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 160.650335] niks3-server[1010]: 2026/09/20 14:33:14 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 160.655159] niks3-server[1010]: 2026/09/20 14:33:14 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 160.658470] niks3-server[1010]: 2026/09/20 14:33:14 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo lb # [ 160.662153] niks3-server[1010]: 2026/09/20 14:33:14 INFO Completed upload id=63 worker1 # [ 160.631602] nix-grpc-daemon[1352]: time=2026-09-20T14:33:14.202Z level=INFO msg="Upload complete. (332ms)" worker1 # [ 160.645120] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53712 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=1 worker1 # [ 160.661785] nix-daemon[835]: reaped child process 1832, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.72 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 160.857805] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: ba34550e2c7947fd8443e901bc02c900 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2 # [ 161.101312] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:54686 client # [ 161.109865] nix[1339]: don't know how to build these paths: client # [ 161.110876] nix[1339]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker2 # [ 161.113699] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54686 client # [ 161.138208] nix[1339]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker worker1 # [ 161.138312] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:14Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 170.294330] envoy[901]: conn peer=[2001:db8:1::1]:33298 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27092 tx=10726 ms=18407 client # [ 191.145667] nix[1339]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu} client # [ 191.157602] nix[1339]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 191.197583] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 191.205394] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 191.209212] systemd[1]: gpu.service: Consumed 171ms CPU time over 30.345s wall clock time, 35.4M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.25 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 49.81 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.09 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 192.941279] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:46Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 194.273414] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 194.281362] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53712 worker1 # [ 194.301358] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:47Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker1 # [ 194.306616] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:47Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 194.346055] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 194.361715] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54686 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 194.377373] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 194.392880] nix-daemon[858]: accepted connection from pid 1884, user nix-grpc-daemon (trusted) worker2 # [ 194.420204] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:47Z level=info event=niks3_push_started pid=1940 worker2 # [ 194.630773] nix-grpc-daemon[1940]: time=2026-09-20T14:33:48.206Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 194.800691] nix-daemon[858]: accepted connection from pid 1953, user nix-grpc-daemon (trusted) worker2 # [ 194.817483] nix-daemon[858]: reaped child process 1956, status = succeeded worker2 # [ 194.988253] nix-daemon[858]: accepted connection from pid 1958, user nix-grpc-daemon (trusted) worker2 # [ 195.004627] nix-daemon[858]: reaped child process 1961, status = succeeded lb # [ 195.051321] niks3-server[1010]: 2026/09/20 14:33:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 195.032066] nix-grpc-daemon[1940]: time=2026-09-20T14:33:48.607Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 195.033556] nix-grpc-daemon[1940]: time=2026-09-20T14:33:48.607Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" worker2 # [ 195.076044] nix-grpc-daemon[1940]: time=2026-09-20T14:33:48.651Z level=INFO msg="Uploading 1 narinfos" lb # [ 195.098516] niks3-server[1010]: 2026/09/20 14:33:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 195.112997] niks3-server[1010]: 2026/09/20 14:33:48 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 195.122623] niks3-server[1010]: 2026/09/20 14:33:48 INFO Signed narinfos id=64 count=1 lb # [ 195.129389] niks3-server[1010]: 2026/09/20 14:33:48 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls worker2 # [ 195.101581] nix-grpc-daemon[1940]: time=2026-09-20T14:33:48.677Z level=INFO msg="Upload complete. (467ms)" lb # [ 195.134250] niks3-server[1010]: 2026/09/20 14:33:48 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 195.138645] niks3-server[1010]: 2026/09/20 14:33:48 INFO Completed upload id=64 worker2 # [ 195.108141] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54686 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 195.141808] niks3-server[1010]: 2026/09/20 14:33:48 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 195.117845] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 195.128460] nix-daemon[858]: accepted connection from pid 1884, user nix-grpc-daemon (trusted) worker2 # [ 195.133176] nix-daemon[858]: reaped child process 1938, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 195.146089] nix-daemon[858]: accepted connection from pid 1884, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-drain worker2 # [ 196.592194] nix-daemon[858]: reaped child process 1965, status = succeeded worker2 # [ 196.771647] nix-daemon[858]: accepted connection from pid 1980, user nix-grpc-daemon (trusted) worker2 # [ 196.789254] nix-daemon[858]: reaped child process 1983, status = succeeded lb # [ 196.838064] niks3-server[1010]: 2026/09/20 14:33:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 196.816442] nix-grpc-daemon[1940]: time=2026-09-20T14:33:50.390Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 196.818001] nix-grpc-daemon[1940]: time=2026-09-20T14:33:50.390Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 196.881083] niks3-server[1010]: 2026/09/20 14:33:50 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 196.894081] niks3-server[1010]: 2026/09/20 14:33:50 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 196.902113] niks3-server[1010]: 2026/09/20 14:33:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 196.908139] niks3-server[1010]: 2026/09/20 14:33:50 INFO Signed narinfos id=65 count=1 worker2 # [ 196.876194] nix-grpc-daemon[1940]: time=2026-09-20T14:33:50.451Z level=INFO msg="Uploading 1 narinfos" lb # [ 196.911441] niks3-server[1010]: 2026/09/20 14:33:50 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 196.923856] niks3-server[1010]: 2026/09/20 14:33:50 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 196.931564] niks3-server[1010]: 2026/09/20 14:33:50 INFO Completed upload id=65 worker2 # [ 196.899687] nix-grpc-daemon[1940]: time=2026-09-20T14:33:50.475Z level=INFO msg="Upload complete. (342ms)" lb # [ 196.934718] niks3-server[1010]: 2026/09/20 14:33:50 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 196.913199] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54686 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=1 worker1 # [ 196.919432] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:50Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker1 # [ 196.925404] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:50Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 196.930377] nix-daemon[858]: reaped child process 1963, status = succeeded worker2 # [ 196.964706] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 196.985628] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 197.006115] nix-grpc-daemon[1940]: time=2026-09-20T14:33:50.582Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 197.016564] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 197.030663] nix-daemon[858]: accepted connection from pid 1884, user nix-grpc-daemon (trusted) worker2 # [ 197.238124] nix-daemon[858]: accepted connection from pid 1987, user nix-grpc-daemon (trusted) worker2 # [ 197.258986] nix-daemon[858]: reaped child process 1990, status = succeeded worker2 # [ 197.436796] nix-daemon[858]: accepted connection from pid 1992, user nix-grpc-daemon (trusted) worker2 # [ 197.454177] nix-daemon[858]: reaped child process 1995, status = succeeded lb # [ 197.498244] niks3-server[1010]: 2026/09/20 14:33:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 197.476136] nix-grpc-daemon[1940]: time=2026-09-20T14:33:51.051Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 197.477643] nix-grpc-daemon[1940]: time=2026-09-20T14:33:51.051Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 197.529575] niks3-server[1010]: 2026/09/20 14:33:51 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 197.506467] nix-grpc-daemon[1940]: time=2026-09-20T14:33:51.082Z level=INFO msg="Uploading 1 narinfos" lb # [ 197.544342] niks3-server[1010]: 2026/09/20 14:33:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 197.554541] niks3-server[1010]: 2026/09/20 14:33:51 INFO Signed narinfos id=66 count=1 lb # [ 197.561739] niks3-server[1010]: 2026/09/20 14:33:51 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls worker2 # [ 197.534139] nix-grpc-daemon[1940]: time=2026-09-20T14:33:51.110Z level=INFO msg="Upload complete. (486ms)" lb # [ 197.567228] niks3-server[1010]: 2026/09/20 14:33:51 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 197.572247] niks3-server[1010]: 2026/09/20 14:33:51 INFO Completed upload id=66 worker2 # [ 197.544265] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54686 duration_s=0 paths=1 nar_bytes_in=632 lb # [ 197.576770] niks3-server[1010]: 2026/09/20 14:33:51 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 197.548565] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 197.560878] nix-daemon[858]: accepted connection from pid 1884, user nix-grpc-daemon (trusted) worker2 # [ 197.563537] nix-daemon[858]: reaped child process 1985, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... worker2 # [ 197.573830] nix-daemon[858]: accepted connection from pid 1884, user nix-grpc-daemon (trusted) client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv client # farm-b> LOG-farm-b-drain worker2 # [ 199.015697] nix-daemon[858]: reaped child process 1999, status = succeeded worker2 # [ 199.197032] nix-daemon[858]: accepted connection from pid 2014, user nix-grpc-daemon (trusted) worker2 # [ 199.213148] nix-daemon[858]: reaped child process 2017, status = succeeded lb # [ 199.259442] niks3-server[1010]: 2026/09/20 14:33:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 199.238394] nix-grpc-daemon[1940]: time=2026-09-20T14:33:52.813Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 199.239876] nix-grpc-daemon[1940]: time=2026-09-20T14:33:52.813Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 199.287648] niks3-server[1010]: 2026/09/20 14:33:52 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 199.301264] niks3-server[1010]: 2026/09/20 14:33:52 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 199.314756] niks3-server[1010]: 2026/09/20 14:33:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 199.287242] nix-grpc-daemon[1940]: time=2026-09-20T14:33:52.863Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.324209] niks3-server[1010]: 2026/09/20 14:33:52 INFO Signed narinfos id=67 count=1 lb # [ 199.326782] niks3-server[1010]: 2026/09/20 14:33:52 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 199.336397] niks3-server[1010]: 2026/09/20 14:33:52 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 199.343852] niks3-server[1010]: 2026/09/20 14:33:52 INFO Completed upload id=67 worker2 # [ 199.311193] nix-grpc-daemon[1940]: time=2026-09-20T14:33:52.887Z level=INFO msg="Upload complete. (324ms)" lb # [ 199.347010] niks3-server[1010]: 2026/09/20 14:33:52 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 199.324566] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54686 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=1 worker1 # [ 199.331665] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:52Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker1 # [ 199.337755] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:52Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 199.340963] nix-daemon[858]: reaped child process 1997, status = succeeded worker2 # [ 199.376735] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 199.393503] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 199.407532] nix-grpc-daemon[1940]: time=2026-09-20T14:33:52.983Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 199.418047] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 199.431151] nix-daemon[858]: accepted connection from pid 1884, user nix-grpc-daemon (trusted) worker2 # [ 199.625062] nix-daemon[858]: accepted connection from pid 2021, user nix-grpc-daemon (trusted) worker2 # [ 199.643912] nix-daemon[858]: reaped child process 2024, status = succeeded worker2 # [ 199.815677] nix-daemon[858]: accepted connection from pid 2026, user nix-grpc-daemon (trusted) worker2 # [ 199.830545] nix-daemon[858]: reaped child process 2029, status = succeeded lb # [ 199.878305] niks3-server[1010]: 2026/09/20 14:33:53 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 199.855173] nix-grpc-daemon[1940]: time=2026-09-20T14:33:53.431Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 199.856769] nix-grpc-daemon[1940]: time=2026-09-20T14:33:53.431Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 199.906986] niks3-server[1010]: 2026/09/20 14:33:53 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 199.884880] nix-grpc-daemon[1940]: time=2026-09-20T14:33:53.460Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.920245] niks3-server[1010]: 2026/09/20 14:33:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 199.931327] niks3-server[1010]: 2026/09/20 14:33:53 INFO Signed narinfos id=68 count=1 lb # [ 199.939359] niks3-server[1010]: 2026/09/20 14:33:53 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls worker2 # [ 199.911746] nix-grpc-daemon[1940]: time=2026-09-20T14:33:53.487Z level=INFO msg="Upload complete. (463ms)" lb # [ 199.944504] niks3-server[1010]: 2026/09/20 14:33:53 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 199.949460] niks3-server[1010]: 2026/09/20 14:33:53 INFO Completed upload id=68 lb # [ 199.952241] niks3-server[1010]: 2026/09/20 14:33:53 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 199.921090] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54686 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 199.929947] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54686 worker2 # [ 199.936135] nix-daemon[858]: accepted connection from pid 1884, user nix-grpc-daemon (trusted) worker2 # [ 199.939993] nix-daemon[858]: reaped child process 2019, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... worker2 # [ 199.951777] nix-daemon[858]: accepted connection from pid 1884, user nix-grpc-daemon (trusted) client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 200.296241] envoy[901]: conn peer=[2001:db8:1::1]:37168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=30065 client # farm-top> LOG-farm-top-drain worker2 # [ 201.579660] nix-daemon[858]: reaped child process 2033, status = succeeded worker2 # [ 201.739956] nix-daemon[858]: accepted connection from pid 2048, user nix-grpc-daemon (trusted) worker2 # [ 201.756109] nix-daemon[858]: reaped child process 2051, status = succeeded lb # [ 201.804541] niks3-server[1010]: 2026/09/20 14:33:55 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 201.784349] nix-grpc-daemon[1940]: time=2026-09-20T14:33:55.358Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 201.786024] nix-grpc-daemon[1940]: time=2026-09-20T14:33:55.358Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 201.833421] niks3-server[1010]: 2026/09/20 14:33:55 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 201.849412] niks3-server[1010]: 2026/09/20 14:33:55 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 201.860926] niks3-server[1010]: 2026/09/20 14:33:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker2 # [ 201.833127] nix-grpc-daemon[1940]: time=2026-09-20T14:33:55.409Z level=INFO msg="Uploading 1 narinfos" lb # [ 201.867419] niks3-server[1010]: 2026/09/20 14:33:55 INFO Signed narinfos id=69 count=1 lb # [ 201.873741] niks3-server[1010]: 2026/09/20 14:33:55 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 201.883008] niks3-server[1010]: 2026/09/20 14:33:55 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 201.888822] niks3-server[1010]: 2026/09/20 14:33:55 INFO Completed upload id=69 worker2 # [ 201.856389] nix-grpc-daemon[1940]: time=2026-09-20T14:33:55.432Z level=INFO msg="Upload complete. (295ms)" lb # [ 201.891944] niks3-server[1010]: 2026/09/20 14:33:55 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 201.868846] nix-grpc-daemon[1884]: ts=2026-09-20T14:33:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54686 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=1 worker2 # [ 201.880095] nix-daemon[858]: reaped child process 2031, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.91 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 202.948604] nix-grpc-daemon[1276]: ts=2026-09-20T14:33:56Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 11.73 seconds) (finished: run the VM test script, in 204.47 seconds) test script finished in 204.76s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.09 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh