tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker1 # Disk image does not exist, creating the virtualisation disk image... worker1 # Formatting '/build/vm-state-worker1/tmp.ZP74nZ2PVq', fmt=raw size=1073741824 worker1 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done worker1: QEMU running (pid 51) worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes lb: QEMU running (pid 50) worker2 # Disk image does not exist, creating the virtualisation disk image... worker1 # Filesystem UUID: 60c27afa-cc42-4a7a-9fbb-12f3061e83b4 worker2: QEMU running (pid 52) lb # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 49) client # Disk image does not exist, creating the virtualisation disk image... lb # Formatting '/build/vm-state-lb/tmp.gz8VOxGIu9', fmt=raw size=1073741824 worker2 # Formatting '/build/vm-state-worker2/tmp.L3QXVz14Nu', fmt=raw size=1073741824 worker1 # Superblock backups stored on blocks: client # Formatting '/build/vm-state-client/tmp.bDBQ9H5Jzb', fmt=raw size=1073741824 lb # mke2fs 1.47.4 (6-Mar-2025) worker1 # 32768, 98304, 163840, 229376 client # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done worker1 # client # Discarding device blocks: 0/262144 done lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Allocating group tables: 0/8 done client # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Filesystem UUID: cd1d32ea-968a-4845-8c6c-e9ad2a458658 worker1 # Writing inode tables: 0/8 done client # Filesystem UUID: 5e27ae01-54fe-4082-93cd-eed420088bcd lb # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 worker1 # Creating journal (8192 blocks): done (finished: start all VMs, in 0.52 seconds) worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Writing superblocks and filesystem accounting information: 0/8 done client: waiting for unit network-addresses-eth1.service worker2 # Discarding device blocks: 0/262144 done lb # client: waiting for the VM to finish booting worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Allocating group tables: 0/8 done client # Superblock backups stored on blocks: lb # Writing inode tables: 0/8 done client # 32768, 98304, 163840, 229376 worker2 # Filesystem UUID: 94753198-4bef-46d3-8096-7b888aaeec4f worker1 # lb # Creating journal (8192 blocks): done client # worker2 # Superblock backups stored on blocks: worker1 # Virtualisation disk image created. lb # Writing superblocks and filesystem accounting information: 0/8 done client # Allocating group tables: 0/8 done lb # client # Writing inode tables: 0/8 done lb # Virtualisation disk image created. client # Creating journal (8192 blocks): done worker2 # 32768, 98304, 163840, 229376 client # Writing superblocks and filesystem accounting information: 0/8 done worker2 # client # worker2 # Allocating group tables: 0/8 done client # Virtualisation disk image created. worker2 # Writing inode tables: 0/8 done worker2 # Creating journal (8192 blocks): done worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # worker2 # Virtualisation disk image created. worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] random: crng init done worker1 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] DMA32 empty worker1 # [ 0.000000] Normal empty worker1 # [ 0.000000] Device empty worker1 # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5zd1y7cz4jr6rf6lhvvzl3jz666fjcb5-nixos-system-worker1-test/init regInfo=/nix/store/2ad7c9kk7bzpgdb8r5y81xd71pygh303-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/2ad7c9kk7bzpgdb8r5y81xd71pygh303-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] random: crng init done worker1 # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] DMA32 empty worker2 # [ 0.000000] Normal empty worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] Device empty worker2 # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] KASLR enabled worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] random: crng init done worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] Zone ranges: worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] DMA32 empty worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] Normal empty client # [ 0.000000] Device empty worker2 # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] Movable zone start for each node client # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gh79m3xzyqyvpdkgcwhw7570p93z0llj-nixos-system-worker2-test/init regInfo=/nix/store/bj7i3c8j1fg5v0svy6zi2d643q7qsc6l-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] KASLR enabled client # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] random: crng init done worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000036] arm-pv: using stolen time PV client # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/bj7i3c8j1fg5v0svy6zi2d643q7qsc6l-closure-info/registration", will be passed to user space. lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000665] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000880] Console: colour dummy device 80x25 lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] Zone ranges: worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000888] printk: legacy console [tty0] enabled client # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] DMA32 empty client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.001103] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000000] Normal empty worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.001109] pid_max: default: 32768 minimum: 301 lb # [ 0.000000] Device empty client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] Movable zone start for each node client # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.001187] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000000] Early memory node ranges client # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.001356] landlock: Up and running. lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.001359] Yama: becoming mindful. client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.001991] LSM support for eBPF active lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.002153] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Policy zone: DMA lb # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.002201] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.003355] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.004109] rcu: Hierarchical SRCU implementation. worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.004113] rcu: Max phase no-delay instances is 1000. lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.005306] fsl-mc MSI: its@8080000 domain created client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gkhkardj3d6k7q4gs4n9bbjjpdx2saf4-nixos-system-client-test/init regInfo=/nix/store/wgb28qz9jy19gamz4ya93y7989416b0w-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.005397] EFI services will not be available. worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.005475] smp: Bringing up secondary CPUs ... worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.005484] smp: Brought up 1 node, 1 CPU lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.005487] SMP: Total of 1 processors activated. client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/wgb28qz9jy19gamz4ya93y7989416b0w-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.005493] CPU: All CPU(s) started at EL1 worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.005504] CPU features: detected: Branch Target Identification worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.005509] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.005512] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.005516] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.005519] CPU features: detected: Common not Private translations client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.005523] CPU features: detected: CRC32 instructions worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.005525] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.005529] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.005532] CPU features: detected: Data independent timing control (DIT) lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/px4c3ifawqq4xs8a4zhy519i865fkk09-nixos-system-lb-test/init regInfo=/nix/store/qp69c7d7ks4qa26wilaji9gbrwmdkkah-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.005535] CPU features: detected: E0PD worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.005538] CPU features: detected: Enhanced Counter Virtualization client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.005540] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.005544] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qp69c7d7ks4qa26wilaji9gbrwmdkkah-closure-info/registration", will be passed to user space. client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.005547] CPU features: detected: Fine Grained Traps worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.005550] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.005555] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.005558] CPU features: detected: LSE atomic instructions worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.005561] CPU features: detected: Privileged Access Never client # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.005564] CPU features: detected: PMUv3 worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.005567] CPU features: detected: RAS Extension Support lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.005569] CPU features: detected: RASv1p1 Extension Support client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.005572] CPU features: detected: Random Number Generator worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.005574] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] Policy zone: DMA worker1 # [ 0.005577] CPU features: detected: Stage-2 Force Write-Back client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.005580] CPU features: detected: TLB range maintenance instructions client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.005585] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000031] arm-pv: using stolen time PV lb # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.005625] alternatives: applying system-wide alternatives lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.008614] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.000521] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000709] Console: colour dummy device 80x25 client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000717] printk: legacy console [tty0] enabled client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.008766] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000925] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000932] pid_max: default: 32768 minimum: 301 lb # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.001018] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.001177] landlock: Up and running. worker2 # [ 0.001180] Yama: becoming mindful. client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.001720] LSM support for eBPF active client # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.001861] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.001894] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.003002] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.003749] rcu: Hierarchical SRCU implementation. client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.003753] rcu: Max phase no-delay instances is 1000. lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.005009] fsl-mc MSI: its@8080000 domain created lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.005103] EFI services will not be available. worker1 # [ 0.009199] devtmpfs: initialized lb # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.005189] smp: Bringing up secondary CPUs ... client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.005197] smp: Brought up 1 node, 1 CPU worker1 # [ 0.011110] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.005201] SMP: Total of 1 processors activated. client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000031] arm-pv: using stolen time PV worker2 # [ 0.005206] CPU: All CPU(s) started at EL1 worker1 # [ 0.011134] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.005218] CPU features: detected: Branch Target Identification worker1 # [ 0.011318] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.000392] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.011322] 0 pages in range for non-PLT usage worker2 # [ 0.005224] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.000552] Console: colour dummy device 80x25 lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.011323] 508288 pages in range for PLT usage client # [ 0.000560] printk: legacy console [tty0] enabled worker2 # [ 0.005227] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.011447] pinctrl core: initialized pinctrl subsystem lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.012236] DMI not present or invalid. client # [ 0.000756] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.005230] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.016445] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.000762] pid_max: default: 32768 minimum: 301 worker2 # [ 0.005234] CPU features: detected: Common not Private translations lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.018702] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.000832] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.005237] CPU features: detected: CRC32 instructions lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000970] landlock: Up and running. client # [ 0.000972] Yama: becoming mindful. worker1 # [ 0.018886] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.005240] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.001456] LSM support for eBPF active worker1 # [ 0.019096] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.005243] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.001624] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.019121] audit: initializing netlink subsys (disabled) worker2 # [ 0.005247] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.005250] CPU features: detected: E0PD worker1 # [ 0.019763] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.001657] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.002773] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.005252] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.019765] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.003518] rcu: Hierarchical SRCU implementation. worker1 # [ 0.019769] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.005255] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.003522] rcu: Max phase no-delay instances is 1000. lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.019774] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.005258] CPU features: detected: Enhanced Virtualization Traps client # [ 0.004734] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.005261] CPU features: detected: Fine Grained Traps client # [ 0.004826] EFI services will not be available. worker1 # [ 0.019777] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.004891] smp: Bringing up secondary CPUs ... lb # [ 0.000029] arm-pv: using stolen time PV worker2 # [ 0.005265] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.019809] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.004899] smp: Brought up 1 node, 1 CPU worker1 # [ 0.019819] cpuidle: using governor ladder worker2 # [ 0.005271] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.004902] SMP: Total of 1 processors activated. worker1 # [ 0.019824] cpuidle: using governor menu lb # [ 0.000420] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.004908] CPU: All CPU(s) started at EL1 worker2 # [ 0.005274] CPU features: detected: LSE atomic instructions lb # [ 0.000593] Console: colour dummy device 80x25 worker1 # [ 0.020024] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.004918] CPU features: detected: Branch Target Identification worker2 # [ 0.005277] CPU features: detected: Privileged Access Never lb # [ 0.000600] printk: legacy console [tty0] enabled worker1 # [ 0.020040] ASID allocator initialised with 65536 entries worker2 # [ 0.005279] CPU features: detected: PMUv3 client # [ 0.004923] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.021358] Serial: AMBA PL011 UART driver worker2 # [ 0.005282] CPU features: detected: RAS Extension Support lb # [ 0.000786] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.004927] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.026794] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.005285] CPU features: detected: RASv1p1 Extension Support lb # [ 0.000793] pid_max: default: 32768 minimum: 301 worker1 # [ 0.026971] printk: console [ttyAMA0] enabled worker2 # [ 0.005287] CPU features: detected: Random Number Generator lb # [ 0.000860] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.004930] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.000990] landlock: Up and running. worker2 # [ 0.005290] CPU features: detected: Speculation barrier (SB) lb # [ 0.000993] Yama: becoming mindful. client # [ 0.004934] CPU features: detected: Common not Private translations worker1 # [ 0.149355] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.005293] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.001469] LSM support for eBPF active client # [ 0.004937] CPU features: detected: CRC32 instructions worker1 # [ 0.149374] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.005296] CPU features: detected: TLB range maintenance instructions lb # [ 0.001632] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.004940] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.149379] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.005301] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.004944] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.001664] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.005340] alternatives: applying system-wide alternatives worker1 # [ 0.149383] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.002798] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.004947] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.008451] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.004950] CPU features: detected: E0PD worker1 # [ 0.149387] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.003524] rcu: Hierarchical SRCU implementation. worker1 # [ 0.149391] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.004952] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.003528] rcu: Max phase no-delay instances is 1000. lb # [ 0.004727] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.149395] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.008688] Memory: 1406496K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) client # [ 0.004955] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.004826] EFI services will not be available. worker2 # [ 0.009086] devtmpfs: initialized worker1 # [ 0.149400] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.004959] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.004892] smp: Bringing up secondary CPUs ... worker2 # [ 0.011140] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.004962] CPU features: detected: Fine Grained Traps lb # [ 0.004900] smp: Brought up 1 node, 1 CPU lb # [ 0.004903] SMP: Total of 1 processors activated. client # [ 0.004966] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.004909] CPU: All CPU(s) started at EL1 client # [ 0.004971] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.156617] fbcon: Taking over console lb # [ 0.004921] CPU features: detected: Branch Target Identification worker1 # [ 0.156634] ACPI: Interpreter disabled. client # [ 0.004974] CPU features: detected: LSE atomic instructions lb # [ 0.004926] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.004977] CPU features: detected: Privileged Access Never client # [ 0.004980] CPU features: detected: PMUv3 lb # [ 0.004930] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.004982] CPU features: detected: RAS Extension Support client # [ 0.004985] CPU features: detected: RASv1p1 Extension Support lb # [ 0.004933] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.004988] CPU features: detected: Random Number Generator lb # [ 0.004937] CPU features: detected: Common not Private translations lb # [ 0.004940] CPU features: detected: CRC32 instructions client # [ 0.004990] CPU features: detected: Speculation barrier (SB) client # [ 0.004993] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.004943] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.004996] CPU features: detected: TLB range maintenance instructions lb # [ 0.004947] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.005001] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.004950] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.011169] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.005038] alternatives: applying system-wide alternatives lb # [ 0.004953] CPU features: detected: E0PD worker1 # [ 0.165227] iommu: Default domain type: Translated worker2 # [ 0.011362] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.004956] CPU features: detected: Enhanced Counter Virtualization client # [ 0.008036] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.011367] 0 pages in range for non-PLT usage worker1 # [ 0.165238] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.011368] 508288 pages in range for PLT usage lb # [ 0.004959] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.166952] SCSI subsystem initialized worker2 # [ 0.011463] pinctrl core: initialized pinctrl subsystem lb # [ 0.004962] CPU features: detected: Enhanced Virtualization Traps client # [ 0.008194] Memory: 1406556K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker2 # [ 0.012272] DMI not present or invalid. client # [ 0.008614] devtmpfs: initialized lb # [ 0.004965] CPU features: detected: Fine Grained Traps worker2 # [ 0.015354] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.167587] usbcore: registered new interface driver usbfs client # [ 0.010459] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.004968] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.167611] usbcore: registered new interface driver hub worker2 # [ 0.017612] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.167637] usbcore: registered new device driver usb lb # [ 0.004974] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.010487] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.017789] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.167906] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.004977] CPU features: detected: LSE atomic instructions client # [ 0.010695] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.017989] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.004980] CPU features: detected: Privileged Access Never client # [ 0.010699] 0 pages in range for non-PLT usage worker1 # [ 0.167912] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.004983] CPU features: detected: PMUv3 worker2 # [ 0.018012] audit: initializing netlink subsys (disabled) client # [ 0.010700] 508288 pages in range for PLT usage worker1 # [ 0.167922] PTP clock support registered lb # [ 0.004985] CPU features: detected: RAS Extension Support worker1 # [ 0.167962] EDAC MC: Ver: 3.0.0 worker2 # [ 0.018637] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.010810] pinctrl core: initialized pinctrl subsystem client # [ 0.011560] DMI not present or invalid. worker2 # [ 0.018639] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.004988] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.172486] scmi_core: SCMI protocol bus registered client # [ 0.014628] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.018643] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.004990] CPU features: detected: Random Number Generator worker1 # [ 0.173420] FPGA manager framework client # [ 0.017028] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.018649] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.004993] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.174407] vgaarb: loaded lb # [ 0.004996] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.018651] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.017231] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.004999] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.018683] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.017435] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.175056] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.018691] cpuidle: using governor ladder lb # [ 0.005004] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.017461] audit: initializing netlink subsys (disabled) worker1 # [ 0.175657] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.018697] cpuidle: using governor menu lb # [ 0.005042] alternatives: applying system-wide alternatives client # [ 0.018019] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.175690] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.018884] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.018020] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.008106] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.018899] ASID allocator initialised with 65536 entries worker2 # [ 0.020094] Serial: AMBA PL011 UART driver client # [ 0.018024] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.179036] netfs: FS-Cache loaded client # [ 0.018029] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.025285] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.008302] Memory: 1406556K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) worker1 # [ 0.179587] pnp: PnP ACPI: disabled lb # [ 0.008712] devtmpfs: initialized worker2 # [ 0.025444] printk: console [ttyAMA0] enabled lb # [ 0.010593] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.144663] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.010616] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.144684] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.010787] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.144689] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.010792] 0 pages in range for non-PLT usage worker2 # [ 0.144693] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.010793] 508288 pages in range for PLT usage worker2 # [ 0.144698] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.010905] pinctrl core: initialized pinctrl subsystem lb # [ 0.011659] DMI not present or invalid. worker2 # [ 0.144702] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.015024] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.144706] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.017245] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.144711] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.184054] NET: Registered PF_INET protocol family lb # [ 0.017438] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.018032] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.184353] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.017643] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.018057] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.017668] audit: initializing netlink subsys (disabled) worker2 # [ 0.152267] fbcon: Taking over console client # [ 0.018065] cpuidle: using governor ladder worker2 # [ 0.152283] ACPI: Interpreter disabled. client # [ 0.018071] cpuidle: using governor menu worker2 # [ 0.154150] iommu: Default domain type: Translated client # [ 0.018272] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.154159] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.018287] ASID allocator initialised with 65536 entries client # [ 0.019428] Serial: AMBA PL011 UART driver worker2 # [ 0.155901] SCSI subsystem initialized client # [ 0.024574] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.024699] printk: console [ttyAMA0] enabled client # [ 0.144172] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.144193] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.144198] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.144202] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.144207] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.018263] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.144211] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.018265] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.144215] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.018268] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.144219] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.018274] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.163513] usbcore: registered new interface driver usbfs worker2 # [ 0.163548] usbcore: registered new interface driver hub lb # [ 0.018277] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.163567] usbcore: registered new device driver usb lb # [ 0.018309] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.163872] pps_core: LinuxPPS API ver. 1 registered client # [ 0.151771] fbcon: Taking over console lb # [ 0.018318] cpuidle: using governor ladder client # [ 0.151786] ACPI: Interpreter disabled. lb # [ 0.018324] cpuidle: using governor menu worker2 # [ 0.163878] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.153572] iommu: Default domain type: Translated worker2 # [ 0.163888] PTP clock support registered lb # [ 0.018523] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.163927] EDAC MC: Ver: 3.0.0 client # [ 0.153581] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.018539] ASID allocator initialised with 65536 entries lb # [ 0.019671] Serial: AMBA PL011 UART driver worker2 # [ 0.168564] scmi_core: SCMI protocol bus registered client # [ 0.155269] SCSI subsystem initialized lb # [ 0.024947] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.169522] FPGA manager framework worker2 # [ 0.170470] vgaarb: loaded lb # [ 0.025105] printk: console [ttyAMA0] enabled lb # [ 0.148560] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.171129] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.148578] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.171740] VFS: Disk quotas dquot_6.6.0 lb # [ 0.148583] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.171766] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.148587] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.174176] netfs: FS-Cache loaded worker2 # [ 0.174278] pnp: PnP ACPI: disabled lb # [ 0.148592] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.148596] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.148600] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.148604] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.162917] usbcore: registered new interface driver usbfs client # [ 0.162948] usbcore: registered new interface driver hub client # [ 0.162978] usbcore: registered new device driver usb client # [ 0.163274] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.156279] fbcon: Taking over console lb # [ 0.156295] ACPI: Interpreter disabled. client # [ 0.163279] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.163297] PTP clock support registered lb # [ 0.158231] iommu: Default domain type: Translated client # [ 0.163338] EDAC MC: Ver: 3.0.0 lb # [ 0.158241] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.167988] scmi_core: SCMI protocol bus registered client # [ 0.168930] FPGA manager framework worker2 # [ 0.180325] NET: Registered PF_INET protocol family client # [ 0.169943] vgaarb: loaded worker2 # [ 0.180600] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.170587] clocksource: Switched to clocksource arch_sys_counter client # [ 0.171928] VFS: Disk quotas dquot_6.6.0 client # [ 0.171958] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.173505] netfs: FS-Cache loaded worker1 # [ 0.213946] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.173623] pnp: PnP ACPI: disabled lb # [ 0.165203] SCSI subsystem initialized worker1 # [ 0.214000] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.165919] usbcore: registered new interface driver usbfs worker1 # [ 0.214034] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.165954] usbcore: registered new interface driver hub worker1 # [ 0.214107] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.165971] usbcore: registered new device driver usb worker1 # [ 0.214253] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.166266] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.214343] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.166272] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.166282] PTP clock support registered worker1 # [ 0.214380] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.166329] EDAC MC: Ver: 3.0.0 worker1 # [ 0.214417] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.171091] scmi_core: SCMI protocol bus registered worker1 # [ 0.214508] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.214554] NET: Registered PF_XDP protocol family lb # [ 0.172082] FPGA manager framework worker1 # [ 0.214573] PCI: CLS 0 bytes, default 64 lb # [ 0.173065] vgaarb: loaded worker1 # [ 0.214845] Trying to unpack rootfs image as initramfs... client # [ 0.179479] NET: Registered PF_INET protocol family lb # [ 0.173710] clocksource: Switched to clocksource arch_sys_counter client # [ 0.179753] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.176672] VFS: Disk quotas dquot_6.6.0 lb # [ 0.176701] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.232940] kvm [1]: HYP mode not available lb # [ 0.180527] netfs: FS-Cache loaded lb # [ 0.180657] pnp: PnP ACPI: disabled lb # [ 0.184585] NET: Registered PF_INET protocol family lb # [ 0.184850] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.211366] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.211413] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.211442] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.211518] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.211661] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.211741] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.209969] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.211776] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.211811] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.210020] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.211931] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.210052] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.211970] NET: Registered PF_XDP protocol family worker2 # [ 0.211989] PCI: CLS 0 bytes, default 64 client # [ 0.210129] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.212223] Trying to unpack rootfs image as initramfs... client # [ 0.210290] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.210378] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.210415] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.210451] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.228688] kvm [1]: HYP mode not available client # [ 0.210541] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.210564] NET: Registered PF_XDP protocol family client # [ 0.210582] PCI: CLS 0 bytes, default 64 client # [ 0.220078] Trying to unpack rootfs image as initramfs... client # [ 0.227386] kvm [1]: HYP mode not available lb # [ 0.215560] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.215615] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.215646] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.215731] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.215875] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.215962] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.216000] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.216047] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.216152] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.216193] NET: Registered PF_XDP protocol family lb # [ 0.216211] PCI: CLS 0 bytes, default 64 lb # [ 0.216473] Trying to unpack rootfs image as initramfs... lb # [ 0.231634] kvm [1]: HYP mode not available worker1 # [ 0.339647] Initialise system trusted keyrings worker1 # [ 0.340463] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.341729] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.342501] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.371185] Key type asymmetric registered worker1 # [ 0.371213] Asymmetric key parser 'x509' registered worker1 # [ 0.371292] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.373445] io scheduler mq-deadline registered worker1 # [ 0.373457] io scheduler kyber registered worker2 # [ 0.338818] Initialise system trusted keyrings worker2 # [ 0.339627] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.340900] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.341658] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.383200] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.335222] Initialise system trusted keyrings client # [ 0.335973] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.384623] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.337262] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.385005] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.338022] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.385021] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.385033] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.385041] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.385064] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.385089] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.385171] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.385180] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.385186] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.385191] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.385196] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.385283] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.385721] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.385910] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.385926] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.342255] Initialise system trusted keyrings worker1 # [ 0.385955] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.365604] Key type asymmetric registered lb # [ 0.343032] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.385971] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.365631] Asymmetric key parser 'x509' registered lb # [ 0.344297] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.386417] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.365704] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.386601] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.345069] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.386617] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.386646] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.406289] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.406480] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.406496] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.406526] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.407015] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.371193] io scheduler mq-deadline registered worker2 # [ 0.371215] io scheduler kyber registered client # [ 0.366738] Key type asymmetric registered client # [ 0.366768] Asymmetric key parser 'x509' registered client # [ 0.366839] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.368974] io scheduler mq-deadline registered worker1 # [ 0.411442] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.368986] io scheduler kyber registered worker1 # [ 0.411461] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.411494] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.411961] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.412147] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.412163] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.412203] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.365677] Key type asymmetric registered worker1 # [ 0.412659] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.412843] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.412859] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.412887] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.383281] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.383923] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.413341] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.413529] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.384336] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.378717] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.413544] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.384354] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.413574] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.384366] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.413590] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.414086] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.384383] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.380040] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.373742] Asymmetric key parser 'x509' registered worker1 # [ 0.414275] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.384404] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.380411] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.373849] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.414305] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.375456] io scheduler mq-deadline registered worker2 # [ 0.384427] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.380427] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.375467] io scheduler kyber registered worker1 # [ 0.414757] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.384502] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.414946] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.380439] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.384511] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.414975] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.384517] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.380447] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.415377] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.384522] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.380477] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.415561] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.384527] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.380500] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.415815] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.384636] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.416109] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.380573] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.385094] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.416126] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.380582] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.385281] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.380588] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.416155] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.385301] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.380592] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.416629] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.385331] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.416815] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.380597] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.385348] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.416831] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.380653] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.385806] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.416860] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.385992] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.381088] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.417430] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.381277] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.386008] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.385850] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.417441] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.381293] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.386037] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.381322] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.417447] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.386492] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.381338] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.386673] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.417491] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.386688] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.381803] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.417537] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.387270] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.381987] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.386718] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.382002] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.417583] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.387669] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.387203] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.382032] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.417630] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.387384] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.387688] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.387400] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.382504] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.417676] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.387709] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.387432] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.417724] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.402001] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.387717] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.387896] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.417771] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.402021] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.388091] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.387749] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.402050] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.417818] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.388108] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.387774] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.402538] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.388137] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.417866] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.387856] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.388602] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.417940] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.387865] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.388784] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.405691] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.417986] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.387871] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.388799] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.405710] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.418008] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.387876] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.388829] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.405742] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.418029] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.387881] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.389282] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.406201] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.418051] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.389464] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.406387] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.387941] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.418075] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.389479] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.406403] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.418096] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.388385] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.389509] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.406432] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.388572] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.418118] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.389525] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.388589] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.418139] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.390018] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.388619] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.418161] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.390204] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.388635] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.418183] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.390234] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.389098] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.418206] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.390689] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.389284] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.418229] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.390873] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.389300] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.418250] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.390902] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.389330] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.418271] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.418292] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.418313] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.408684] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.418334] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.408878] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.418355] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.408895] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.418377] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.408925] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.418398] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.418420] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.409403] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.418446] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.409587] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.409603] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.418455] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.418460] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.409636] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.435364] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.435558] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.418984] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.435821] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.419195] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.436134] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.419212] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.436152] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.419241] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.436182] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.419763] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.436652] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.419952] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.436833] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.419968] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.436849] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.419997] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.436878] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.420013] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.437455] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.420465] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.437466] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.420652] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.483715] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.437471] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.420681] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.437517] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.421129] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.437563] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.421318] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.421347] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.437611] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.422185] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.421737] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.437657] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.422391] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.421921] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.422408] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.437704] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.422167] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.422439] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.437752] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.422462] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.422912] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.437804] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.422479] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.423097] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.422508] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.437852] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.423113] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.422996] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.437899] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.423143] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.423179] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.437977] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.423631] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.423195] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.438024] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.423818] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.423224] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.438048] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.423834] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.423831] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.438070] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.423864] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.423841] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.438092] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.423880] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.423847] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.438116] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.424345] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.423893] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.438138] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.424533] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.438160] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.423940] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.424563] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.438183] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.423987] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.425016] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.438206] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.425206] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.424034] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.438228] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.425236] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.424085] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.438251] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.425649] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.424131] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.438274] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.425850] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.438295] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.424177] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.438317] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.426105] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.424224] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.438339] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.426383] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.424271] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.426400] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.438360] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.438382] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.426430] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.424344] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.438404] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.424391] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.426919] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.438426] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.424412] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.427105] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.438447] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.427121] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.424434] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.438469] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.427151] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.424457] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.438495] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.509285] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.424482] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.427731] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.438505] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.424504] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.427742] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.438509] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.424525] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.427748] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.424547] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.427792] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.424568] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.427840] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.424590] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.427887] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.424613] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.424635] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.427934] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.424656] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.427980] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.424676] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.424697] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.428027] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.515348] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.424719] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.428074] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.517586] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.424739] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.428122] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.483772] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.424760] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.424782] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.428169] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.424803] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.428241] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.424825] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.428287] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.424852] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.428309] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.424861] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.428331] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.424865] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.426046] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.428353] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.428378] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.428400] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.428422] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.428444] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.428466] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.527690] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.428488] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.529764] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.428511] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.428534] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.428556] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.428577] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.428599] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.428620] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.428642] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.428664] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.428686] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.428707] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.428730] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.428756] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.428766] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.428770] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.504831] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.539638] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.542720] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.544867] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.546912] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.490038] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.502071] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.515480] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.517818] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker1 # [ 0.556543] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.512035] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.563190] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.527776] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.529929] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.516538] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.532101] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.518545] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.520630] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.534307] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.576344] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.514897] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.517097] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.578864] msm_serial: driver initialized worker1 # [ 0.579012] SuperH (H)SCI(F) driver initialized worker2 # [ 0.544565] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.546695] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.580206] STM32 USART driver initialized lb # [ 0.528116] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.531083] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.533108] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.556520] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.538837] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.558793] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.541202] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.543435] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.545884] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.543302] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.571300] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.556118] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.549789] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.551843] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.613946] loop: module loaded worker1 # [ 0.614154] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.614952] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.562691] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.580539] msm_serial: driver initialized worker2 # [ 0.580727] SuperH (H)SCI(F) driver initialized worker2 # [ 0.580780] STM32 USART driver initialized worker1 # [ 0.619775] megasas: 07.734.00.00-rc1 lb # [ 0.561936] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.563823] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.620512] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.575918] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.578516] msm_serial: driver initialized client # [ 0.579193] SuperH (H)SCI(F) driver initialized client # [ 0.579250] STM32 USART driver initialized worker1 # [ 0.632237] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.632283] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.634013] Using buffer write method lb # [ 0.574337] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.634106] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.586458] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.609998] loop: module loaded lb # [ 0.589232] msm_serial: driver initialized worker2 # [ 0.610187] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.589408] SuperH (H)SCI(F) driver initialized worker2 # [ 0.610951] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.589463] STM32 USART driver initialized worker1 # [ 0.649938] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.649995] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.615819] megasas: 07.734.00.00-rc1 worker2 # [ 0.616630] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.618532] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.618558] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.659710] Using buffer write method worker1 # [ 0.659760] Concatenating MTD devices: worker1 # [ 0.659765] (0): "0.flash" worker1 # [ 0.659769] (1): "0.flash" worker1 # [ 0.659773] into device "0.flash" client # [ 0.612196] loop: module loaded client # [ 0.612390] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.613167] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.629022] Using buffer write method worker2 # [ 0.629098] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.630602] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.630652] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.619273] megasas: 07.734.00.00-rc1 client # [ 0.620043] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.640088] Using buffer write method worker2 # [ 0.640123] Concatenating MTD devices: worker2 # [ 0.640127] (0): "0.flash" worker2 # [ 0.640131] (1): "0.flash" worker2 # [ 0.640134] into device "0.flash" lb # [ 0.620521] loop: module loaded lb # [ 0.620715] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.621498] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.631839] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.631878] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.634060] Using buffer write method client # [ 0.634137] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.639303] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.639340] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.641101] Using buffer write method client # [ 0.641128] Concatenating MTD devices: client # [ 0.641132] (0): "0.flash" client # [ 0.641136] (1): "0.flash" client # [ 0.641139] into device "0.flash" lb # [ 0.634446] megasas: 07.734.00.00-rc1 lb # [ 0.635172] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.637551] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.637580] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.639098] Using buffer write method lb # [ 0.639169] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.640848] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.640878] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.658404] Using buffer write method lb # [ 0.658446] Concatenating MTD devices: lb # [ 0.658450] (0): "0.flash" lb # [ 0.658454] (1): "0.flash" lb # [ 0.658457] into device "0.flash" worker1 # [ 0.909069] Freeing initrd memory: 26148K worker1 # [ 0.915220] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.919147] thunder_xcv, ver 1.0 worker1 # [ 0.919194] thunder_bgx, ver 1.0 worker1 # [ 0.919217] nicpf, ver 1.0 worker1 # [ 0.919773] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.919780] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.919807] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.919816] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.919846] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.919852] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 0.919876] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.919882] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.920014] sky2: driver version 1.30 worker1 # [ 0.921587] usbcore: registered new interface driver usb-storage worker1 # [ 0.921659] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.921673] usbserial: USB Serial support registered for generic worker1 # [ 0.922253] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.923562] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.898337] Freeing initrd memory: 26148K worker1 # [ 0.923592] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.923826] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.936317] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.936679] hub 1-0:1.0: USB hub found worker1 # [ 0.936699] hub 1-0:1.0: 6 ports detected worker1 # [ 0.938929] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.938959] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T21:08:24 UTC (1789938504) worker2 # [ 0.904385] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.941139] i2c_dev: i2c /dev entries driver worker1 # [ 0.944393] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.944404] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.908136] thunder_xcv, ver 1.0 worker1 # [ 0.944667] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.908183] thunder_bgx, ver 1.0 worker2 # [ 0.908206] nicpf, ver 1.0 worker1 # [ 0.945027] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.908761] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.946680] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.908770] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.946918] usbcore: registered new interface driver usbhid worker2 # [ 0.908800] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.946924] usbhid: USB HID core driver client # [ 0.901397] Freeing initrd memory: 26160K worker2 # [ 0.908809] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.908837] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.908843] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.908869] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.908875] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.909007] sky2: driver version 1.30 worker1 # [ 0.952584] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.910609] usbcore: registered new interface driver usb-storage worker1 # [ 0.954059] drop_monitor: Initializing network drop monitor service worker2 # [ 0.910694] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.954211] NET: Registered PF_INET6 protocol family worker2 # [ 0.910709] usbserial: USB Serial support registered for generic worker1 # [ 0.957361] Segment Routing with IPv6 client # [ 0.907474] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.911928] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 0.957385] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.957434] NET: Registered PF_PACKET protocol family worker2 # [ 0.912014] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.912184] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.923774] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.924218] hub 1-0:1.0: USB hub found worker2 # [ 0.924234] hub 1-0:1.0: 6 ports detected worker1 # [ 0.959268] 9pnet: Installing 9P2000 support worker2 # [ 0.926470] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.961527] Key type dns_resolver registered client # [ 0.911338] thunder_xcv, ver 1.0 worker2 # [ 0.928051] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.911386] thunder_bgx, ver 1.0 client # [ 0.911408] nicpf, ver 1.0 worker2 # [ 0.928081] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T21:08:24 UTC (1789938504) client # [ 0.911955] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.928391] i2c_dev: i2c /dev entries driver client # [ 0.911962] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.911991] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.911999] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.912027] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.912032] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.912055] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.968460] registered taskstats version 1 worker2 # [ 0.933265] sdhci: Secure Digital Host Controller Interface driver client # [ 0.912061] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.968640] Loading compiled-in X.509 certificates client # [ 0.912194] sky2: driver version 1.30 worker2 # [ 0.933275] sdhci: Copyright(c) Pierre Ossman client # [ 0.913785] usbcore: registered new interface driver usb-storage worker2 # [ 0.933541] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.933921] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 0.913880] usbcore: registered new interface driver usbserial_generic client # [ 0.913895] usbserial: USB Serial support registered for generic client # [ 0.914497] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.938308] hid: raw HID events driver (C) Jiri Kosina client # [ 0.915314] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.938584] usbcore: registered new interface driver usbhid client # [ 0.915347] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.938591] usbhid: USB HID core driver client # [ 0.915513] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.977264] Demotion targets for Node 0: null worker1 # [ 0.977378] Key type .fscrypt registered client # [ 0.927764] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.977384] Key type fscrypt-provisioning registered lb # [ 0.918412] Freeing initrd memory: 26140K client # [ 0.928112] hub 1-0:1.0: USB hub found worker1 # [ 0.977486] ima: No TPM chip found, activating TPM-bypass! client # [ 0.928132] hub 1-0:1.0: 6 ports detected worker2 # [ 0.941451] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.977506] ima: Allocated hash algorithm: sha1 worker2 # [ 0.942951] drop_monitor: Initializing network drop monitor service worker1 # [ 0.977526] ima: No architecture policies found worker2 # [ 0.943085] NET: Registered PF_INET6 protocol family worker1 # [ 0.981658] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.931058] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.946072] Segment Routing with IPv6 worker2 # [ 0.946092] In-situ OAM (IOAM) with IPv6 client # [ 0.931086] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T21:08:24 UTC (1789938504) worker2 # [ 0.946132] NET: Registered PF_PACKET protocol family client # [ 0.931390] i2c_dev: i2c /dev entries driver worker2 # [ 0.947969] 9pnet: Installing 9P2000 support worker2 # [ 0.950170] Key type dns_resolver registered client # [ 0.936269] sdhci: Secure Digital Host Controller Interface driver client # [ 0.936280] sdhci: Copyright(c) Pierre Ossman lb # [ 0.924476] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.936544] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.927653] thunder_xcv, ver 1.0 lb # [ 0.927698] thunder_bgx, ver 1.0 client # [ 0.936913] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.927720] nicpf, ver 1.0 client # [ 0.938577] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.928273] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.928281] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.942161] usbcore: registered new interface driver usbhid lb # [ 0.928306] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.942172] usbhid: USB HID core driver lb # [ 0.928315] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.928347] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.928352] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.928376] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.957052] registered taskstats version 1 worker2 # [ 0.957206] Loading compiled-in X.509 certificates lb # [ 0.928381] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.944502] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.928511] sky2: driver version 1.30 lb # [ 0.930439] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.946030] drop_monitor: Initializing network drop monitor service client # [ 0.946179] NET: Registered PF_INET6 protocol family lb # [ 0.930488] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.949285] Segment Routing with IPv6 lb # [ 0.930775] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.949305] In-situ OAM (IOAM) with IPv6 client # [ 0.949336] NET: Registered PF_PACKET protocol family lb # [ 0.941552] usbcore: registered new interface driver usb-storage lb # [ 0.941674] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.999708] clk: Disabling unused clocks worker2 # [ 0.965582] Demotion targets for Node 0: null lb # [ 0.941688] usbserial: USB Serial support registered for generic worker1 # [ 0.999735] PM: genpd: Disabling unused power domains worker2 # [ 0.965693] Key type .fscrypt registered lb # [ 0.944014] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.965700] Key type fscrypt-provisioning registered lb # [ 0.945085] hub 1-0:1.0: USB hub found worker2 # [ 0.965793] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.945603] hub 1-0:1.0: 6 ports detected worker1 # [ 1.003980] Freeing unused kernel memory: 4736K client # [ 0.951190] 9pnet: Installing 9P2000 support worker2 # [ 0.965813] ima: Allocated hash algorithm: sha1 worker1 # [ 1.004187] Run /init as init process client # [ 0.953457] Key type dns_resolver registered worker2 # [ 0.965834] ima: No architecture policies found worker2 # [ 0.969954] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.947114] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.948647] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.948675] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T21:08:24 UTC (1789938504) lb # [ 0.948983] i2c_dev: i2c /dev entries driver client # [ 0.960337] registered taskstats version 1 client # [ 0.960486] Loading compiled-in X.509 certificates lb # [ 0.954031] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.954041] sdhci: Copyright(c) Pierre Ossman lb # [ 0.954305] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.954676] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.956362] hid: raw HID events driver (C) Jiri Kosina client # [ 0.968958] Demotion targets for Node 0: null client # [ 0.969071] Key type .fscrypt registered lb # [ 0.956596] usbcore: registered new interface driver usbhid client # [ 0.969078] Key type fscrypt-provisioning registered lb # [ 0.956603] usbhid: USB HID core driver client # [ 0.969185] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 1.021400] systemd[1]: Successfully made /usr/ read-only. client # [ 0.969205] ima: Allocated hash algorithm: sha1 client # [ 0.969228] ima: No architecture policies found lb # [ 0.962450] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.973408] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.963976] drop_monitor: Initializing network drop monitor service lb # [ 0.964191] NET: Registered PF_INET6 protocol family worker2 # [ 0.987734] clk: Disabling unused clocks lb # [ 0.967324] Segment Routing with IPv6 lb # [ 0.967344] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.987765] PM: genpd: Disabling unused power domains lb # [ 0.967374] NET: Registered PF_PACKET protocol family lb # [ 0.969046] 9pnet: Installing 9P2000 support worker2 # [ 0.992070] Freeing unused kernel memory: 4736K worker2 # [ 0.992275] Run /init as init process lb # [ 0.972103] Key type dns_resolver registered lb # [ 0.978620] registered taskstats version 1 lb # [ 0.978767] Loading compiled-in X.509 certificates client # [ 0.992056] clk: Disabling unused clocks client # [ 0.992085] PM: genpd: Disabling unused power domains worker2 # [ 1.009465] systemd[1]: Successfully made /usr/ read-only. client # [ 0.996330] Freeing unused kernel memory: 4736K lb # [ 0.987510] Demotion targets for Node 0: null client # [ 0.996536] Run /init as init process lb # [ 0.987633] Key type .fscrypt registered lb # [ 0.987640] Key type fscrypt-provisioning registered lb # [ 0.987737] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.987756] ima: Allocated hash algorithm: sha1 lb # [ 0.987778] ima: No architecture policies found lb # [ 0.991970] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 1.012901] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.011104] clk: Disabling unused clocks lb # [ 1.011133] PM: genpd: Disabling unused power domains lb # [ 1.015426] Freeing unused kernel memory: 4736K lb # [ 1.015647] Run /init as init process lb # [ 1.032137] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.183133] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.171211] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.174677] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.193758] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.335438] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.323358] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.356231] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.368217] systemd[1]: Detected virtualization qemu. worker1 # [ 1.370183] systemd[1]: Detected architecture arm64. worker1 # [ 1.372125] systemd[1]: Running in initrd. worker1 # [ 1.374670] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.377562] systemd[1]: Hostname set to . client # [ 1.326702] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.344341] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.356178] systemd[1]: Detected virtualization qemu. worker2 # [ 1.358150] systemd[1]: Detected architecture arm64. worker2 # [ 1.360113] systemd[1]: Running in initrd. worker2 # [ 1.362615] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.365486] systemd[1]: Hostname set to . lb # [ 1.343645] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.347728] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.359677] systemd[1]: Detected virtualization qemu. client # [ 1.361667] systemd[1]: Detected architecture arm64. client # [ 1.363635] systemd[1]: Running in initrd. client # [ 1.366235] systemd[1]: Initializing machine ID from random generator. client # [ 1.369330] systemd[1]: Hostname set to . worker1 # [ 1.423382] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.367116] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.379442] systemd[1]: Detected virtualization qemu. lb # [ 1.381554] systemd[1]: Detected architecture arm64. lb # [ 1.383598] systemd[1]: Running in initrd. lb # [ 1.386271] systemd[1]: Initializing machine ID from random generator. lb # [ 1.389253] systemd[1]: Hostname set to . worker2 # [ 1.411453] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.418897] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.434028] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.547142] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.535231] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.542678] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.557798] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.690968] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.670212] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.707479] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.713234] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.693717] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.682782] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.699402] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.700918] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.711047] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.706927] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.724242] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.729209] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker1 # [ 1.803803] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.813385] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.778272] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.814562] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.815930] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.816969] systemd[1]: Reached target Path Units. worker1 # [ 1.817751] systemd[1]: Reached target Slice Units. worker1 # [ 1.818555] systemd[1]: Reached target Swaps. worker1 # [ 1.819312] systemd[1]: Reached target Timer Units. worker1 # [ 1.820301] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.821480] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.822576] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.823567] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.824571] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.825433] systemd[1]: Reached target Socket Units. worker2 # [ 1.789537] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.790718] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.827989] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.792133] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.792173] systemd[1]: Reached target Path Units. worker2 # [ 1.792194] systemd[1]: Reached target Slice Units. worker2 # [ 1.792213] systemd[1]: Reached target Swaps. worker2 # [ 1.792232] systemd[1]: Reached target Timer Units. worker2 # [ 1.792455] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.792607] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.792745] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.792881] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.792992] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.793013] systemd[1]: Reached target Socket Units. worker1 # [ 1.838544] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.803663] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.839895] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.793520] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.811362] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.812547] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.852748] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.819472] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.806717] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.806942] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.806977] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.807009] systemd[1]: Reached target Path Units. client # [ 1.807029] systemd[1]: Reached target Slice Units. client # [ 1.807044] systemd[1]: Reached target Swaps. client # [ 1.807063] systemd[1]: Reached target Timer Units. client # [ 1.807243] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.807405] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.807539] systemd[1]: Listening on Journal Sockets. client # [ 1.807671] systemd[1]: Listening on udev Control Socket. client # [ 1.807781] systemd[1]: Listening on udev Kernel Socket. client # [ 1.807802] systemd[1]: Reached target Socket Units. client # [ 1.820451] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.838724] systemd[1]: Starting Journal Service... worker1 # [ 1.875330] systemd[1]: Starting Journal Service... lb # [ 1.817626] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.827402] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.879200] systemd[1]: Starting Load Kernel Modules... client # [ 1.828498] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.880096] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.848678] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.848809] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.828584] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.838783] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.830140] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.831737] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.833016] systemd[1]: Reached target Path Units. lb # [ 1.834070] systemd[1]: Reached target Slice Units. lb # [ 1.835072] systemd[1]: Reached target Swaps. lb # [ 1.836014] systemd[1]: Reached target Timer Units. lb # [ 1.837246] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.848275] systemd[1]: Starting Journal Service... lb # [ 1.838854] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.839033] systemd[1]: Listening on Journal Sockets. lb # [ 1.839198] systemd[1]: Listening on udev Control Socket. lb # [ 1.839344] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.903677] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.839371] systemd[1]: Reached target Socket Units. lb # [ 1.846578] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.857965] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.879436] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.859260] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.919554] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.921519] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.863118] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.926542] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.892108] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.893089] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.880265] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.894043] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.880406] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.935567] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.935934] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.907366] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.943485] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.948370] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.901041] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.904346] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.898045] systemd[1]: Starting Journal Service... worker1 # [ 1.957289] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.957535] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.957543] [drm] features: -context_init worker1 # [ 1.958265] [drm] number of scanouts: 1 worker1 # [ 1.958282] [drm] number of cap sets: 0 worker1 # [ 1.968695] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.968719] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 1.919306] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.913192] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.935384] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.920334] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.914219] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.920643] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.920879] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.939472] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.945684] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.923029] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.984953] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.935018] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.967238] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 2.010370] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.974987] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 1.949932] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.950988] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.951308] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.951561] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.956394] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.966256] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 2.016189] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.983891] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.987304] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.987323] [drm] features: -context_init worker2 # [ 1.988097] [drm] number of scanouts: 1 worker2 # [ 1.988116] [drm] number of cap sets: 0 client # [ 1.978715] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.971786] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 2.031230] Console: switching to colour frame buffer device 160x50 worker1 # [ 2.031913] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.995559] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.977803] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 2.000508] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 2.000532] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 1.990673] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.990909] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.990919] [drm] features: -context_init client # [ 1.991717] [drm] number of scanouts: 1 client # [ 1.991738] [drm] number of cap sets: 0 worker1 # [ 2.047974] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.050297] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.993810] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 2.007345] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 2.010022] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 2.005953] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 2.006208] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 2.006219] [drm] features: -context_init lb # [ 2.006968] [drm] number of scanouts: 1 lb # [ 2.006986] [drm] number of cap sets: 0 client # [ 2.015131] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 2.015158] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 2.027547] Console: switching to colour frame buffer device 160x50 worker1 # [ 2.071214] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 2.073542] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.017860] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 2.020539] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 2.079330] systemd[1]: Reached target Local File Systems. worker2 # [ 2.051871] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.052902] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 2.053774] systemd[1]: Reached target Local File Systems. worker1 # [ 2.091460] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.059771] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 2.034008] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 2.042863] Console: switching to colour frame buffer device 160x50 lb # [ 2.034030] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 2.064042] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.049479] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 2.111359] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.084700] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.074467] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.062065] Console: switching to colour frame buffer device 160x50 client # [ 2.078877] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 2.079307] systemd[1]: Reached target Preparation for Local File Systems. client # [ 2.079348] systemd[1]: Reached target Local File Systems. client # [ 2.084670] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.099612] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.099781] systemd[1]: Started Journal Service. worker2 # [ 2.088566] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker2 # [ 2.089755] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.090811] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.077936] systemd-modules-load[75]: Inserted module 'dm_mod' lb # [ 2.082455] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.091778] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.082846] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.082873] systemd[1]: Reached target Local File Systems. client # [ 2.084346] systemd-modules-load[75]: Module 'virtio_balloon' is built in lb # [ 2.090165] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.085481] systemd-modules-load[75]: Module 'virtio_console' is built in client # [ 2.086575] systemd-modules-load[75]: Inserted module 'virtio_gpu' client # [ 2.087567] systemd-modules-load[75]: Module 'virtio_rng' is built in client # [ 2.103200] systemd[1]: Finished Load Kernel Modules. lb # [ 2.094554] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.105390] systemd[1]: Started Journal Service. worker1 # [ 2.159282] systemd[1]: Started Journal Service. worker1 # [ 2.147638] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.148982] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker2 # [ 2.113181] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.150105] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.151167] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.108560] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.164260] systemd-modules-load[74]: Module 'virtio_rng' is built in worker1 # [ 2.169875] systemd[1]: Starting Create System Files and Directories... client # [ 2.122577] systemd[1]: Starting Create System Files and Directories... lb # [ 2.130079] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.178070] systemd-udevd[81]: Using default interface naming scheme 'v261'. lb # [ 2.133633] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.159157] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.161694] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 2.200763] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.164736] systemd[1]: Finished Apply Kernel Variables. lb # [ 2.162850] systemd[1]: Started Journal Service. lb # [ 2.160318] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.169128] systemd[1]: Finished Create System Files and Directories. lb # [ 2.161628] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.162724] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.220808] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.163824] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.172462] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.194701] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.176487] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.177594] systemd[1]: Starting Create System Files and Directories... client # [ 2.186678] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 2.189705] systemd[1]: Finished Apply Kernel Variables. lb # [ 2.208670] systemd-udevd[79]: Using default interface naming scheme 'v261'. client # [ 2.217855] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.211883] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.288146] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.251891] systemd[1]: Starting Virtual Console Setup... lb # [ 2.241019] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.273662] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.332621] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.336170] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.308537] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.312161] systemd[1]: Finished Virtual Console Setup. lb # [ 2.308194] systemd[1]: Starting Virtual Console Setup... client # [ 2.328619] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.332080] systemd[1]: Finished Virtual Console Setup. lb # [ 2.352462] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.356178] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.921186] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.922187] systemd[1]: Reached target System Initialization. worker1 # [ 2.923187] systemd[1]: Reached target Basic System. worker2 # [ 2.916259] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.917260] systemd[1]: Reached target System Initialization. worker2 # [ 2.920236] systemd[1]: Reached target Basic System. client # [ 2.915779] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.916799] systemd[1]: Reached target System Initialization. client # [ 2.920107] systemd[1]: Reached target Basic System. lb # [ 2.956763] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.958590] systemd[1]: Reached target System Initialization. lb # [ 2.965163] systemd[1]: Reached target Basic System. worker1 # [ 3.063998] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.052444] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.097056] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.101193] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.056242] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.086599] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.090174] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.089850] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.096860] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.108440] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.170264] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.182319] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.188114] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.161664] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.168110] systemd[1]: Reached target Initrd Root Device. lb # [ 3.146976] (udev-worker)[106]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.149540] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.172193] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.180500] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.184539] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.235974] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.187768] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.243653] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.246014] systemd[1]: Mounting /sysroot... worker2 # [ 3.225512] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.233407] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.235991] systemd[1]: Mounting /sysroot... worker1 # [ 3.295520] EXT4-fs (vda): mounted filesystem 60c27afa-cc42-4a7a-9fbb-12f3061e83b4 r/w with ordered data mode. Quota mode: none. client # [ 3.235922] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.286487] systemd[1]: Mounted /sysroot. worker1 # [ 3.288654] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.292750] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.244103] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.247078] systemd[1]: Mounting /sysroot... lb # [ 3.246155] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.248307] systemd[1]: Reached target Initrd Root Device. lb # [ 3.252207] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.292697] EXT4-fs (vda): mounted filesystem 94753198-4bef-46d3-8096-7b888aaeec4f r/w with ordered data mode. Quota mode: none. worker2 # [ 3.286631] systemd[1]: Mounted /sysroot. worker1 # [ 3.322780] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.290026] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.327391] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.331965] systemd[1]: Reloading... client # [ 3.298643] EXT4-fs (vda): mounted filesystem 5e27ae01-54fe-4082-93cd-eed420088bcd r/w with ordered data mode. Quota mode: none. worker2 # [ 3.300325] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.293969] systemd[1]: Mounted /sysroot. client # [ 3.295947] systemd[1]: Reached target Initrd Root File System. client # [ 3.300364] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.320430] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.300445] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.327003] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.308187] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.331861] systemd[1]: Reloading... lb # [ 3.312228] systemd[1]: Mounting /sysroot... client # [ 3.324259] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.331128] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.336067] systemd[1]: Reloading... lb # [ 3.368266] EXT4-fs (vda): mounted filesystem cd1d32ea-968a-4845-8c6c-e9ad2a458658 r/w with ordered data mode. Quota mode: none. lb # [ 3.360990] systemd[1]: Mounted /sysroot. lb # [ 3.363063] systemd[1]: Reached target Initrd Root File System. lb # [ 3.368079] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.395856] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.402574] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.408165] systemd[1]: Reloading... worker1 # [ 3.543538] systemd[1]: Reloading finished in 212 ms. worker1 # [ 3.575884] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.543106] systemd[1]: Reloading finished in 213 ms. worker1 # [ 3.582748] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.592078] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.596459] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.599453] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.552152] systemd[1]: Reloading finished in 216 ms. worker1 # [ 3.603572] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.574311] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.578284] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.617063] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 3.584258] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.620455] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.586676] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.585210] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.600192] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.589609] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker2 # [ 3.603891] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.596373] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.610301] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.598994] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.613968] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.606605] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.608212] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.632539] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.625037] systemd[1]: Reloading finished in 218 ms. client # [ 3.635837] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.660598] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... lb # [ 3.665546] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.672093] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.678437] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.680728] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.685950] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.704505] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.706023] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.906450] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.872446] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.923211] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.891090] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.897242] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.909299] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.951853] systemd[1]: Mounting /sysroot/run... client # [ 3.906477] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.955960] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.919477] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.971162] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.913812] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.943533] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.930543] systemd[1]: Mounting /sysroot/run... lb # [ 3.930773] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.991367] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.938798] systemd[1]: Mounting /sysroot/run... client # [ 3.950772] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 4.011583] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.977173] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.957820] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.970112] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.987386] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 4.037835] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.001839] systemd[1]: Mounted /sysroot/run. worker1 # [ 4.040160] systemd[1]: Mounted /sysroot/run. worker2 # [ 4.006222] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 4.020760] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.008999] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 4.024214] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.006269] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 4.067194] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 4.071239] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 4.023631] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 4.079409] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.080632] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.024557] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 4.034223] systemd[1]: Mounted /sysroot/run. lb # [ 4.031441] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 4.054141] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.055538] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.051764] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.047310] systemd[1]: Mounted /sysroot/run. client # [ 4.055642] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 4.062301] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.054528] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 4.066213] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.070825] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 4.085735] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.086886] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.097822] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.100194] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.101837] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.145435] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.146296] systemd[1]: Reached target Initrd File Systems. lb # [ 4.149284] systemd[1]: Starting Find NixOS closure... lb # [ 4.160113] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.195886] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.215194] systemd[1]: Finished Find NixOS closure. lb # [ 4.218007] systemd[1]: Reached target Initrd Default Target. lb # [ 4.220405] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.254229] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.258331] systemd[1]: Stopped target Basic System. lb # [ 4.259314] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.264232] systemd[1]: Stopped target Path Units. lb # [ 4.266090] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.267981] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.271564] systemd[1]: Stopped target Slice Units. lb # [ 4.274171] systemd[1]: Stopped target Socket Units. lb # [ 4.276136] systemd[1]: Stopped target System Initialization. lb # [ 4.281350] systemd[1]: Stopped target Swaps. lb # [ 4.283122] systemd[1]: Stopped target Timer Units. lb # [ 4.284470] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.288734] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.290701] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.292380] systemd[1]: Stopped Find NixOS closure. lb # [ 4.299202] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 4.302886] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.307105] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.308350] systemd[1]: Stopped Apply Kernel Variables. lb # [ 4.311191] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 4.315569] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.325684] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 4.326979] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 4.339155] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.343931] systemd[1]: Stopped Create System Files and Directories. lb # [ 4.348342] systemd[1]: Stopped target Local File Systems. lb # [ 4.349983] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.352228] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.355406] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.356652] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.357719] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.358758] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.359493] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.368267] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.369303] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.371868] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.428663] (udev-worker)[102]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.373364] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 4.374388] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 4.375229] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.376352] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.377351] systemd[1]: systemd-udevd.service: Consumed 1.067s CPU time over 2.286s wall clock time, 17.6M memory peak. lb # [ 4.378782] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.379796] systemd[1]: Closed udev Control Socket. worker1 # [ 4.434959] (udev-worker)[102]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory lb # [ 4.384303] systemd[1]: Starting Cleanup udev Database... lb # [ 4.385207] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.388364] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.392452] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.393668] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.394647] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.396136] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.463347] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.464588] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.466116] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.468309] systemd[1]: Starting Virtual Console Setup... lb # [ 4.417884] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.419468] systemd[1]: Finished Cleanup udev Database. lb # [ 4.422768] systemd[1]: Reached target Switch Root. worker2 # [ 4.445803] (udev-worker)[101]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.428530] systemd[1]: Starting NixOS Activation... worker2 # [ 4.450861] (udev-worker)[101]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.448726] (udev-worker)[98]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.501481] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.504932] systemd[1]: Finished Virtual Console Setup. client # [ 4.454187] (udev-worker)[98]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.483103] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.485607] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.486822] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 4.491458] systemd[1]: Starting Virtual Console Setup... client # [ 4.487441] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.489472] systemd[1]: Stopped Virtual Console Setup. client # [ 4.492771] systemd[1]: Stopping Virtual Console Setup... client # [ 4.493624] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.517236] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 4.520721] systemd[1]: Finished Virtual Console Setup. client # [ 4.520844] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.524484] systemd[1]: Finished Virtual Console Setup. lb # [ 4.602168] initrd-nixos-activation-start[172]: booting system configuration /nix/store/px4c3ifawqq4xs8a4zhy519i865fkk09-nixos-system-lb-test lb # [ 4.673024] initrd-nixos-activation-start[172]: running activation script... worker1 # [ 4.908163] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.875197] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.906771] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.935680] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.976695] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.940483] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.980867] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.947244] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.986018] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.956541] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.996584] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.957375] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.959746] systemd[1]: Reached target Initrd File Systems. client # [ 4.963931] systemd[1]: Starting Find NixOS closure... client # [ 4.972444] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 5.006546] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 5.012580] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 5.051664] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.060443] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 5.028316] systemd[1]: Finished Find NixOS closure. client # [ 5.014696] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 5.018262] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 5.032384] systemd[1]: Reached target Initrd Default Target. worker2 # [ 5.036738] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 5.073272] systemd[1]: Finished Find NixOS closure. worker1 # [ 5.076346] systemd[1]: Reached target Initrd Default Target. worker1 # [ 5.078791] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.031221] systemd[1]: Finished Find NixOS closure. client # [ 5.034793] systemd[1]: Reached target Initrd Default Target. client # [ 5.040950] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 5.061292] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 5.063008] systemd[1]: Stopped target Basic System. worker2 # [ 5.064184] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.065315] systemd[1]: Stopped target Path Units. worker2 # [ 5.066229] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 5.068610] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.072474] systemd[1]: Stopped target Slice Units. worker2 # [ 5.073437] systemd[1]: Stopped target Socket Units. worker1 # [ 5.111038] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.113226] systemd[1]: Stopped target Basic System. client # [ 5.063962] systemd[1]: Stopped target Initrd Default Target. client # [ 5.065605] systemd[1]: Stopped target Basic System. worker2 # [ 5.080322] systemd[1]: Stopped target System Initialization. worker1 # [ 5.116419] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.081241] systemd[1]: Stopped target Swaps. client # [ 5.068435] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.081889] systemd[1]: Stopped target Timer Units. worker1 # [ 5.118149] systemd[1]: Stopped target Path Units. worker2 # [ 5.082569] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.069944] systemd[1]: Stopped target Path Units. worker2 # [ 5.083389] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.120340] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.072148] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 5.085653] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.123349] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.088189] systemd[1]: Stopped Find NixOS closure. client # [ 5.074687] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.089537] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 5.126639] systemd[1]: Stopped target Slice Units. client # [ 5.077790] systemd[1]: Stopped target Slice Units. worker2 # [ 5.091584] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.080314] systemd[1]: Stopped target Socket Units. client # [ 5.081210] systemd[1]: Stopped target System Initialization. worker1 # [ 5.132179] systemd[1]: Stopped target Socket Units. worker1 # [ 5.133150] systemd[1]: Stopped target System Initialization. worker2 # [ 5.096809] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.084243] systemd[1]: Stopped target Swaps. worker1 # [ 5.134085] systemd[1]: Stopped target Swaps. worker2 # [ 5.097820] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.085062] systemd[1]: Stopped target Timer Units. worker1 # [ 5.134821] systemd[1]: Stopped target Timer Units. worker2 # [ 5.098549] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 5.099522] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.135620] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.086396] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.088828] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.140239] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.141243] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.092333] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.142403] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.143209] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.094235] systemd[1]: Stopped Find NixOS closure. worker2 # [ 5.107366] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.096203] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 5.147115] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.099724] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.150276] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.100955] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.114426] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 5.115550] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.102960] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.154835] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.106006] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 5.120285] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.157374] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 5.122895] systemd[1]: Stopped target Local File Systems. lb # [ 5.105062] initrd-nixos-activation-start[195]: setting up /etc... client # [ 5.117158] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.169517] systemd[1]: Stopped Load Kernel Modules. client # [ 5.119911] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 5.133619] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 5.134740] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.172272] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.125423] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.126770] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.127827] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.177739] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 5.142821] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 5.146528] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.147702] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.184180] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 5.150343] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.188141] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 5.152158] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.189369] systemd[1]: Stopped target Local File Systems. worker2 # [ 5.154537] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.191190] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 5.156463] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.143754] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.193540] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 5.146309] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.196299] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 5.160189] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.197220] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.161494] systemd[1]: systemd-udevd.service: Consumed 1.399s CPU time over 3.084s wall clock time, 22.2M memory peak. client # [ 5.149627] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.199899] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.164195] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.151255] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 5.165926] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 5.166874] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 5.167871] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.204473] systemd[1]: Stopped Virtual Console Setup. client # [ 5.154894] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.168853] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.205243] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.155988] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.169830] systemd[1]: Closed udev Control Socket. worker1 # [ 5.206134] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 5.170521] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.207005] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.157971] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 5.171276] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.207970] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.209800] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.160384] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.210751] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.211722] systemd[1]: systemd-udevd.service: Consumed 1.374s CPU time over 3.114s wall clock time, 22.2M memory peak. worker1 # [ 5.213284] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.164404] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.214282] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.165384] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.215122] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.166464] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 5.180354] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.167295] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 5.181302] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.168503] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.169346] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.170424] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.220246] systemd[1]: Closed udev Control Socket. worker2 # [ 5.184438] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.171430] systemd[1]: systemd-udevd.service: Consumed 1.397s CPU time over 3.082s wall clock time, 22.5M memory peak. worker2 # [ 5.185452] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.224186] systemd[1]: Starting Cleanup udev Database... worker2 # [ 5.188147] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.225173] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.226372] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.228237] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.180299] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.181338] systemd[1]: Closed udev Control Socket. client # [ 5.182312] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.232128] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.233138] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.184189] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.234096] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.188195] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.189083] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.190187] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.192148] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.196351] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.216748] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 5.218490] systemd[1]: Finished Cleanup udev Database. worker2 # [ 5.220138] systemd[1]: Reached target Switch Root. worker2 # [ 5.223996] systemd[1]: Starting NixOS Activation... worker1 # [ 5.263540] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.264828] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.265591] systemd[1]: Reached target Switch Root. worker1 # [ 5.268107] systemd[1]: Starting NixOS Activation... client # [ 5.220832] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.222802] systemd[1]: Finished Cleanup udev Database. client # [ 5.227771] systemd[1]: Reached target Switch Root. client # [ 5.228636] systemd[1]: Starting NixOS Activation... lb # [ 5.358685] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.360389] systemd[1]: Finished NixOS Activation. lb # [ 5.362728] systemd[1]: Starting Switch Root... worker2 # [ 5.385856] initrd-nixos-activation-start[179]: booting system configuration /nix/store/gh79m3xzyqyvpdkgcwhw7570p93z0llj-nixos-system-worker2-test worker1 # [ 5.425405] initrd-nixos-activation-start[179]: booting system configuration /nix/store/5zd1y7cz4jr6rf6lhvvzl3jz666fjcb5-nixos-system-worker1-test client # [ 5.387846] initrd-nixos-activation-start[179]: booting system configuration /nix/store/gkhkardj3d6k7q4gs4n9bbjjpdx2saf4-nixos-system-client-test lb # [ 5.383525] systemd[1]: Switching root. worker2 # [ 5.450816] initrd-nixos-activation-start[179]: running activation script... worker1 # [ 5.490562] initrd-nixos-activation-start[179]: running activation script... client # [ 5.454170] initrd-nixos-activation-start[179]: running activation script... lb # [ 5.573382] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.859305] initrd-nixos-activation-start[202]: setting up /etc... client # [ 5.859376] initrd-nixos-activation-start[202]: setting up /etc... worker1 # [ 5.911371] initrd-nixos-activation-start[202]: setting up /etc... worker2 # [ 6.113709] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 6.116169] systemd[1]: Finished NixOS Activation. worker2 # [ 6.117833] systemd[1]: Starting Switch Root... client # [ 6.122100] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.124684] systemd[1]: Finished NixOS Activation. worker2 # [ 6.139962] systemd[1]: Switching root. client # [ 6.128215] systemd[1]: Starting Switch Root... worker1 # [ 6.178729] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.181574] systemd[1]: Finished NixOS Activation. worker1 # [ 6.182778] systemd[1]: Starting Switch Root... client # [ 6.147732] systemd[1]: Switching root. worker1 # [ 6.199671] systemd[1]: Switching root. lb # [ 6.165156] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.177493] systemd[1]: Detected virtualization qemu. lb # [ 6.180917] systemd[1]: Detected architecture arm64. lb # [ 6.184934] systemd[1]: Detected first boot. lb # [ 6.192495] systemd[1]: Initializing machine ID from random generator. worker2 # [ 6.330464] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 6.338735] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.390769] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.526687] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 6.723197] systemd[1]: Applying preset policy. worker2 # [ 6.902879] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.909599] systemd[1]: Detected virtualization qemu. worker2 # [ 6.911624] systemd[1]: Detected architecture arm64. worker2 # [ 6.915482] systemd[1]: Detected first boot. worker2 # [ 6.922529] systemd[1]: Initializing machine ID from random generator. client # [ 6.945994] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.997568] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.958287] systemd[1]: Detected virtualization qemu. worker1 # [ 7.010515] systemd[1]: Detected virtualization qemu. client # [ 6.961293] systemd[1]: Detected architecture arm64. client # [ 6.964963] systemd[1]: Detected first boot. worker1 # [ 7.013729] systemd[1]: Detected architecture arm64. worker1 # [ 7.017754] systemd[1]: Detected first boot. client # [ 6.972235] systemd[1]: Initializing machine ID from random generator. worker1 # [ 7.025067] systemd[1]: Initializing machine ID from random generator. lb # [ 7.229165] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.256708] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.293147] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 7.351199] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 7.449504] systemd[1]: Applying preset policy. client # [ 7.487794] systemd[1]: Applying preset policy. worker1 # [ 7.541238] systemd[1]: Applying preset policy. lb # [ 7.752967] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 7.754625] systemd[1]: Stopped initrd-switch-root.service. lb # [ 7.757873] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 7.761525] systemd[1]: Created slice Slice /system/getty. lb # [ 7.763223] systemd[1]: Created slice User and Session Slice. lb # [ 7.764526] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 7.766663] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 7.767032] systemd[1]: Expecting device /dev/hvc0... lb # [ 7.767313] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 7.767566] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 7.767826] systemd[1]: Stopped target initrd-fs.target. lb # [ 7.768073] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 7.768319] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 7.768569] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 7.768832] systemd[1]: Reached target Path Units. lb # [ 7.769074] systemd[1]: Reached target Remote File Systems. lb # [ 7.769325] systemd[1]: Reached target Slice Units. lb # [ 7.769560] systemd[1]: Reached target Swaps. lb # [ 7.781154] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 7.786139] systemd[1]: Listening on Process Core Dump Socket. lb # [ 7.790029] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 7.793935] systemd[1]: Listening on Factory Reset Management. lb # [ 7.795183] systemd[1]: Listening on Hostname Service Socket. lb # [ 7.801054] systemd[1]: Starting Journal Log Access Socket... lb # [ 7.804132] systemd[1]: Listening on Journal Audit Socket. lb # [ 7.808825] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 7.811449] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 7.813989] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.816502] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 7.828360] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 7.829857] systemd[1]: Listening on udev Control Socket. lb # [ 7.831505] systemd[1]: Listening on udev Varlink Socket. lb # [ 7.835939] systemd[1]: Mounting Huge Pages File System... lb # [ 7.841210] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 7.848080] systemd[1]: Mounting Kernel Debug File System... lb # [ 7.855306] systemd[1]: Mounting Kernel Trace File System... lb # [ 7.870984] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 7.885087] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 7.885456] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 7.914608] systemd[1]: Populated /etc with preset unit settings. lb # [ 7.893659] systemd[1]: Mounting Kernel Configuration File System... lb # [ 7.895940] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 7.898336] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 7.919369] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 7.982014] systemd[1]: Populated /etc with preset unit settings. lb # [ 7.929087] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.975391] systemd[1]: Populated /etc with preset unit settings. lb # [ 8.030348] systemd[1]: Starting Journal Service... lb # [ 8.064783] systemd[1]: Starting Load Kernel Modules... lb # [ 8.082199] fuse: init (API version 7.45) lb # [ 8.116625] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.132137] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 8.138663] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.165935] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.173057] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.183311] systemd-journald[267]: Collecting audit messages is enabled. lb # [ 8.192727] systemd[1]: Mounted Huge Pages File System. lb # [ 8.197682] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 8.190608] systemd[1]: Queued start job for default target Multi-User System. lb # [ 8.206171] systemd[1]: Started Journal Service. lb # [ 8.195708] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.203181] systemd-modules-load[268]: Module 'atkbd' is built in lb # [ 8.208902] systemd-modules-load[268]: Module 'loop' is built in lb # [ 8.215393] systemd[1]: Mounted Kernel Debug File System. lb # [ 8.223351] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.229216] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.247837] EXT4-fs (vda): re-mounted cd1d32ea-968a-4845-8c6c-e9ad2a458658. lb # [ 8.237800] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.247101] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 8.248652] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.253264] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 8.258125] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.264532] systemd[1]: Finished Load Kernel Modules. lb # [ 8.265369] systemd[1]: Mounting FUSE Control File System... lb # [ 8.268213] systemd[1]: Starting Firewall... lb # [ 8.278930] systemd[1]: Starting Apply Kernel Variables... lb # [ 8.288719] systemd-oomd[269]: No swap; memory pressure usage will be degraded lb # [ 8.311146] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.312538] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 8.320658] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.404924] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 8.406238] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.410236] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 8.377876] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.414715] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.417480] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.419708] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.421984] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 8.424191] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.425991] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.464491] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 8.427943] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 8.465813] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.430027] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 8.431935] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.469238] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.433796] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.435803] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.472973] systemd[1]: Created slice Slice /system/getty. lb # [ 8.401739] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 8.437793] systemd[1]: Reached target Path Units. worker1 # [ 8.475683] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.439590] systemd[1]: Reached target Remote File Systems. worker1 # [ 8.476916] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.441447] systemd[1]: Reached target Slice Units. worker1 # [ 8.478498] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 8.405878] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.443257] systemd[1]: Reached target Swaps. worker1 # [ 8.480142] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 8.481803] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.482829] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 8.484153] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 8.447490] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.485374] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.487199] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 8.488331] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 8.452703] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.489758] systemd[1]: Reached target Path Units. worker1 # [ 8.491326] systemd[1]: Reached target Remote File Systems. worker2 # [ 8.456909] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 8.493613] systemd[1]: Reached target Slice Units. worker1 # [ 8.495984] systemd[1]: Reached target Swaps. worker2 # [ 8.461045] systemd[1]: Listening on Factory Reset Management. worker2 # [ 8.462921] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.500422] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 8.429252] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 8.432276] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.468242] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.505517] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 8.471335] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.509894] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.476152] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 8.514323] systemd[1]: Listening on Factory Reset Management. worker2 # [ 8.479239] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.516719] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 8.481921] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.485356] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 8.522826] systemd[1]: Starting Journal Log Access Socket... client # [ 8.477264] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 8.526149] systemd[1]: Listening on Journal Audit Socket. lb # [ 8.455374] systemd[1]: Finished Apply Kernel Variables. client # [ 8.478904] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.531402] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.483216] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.496548] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.534601] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 8.498892] systemd[1]: Listening on udev Control Socket. client # [ 8.487183] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.501110] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.537479] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.489611] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.540819] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.491580] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.506249] systemd[1]: Mounting Huge Pages File System... client # [ 8.493867] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.496117] systemd[1]: Expecting device /dev/hvc0... client # [ 8.497911] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 8.511899] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.499873] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.500974] systemd[1]: Stopped target initrd-fs.target. client # [ 8.502680] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.552384] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.504224] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 8.554916] systemd[1]: Listening on udev Control Socket. client # [ 8.505860] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.556311] systemd[1]: Listening on udev Varlink Socket. client # [ 8.507692] systemd[1]: Reached target Path Units. client # [ 8.509943] systemd[1]: Reached target Remote File Systems. worker1 # [ 8.561264] systemd[1]: Mounting Huge Pages File System... worker2 # [ 8.524383] systemd[1]: Mounting Kernel Debug File System... client # [ 8.511056] systemd[1]: Reached target Slice Units. client # [ 8.513326] systemd[1]: Reached target Swaps. lb # [ 8.490217] systemd[1]: Mounted FUSE Control File System. worker1 # [ 8.566304] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.517294] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.534538] systemd[1]: Mounting Kernel Trace File System... client # [ 8.522417] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.502911] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 8.574280] systemd[1]: Mounting Kernel Debug File System... client # [ 8.526400] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.530443] systemd[1]: Listening on Factory Reset Management. client # [ 8.531690] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 8.550184] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.537668] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.517207] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 8.589467] systemd[1]: Mounting Kernel Trace File System... client # [ 8.540893] systemd[1]: Listening on Journal Audit Socket. client # [ 8.545731] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.548359] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.550999] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.542768] systemd-journald[267]: Received client request to flush runtime journal. client # [ 8.553613] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.569455] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 8.606842] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 8.571295] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.565316] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.568140] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.618971] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.570301] systemd[1]: Listening on udev Varlink Socket. client # [ 8.575326] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.624598] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.592731] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.580756] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 8.594989] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.634080] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 8.599750] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.635867] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.589834] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 8.641126] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.617825] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.654722] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 8.619463] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.606910] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.656345] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.614139] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 8.639386] systemd[1]: Starting Journal Service... client # [ 8.631527] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 8.634169] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.650477] systemd[1]: Starting Load Kernel Modules... lb # [ 8.617685] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 8.619363] systemd[1]: Reached target First Boot Complete. lb # [ 8.626907] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 8.651094] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 8.667752] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 8.654430] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.662819] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.688375] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 8.688787] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.733137] systemd[1]: Starting Journal Service... worker2 # [ 8.700300] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.668766] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 8.705935] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.672249] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 8.746641] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.711508] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.713829] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 8.716888] systemd[1]: Mounted Kernel Debug File System. lb # [ 8.678924] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 8.719126] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 8.721399] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.719171] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.725973] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.779688] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 8.786484] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.789270] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.803583] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 8.809620] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 8.813430] systemd[1]: Mounted Huge Pages File System. client # [ 8.764829] systemd[1]: Starting Journal Service... worker1 # [ 8.816540] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 8.822873] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 8.823617] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.753912] systemd[1]: Mounting /run/wrappers... worker1 # [ 8.824060] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.784782] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.800753] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 8.810237] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 8.803847] fuse: init (API version 7.45) worker1 # [ 8.856199] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 8.864986] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 8.817341] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 8.828420] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 8.832495] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.827238] systemd[1]: Mounted /run/wrappers. lb # [ 8.836347] systemd[1]: Reached target Local File Systems. lb # [ 8.840133] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 8.870396] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.850912] systemd[1]: Starting register-nix-paths.service... lb # [ 8.854808] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 8.856268] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.900313] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 8.903391] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 8.940769] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 8.893641] systemd-journald[273]: Collecting audit messages is enabled. worker1 # [ 8.944074] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 8.915529] systemd[1]: Finished Load Kernel Modules. lb # [ 8.884366] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 8.956962] systemd[1]: Finished Load Kernel Modules. client # [ 8.906531] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 8.960313] EXT4-fs (vda): re-mounted 60c27afa-cc42-4a7a-9fbb-12f3061e83b4. worker2 # [ 8.924229] systemd[1]: Starting Firewall... client # [ 8.899608] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.904550] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.933995] EXT4-fs (vda): re-mounted 94753198-4bef-46d3-8096-7b888aaeec4f. worker1 # [ 8.973519] systemd-journald[273]: Collecting audit messages is enabled. worker2 # [ 8.939021] systemd[1]: Starting Apply Kernel Variables... client # [ 8.912684] systemd-modules-load[274]: Module 'atkbd' is built in worker1 # [ 8.976815] systemd[1]: Starting Firewall... client # [ 8.928699] systemd[1]: Started Journal Service. worker2 # [ 8.943673] systemd-journald[273]: Collecting audit messages is enabled. client # [ 8.920659] systemd-modules-load[274]: Module 'loop' is built in client # [ 8.926444] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.956021] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.958763] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 8.932753] systemd[1]: Mounted POSIX Message Queue File System. client # [ 8.933839] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 8.997389] fuse: init (API version 7.45) client # [ 8.934780] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 8.961111] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 8.935737] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.927838] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.000919] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 9.007192] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 9.011264] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.979777] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 9.015403] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.980189] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.955544] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 8.985730] systemd[1]: Started Journal Service. worker1 # [ 9.009760] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.960869] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.961935] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.962888] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.963869] systemd[1]: Finished Load Kernel Module fuse. worker1 # [ 9.037373] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 9.037814] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 9.004011] fuse: init (API version 7.45) worker1 # [ 9.038358] systemd[1]: Started Journal Service. client # [ 8.978852] systemd[1]: Finished Load Kernel Modules. worker1 # [ 9.028611] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.996870] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.999072] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 9.004580] systemd-modules-load[274]: Module 'atkbd' is built in worker1 # [ 9.040910] systemd-modules-load[274]: Module 'atkbd' is built in client # [ 8.993833] systemd[1]: Mounting FUSE Control File System... client # [ 9.011450] EXT4-fs (vda): re-mounted 5e27ae01-54fe-4082-93cd-eed420088bcd. worker2 # [ 9.012161] systemd-modules-load[274]: Module 'loop' is built in client # [ 9.005382] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 9.059915] systemd-modules-load[274]: Module 'loop' is built in worker2 # [ 9.036217] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 9.026337] systemd-oomd[275]: No swap; memory pressure usage will be degraded worker1 # [ 9.080674] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 9.025908] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 9.048713] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 9.033300] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.042603] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 9.044834] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 9.094159] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 9.059756] systemd[1]: Finished Load Kernel Module fuse. client # [ 9.050988] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 9.108425] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 9.074447] systemd-oomd[275]: No swap; memory pressure usage will be degraded worker2 # [ 9.080810] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 9.078480] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 9.139357] systemd-oomd[275]: No swap; memory pressure usage will be degraded client # [ 9.096269] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 9.090818] systemd-udevd[309]: Using default interface naming scheme 'v261'. worker2 # [ 9.113026] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 9.114795] systemd[1]: Reached target First Boot Complete. client # [ 9.106050] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 9.159397] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 9.113317] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 9.145420] systemd-journald[273]: Received client request to flush runtime journal. client # [ 9.120860] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.191970] systemd-journald[273]: Received client request to flush runtime journal. client # [ 9.187023] systemd[1]: Finished Apply Kernel Variables. client # [ 9.209778] systemd-journald[273]: Received client request to flush runtime journal. lb # [ 9.189499] systemd[1]: Finished Create System Files and Directories. worker2 # [ 9.211469] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 9.221855] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 9.226197] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.262970] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 9.208182] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 9.229873] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 9.273843] systemd[1]: Reached target First Boot Complete. worker1 # [ 9.275912] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.277160] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 9.278386] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.219243] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.282219] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 9.267234] systemd[1]: Mounted FUSE Control File System. client # [ 9.274544] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 9.281907] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 9.284954] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 9.300151] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 9.303361] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.292095] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.293368] systemd[1]: Reached target First Boot Complete. worker2 # [ 9.308810] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 9.375901] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.378051] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 9.382056] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.350405] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.351461] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.354075] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 9.399605] systemd[1]: Mounting /run/wrappers... lb # [ 9.373126] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 9.401990] systemd[1]: Mounting FUSE Control File System... worker1 # [ 9.458197] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.460589] systemd[1]: Mounting FUSE Control File System... worker2 # [ 9.447825] systemd[1]: Mounted FUSE Control File System. lb # [ 9.436191] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 9.459370] systemd-udevd[310]: Using default interface naming scheme 'v261'. worker1 # [ 9.507586] systemd[1]: Mounted FUSE Control File System. worker2 # [ 9.479476] systemd[1]: Mounted /run/wrappers. worker2 # [ 9.481884] systemd[1]: Reached target Local File Systems. client # [ 9.469709] systemd[1]: Mounting /run/wrappers... worker2 # [ 9.485186] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.473144] systemd-udevd[305]: Using default interface naming scheme 'v261'. lb # [ 9.465593] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 9.493179] systemd[1]: Starting register-nix-paths.service... worker2 # [ 9.504537] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 9.505745] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 9.488858] systemd[1]: Starting Update is Completed... worker1 # [ 9.548414] systemd[1]: Mounted /run/wrappers. worker2 # [ 9.514784] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.553376] systemd[1]: Reached target Local File Systems. worker1 # [ 9.556577] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 9.525635] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.572407] systemd-udevd[312]: Using default interface naming scheme 'v261'. worker1 # [ 9.574227] systemd[1]: Starting register-nix-paths.service... client # [ 9.526079] systemd[1]: Mounted /run/wrappers. client # [ 9.527740] systemd[1]: Reached target Local File Systems. client # [ 9.531148] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 9.584698] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.539371] systemd[1]: Starting register-nix-paths.service... worker1 # [ 9.593550] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.546925] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.548964] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.607071] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.609183] systemd[1]: Starting Create System Files and Directories... client # [ 9.577297] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 9.585725] systemd[1]: Starting Create System Files and Directories... worker2 # [ 9.606465] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 9.616223] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 9.598752] systemd[1]: Finished Update is Completed. worker1 # [ 9.685445] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 9.696384] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.682283] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.692219] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 9.752879] systemd[1]: Finished Create System Files and Directories. worker2 # [ 9.764321] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.757125] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 9.778280] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.835713] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.840475] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 9.846900] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 9.805174] systemd[1]: Finished Create System Files and Directories. worker2 # [ 9.811173] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.824110] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.829300] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.923207] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 9.911809] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.971321] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.929518] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 9.986860] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 9.989904] systemd[1]: Starting Update is Completed... client # [ 9.977997] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.988741] systemd[1]: Starting Update is Completed... worker1 # [ 10.079316] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 10.084251] systemd[1]: Starting Update is Completed... client # [ 10.061962] systemd[1]: Finished Update is Completed. worker2 # [ 10.075335] systemd[1]: Finished Update is Completed. worker1 # [ 10.167572] systemd[1]: Finished Update is Completed. lb # [ 10.133457] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 10.139780] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 10.480801] systemd[1]: Finished register-nix-paths.service. client # [ 10.526586] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.530887] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.549682] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 10.554175] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 10.603235] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 10.605879] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 10.696097] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.698244] systemd[1]: Reached target System Initialization. lb # [ 10.700498] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 10.705934] systemd[1]: Started niks3 garbage collection timer. lb # [ 10.707433] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 10.710892] systemd[1]: Reached target Timer Units. lb # [ 10.720296] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 10.721254] systemd[1]: Listening on niks3 server socket. lb # [ 10.722046] systemd[1]: Listening on Nix Daemon Socket. lb # [ 10.722817] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 10.724540] systemd[1]: Reached target Socket Units. client # [ 10.734301] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.731242] systemd[1]: Reached target Basic System. lb # [ 10.735811] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 10.744828] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 10.754193] systemd[1]: Starting Post-Boot Actions... lb # [ 10.776637] systemd[1]: Started Reset console on configuration changes. client # [ 10.797449] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 10.808923] systemd[1]: Starting resolvconf update... lb # [ 10.844326] systemd[1]: Started rustfs.service. lb # [ 10.870611] systemd[1]: Starting rustfs-bucket.service... lb # [ 10.913656] nsncd[481]: Sep 20 21:08:34.477 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 10.924230] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 10.934233] systemd[1]: Finished Post-Boot Actions. lb # [ 10.984809] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 10.989857] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.001316] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 11.008622] systemd[1]: Starting D-Bus System Message Bus... client # [ 11.058188] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 11.053019] systemd[1]: Starting User Login Management... lb # [ 11.059327] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 11.118351] systemd[1]: Finished Firewall. lb # [ 11.104362] systemd[1]: Finished Firewall. worker2 # [ 11.128534] systemd[1]: Finished Firewall. worker2 # [ 11.224462] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 11.273382] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 11.286847] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 11.330582] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 11.283240] systemd[1]: Finished register-nix-paths.service. client # [ 11.287151] systemd[1]: Reached target System Initialization. client # [ 11.289392] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 11.283577] dbus-broker-launch[516]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.291743] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.297530] systemd[1]: Reached target Timer Units. client # [ 11.298322] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.299206] systemd[1]: Listening on Nix Daemon Socket. client # [ 11.299997] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.308472] systemd[1]: Reached target Socket Units. client # [ 11.312265] systemd[1]: Reached target Basic System. lb # [ 11.304762] dbus-broker-launch[516]: NSS returned no entry for 'systemd-timesync' client # [ 11.314163] systemd[1]: Started backdoor.service. client # [ 11.317480] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.324175] systemd[1]: Starting nftables firewall... lb # [ 11.311128] dbus-broker-launch[516]: Invalid user-name in /nix/store/r3k08synkldj3yxnxmc97ljig0y68d44-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.328435] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.338012] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.353528] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.350133] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 11.358399] systemd[1]: Stopping User and Group Name Lookups... lb # [ 11.372922] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.373913] systemd[1]: nscd.service: Deactivated successfully. lb # [ 11.374758] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.375956] systemd-logind[525]: New seat seat0. client # [ 11.383610] systemd[1]: Starting Post-Boot Actions... client # [ 11.393495] systemd[1]: Started Reset console on configuration changes. lb # [ 11.397165] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.405418] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.411441] systemd[1]: Started User Login Management. client # [ 11.426514] (udev-worker)[372]: Network interface NamePolicy= disabled on kernel command line. lb # [ 11.419661] systemd[1]: Starting linger-users.service... client # [ 11.444241] systemd[1]: Starting resolvconf update... client # connecting to host... worker1 # [ 11.508194] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 11.486009] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 11.473160] dbus-broker-launch[516]: Ready client # [ 11.488457] (udev-worker)[324]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 11.503396] (udev-worker)[324]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.526825] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client: Guest shell says: b'Spawning backdoor root shell...\n' worker1 # [ 11.572107] systemd[1]: Finished register-nix-paths.service. worker1 # [ 11.576308] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 11.578957] systemd[1]: Reached target System Initialization. worker1 # [ 11.581924] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 11.585796] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 11.587949] systemd[1]: Reached target Timer Units. worker2 # [ 11.551985] systemd[1]: Finished register-nix-paths.service. worker1 # [ 11.595315] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.550053] systemd[1]: Finished Post-Boot Actions. lb # [ 11.546558] nsncd[579]: Sep 20 21:08:35.107 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client: connected to guest root shell worker1 # [ 11.601315] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.555085] systemd[1]: Reached target System Initialization. lb # [ 11.558931] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.557998] nsncd[396]: Sep 20 21:08:35.139 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client: (connecting took 11.98 seconds) worker1 # [ 11.605063] systemd[1]: Listening on Nix worker-protocol over gRPC. lb # [ 11.564433] systemd[1]: linger-users.service: Deactivated successfully. client: (finished: waiting for the VM to finish booting, in 11.98 seconds) worker1 # [ 11.618259] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 11.569040] systemd[1]: Finished linger-users.service. worker2 # [ 11.557320] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.566953] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.627137] systemd[1]: Reached target Socket Units. lb # [ 11.574932] systemd[1]: Finished resolvconf update. worker1 # [ 11.629012] systemd[1]: Reached target Basic System. lb # [ 11.575669] systemd[1]: Reached target Preparation for Network. worker1 # [ 11.638464] systemd[1]: Started backdoor.service. lb # [ 11.578693] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.559155] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 11.581679] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.562094] systemd[1]: Reached target Timer Units. lb # [ 11.586901] systemd[1]: Starting DHCP Client... worker2 # [ 11.566054] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 11.570732] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.575152] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 11.586975] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.646295] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 11.595457] systemd[1]: Reached target Socket Units. worker2 # [ 11.597375] systemd[1]: Reached target Basic System. worker2 # [ 11.604941] systemd[1]: Started backdoor.service. client # [ 11.595494] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.616304] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.597201] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.655687] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.603633] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.666002] systemd[1]: Starting Post-Boot Actions... client # [ 11.617933] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 11.633272] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.638586] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.641838] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.675900] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.689792] systemd[1]: Starting resolvconf update... worker2 # [ 11.654170] systemd[1]: Starting resolvconf update... worker1 # [ 11.697325] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 11.665679] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.661674] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 11.658166] systemd[1]: Starting User Login Management... client # [ 11.663807] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 11.762620] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.737264] systemd[1]: Finished Post-Boot Actions. worker1 # [ 11.809319] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # connecting to host... worker2 # connecting to host... worker1 # [ 11.815012] nsncd[497]: Sep 20 21:08:35.382 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.782425] nsncd[495]: Sep 20 21:08:35.368 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.831230] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.834465] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.801741] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.802666] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.803531] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.844433] systemd[1]: Starting User Login Management... worker1 # [ 11.849347] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 11.815241] systemd[1]: Starting User Login Management... worker2 # [ 11.832490] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 11.928226] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 11.893276] dbus-broker-launch[499]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.885900] dbus-broker-launch[429]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 11.912919] dbus-broker-launch[499]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.951053] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.956546] dbus-broker-launch[501]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.914435] dbus-broker-launch[429]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.918649] dbus-broker-launch[499]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.909136] dhcpcd[612]: dhcpcd-10.3.2 starting lb # [ 11.924159] dhcpcd[653]: dev: loaded udev client # [ 11.920600] dbus-broker-launch[429]: Invalid user-name in /nix/store/i87y3v12qnxz4jgnndbs0w0ih92vmmjw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.934343] dhcpcd[653]: no valid interfaces found client # [ 11.939329] systemd-logind[432]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 11.935272] dhcpcd[653]: no valid interfaces found client # [ 11.944757] systemd-logind[432]: New seat seat0. worker1 # [ 11.999504] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 11.964148] systemd[1]: Started D-Bus System Message Bus. client # [ 11.947339] systemd[1]: Started User Login Management. client # [ 11.953659] systemd[1]: Starting linger-users.service... client # [ 11.969985] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 12.020499] systemd-logind[520]: New seat seat0. client # [ 11.977358] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 11.982083] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 12.032104] systemd[1]: Started User Login Management. client # [ 11.986214] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 12.035332] systemd[1]: Starting linger-users.service... worker2 # [ 12.000495] systemd-logind[519]: New seat seat0. lb # [ 11.985768] systemd[1]: Finished Extra networking commands.. client # [ 11.994398] systemd[1]: Stopping User and Group Name Lookups... lb # [ 11.988273] systemd[1]: Reached target Network. worker2 # [ 12.009834] systemd[1]: Started User Login Management. client # [ 12.002329] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 12.003268] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 12.016677] systemd[1]: Starting linger-users.service... lb # [ 11.998611] systemd[1]: Starting PostgreSQL Server... worker1 # [ 12.059895] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 12.013491] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 12.066576] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 12.033796] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 12.012841] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.034809] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 12.035645] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 12.077158] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 12.078100] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 12.078905] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 12.079764] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 12.046792] systemd[1]: Stopping User and Group Name Lookups... client # [ 12.036629] dbus-broker-launch[429]: Ready worker2 # [ 12.055962] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 12.093727] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 12.044518] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 12.060507] dbus-broker-launch[499]: Ready worker2 # [ 12.061204] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 12.097874] dbus-broker-launch[501]: Ready worker2 # [ 12.062012] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 12.062841] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 12.104353] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 12.072760] systemd[1]: linger-users.service: Deactivated successfully. client # [ 12.079463] systemd[1]: Finished linger-users.service. client # [ 12.083973] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 12.093711] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.152316] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 12.158075] systemd[1]: Finished linger-users.service. lb # [ 12.108627] systemd[1]: Started Getty on tty1. lb # [ 12.115724] systemd[1]: Reached target Login Prompts. worker2 # [ 12.138680] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 12.142116] systemd[1]: Finished linger-users.service. worker1 # [ 12.181673] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 12.182636] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 12.183528] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 12.148953] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 12.150290] nsncd[566]: Sep 20 21:08:35.734 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 12.157732] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 12.191037] nsncd[568]: Sep 20 21:08:35.760 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 12.160332] systemd[1]: Reached target User and Group Name Lookups. client # [ 12.148638] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 12.153318] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 12.202029] (udev-worker)[468]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 12.156886] nsncd[495]: Sep 20 21:08:35.730 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 12.158851] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 12.210690] (udev-worker)[468]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.186638] (udev-worker)[363]: Network interface NamePolicy= disabled on kernel command line. client # [ 12.171454] systemd[1]: Finished resolvconf update. worker2 # [ 12.191699] (udev-worker)[366]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 12.231189] systemd[1]: Finished resolvconf update. client # [ 12.181806] systemd[1]: Starting DHCP Client... worker1 # [ 12.233424] systemd[1]: Reached target Preparation for Network. worker2 # [ 12.199102] (udev-worker)[366]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.236567] systemd[1]: Starting DHCP Client... worker1 # [ 12.241348] systemd[1]: Starting Extra networking commands.... worker2 # [ 12.207421] systemd[1]: Finished resolvconf update. worker2 # [ 12.208484] systemd[1]: Reached target Preparation for Network. worker2 # [ 12.212540] systemd[1]: Starting DHCP Client... worker2 # [ 12.221141] systemd[1]: Starting Extra networking commands.... worker1 # [ 12.259606] (udev-worker)[372]: Network interface NamePolicy= disabled on kernel command line. client # [ 12.258510] mousedev: PS/2 mouse device common for all mice worker1 # [ 12.412893] systemd-logind[520]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 12.377147] postgresql-pre-start[679]: The files belonging to this database system will be owned by user "postgres". client # [ 12.386525] dhcpcd[530]: dhcpcd-10.3.2 starting lb # [ 12.380939] postgresql-pre-start[679]: This user must also own the server process. lb # [ 12.392100] postgresql-pre-start[679]: The database cluster will be initialized with locale "en_US.UTF-8". client # [ 12.402429] systemd-logind[432]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 12.396438] postgresql-pre-start[679]: The default database encoding has accordingly been set to "UTF8". client # [ 12.407077] dhcpcd[540]: dev: loaded udev lb # [ 12.400646] postgresql-pre-start[679]: The default text search configuration will be set to "english". lb # [ 12.402840] postgresql-pre-start[679]: Data page checksums are enabled. lb # [ 12.406370] postgresql-pre-start[679]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.412162] postgresql-pre-start[679]: creating subdirectories ... ok lb # [ 12.416420] postgresql-pre-start[679]: selecting dynamic shared memory implementation ... posix worker1 # [ 12.486126] dhcpcd[604]: dhcpcd-10.3.2 starting worker2 # [ 12.451078] dhcpcd[602]: dhcpcd-10.3.2 starting worker2 # [ 12.459625] systemd-logind[519]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 12.500315] dhcpcd[644]: dev: loaded udev client # [ 12.464588] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.471299] dhcpcd[641]: dev: loaded udev client # [ 12.465335] systemd[1]: Finished nftables firewall. client # [ 12.469226] systemd[1]: Reached target Preparation for Network. client # [ 12.474572] systemd[1]: Starting Address configuration of eth1... worker2 # [ 12.492322] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.496288] systemd[1]: Starting Address configuration of eth1... client # [ 12.483895] systemd[1]: Starting Extra networking commands.... worker1 # [ 12.550449] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 12.552414] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.535999] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 12.559789] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.580772] systemd[1]: Finished Extra networking commands.. worker1 # [ 12.590114] systemd[1]: Reached target Network. worker1 # [ 12.590821] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.562912] systemd[1]: Finished Extra networking commands.. worker2 # [ 12.563853] systemd[1]: Reached target Network. worker2 # [ 12.572240] systemd[1]: Starting Permit User Sessions... client # [ 12.595758] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.650084] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 12.625473] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.629775] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 12.608369] postgresql-pre-start[679]: selecting default "max_connections" ... 100 worker1 # [ 12.686905] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.689686] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 12.644737] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.694147] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.645216] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.694474] cfg80211: failed to load regulatory.db worker2 # [ 12.651414] systemd[1]: Finished Permit User Sessions. client # [ 12.651626] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.651954] cfg80211: failed to load regulatory.db worker2 # [ 12.669739] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.670253] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.698699] systemd[1]: Finished Permit User Sessions. worker2 # [ 12.675956] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.676283] cfg80211: failed to load regulatory.db worker1 # [ 12.702142] systemd[1]: Started Getty on tty1. client # [ 12.653129] network-addresses-eth1-start[546]: adding address 192.168.1.1/24... done worker1 # [ 12.705503] systemd[1]: Reached target Login Prompts. worker2 # [ 12.671939] systemd[1]: Started Getty on tty1. worker2 # [ 12.676371] systemd[1]: Reached target Login Prompts. worker2 # [ 12.697956] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 12.678806] network-addresses-eth1-start[546]: adding address 2001:db8:1::1/64... done worker1 # [ 12.759985] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 12.712562] network-addresses-eth1-start[649]: adding address 192.168.1.4/24... done lb # [ 12.693965] systemd[1]: Starting Virtual Console Setup... client # [ 12.708575] systemd[1]: Finished Address configuration of eth1. worker2 # [ 12.730526] network-addresses-eth1-start[649]: adding address 2001:db8:1::4/64... done worker1 # [ 12.772828] network-addresses-eth1-start[657]: adding address 192.168.1.3/24... done client # [ 12.738920] dhcpcd[589]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (550) - Operation not permitted worker1 # [ 12.805716] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 12.754506] systemd[1]: Finished Address configuration of eth1. worker1 # [ 12.792634] dhcpcd[644]: eth0: waiting for carrier client # [ 12.745832] dhcpcd[589]: .resolvconf-wrapped: clearing stale lock pid 550 worker1 # [ 12.796885] dhcpcd[644]: eth0: waiting for carrier worker1 # [ 12.798020] network-addresses-eth1-start[657]: adding address 2001:db8:1::3/64... done worker1 # [ 12.801105] dhcpcd[644]: eth0: carrier acquired worker2 # [ 12.792796] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 12.781939] dhcpcd[641]: eth0: waiting for carrier worker2 # [ 12.782711] dhcpcd[641]: eth0: waiting for carrier worker2 # [ 12.783375] dhcpcd[641]: eth0: carrier acquired worker1 # [ 12.820567] dhcpcd[644]: DUID 00:01:00:01:32:43:07:d4:52:54:00:12:34:56 worker1 # [ 12.821548] dhcpcd[644]: eth0: IAID 00:12:34:56 worker1 # [ 12.822180] dhcpcd[644]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 12.768889] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 12.828091] systemd[1]: Finished Address configuration of eth1. worker2 # [ 12.804228] dhcpcd[641]: DUID 00:01:00:01:32:43:07:d4:52:54:00:12:34:56 client # [ 12.805622] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 12.805244] dhcpcd[641]: eth0: IAID 00:12:34:56 worker2 # [ 12.805873] dhcpcd[641]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 12.793345] dhcpcd[540]: eth0: waiting for carrier client # [ 12.797097] dhcpcd[540]: libudev: received NULL device client # [ 12.798486] dhcpcd[540]: libudev: received NULL device client # [ 12.800935] dhcpcd[540]: eth0: carrier acquired client # [ 12.815138] dhcpcd[540]: DUID 00:01:00:01:32:43:07:d4:52:54:00:12:34:56 client # [ 12.817383] dhcpcd[540]: eth0: IAID 00:12:34:56 client # [ 12.818050] dhcpcd[540]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 12.884901] mousedev: PS/2 mouse device common for all mice client # [ 12.823887] systemd[1]: Finished Extra networking commands.. client # [ 12.827635] systemd[1]: Reached target Network. client # [ 12.831594] systemd[1]: Starting Permit User Sessions... lb # [ 12.837283] postgresql-pre-start[679]: selecting default "shared_buffers" ... 128MB worker2 # [ 12.883275] mousedev: PS/2 mouse device common for all mice client # [ 12.882738] systemd[1]: Finished Permit User Sessions. worker2 # [ 12.895683] systemd-logind[519]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 12.889911] systemd[1]: Started Getty on tty1. client # [ 12.892556] systemd[1]: Reached target Login Prompts. worker1 # [ 12.942457] systemd-logind[520]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client: (finished: waiting for unit network-addresses-eth1.service, in 13.39 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb # [ 13.146842] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 13.214847] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 13.223311] systemd[1]: Started backdoor.service. lb # [ 13.304943] 8021q: 802.1Q VLAN Support v1.8 lb # connecting to host... lb # [ 13.368414] systemd-vconsole-setup[704]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 13.379973] systemd[1]: Finished Virtual Console Setup. lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.35 seconds) lb: (finished: waiting for the VM to finish booting, in 0.35 seconds) lb # [ 13.431568] (udev-worker)[686]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 13.437729] (udev-worker)[687]: Network interface NamePolicy= disabled on kernel command line. lb # [ 13.442067] (udev-worker)[686]: Network interface NamePolicy= disabled on kernel command line. lb # [ 13.465334] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 13.505249] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.515952] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 13.516467] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 13.522746] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 13.523112] cfg80211: failed to load regulatory.db worker2 # [ 13.577661] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker1 # [ 13.625839] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.679552] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 13.688631] systemd[1]: Starting Address configuration of eth1... client # [ 13.739516] dhcpcd[540]: eth0: soliciting a DHCP lease client # [ 13.748563] dhcpcd[540]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 13.756221] dhcpcd[540]: eth0: probing address 10.0.2.15/24 client # [ 13.802822] systemd[1]: Starting Virtual Console Setup... lb # [ 13.809360] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 13.821888] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 13.811017] dhcpcd[653]: eth0: waiting for carrier lb # [ 13.814077] dhcpcd[653]: eth0: carrier acquired client # [ 13.828092] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 13.829177] systemd[1]: Stopped Virtual Console Setup. lb # [ 13.827394] network-addresses-eth1-start[735]: adding address 192.168.1.2/24... done lb # [ 13.833203] dhcpcd[653]: DUID 00:01:00:01:32:43:07:d5:52:54:00:12:34:56 lb # [ 13.835832] dhcpcd[653]: eth0: IAID 00:12:34:56 lb # [ 13.838326] dhcpcd[653]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 13.846446] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 13.851065] systemd[1]: Starting Virtual Console Setup... lb # [ 13.847532] network-addresses-eth1-start[735]: adding address 2001:db8:1::2/64... done worker2 # [ 13.873371] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 13.888768] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.926772] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 13.869728] systemd[1]: Finished Address configuration of eth1. worker1 # [ 13.946360] systemd[1]: Starting Virtual Console Setup... client # [ 13.898485] systemd-logind[432]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 13.971676] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.976470] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 13.977232] systemd[1]: Starting Virtual Console Setup... lb # [ 13.923055] systemd-logind[525]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 13.959189] systemd-logind[519]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 14.018118] systemd-logind[520]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 14.017696] mousedev: PS/2 mouse device common for all mice client # [ 14.087701] dhcpcd[540]: eth0: soliciting an IPv6 router client # [ 14.089235] dhcpcd[540]: eth0: Router Advertisement from fe80::2 client # [ 14.090208] dhcpcd[540]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 14.091219] dhcpcd[540]: eth0: adding route to fec0::/64 client # [ 14.092099] dhcpcd[540]: eth0: adding default route via fe80::2 lb # [ 14.177095] systemd-logind[525]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 14.200831] dhcpcd[641]: eth0: soliciting an IPv6 router worker2 # [ 14.202273] dhcpcd[641]: eth0: Router Advertisement from fe80::2 worker2 # [ 14.203728] dhcpcd[641]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 14.205119] dhcpcd[641]: eth0: adding route to fec0::/64 worker2 # [ 14.206028] dhcpcd[641]: eth0: adding default route via fe80::2 worker1 # [ 14.271842] dhcpcd[644]: eth0: soliciting a DHCP lease worker1 # [ 14.276531] dhcpcd[644]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 14.284219] dhcpcd[644]: eth0: probing address 10.0.2.15/24 client # [ 14.277474] systemd-vconsole-setup[648]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 14.281518] systemd[1]: Finished Virtual Console Setup. worker2 # [ 14.332891] systemd-vconsole-setup[698]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.337779] systemd[1]: Finished Virtual Console Setup. worker1 # [ 14.395345] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.399408] systemd[1]: Finished Virtual Console Setup. worker1 # [ 14.605368] dhcpcd[644]: eth0: soliciting an IPv6 router worker1 # [ 14.608938] dhcpcd[644]: eth0: Router Advertisement from fe80::2 worker1 # [ 14.611472] dhcpcd[644]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 14.614401] dhcpcd[644]: eth0: adding route to fec0::/64 worker1 # [ 14.616813] dhcpcd[644]: eth0: adding default route via fe80::2 worker2 # [ 14.693782] dhcpcd[641]: eth0: soliciting a DHCP lease lb: (finished: waiting for unit network-addresses-eth1.service, in 1.63 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker2 # [ 14.700979] dhcpcd[641]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 14.704460] dhcpcd[641]: eth0: probing address 10.0.2.15/24 lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.06 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds) lb: waiting for unit niks3.service lb # [ 15.324950] dhcpcd[653]: eth0: soliciting a DHCP lease lb # [ 15.332517] dhcpcd[653]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 15.340237] dhcpcd[653]: eth0: probing address 10.0.2.15/24 lb # [ 15.871184] postgresql-pre-start[679]: selecting default time zone ... UTC lb # [ 15.876237] postgresql-pre-start[679]: creating configuration files ... ok lb # [ 15.888501] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.893140] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.893970] systemd[1]: Stopping Virtual Console Setup... lb # [ 15.900205] systemd[1]: Starting Virtual Console Setup... lb # [ 15.939613] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 15.949028] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.955169] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.968883] dhcpcd[653]: eth0: soliciting an IPv6 router lb # [ 15.969708] systemd[1]: Starting Virtual Console Setup... lb # [ 15.970442] dhcpcd[653]: eth0: Router Advertisement from fe80::2 lb # [ 15.971274] dhcpcd[653]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 15.979962] dhcpcd[653]: eth0: adding route to fec0::/64 lb # [ 15.981055] dhcpcd[653]: eth0: adding default route via fe80::2 lb # [ 16.002795] systemd-logind[525]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 16.364399] postgresql-pre-start[679]: running bootstrap script ... ok lb # [ 16.412460] systemd-vconsole-setup[790]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 16.417424] systemd[1]: Finished Virtual Console Setup. lb # [ 16.987398] postgresql-pre-start[679]: performing post-bootstrap initialization ... ok lb # [ 17.132474] postgresql-pre-start[679]: syncing data to disk ... ok lb # [ 17.136552] postgresql-pre-start[679]: initdb: warning: enabling "trust" authentication for local connections lb # [ 17.138644] postgresql-pre-start[679]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 17.141963] postgresql-pre-start[679]: Success. You can now start the database server using: lb # [ 17.143806] postgresql-pre-start[679]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 17.279806] postgres[808]: [808] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.284352] postgres[808]: [808] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.285520] postgres[808]: [808] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.287483] postgres[808]: [808] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.300447] postgres[817]: [817] LOG: database system was shut down at 2026-09-20 21:08:40 GMT lb # [ 17.306480] postgres[808]: [808] LOG: database system is ready to accept connections lb # [ 17.312694] systemd[1]: Started PostgreSQL Server. lb # [ 17.322416] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 17.571942] postgresql-setup-start[837]: CREATE DATABASE lb # [ 17.621708] postgresql-setup-start[842]: CREATE ROLE lb # [ 17.645154] postgresql-setup-start[844]: ALTER DATABASE lb # [ 17.652128] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 17.653937] systemd[1]: Reached target PostgreSQL. client # [ 18.629015] dhcpcd[540]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 18.632708] dhcpcd[540]: eth0: adding route to 10.0.2.0/24 client # [ 18.635092] dhcpcd[540]: eth0: adding default route via 10.0.2.2 client # [ 18.805552] systemd[1]: Started DHCP Client. client # [ 18.807981] systemd[1]: Reached target Multi-User System. client # [ 18.809750] systemd[1]: Startup finished in 986ms (kernel) + 5.464s (initrd) + 12.358s (userspace) = 18.809s. worker2 # [ 19.535193] dhcpcd[641]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 19.539371] dhcpcd[641]: eth0: adding route to 10.0.2.0/24 worker2 # [ 19.542435] dhcpcd[641]: eth0: adding default route via 10.0.2.2 worker2 # [ 19.703375] systemd[1]: Started DHCP Client. worker2 # [ 19.705716] systemd[1]: Reached target Multi-User System. worker2 # [ 19.706561] systemd[1]: Startup finished in 981ms (kernel) + 5.445s (initrd) + 13.277s (userspace) = 19.705s. worker1 # [ 19.794859] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 19.798457] dhcpcd[644]: eth0: adding route to 10.0.2.0/24 worker1 # [ 19.801635] dhcpcd[644]: eth0: adding default route via 10.0.2.2 worker1 # [ 19.958604] systemd[1]: Started DHCP Client. worker1 # [ 19.960557] systemd[1]: Reached target Multi-User System. worker1 # [ 19.962162] systemd[1]: Startup finished in 993ms (kernel) + 5.511s (initrd) + 13.456s (userspace) = 19.961s. lb # [ 20.213596] dhcpcd[653]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 20.219770] dhcpcd[653]: eth0: adding route to 10.0.2.0/24 lb # [ 20.223509] dhcpcd[653]: eth0: adding default route via 10.0.2.2 lb # [ 20.416402] systemd[1]: Started DHCP Client. lb # [ 20.418214] systemd[1]: Reached target Network is Online. lb # [ 20.423085] systemd[1]: Started Envoy reverse proxy. lb # [ 20.429149] systemd[1]: Started mock-oidc.service. lb # [ 20.524364] mock-oidc-server[927]: Mock OIDC Server running lb # [ 20.525695] mock-oidc-server[927]: OIDC Address: 192.168.1.2:8080 lb # [ 20.526687] mock-oidc-server[927]: Issue Address: 0.0.0.0:8081 lb # [ 20.527971] mock-oidc-server[927]: Issuer: http://192.168.1.2:8080/oidc lb # [ 20.529148] mock-oidc-server[927]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 20.530348] mock-oidc-server[927]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 20.531851] mock-oidc-server[927]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 21.192501] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 21.192665] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 21.192704] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 21.192737] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 21.192770] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 21.192802] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 21.192845] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 21.192877] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 21.192910] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 21.192942] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 21.192999] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 21.193035] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 21.193067] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 21.193100] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 21.193142] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 21.193175] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 21.193207] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 21.193239] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 21.193272] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 21.238040] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 21.238118] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 21.238154] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 21.238187] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 21.238220] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 21.238254] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 21.251326] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 21.279250] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 21.285286] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 21.287916] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 21.289880] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 21.292779] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 21.294977] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 21.297243] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 21.299662] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 21.306543] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 21.309537] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 21.311479] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 21.317968] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 21.320905] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 21.322602] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 21.324842] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 21.327327] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 21.329459] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 21.331764] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 21.339081] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 21.341078] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 21.343225] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 21.345288] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 21.347583] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 21.349875] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 21.353855] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 21.355730] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 21.357534] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 21.362891] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 21.365768] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 21.369750] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 21.371344] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 21.376955] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 21.380750] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 21.382648] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 21.386092] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 21.391243] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 21.394040] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 21.396339] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 21.398156] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 21.401277] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 21.403982] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 21.406278] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 21.408314] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 21.410653] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 21.412955] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 21.421425] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 21.423868] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 21.427352] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 21.429324] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 21.431268] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 21.434959] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 21.436861] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 21.445477] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 21.447407] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 21.450466] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 21.452748] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 21.454922] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 21.468790] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 21.471416] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 21.473593] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 21.475490] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 21.478012] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 21.479944] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 21.482190] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 21.486037] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 21.487891] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 21.495433] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 21.507169] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 21.510892] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 21.513776] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 21.544727] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 21.551854] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 21.554403] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 21.557018] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 21.559098] envoy[926]: [2026-09-20 21:08:44.756][926][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 21.563287] envoy[926]: [2026-09-20 21:08:44.757][926][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 21.566931] envoy[926]: [2026-09-20 21:08:44.757][926][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 21.571941] envoy[926]: [2026-09-20 21:08:44.757][926][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 21.574681] envoy[926]: [2026-09-20 21:08:44.757][926][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 21.579660] envoy[926]: [2026-09-20 21:08:44.802][926][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 21.585629] envoy[926]: [2026-09-20 21:08:44.812][926][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 21.587103] envoy[926]: [2026-09-20 21:08:44.814][926][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 21.602342] envoy[926]: [2026-09-20 21:08:44.814][926][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 21.604501] envoy[926]: [2026-09-20 21:08:44.814][926][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 21.613587] envoy[926]: [2026-09-20 21:08:44.814][926][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 21.615596] envoy[926]: [2026-09-20 21:08:45.042][926][info][main] [source/server/server.cc:968] runtime: {} lb # [ 21.617253] envoy[926]: [2026-09-20 21:08:45.075][926][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 21.619055] envoy[926]: [2026-09-20 21:08:45.075][926][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 21.620881] envoy[926]: [2026-09-20 21:08:45.075][926][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 21.622545] envoy[926]: [2026-09-20 21:08:45.109][926][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 21.624488] envoy[926]: [2026-09-20 21:08:45.109][926][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 21.626088] envoy[926]: [2026-09-20 21:08:45.109][926][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 21.653038] envoy[926]: [2026-09-20 21:08:45.217][926][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) worker2 # [ 21.678766] systemd[1]: Reached target Network is Online. lb # [ 21.662850] envoy[926]: [2026-09-20 21:08:45.227][926][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 21.665697] envoy[926]: [2026-09-20 21:08:45.230][926][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. worker1 # [ 21.724223] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 21.669140] envoy[926]: [2026-09-20 21:08:45.230][926][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 21.689909] systemd[1]: Starting scheduler-token.service... worker2 # [ 21.814543] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 21.818722] systemd[1]: Finished scheduler-token.service. worker2 # [ 21.825312] systemd[1]: scheduler-token.service: Consumed 53ms CPU time over 128ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 21.832631] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 21.964923] nix-grpc-daemon[774]: ts=2026-09-20T21:08:45Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 21.977196] nix-grpc-daemon[774]: ts=2026-09-20T21:08:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 21.979466] nix-grpc-daemon[774]: ts=2026-09-20T21:08:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 22.028357] nix-grpc-daemon[774]: ts=2026-09-20T21:08:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 22.032792] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 22.011093] envoy[926]: [2026-09-20 21:08:45.575][926][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 22.017968] envoy[926]: [2026-09-20 21:08:45.575][926][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 22.023520] envoy[926]: [2026-09-20 21:08:45.575][926][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker2 # [ 22.053029] nix-grpc-daemon[775]: ts=2026-09-20T21:08:45Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb # [ 22.034178] envoy[926]: [2026-09-20 21:08:45.575][926][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 22.064974] nix-grpc-daemon[775]: ts=2026-09-20T21:08:45Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 22.101533] nix-grpc-daemon[774]: ts=2026-09-20T21:08:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.067354] nix-grpc-daemon[775]: ts=2026-09-20T21:08:45Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 22.105893] nix-grpc-daemon[774]: ts=2026-09-20T21:08:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.116087] nix-grpc-daemon[775]: ts=2026-09-20T21:08:45Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 22.121762] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 22.180404] nix-grpc-daemon[775]: ts=2026-09-20T21:08:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.182280] nix-grpc-daemon[775]: ts=2026-09-20T21:08:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.307288] nix-grpc-daemon[774]: ts=2026-09-20T21:08:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.312754] nix-grpc-daemon[774]: ts=2026-09-20T21:08:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.383853] nix-grpc-daemon[775]: ts=2026-09-20T21:08:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.389048] nix-grpc-daemon[775]: ts=2026-09-20T21:08:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.513602] nix-grpc-daemon[774]: ts=2026-09-20T21:08:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.520747] nix-grpc-daemon[774]: ts=2026-09-20T21:08:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.589800] nix-grpc-daemon[775]: ts=2026-09-20T21:08:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.593181] nix-grpc-daemon[775]: ts=2026-09-20T21:08:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.719870] nix-grpc-daemon[774]: ts=2026-09-20T21:08:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.725112] nix-grpc-daemon[774]: ts=2026-09-20T21:08:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.794501] nix-grpc-daemon[775]: ts=2026-09-20T21:08:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.799661] nix-grpc-daemon[775]: ts=2026-09-20T21:08:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.925804] nix-grpc-daemon[774]: ts=2026-09-20T21:08:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.930774] nix-grpc-daemon[774]: ts=2026-09-20T21:08:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.000881] nix-grpc-daemon[775]: ts=2026-09-20T21:08:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.005933] nix-grpc-daemon[775]: ts=2026-09-20T21:08:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.133455] nix-grpc-daemon[774]: ts=2026-09-20T21:08:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.137558] nix-grpc-daemon[774]: ts=2026-09-20T21:08:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.208780] nix-grpc-daemon[775]: ts=2026-09-20T21:08:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.212883] nix-grpc-daemon[775]: ts=2026-09-20T21:08:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.333741] nix-grpc-daemon[774]: ts=2026-09-20T21:08:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.338767] nix-grpc-daemon[774]: ts=2026-09-20T21:08:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.409531] nix-grpc-daemon[775]: ts=2026-09-20T21:08:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.414604] nix-grpc-daemon[775]: ts=2026-09-20T21:08:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.539666] nix-grpc-daemon[774]: ts=2026-09-20T21:08:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.544906] nix-grpc-daemon[774]: ts=2026-09-20T21:08:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.615820] nix-grpc-daemon[775]: ts=2026-09-20T21:08:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.621115] nix-grpc-daemon[775]: ts=2026-09-20T21:08:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.745696] nix-grpc-daemon[774]: ts=2026-09-20T21:08:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.750691] nix-grpc-daemon[774]: ts=2026-09-20T21:08:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.822194] nix-grpc-daemon[775]: ts=2026-09-20T21:08:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.827269] nix-grpc-daemon[775]: ts=2026-09-20T21:08:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.951987] nix-grpc-daemon[774]: ts=2026-09-20T21:08:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.957281] nix-grpc-daemon[774]: ts=2026-09-20T21:08:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.028919] nix-grpc-daemon[775]: ts=2026-09-20T21:08:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.034709] nix-grpc-daemon[775]: ts=2026-09-20T21:08:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.159844] nix-grpc-daemon[774]: ts=2026-09-20T21:08:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.164174] nix-grpc-daemon[774]: ts=2026-09-20T21:08:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.237624] nix-grpc-daemon[775]: ts=2026-09-20T21:08:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.241809] nix-grpc-daemon[775]: ts=2026-09-20T21:08:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.360786] nix-grpc-daemon[774]: ts=2026-09-20T21:08:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.366027] nix-grpc-daemon[774]: ts=2026-09-20T21:08:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.438724] nix-grpc-daemon[775]: ts=2026-09-20T21:08:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.444137] nix-grpc-daemon[775]: ts=2026-09-20T21:08:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.566983] nix-grpc-daemon[774]: ts=2026-09-20T21:08:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.572309] nix-grpc-daemon[774]: ts=2026-09-20T21:08:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.645213] nix-grpc-daemon[775]: ts=2026-09-20T21:08:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.650304] nix-grpc-daemon[775]: ts=2026-09-20T21:08:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.773258] nix-grpc-daemon[774]: ts=2026-09-20T21:08:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.778516] nix-grpc-daemon[774]: ts=2026-09-20T21:08:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.851633] nix-grpc-daemon[775]: ts=2026-09-20T21:08:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.856984] nix-grpc-daemon[775]: ts=2026-09-20T21:08:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.979396] nix-grpc-daemon[774]: ts=2026-09-20T21:08:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.984798] nix-grpc-daemon[774]: ts=2026-09-20T21:08:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.058433] nix-grpc-daemon[775]: ts=2026-09-20T21:08:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.063559] nix-grpc-daemon[775]: ts=2026-09-20T21:08:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.187205] nix-grpc-daemon[774]: ts=2026-09-20T21:08:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.192703] nix-grpc-daemon[774]: ts=2026-09-20T21:08:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.266527] nix-grpc-daemon[775]: ts=2026-09-20T21:08:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.270814] nix-grpc-daemon[775]: ts=2026-09-20T21:08:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.393704] nix-grpc-daemon[774]: ts=2026-09-20T21:08:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.399307] nix-grpc-daemon[774]: ts=2026-09-20T21:08:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.467639] nix-grpc-daemon[775]: ts=2026-09-20T21:08:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.473023] nix-grpc-daemon[775]: ts=2026-09-20T21:08:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.600497] nix-grpc-daemon[774]: ts=2026-09-20T21:08:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.605914] nix-grpc-daemon[774]: ts=2026-09-20T21:08:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.674596] nix-grpc-daemon[775]: ts=2026-09-20T21:08:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.680424] nix-grpc-daemon[775]: ts=2026-09-20T21:08:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.806841] nix-grpc-daemon[774]: ts=2026-09-20T21:08:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.812301] nix-grpc-daemon[774]: ts=2026-09-20T21:08:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.881288] nix-grpc-daemon[775]: ts=2026-09-20T21:08:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.891644] nix-grpc-daemon[775]: ts=2026-09-20T21:08:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.013312] nix-grpc-daemon[774]: ts=2026-09-20T21:08:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.018638] nix-grpc-daemon[774]: ts=2026-09-20T21:08:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.089591] nix-grpc-daemon[775]: ts=2026-09-20T21:08:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.094835] nix-grpc-daemon[775]: ts=2026-09-20T21:08:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.221431] nix-grpc-daemon[774]: ts=2026-09-20T21:08:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.225647] nix-grpc-daemon[774]: ts=2026-09-20T21:08:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.298149] nix-grpc-daemon[775]: ts=2026-09-20T21:08:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.302392] nix-grpc-daemon[775]: ts=2026-09-20T21:08:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.422016] nix-grpc-daemon[774]: ts=2026-09-20T21:08:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.427343] nix-grpc-daemon[774]: ts=2026-09-20T21:08:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.498826] nix-grpc-daemon[775]: ts=2026-09-20T21:08:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.504273] nix-grpc-daemon[775]: ts=2026-09-20T21:08:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.628169] nix-grpc-daemon[774]: ts=2026-09-20T21:08:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.633245] nix-grpc-daemon[774]: ts=2026-09-20T21:08:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.705295] nix-grpc-daemon[775]: ts=2026-09-20T21:08:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.710365] nix-grpc-daemon[775]: ts=2026-09-20T21:08:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.834187] nix-grpc-daemon[774]: ts=2026-09-20T21:08:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.839249] nix-grpc-daemon[774]: ts=2026-09-20T21:08:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.911629] nix-grpc-daemon[775]: ts=2026-09-20T21:08:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.916774] nix-grpc-daemon[775]: ts=2026-09-20T21:08:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.040106] nix-grpc-daemon[774]: ts=2026-09-20T21:08:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.045107] nix-grpc-daemon[774]: ts=2026-09-20T21:08:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.117887] nix-grpc-daemon[775]: ts=2026-09-20T21:08:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.123432] nix-grpc-daemon[775]: ts=2026-09-20T21:08:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.247778] nix-grpc-daemon[774]: ts=2026-09-20T21:08:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.252174] nix-grpc-daemon[774]: ts=2026-09-20T21:08:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.326207] nix-grpc-daemon[775]: ts=2026-09-20T21:08:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.330310] nix-grpc-daemon[775]: ts=2026-09-20T21:08:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.448880] nix-grpc-daemon[774]: ts=2026-09-20T21:08:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.454070] nix-grpc-daemon[774]: ts=2026-09-20T21:08:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.527066] nix-grpc-daemon[775]: ts=2026-09-20T21:08:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.532136] nix-grpc-daemon[775]: ts=2026-09-20T21:08:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.654924] nix-grpc-daemon[774]: ts=2026-09-20T21:08:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.659713] nix-grpc-daemon[774]: ts=2026-09-20T21:08:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.733662] nix-grpc-daemon[775]: ts=2026-09-20T21:08:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.739018] nix-grpc-daemon[775]: ts=2026-09-20T21:08:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.861072] nix-grpc-daemon[774]: ts=2026-09-20T21:08:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.866544] nix-grpc-daemon[774]: ts=2026-09-20T21:08:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.940913] nix-grpc-daemon[775]: ts=2026-09-20T21:08:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.946406] nix-grpc-daemon[775]: ts=2026-09-20T21:08:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.072168] nix-grpc-daemon[774]: ts=2026-09-20T21:08:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.077096] nix-grpc-daemon[774]: ts=2026-09-20T21:08:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.148750] nix-grpc-daemon[775]: ts=2026-09-20T21:08:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.154692] nix-grpc-daemon[775]: ts=2026-09-20T21:08:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.281390] nix-grpc-daemon[774]: ts=2026-09-20T21:08:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.285762] nix-grpc-daemon[774]: ts=2026-09-20T21:08:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.358065] nix-grpc-daemon[775]: ts=2026-09-20T21:08:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.363104] nix-grpc-daemon[775]: ts=2026-09-20T21:08:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.482008] nix-grpc-daemon[774]: ts=2026-09-20T21:08:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.488428] nix-grpc-daemon[774]: ts=2026-09-20T21:08:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.564924] nix-grpc-daemon[775]: ts=2026-09-20T21:08:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.570558] nix-grpc-daemon[775]: ts=2026-09-20T21:08:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.689874] nix-grpc-daemon[774]: ts=2026-09-20T21:08:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.695687] nix-grpc-daemon[774]: ts=2026-09-20T21:08:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.772916] nix-grpc-daemon[775]: ts=2026-09-20T21:08:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.778747] nix-grpc-daemon[775]: ts=2026-09-20T21:08:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.896922] nix-grpc-daemon[774]: ts=2026-09-20T21:08:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.902425] nix-grpc-daemon[774]: ts=2026-09-20T21:08:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.980537] nix-grpc-daemon[775]: ts=2026-09-20T21:08:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.985666] nix-grpc-daemon[775]: ts=2026-09-20T21:08:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.103400] nix-grpc-daemon[774]: ts=2026-09-20T21:08:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.109013] nix-grpc-daemon[774]: ts=2026-09-20T21:08:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.188314] nix-grpc-daemon[775]: ts=2026-09-20T21:08:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.197011] nix-grpc-daemon[775]: ts=2026-09-20T21:08:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.312096] nix-grpc-daemon[774]: ts=2026-09-20T21:08:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.314681] nix-grpc-daemon[774]: ts=2026-09-20T21:08:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.401676] nix-grpc-daemon[775]: ts=2026-09-20T21:08:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.406027] nix-grpc-daemon[775]: ts=2026-09-20T21:08:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.513418] nix-grpc-daemon[774]: ts=2026-09-20T21:08:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.519063] nix-grpc-daemon[774]: ts=2026-09-20T21:08:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.603037] nix-grpc-daemon[775]: ts=2026-09-20T21:08:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.608771] nix-grpc-daemon[775]: ts=2026-09-20T21:08:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.720401] nix-grpc-daemon[774]: ts=2026-09-20T21:08:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.725934] nix-grpc-daemon[774]: ts=2026-09-20T21:08:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.810470] nix-grpc-daemon[775]: ts=2026-09-20T21:08:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.816443] nix-grpc-daemon[775]: ts=2026-09-20T21:08:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.927049] nix-grpc-daemon[774]: ts=2026-09-20T21:08:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.933393] nix-grpc-daemon[774]: ts=2026-09-20T21:08:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.018367] nix-grpc-daemon[775]: ts=2026-09-20T21:08:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.024965] nix-grpc-daemon[775]: ts=2026-09-20T21:08:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.134670] nix-grpc-daemon[774]: ts=2026-09-20T21:08:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.140714] nix-grpc-daemon[774]: ts=2026-09-20T21:08:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.227061] nix-grpc-daemon[775]: ts=2026-09-20T21:08:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.233419] nix-grpc-daemon[775]: ts=2026-09-20T21:08:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.344895] nix-grpc-daemon[774]: ts=2026-09-20T21:08:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.349465] nix-grpc-daemon[774]: ts=2026-09-20T21:08:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.437644] nix-grpc-daemon[775]: ts=2026-09-20T21:08:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.441956] nix-grpc-daemon[775]: ts=2026-09-20T21:08:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.545889] nix-grpc-daemon[774]: ts=2026-09-20T21:08:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.551159] nix-grpc-daemon[774]: ts=2026-09-20T21:08:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.639590] nix-grpc-daemon[775]: ts=2026-09-20T21:08:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.645798] nix-grpc-daemon[775]: ts=2026-09-20T21:08:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.752501] nix-grpc-daemon[774]: ts=2026-09-20T21:08:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.758647] nix-grpc-daemon[774]: ts=2026-09-20T21:08:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.847241] nix-grpc-daemon[775]: ts=2026-09-20T21:08:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.853177] nix-grpc-daemon[775]: ts=2026-09-20T21:08:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.960980] nix-grpc-daemon[774]: ts=2026-09-20T21:08:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.967412] nix-grpc-daemon[774]: ts=2026-09-20T21:08:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.055352] nix-grpc-daemon[775]: ts=2026-09-20T21:08:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.061328] nix-grpc-daemon[775]: ts=2026-09-20T21:08:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.168181] nix-grpc-daemon[774]: ts=2026-09-20T21:08:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.174203] nix-grpc-daemon[774]: ts=2026-09-20T21:08:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.263228] nix-grpc-daemon[775]: ts=2026-09-20T21:08:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.269861] nix-grpc-daemon[775]: ts=2026-09-20T21:08:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.314539] rustfs-bucket-start[1035]: mb s3://farm worker1 # [ 31.377859] nix-grpc-daemon[774]: ts=2026-09-20T21:08:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.384122] nix-grpc-daemon[774]: ts=2026-09-20T21:08:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.339763] systemd[1]: Finished rustfs-bucket.service. lb # [ 31.360325] systemd[1]: Starting niks3 server... worker2 # [ 31.474582] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.479046] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.585196] nix-grpc-daemon[774]: ts=2026-09-20T21:08:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.591461] nix-grpc-daemon[774]: ts=2026-09-20T21:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.675239] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.681616] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.680791] postgres[1052]: [1052] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 31.682139] postgres[1052]: [1052] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 31.723933] niks3-server[1045]: 2026/09/20 21:08:55 OK 20241026095416_initial_model.sql (25.68ms) lb # [ 31.728509] niks3-server[1045]: 2026/09/20 21:08:55 OK 20251210153512_drop_unused_gin_index.sql (4.97ms) lb # [ 31.736963] niks3-server[1045]: 2026/09/20 21:08:55 OK 20251218171726_add_pins.sql (8.39ms) worker1 # [ 31.792643] nix-grpc-daemon[774]: ts=2026-09-20T21:08:55Z level=info event=scheduler_connected addr=lb:50051 lb # [ 31.743145] niks3-server[1045]: 2026/09/20 21:08:55 OK 20260628120000_add_object_size_and_stats.sql (6.1ms) worker1 # [ 31.798691] nix-grpc-daemon[774]: ts=2026-09-20T21:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.750058] niks3-server[1045]: 2026/09/20 21:08:55 OK 20260905000000_add_claims.sql (6.86ms) lb # [ 31.755514] niks3-server[1045]: 2026/09/20 21:08:55 OK 20260920000000_drop_claims.sql (5.22ms) lb # [ 31.757722] niks3-server[1045]: 2026/09/20 21:08:55 goose: successfully migrated database to version: 20260920000000 lb # [ 31.763047] niks3-server[1045]: 2026/09/20 21:08:55 OK 1_commit_pending_closure.sql (7.53ms) lb # [ 31.766577] niks3-server[1045]: 2026/09/20 21:08:55 OK 2_object_stats_trigger.sql (3.37ms) lb # [ 31.767976] niks3-server[1045]: 2026/09/20 21:08:55 goose: up to current file version: 2 lb # [ 31.772400] niks3-server[1045]: 2026/09/20 21:08:55 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 31.831026] niks3-server[1045]: 2026/09/20 21:08:55 INFO Read proxy enabled — serving cache objects from S3 lb # [ 31.835156] niks3-server[1045]: 2026/09/20 21:08:55 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 31.840828] niks3-server[1045]: 2026/09/20 21:08:55 INFO systemd watchdog enabled interval=15s lb # [ 31.843668] niks3-server[1045]: 2026/09/20 21:08:55 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 31.852365] systemd[1]: Started niks3 server. lb # [ 31.853209] systemd[1]: Reached target Multi-User System. lb # [ 31.854006] systemd[1]: Startup finished in 1.006s (kernel) + 4.678s (initrd) + 26.155s (userspace) = 31.839s. worker2 # [ 31.883969] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=scheduler_connected addr=lb:50051 lb # [ 31.868318] niks3-server[1045]: 2026/09/20 21:08:55 INFO lead: acquired remote=192.168.1.4:33512 worker2 # [ 31.892255] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.898399] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=scheduler_take_over worker1 # [ 31.995408] nix-grpc-daemon[774]: ts=2026-09-20T21:08:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.001399] nix-grpc-daemon[774]: ts=2026-09-20T21:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 16.97 seconds) lb: waiting for TCP port 5751 on localhost worker2 # [ 32.087385] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.093565] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds) lb: waiting for unit envoy.service worker1 # [ 32.202836] nix-grpc-daemon[774]: ts=2026-09-20T21:08:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.208753] nix-grpc-daemon[774]: ts=2026-09-20T21:08:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit envoy.service, in 0.08 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 32.226962] envoy[926]: conn peer=[::1]:43722 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=4 lb: (finished: waiting for TCP port 50051 on localhost, in 0.05 seconds) worker2 # [ 32.295794] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.332220] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 32.339038] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:40580 worker2 # [ 32.344862] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 32.410243] nix-grpc-daemon[774]: ts=2026-09-20T21:08:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.376819] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:40580 worker2 # [ 32.386312] nix-grpc-daemon[775]: ts=2026-09-20T21:08:55Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 32.484859] systemd[1]: Starting scheduler-token.service... worker2 # [ 32.625188] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 32.630119] systemd[1]: Finished scheduler-token.service. worker2 # [ 32.631005] systemd[1]: scheduler-token.service: Consumed 40ms CPU time over 144ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.14 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.14 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.11 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 1.05 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 34.317839] nix-grpc-daemon[774]: ts=2026-09-20T21:08:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 34.342427] systemd[1]: Started Nix Daemon. worker1 # [ 34.695108] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 34.745785] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 89 ms (attempt 1/5) worker1 # [ 34.838282] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 66 ms (attempt 2/5) worker1 # [ 34.904963] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 207 ms (attempt 3/5) worker1 # [ 35.120109] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 679 ms (attempt 4/5) worker1 # [ 35.803422] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 35.825694] nix-grpc-daemon[775]: ts=2026-09-20T21:08:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 35.839353] systemd[1]: Started Nix Daemon. worker2 # [ 36.196233] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 36.230399] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 1/5) worker2 # [ 36.324927] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 2/5) worker2 # [ 36.368822] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 3/5) worker2 # [ 36.387596] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 315 ms (attempt 4/5) worker2 # [ 36.713115] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 36.730766] nix-grpc-daemon[775]: ts=2026-09-20T21:09:00Z level=debug event=path_info_miss path=gkhkardj3d6k7q4gs4n9bbjjpdx2saf4-nixos-system-client-test error="error: path '/nix/store/gkhkardj3d6k7q4gs4n9bbjjpdx2saf4-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 36.775658] nix-grpc-daemon[774]: ts=2026-09-20T21:09:00Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 36.793785] nix-grpc-daemon[774]: ts=2026-09-20T21:09:00Z level=debug event=path_info_miss path=gkhkardj3d6k7q4gs4n9bbjjpdx2saf4-nixos-system-client-test error="error: path '/nix/store/gkhkardj3d6k7q4gs4n9bbjjpdx2saf4-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds) client: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.06 seconds) worker2 # [ 37.237081] nix-grpc-daemon[775]: ts=2026-09-20T21:09:00Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:40582 worker2 # [ 37.258109] nix-grpc-daemon[775]: ts=2026-09-20T21:09:00Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:40582 worker2 # [ 37.270888] nix-grpc-daemon[775]: ts=2026-09-20T21:09:00Z level=debug event=path_info_miss path=gkhkardj3d6k7q4gs4n9bbjjpdx2saf4-nixos-system-client-test error="error: path '/nix/store/gkhkardj3d6k7q4gs4n9bbjjpdx2saf4-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 37.325308] nix-grpc-daemon[774]: ts=2026-09-20T21:09:00Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 37.331442] nix-grpc-daemon[774]: ts=2026-09-20T21:09:00Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:56404 worker1 # [ 37.339975] nix-grpc-daemon[774]: ts=2026-09-20T21:09:00Z level=debug event=path_info_miss path=gkhkardj3d6k7q4gs4n9bbjjpdx2saf4-nixos-system-client-test error="error: path '/nix/store/gkhkardj3d6k7q4gs4n9bbjjpdx2saf4-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds) worker2 # [ 37.625057] nix-grpc-daemon[775]: ts=2026-09-20T21:09:01Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 37.933156] nix-grpc-daemon[774]: ts=2026-09-20T21:09:01Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 4.09 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 38.206703] nix-grpc-daemon[774]: ts=2026-09-20T21:09:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56404 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 38.187251] nix-grpc-daemon[775]: ts=2026-09-20T21:09:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 38.232447] nix-grpc-daemon[775]: ts=2026-09-20T21:09:01Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 38.241318] nix-grpc-daemon[775]: ts=2026-09-20T21:09:01Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 38.283713] nix-grpc-daemon[775]: ts=2026-09-20T21:09:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 38.306945] nix-grpc-daemon[775]: ts=2026-09-20T21:09:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 client # copying 1 paths to 'lb:50051'... worker2 # [ 38.324134] nix-grpc-daemon[775]: ts=2026-09-20T21:09:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker2 # [ 38.351628] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 38.399168] nix-grpc-daemon[775]: ts=2026-09-20T21:09:01Z level=info event=niks3_push_started pid=868 worker2 # [ 38.718151] nix-grpc-daemon[868]: time=2026-09-20T21:09:02.303Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 38.921848] nix-daemon[856]: accepted connection from pid 881, user nix-grpc-daemon (trusted) worker2 # [ 38.943963] nix-daemon[856]: reaped child process 884, status = succeeded worker2 # [ 39.122562] nix-daemon[856]: accepted connection from pid 886, user nix-grpc-daemon (trusted) worker2 # [ 39.146401] nix-daemon[856]: reaped child process 889, status = succeeded lb # [ 39.142160] niks3-server[1045]: 2026/09/20 21:09:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 39.190992] nix-grpc-daemon[868]: time=2026-09-20T21:09:02.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 39.192902] nix-grpc-daemon[868]: time=2026-09-20T21:09:02.779Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 39.223838] niks3-server[1045]: 2026/09/20 21:09:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 39.231498] niks3-server[1045]: 2026/09/20 21:09:02 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 39.263981] niks3-server[1045]: 2026/09/20 21:09:02 INFO Signed narinfos id=1 count=1 worker2 # [ 39.291876] nix-grpc-daemon[868]: time=2026-09-20T21:09:02.878Z level=INFO msg="Uploading 1 narinfos" lb # [ 39.282829] niks3-server[1045]: 2026/09/20 21:09:02 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 39.293112] niks3-server[1045]: 2026/09/20 21:09:02 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 39.304388] niks3-server[1045]: 2026/09/20 21:09:02 INFO Completed upload id=1 worker2 # [ 39.326068] nix-grpc-daemon[868]: time=2026-09-20T21:09:02.912Z level=INFO msg="Upload complete. (599ms)" lb # [ 39.315841] niks3-server[1045]: 2026/09/20 21:09:02 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo worker2 # [ 39.335929] nix-grpc-daemon[775]: ts=2026-09-20T21:09:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=1 paths=1 nar_bytes_in=504 worker2 # [ 39.352630] nix-grpc-daemon[775]: ts=2026-09-20T21:09:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 39.362418] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 39.368413] nix-daemon[856]: reaped child process 866, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker2 # [ 39.385195] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-t1 worker2 # [ 40.824265] nix-daemon[856]: reaped child process 894, status = succeeded worker2 # [ 41.020174] nix-daemon[856]: accepted connection from pid 909, user nix-grpc-daemon (trusted) worker2 # [ 41.040891] nix-daemon[856]: reaped child process 912, status = succeeded lb # [ 41.033822] niks3-server[1045]: 2026/09/20 21:09:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 41.076302] nix-grpc-daemon[868]: time=2026-09-20T21:09:04.661Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 41.079218] nix-grpc-daemon[868]: time=2026-09-20T21:09:04.661Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 41.095481] niks3-server[1045]: 2026/09/20 21:09:04 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 41.119648] niks3-server[1045]: 2026/09/20 21:09:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign worker2 # [ 41.149361] nix-grpc-daemon[868]: time=2026-09-20T21:09:04.734Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.130391] niks3-server[1045]: 2026/09/20 21:09:04 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 41.140107] niks3-server[1045]: 2026/09/20 21:09:04 INFO Signed narinfos id=2 count=1 lb # [ 41.145950] niks3-server[1045]: 2026/09/20 21:09:04 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 41.158883] niks3-server[1045]: 2026/09/20 21:09:04 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 41.164586] niks3-server[1045]: 2026/09/20 21:09:04 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo lb # [ 41.170360] niks3-server[1045]: 2026/09/20 21:09:04 INFO Completed upload id=2 worker2 # [ 41.192081] nix-grpc-daemon[868]: time=2026-09-20T21:09:04.778Z level=INFO msg="Upload complete. (387ms)" worker2 # [ 41.221025] nix-grpc-daemon[775]: ts=2026-09-20T21:09:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 41.239832] nix-grpc-daemon[775]: ts=2026-09-20T21:09:04Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 41.244539] nix-grpc-daemon[775]: ts=2026-09-20T21:09:04Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 41.249785] nix-daemon[856]: reaped child process 892, status = succeeded worker2 # [ 41.262880] nix-grpc-daemon[775]: ts=2026-09-20T21:09:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 41.281159] nix-grpc-daemon[775]: ts=2026-09-20T21:09:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 41.302334] nix-grpc-daemon[868]: time=2026-09-20T21:09:04.889Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 41.314891] nix-grpc-daemon[775]: ts=2026-09-20T21:09:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker2 # [ 41.339089] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 41.571004] nix-daemon[856]: accepted connection from pid 918, user nix-grpc-daemon (trusted) worker2 # [ 41.592562] nix-daemon[856]: reaped child process 921, status = succeeded lb # [ 41.654078] envoy[926]: conn peer=[2001:db8:1::1]:44976 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=2540 lb # [ 41.659628] envoy[926]: conn peer=[2001:db8:1::1]:44982 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=84 lb # [ 41.665254] envoy[926]: conn peer=[2001:db8:1::1]:44992 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=13 lb # [ 41.670007] envoy[926]: conn peer=[2001:db8:1::1]:45002 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=14 worker2 # [ 41.780096] nix-daemon[856]: accepted connection from pid 923, user nix-grpc-daemon (trusted) worker2 # [ 41.799825] nix-daemon[856]: reaped child process 926, status = succeeded lb # [ 41.791592] niks3-server[1045]: 2026/09/20 21:09:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 41.825429] nix-grpc-daemon[868]: time=2026-09-20T21:09:05.411Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 41.827069] nix-grpc-daemon[868]: time=2026-09-20T21:09:05.411Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 41.824211] niks3-server[1045]: 2026/09/20 21:09:05 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 41.838225] niks3-server[1045]: 2026/09/20 21:09:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker2 # [ 41.867389] nix-grpc-daemon[868]: time=2026-09-20T21:09:05.453Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.852774] niks3-server[1045]: 2026/09/20 21:09:05 INFO Signed narinfos id=3 count=1 lb # [ 41.855119] niks3-server[1045]: 2026/09/20 21:09:05 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 41.864692] niks3-server[1045]: 2026/09/20 21:09:05 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 41.872505] niks3-server[1045]: 2026/09/20 21:09:05 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo lb # [ 41.878594] niks3-server[1045]: 2026/09/20 21:09:05 INFO Completed upload id=3 worker2 # [ 41.900134] nix-grpc-daemon[868]: time=2026-09-20T21:09:05.487Z level=INFO msg="Upload complete. (542ms)" worker2 # [ 41.907184] nix-grpc-daemon[775]: ts=2026-09-20T21:09:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 41.922522] nix-grpc-daemon[775]: ts=2026-09-20T21:09:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 41.929796] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 41.935040] nix-daemon[856]: reaped child process 916, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... worker2 # [ 41.947234] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv client # farm-b> LOG-farm-b-t1 worker2 # [ 43.190977] nix-daemon[856]: reaped child process 930, status = succeeded worker2 # [ 43.378624] nix-daemon[856]: accepted connection from pid 946, user nix-grpc-daemon (trusted) worker2 # [ 43.401911] nix-daemon[856]: reaped child process 949, status = succeeded lb # [ 43.394534] niks3-server[1045]: 2026/09/20 21:09:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 43.428760] nix-grpc-daemon[868]: time=2026-09-20T21:09:07.014Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 43.431577] nix-grpc-daemon[868]: time=2026-09-20T21:09:07.014Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 43.441328] niks3-server[1045]: 2026/09/20 21:09:07 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst worker2 # [ 43.476180] nix-grpc-daemon[868]: time=2026-09-20T21:09:07.062Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.454714] niks3-server[1045]: 2026/09/20 21:09:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 43.467682] niks3-server[1045]: 2026/09/20 21:09:07 INFO Signed narinfos id=4 count=1 lb # [ 43.475633] niks3-server[1045]: 2026/09/20 21:09:07 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 43.492253] niks3-server[1045]: 2026/09/20 21:09:07 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 43.495999] niks3-server[1045]: 2026/09/20 21:09:07 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 43.505895] niks3-server[1045]: 2026/09/20 21:09:07 INFO Completed upload id=4 worker2 # [ 43.526793] nix-grpc-daemon[868]: time=2026-09-20T21:09:07.113Z level=INFO msg="Upload complete. (365ms)" lb # [ 43.510698] niks3-server[1045]: 2026/09/20 21:09:07 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker2 # [ 43.549420] nix-grpc-daemon[775]: ts=2026-09-20T21:09:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 43.567530] nix-grpc-daemon[775]: ts=2026-09-20T21:09:07Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 43.572683] nix-grpc-daemon[775]: ts=2026-09-20T21:09:07Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 43.577052] nix-daemon[856]: reaped child process 928, status = succeeded worker2 # [ 43.596184] nix-grpc-daemon[775]: ts=2026-09-20T21:09:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 43.612937] nix-grpc-daemon[775]: ts=2026-09-20T21:09:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 43.629985] nix-grpc-daemon[868]: time=2026-09-20T21:09:07.216Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker2 # [ 43.643013] nix-grpc-daemon[775]: ts=2026-09-20T21:09:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 43.662735] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 43.881166] nix-daemon[856]: accepted connection from pid 955, user nix-grpc-daemon (trusted) worker2 # [ 43.902978] nix-daemon[856]: reaped child process 958, status = succeeded worker2 # [ 44.098214] nix-daemon[856]: accepted connection from pid 960, user nix-grpc-daemon (trusted) worker2 # [ 44.119270] nix-daemon[856]: reaped child process 963, status = succeeded lb # [ 44.111433] niks3-server[1045]: 2026/09/20 21:09:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 44.144315] nix-grpc-daemon[868]: time=2026-09-20T21:09:07.731Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 44.146647] nix-grpc-daemon[868]: time=2026-09-20T21:09:07.733Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 44.144372] niks3-server[1045]: 2026/09/20 21:09:07 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst worker2 # [ 44.190478] nix-grpc-daemon[868]: time=2026-09-20T21:09:07.777Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.163008] niks3-server[1045]: 2026/09/20 21:09:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 44.178797] niks3-server[1045]: 2026/09/20 21:09:07 INFO Signed narinfos id=5 count=1 lb # [ 44.185477] niks3-server[1045]: 2026/09/20 21:09:07 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 44.192399] niks3-server[1045]: 2026/09/20 21:09:07 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 44.206591] niks3-server[1045]: 2026/09/20 21:09:07 INFO Completed upload id=5 worker2 # [ 44.228730] nix-grpc-daemon[868]: time=2026-09-20T21:09:07.815Z level=INFO msg="Upload complete. (549ms)" lb # [ 44.210812] niks3-server[1045]: 2026/09/20 21:09:07 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker2 # [ 44.240600] nix-grpc-daemon[775]: ts=2026-09-20T21:09:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 44.248636] nix-grpc-daemon[775]: ts=2026-09-20T21:09:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 44.265188] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 44.268765] nix-daemon[856]: reaped child process 953, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 44.286415] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1 worker2 # [ 45.320765] nix-daemon[856]: reaped child process 967, status = succeeded worker2 # [ 45.506855] nix-daemon[856]: accepted connection from pid 982, user nix-grpc-daemon (trusted) worker2 # [ 45.530734] nix-daemon[856]: reaped child process 985, status = succeeded lb # [ 45.522875] niks3-server[1045]: 2026/09/20 21:09:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.556553] nix-grpc-daemon[868]: time=2026-09-20T21:09:09.142Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 45.558346] nix-grpc-daemon[868]: time=2026-09-20T21:09:09.142Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 45.576218] niks3-server[1045]: 2026/09/20 21:09:09 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 45.587889] niks3-server[1045]: 2026/09/20 21:09:09 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 45.599364] niks3-server[1045]: 2026/09/20 21:09:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign worker2 # [ 45.621277] nix-grpc-daemon[868]: time=2026-09-20T21:09:09.207Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.608660] niks3-server[1045]: 2026/09/20 21:09:09 INFO Signed narinfos id=6 count=1 lb # [ 45.614844] niks3-server[1045]: 2026/09/20 21:09:09 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 45.628184] niks3-server[1045]: 2026/09/20 21:09:09 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 45.637327] niks3-server[1045]: 2026/09/20 21:09:09 INFO Completed upload id=6 lb # [ 45.641566] niks3-server[1045]: 2026/09/20 21:09:09 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker2 # [ 45.658978] nix-grpc-daemon[868]: time=2026-09-20T21:09:09.245Z level=INFO msg="Upload complete. (358ms)" worker2 # [ 45.673200] nix-grpc-daemon[775]: ts=2026-09-20T21:09:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker2 # [ 45.694994] nix-daemon[856]: reaped child process 965, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.79 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.26 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.33 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.54 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 47.393739] nix-grpc-daemon[774]: ts=2026-09-20T21:09:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 47.402663] nix-grpc-daemon[774]: ts=2026-09-20T21:09:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56404 worker2 # [ 47.395651] nix-grpc-daemon[775]: ts=2026-09-20T21:09:10Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.37 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.22 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.56 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 48.548501] nix-grpc-daemon[774]: ts=2026-09-20T21:09:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 48.555649] nix-grpc-daemon[774]: ts=2026-09-20T21:09:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56404 worker2 # [ 48.544326] nix-grpc-daemon[775]: ts=2026-09-20T21:09:12Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 48.547759] nix-grpc-daemon[775]: ts=2026-09-20T21:09:12Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 48.595388] nix-grpc-daemon[775]: ts=2026-09-20T21:09:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 48.615501] nix-grpc-daemon[775]: ts=2026-09-20T21:09:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 48.632955] nix-grpc-daemon[868]: time=2026-09-20T21:09:12.218Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker2 # [ 48.645962] nix-grpc-daemon[775]: ts=2026-09-20T21:09:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 48.662775] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 48.875705] nix-daemon[856]: accepted connection from pid 1015, user nix-grpc-daemon (trusted) worker2 # [ 48.895777] nix-daemon[856]: reaped child process 1018, status = succeeded worker2 # [ 49.100114] nix-daemon[856]: accepted connection from pid 1020, user nix-grpc-daemon (trusted) worker2 # [ 49.121105] nix-daemon[856]: reaped child process 1023, status = succeeded lb # [ 49.114609] niks3-server[1045]: 2026/09/20 21:09:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 49.147405] nix-grpc-daemon[868]: time=2026-09-20T21:09:12.733Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 49.149179] nix-grpc-daemon[868]: time=2026-09-20T21:09:12.733Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 49.146459] niks3-server[1045]: 2026/09/20 21:09:12 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 49.164323] niks3-server[1045]: 2026/09/20 21:09:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker2 # [ 49.191591] nix-grpc-daemon[868]: time=2026-09-20T21:09:12.778Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.176785] niks3-server[1045]: 2026/09/20 21:09:12 INFO Signed narinfos id=7 count=1 lb # [ 49.182025] niks3-server[1045]: 2026/09/20 21:09:12 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 49.194908] niks3-server[1045]: 2026/09/20 21:09:12 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 49.201881] niks3-server[1045]: 2026/09/20 21:09:12 INFO Completed upload id=7 worker2 # [ 49.223487] nix-grpc-daemon[868]: time=2026-09-20T21:09:12.810Z level=INFO msg="Upload complete. (542ms)" lb # [ 49.205346] niks3-server[1045]: 2026/09/20 21:09:12 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker2 # [ 49.232508] nix-grpc-daemon[775]: ts=2026-09-20T21:09:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 49.249780] nix-grpc-daemon[775]: ts=2026-09-20T21:09:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 49.256866] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 49.262416] nix-daemon[856]: reaped child process 1013, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 49.275694] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1b worker2 # [ 50.908856] nix-daemon[856]: reaped child process 1027, status = succeeded worker2 # [ 51.088262] nix-daemon[856]: accepted connection from pid 1042, user nix-grpc-daemon (trusted) worker2 # [ 51.109435] nix-daemon[856]: reaped child process 1045, status = succeeded lb # [ 51.105710] niks3-server[1045]: 2026/09/20 21:09:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 51.143596] nix-grpc-daemon[868]: time=2026-09-20T21:09:14.726Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 51.145629] nix-grpc-daemon[868]: time=2026-09-20T21:09:14.726Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 51.149480] niks3-server[1045]: 2026/09/20 21:09:14 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 51.156236] niks3-server[1045]: 2026/09/20 21:09:14 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 51.164499] niks3-server[1045]: 2026/09/20 21:09:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker2 # [ 51.186402] nix-grpc-daemon[868]: time=2026-09-20T21:09:14.772Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.166979] niks3-server[1045]: 2026/09/20 21:09:14 INFO Signed narinfos id=8 count=1 lb # [ 51.176634] niks3-server[1045]: 2026/09/20 21:09:14 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 51.187658] niks3-server[1045]: 2026/09/20 21:09:14 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete worker2 # [ 51.213567] nix-grpc-daemon[868]: time=2026-09-20T21:09:14.800Z level=INFO msg="Upload complete. (322ms)" lb # [ 51.194048] niks3-server[1045]: 2026/09/20 21:09:14 INFO Completed upload id=8 lb # [ 51.196972] niks3-server[1045]: 2026/09/20 21:09:14 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker2 # [ 51.220650] nix-grpc-daemon[775]: ts=2026-09-20T21:09:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker2 # [ 51.230911] nix-daemon[856]: reaped child process 1025, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 3.05 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.25 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true lb # [ 51.654162] envoy[926]: conn peer=[2001:db8:1::1]:45012 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9566 tx=3881 ms=7534 lb # [ 51.656426] envoy[926]: conn peer=[2001:db8:1::1]:33732 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=61 lb # [ 51.658228] envoy[926]: conn peer=[2001:db8:1::1]:33744 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4159 tx=1730 ms=2737 worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.71 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 51.809996] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 1f129ff850a3480d9857f2cc56beb2a0 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.11 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup worker1 # [ 52.147223] nix-grpc-daemon[774]: ts=2026-09-20T21:09:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56404 client # [ 52.107245] nix[878]: don't know how to build these paths: client # [ 52.109392] nix[878]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 52.134808] nix-grpc-daemon[775]: ts=2026-09-20T21:09:15Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 52.135249] nix-grpc-daemon[775]: ts=2026-09-20T21:09:15Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 52.220284] nix-grpc-daemon[774]: ts=2026-09-20T21:09:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 52.243346] nix-grpc-daemon[774]: ts=2026-09-20T21:09:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56404 client # [ 52.211318] nix[878]: copying 1 paths to 'lb:50051'... worker1 # [ 52.262309] nix-grpc-daemon[774]: ts=2026-09-20T21:09:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56404 client # [ 52.214263] nix[878]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker1 # [ 52.282827] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 52.317310] nix-grpc-daemon[774]: ts=2026-09-20T21:09:15Z level=info event=niks3_push_started pid=861 worker1 # [ 52.613535] nix-grpc-daemon[861]: time=2026-09-20T21:09:16.187Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 52.822600] nix-daemon[835]: accepted connection from pid 874, user nix-grpc-daemon (trusted) worker1 # [ 52.847709] nix-daemon[835]: reaped child process 877, status = succeeded client # [ 52.938508] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds) worker1 # [ 53.048365] nix-daemon[835]: accepted connection from pid 879, user nix-grpc-daemon (trusted) worker1 # [ 53.079870] nix-daemon[835]: reaped child process 885, status = succeeded lb # [ 53.042846] niks3-server[1045]: 2026/09/20 21:09:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.111462] nix-grpc-daemon[861]: time=2026-09-20T21:09:16.687Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 53.115206] nix-grpc-daemon[861]: time=2026-09-20T21:09:16.687Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" worker1 # [ 53.165409] nix-grpc-daemon[861]: time=2026-09-20T21:09:16.740Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.096903] niks3-server[1045]: 2026/09/20 21:09:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 53.109958] niks3-server[1045]: 2026/09/20 21:09:16 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst lb # [ 53.120205] niks3-server[1045]: 2026/09/20 21:09:16 INFO Signed narinfos id=9 count=1 lb # [ 53.126362] niks3-server[1045]: 2026/09/20 21:09:16 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 53.137688] niks3-server[1045]: 2026/09/20 21:09:16 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 53.143939] niks3-server[1045]: 2026/09/20 21:09:16 INFO Completed upload id=9 worker1 # [ 53.201931] nix-grpc-daemon[861]: time=2026-09-20T21:09:16.777Z level=INFO msg="Upload complete. (579ms)" lb # [ 53.147289] niks3-server[1045]: 2026/09/20 21:09:16 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker1 # [ 53.208929] nix-grpc-daemon[774]: ts=2026-09-20T21:09:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56404 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 53.221699] nix-grpc-daemon[774]: ts=2026-09-20T21:09:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 53.227880] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 53.232824] nix-daemon[835]: reaped child process 859, status = succeeded worker1 # [ 53.245471] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # Running as unit: dedup2.service; invocation ID: 33cb3ed38fcc4886b4f92c74d9c537cd client # [ 53.201035] nix[878]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client # [ 53.305185] nix[894]: don't know how to build these paths: client # [ 53.306275] nix[894]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 53.315476] nix-grpc-daemon[775]: ts=2026-09-20T21:09:16Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 53.332712] nix-grpc-daemon[775]: ts=2026-09-20T21:09:16Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker1 # [ 53.381849] nix-grpc-daemon[774]: ts=2026-09-20T21:09:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56404 client # [ 53.340299] nix[894]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.07 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker1 # [ 57.887480] nix-daemon[835]: reaped child process 890, status = succeeded worker1 # [ 58.067075] nix-daemon[835]: accepted connection from pid 919, user nix-grpc-daemon (trusted) worker1 # [ 58.086999] nix-daemon[835]: reaped child process 922, status = succeeded lb # [ 58.044754] niks3-server[1045]: 2026/09/20 21:09:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 58.117619] nix-grpc-daemon[861]: time=2026-09-20T21:09:21.691Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 58.119823] nix-grpc-daemon[861]: time=2026-09-20T21:09:21.691Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 58.087880] niks3-server[1045]: 2026/09/20 21:09:21 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 58.112685] niks3-server[1045]: 2026/09/20 21:09:21 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 58.129982] niks3-server[1045]: 2026/09/20 21:09:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign worker1 # [ 58.195118] nix-grpc-daemon[861]: time=2026-09-20T21:09:21.769Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.138348] niks3-server[1045]: 2026/09/20 21:09:21 INFO Signed narinfos id=10 count=1 lb # [ 58.141918] niks3-server[1045]: 2026/09/20 21:09:21 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 58.156150] niks3-server[1045]: 2026/09/20 21:09:21 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 58.167901] niks3-server[1045]: 2026/09/20 21:09:21 INFO Completed upload id=10 worker1 # [ 58.224197] nix-grpc-daemon[861]: time=2026-09-20T21:09:21.800Z level=INFO msg="Upload complete. (359ms)" lb # [ 58.173449] niks3-server[1045]: 2026/09/20 21:09:21 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker1 # [ 58.237423] nix-grpc-daemon[774]: ts=2026-09-20T21:09:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56404 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 58.258361] nix-grpc-daemon[774]: ts=2026-09-20T21:09:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56404 duration_s=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker1 # [ 58.265355] nix-daemon[835]: reaped child process 888, status = succeeded client # [ 58.261328] systemd[1]: dedup2.service: Deactivated successfully. client # [ 58.266226] systemd[1]: dedup2.service: Consumed 205ms CPU time over 5.327s wall clock time, 33.2M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client # [ 58.277816] systemd[1]: dedup1.service: Deactivated successfully. client # [ 58.279728] systemd[1]: dedup1.service: Consumed 199ms CPU time over 6.466s wall clock time, 41.2M memory peak, 6.9K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.15 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: two clients wanting the same drv build it once, in 7.61 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 59.555005] systemd[1]: Started Nix Daemon. client # [ 59.751583] nix-daemon[936]: accepted connection from pid 933, user root (trusted) worker2 # [ 59.999763] nix-grpc-daemon[775]: ts=2026-09-20T21:09:23Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:40582 worker1 # [ 60.041884] nix-grpc-daemon[774]: ts=2026-09-20T21:09:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56404 worker2 # [ 60.028356] nix-grpc-daemon[775]: ts=2026-09-20T21:09:23Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 60.034824] nix-grpc-daemon[775]: ts=2026-09-20T21:09:23Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 60.082489] nix-grpc-daemon[775]: ts=2026-09-20T21:09:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 60.100877] nix-grpc-daemon[775]: ts=2026-09-20T21:09:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 60.117855] nix-grpc-daemon[775]: ts=2026-09-20T21:09:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 60.134218] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 60.357154] nix-daemon[856]: accepted connection from pid 1085, user nix-grpc-daemon (trusted) worker2 # [ 60.380576] nix-daemon[856]: reaped child process 1088, status = succeeded worker2 # [ 60.576577] nix-daemon[856]: accepted connection from pid 1090, user nix-grpc-daemon (trusted) worker2 # [ 60.598300] nix-daemon[856]: reaped child process 1093, status = succeeded lb # [ 60.589175] niks3-server[1045]: 2026/09/20 21:09:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 60.621389] nix-grpc-daemon[868]: time=2026-09-20T21:09:24.207Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 60.622953] nix-grpc-daemon[868]: time=2026-09-20T21:09:24.207Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 60.625596] niks3-server[1045]: 2026/09/20 21:09:24 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 60.640485] niks3-server[1045]: 2026/09/20 21:09:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker2 # [ 60.666488] nix-grpc-daemon[868]: time=2026-09-20T21:09:24.253Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.648230] niks3-server[1045]: 2026/09/20 21:09:24 INFO Signed narinfos id=11 count=1 lb # [ 60.654115] niks3-server[1045]: 2026/09/20 21:09:24 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 60.667147] niks3-server[1045]: 2026/09/20 21:09:24 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete worker2 # [ 60.695365] nix-grpc-daemon[868]: time=2026-09-20T21:09:24.282Z level=INFO msg="Upload complete. (543ms)" lb # [ 60.673826] niks3-server[1045]: 2026/09/20 21:09:24 INFO Completed upload id=11 worker2 # [ 60.700244] nix-grpc-daemon[775]: ts=2026-09-20T21:09:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 60.677776] niks3-server[1045]: 2026/09/20 21:09:24 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker2 # [ 60.710511] nix-grpc-daemon[775]: ts=2026-09-20T21:09:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 60.715145] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 60.718743] nix-daemon[856]: reaped child process 1083, status = succeeded worker2 # [ 60.729656] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) lb # [ 61.653097] envoy[926]: conn peer=[2001:db8:1::1]:48572 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1373 ms=6114 lb # [ 61.658308] envoy[926]: conn peer=[2001:db8:1::1]:48584 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=4915 worker2 # [ 61.779167] nix-daemon[856]: reaped child process 1097, status = succeeded worker2 # [ 61.975591] nix-daemon[856]: accepted connection from pid 1112, user nix-grpc-daemon (trusted) worker2 # [ 61.998469] nix-daemon[856]: reaped child process 1115, status = succeeded lb # [ 61.990182] niks3-server[1045]: 2026/09/20 21:09:25 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 62.023661] nix-grpc-daemon[868]: time=2026-09-20T21:09:25.607Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 62.025949] nix-grpc-daemon[868]: time=2026-09-20T21:09:25.608Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 62.029393] niks3-server[1045]: 2026/09/20 21:09:25 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 62.045300] niks3-server[1045]: 2026/09/20 21:09:25 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 62.060326] niks3-server[1045]: 2026/09/20 21:09:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker2 # [ 62.090130] nix-grpc-daemon[868]: time=2026-09-20T21:09:25.676Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.071634] niks3-server[1045]: 2026/09/20 21:09:25 INFO Signed narinfos id=12 count=1 lb # [ 62.077494] niks3-server[1045]: 2026/09/20 21:09:25 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 62.088220] niks3-server[1045]: 2026/09/20 21:09:25 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 62.094840] niks3-server[1045]: 2026/09/20 21:09:25 INFO Completed upload id=12 worker2 # [ 62.116558] nix-grpc-daemon[868]: time=2026-09-20T21:09:25.703Z level=INFO msg="Upload complete. (378ms)" lb # [ 62.097794] niks3-server[1045]: 2026/09/20 21:09:25 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker1 # [ 62.169314] nix-grpc-daemon[774]: ts=2026-09-20T21:09:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56404 worker2 # [ 62.133441] nix-grpc-daemon[775]: ts=2026-09-20T21:09:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker2 # [ 62.152229] nix-daemon[856]: reaped child process 1095, status = succeeded worker1 # [ 62.189772] nix-grpc-daemon[774]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker2 # [ 62.206839] nix-grpc-daemon[775]: ts=2026-09-20T21:09:25Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 62.216351] nix-grpc-daemon[775]: ts=2026-09-20T21:09:25Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 62.545890] nix-grpc-daemon[774]: ts=2026-09-20T21:09:26Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 62.554224] nix-grpc-daemon[774]: ts=2026-09-20T21:09:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 62.562650] nix-grpc-daemon[861]: time=2026-09-20T21:09:26.136Z level=INFO msg="All 1 paths already cached" worker2 # [ 62.541789] nix-grpc-daemon[775]: ts=2026-09-20T21:09:26Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 62.551209] nix-grpc-daemon[775]: ts=2026-09-20T21:09:26Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 62.559422] nix-grpc-daemon[775]: ts=2026-09-20T21:09:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 62.572907] nix-grpc-daemon[775]: ts=2026-09-20T21:09:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 62.590163] nix-grpc-daemon[868]: time=2026-09-20T21:09:26.177Z level=INFO msg="All 1 paths already cached" worker2 # [ 62.601123] nix-grpc-daemon[775]: ts=2026-09-20T21:09:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 62.614854] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 62.834593] nix-daemon[856]: accepted connection from pid 1121, user nix-grpc-daemon (trusted) worker2 # [ 62.859665] nix-daemon[856]: reaped child process 1124, status = succeeded worker2 # [ 63.035839] nix-daemon[856]: accepted connection from pid 1126, user nix-grpc-daemon (trusted) worker2 # [ 63.061174] nix-daemon[856]: reaped child process 1129, status = succeeded lb # [ 63.054023] niks3-server[1045]: 2026/09/20 21:09:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 63.091607] nix-grpc-daemon[868]: time=2026-09-20T21:09:26.677Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 63.093462] nix-grpc-daemon[868]: time=2026-09-20T21:09:26.677Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 63.094960] niks3-server[1045]: 2026/09/20 21:09:26 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker2 # [ 63.127414] nix-grpc-daemon[868]: time=2026-09-20T21:09:26.714Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.110039] niks3-server[1045]: 2026/09/20 21:09:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 63.120925] niks3-server[1045]: 2026/09/20 21:09:26 INFO Signed narinfos id=13 count=1 lb # [ 63.132363] niks3-server[1045]: 2026/09/20 21:09:26 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 63.138100] niks3-server[1045]: 2026/09/20 21:09:26 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 63.145832] niks3-server[1045]: 2026/09/20 21:09:26 INFO Completed upload id=13 worker2 # [ 63.167800] nix-grpc-daemon[868]: time=2026-09-20T21:09:26.754Z level=INFO msg="Upload complete. (530ms)" worker2 # [ 63.178542] nix-grpc-daemon[775]: ts=2026-09-20T21:09:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 63.159715] niks3-server[1045]: 2026/09/20 21:09:26 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker2 # [ 63.193431] nix-grpc-daemon[775]: ts=2026-09-20T21:09:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 63.201842] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 63.207459] nix-daemon[856]: reaped child process 1119, status = succeeded worker2 # [ 63.224701] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 64.673641] nix-daemon[856]: reaped child process 1133, status = succeeded worker2 # [ 64.867264] nix-daemon[856]: accepted connection from pid 1148, user nix-grpc-daemon (trusted) worker2 # [ 64.888034] nix-daemon[856]: reaped child process 1151, status = succeeded lb # [ 64.881820] niks3-server[1045]: 2026/09/20 21:09:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 64.913943] nix-grpc-daemon[868]: time=2026-09-20T21:09:28.499Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 64.915735] nix-grpc-daemon[868]: time=2026-09-20T21:09:28.499Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 64.916820] niks3-server[1045]: 2026/09/20 21:09:28 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 64.931052] niks3-server[1045]: 2026/09/20 21:09:28 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 64.946103] niks3-server[1045]: 2026/09/20 21:09:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign worker2 # [ 64.971874] nix-grpc-daemon[868]: time=2026-09-20T21:09:28.558Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.955361] niks3-server[1045]: 2026/09/20 21:09:28 INFO Signed narinfos id=14 count=1 lb # [ 64.961214] niks3-server[1045]: 2026/09/20 21:09:28 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 64.970337] niks3-server[1045]: 2026/09/20 21:09:28 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 64.976257] niks3-server[1045]: 2026/09/20 21:09:28 INFO Completed upload id=14 worker2 # [ 64.997173] nix-grpc-daemon[868]: time=2026-09-20T21:09:28.584Z level=INFO msg="Upload complete. (359ms)" lb # [ 64.979484] niks3-server[1045]: 2026/09/20 21:09:28 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker2 # [ 65.014560] nix-grpc-daemon[775]: ts=2026-09-20T21:09:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker2 # [ 65.028956] nix-grpc-daemon[775]: ts=2026-09-20T21:09:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 65.035651] nix-daemon[856]: reaped child process 1131, status = succeeded worker1 # [ 65.077279] nix-grpc-daemon[774]: ts=2026-09-20T21:09:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 65.092622] nix-grpc-daemon[774]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker1 # [ 65.113098] nix-grpc-daemon[774]: ts=2026-09-20T21:09:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56404 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 65.449331] nix-grpc-daemon[774]: ts=2026-09-20T21:09:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:56404 worker2 # [ 65.417637] nix-grpc-daemon[775]: ts=2026-09-20T21:09:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 65.428144] nix-grpc-daemon[868]: time=2026-09-20T21:09:29.014Z level=INFO msg="All 2 paths already cached" worker2 # [ 65.448101] nix-grpc-daemon[775]: ts=2026-09-20T21:09:29Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 65.455554] nix-grpc-daemon[775]: ts=2026-09-20T21:09:29Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 65.464830] nix-grpc-daemon[775]: ts=2026-09-20T21:09:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 65.477442] nix-grpc-daemon[775]: ts=2026-09-20T21:09:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 65.490356] nix-grpc-daemon[868]: time=2026-09-20T21:09:29.077Z level=INFO msg="All 2 paths already cached" worker2 # [ 65.499517] nix-grpc-daemon[775]: ts=2026-09-20T21:09:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 65.509759] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 65.702200] nix-daemon[856]: accepted connection from pid 1157, user nix-grpc-daemon (trusted) worker2 # [ 65.724430] nix-daemon[856]: reaped child process 1160, status = succeeded worker2 # [ 65.902805] nix-daemon[856]: accepted connection from pid 1162, user nix-grpc-daemon (trusted) worker2 # [ 65.922495] nix-daemon[856]: reaped child process 1165, status = succeeded lb # [ 65.915420] niks3-server[1045]: 2026/09/20 21:09:29 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 65.947259] nix-grpc-daemon[868]: time=2026-09-20T21:09:29.533Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 65.949006] nix-grpc-daemon[868]: time=2026-09-20T21:09:29.533Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 65.949453] niks3-server[1045]: 2026/09/20 21:09:29 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst lb # [ 65.960630] niks3-server[1045]: 2026/09/20 21:09:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker2 # [ 65.989671] nix-grpc-daemon[868]: time=2026-09-20T21:09:29.576Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.968226] niks3-server[1045]: 2026/09/20 21:09:29 INFO Signed narinfos id=15 count=1 lb # [ 65.977055] niks3-server[1045]: 2026/09/20 21:09:29 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 65.986906] niks3-server[1045]: 2026/09/20 21:09:29 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete worker2 # [ 66.015531] nix-grpc-daemon[868]: time=2026-09-20T21:09:29.602Z level=INFO msg="Upload complete. (493ms)" lb # [ 65.994378] niks3-server[1045]: 2026/09/20 21:09:29 INFO Completed upload id=15 lb # [ 65.997610] niks3-server[1045]: 2026/09/20 21:09:29 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker2 # [ 66.025107] nix-grpc-daemon[775]: ts=2026-09-20T21:09:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 66.039641] nix-grpc-daemon[775]: ts=2026-09-20T21:09:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 66.046826] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 66.052814] nix-daemon[856]: reaped child process 1155, status = succeeded worker2 # [ 66.068700] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 67.117687] nix-daemon[856]: reaped child process 1169, status = succeeded worker2 # [ 67.293985] nix-daemon[856]: accepted connection from pid 1184, user nix-grpc-daemon (trusted) worker2 # [ 67.316322] nix-daemon[856]: reaped child process 1187, status = succeeded lb # [ 67.308811] niks3-server[1045]: 2026/09/20 21:09:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 67.344516] nix-grpc-daemon[868]: time=2026-09-20T21:09:30.927Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 67.346490] nix-grpc-daemon[868]: time=2026-09-20T21:09:30.927Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 67.356320] niks3-server[1045]: 2026/09/20 21:09:30 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 67.369608] niks3-server[1045]: 2026/09/20 21:09:30 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker2 # [ 67.404630] nix-grpc-daemon[868]: time=2026-09-20T21:09:30.991Z level=INFO msg="Uploading 1 narinfos" lb # [ 67.382683] niks3-server[1045]: 2026/09/20 21:09:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 67.392970] niks3-server[1045]: 2026/09/20 21:09:30 INFO Signed narinfos id=16 count=1 lb # [ 67.398732] niks3-server[1045]: 2026/09/20 21:09:30 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 67.410154] niks3-server[1045]: 2026/09/20 21:09:30 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 67.419776] niks3-server[1045]: 2026/09/20 21:09:30 INFO Completed upload id=16 worker2 # [ 67.441324] nix-grpc-daemon[868]: time=2026-09-20T21:09:31.028Z level=INFO msg="Upload complete. (361ms)" lb # [ 67.423093] niks3-server[1045]: 2026/09/20 21:09:30 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker2 # [ 67.453324] nix-grpc-daemon[775]: ts=2026-09-20T21:09:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker2 # [ 67.473272] nix-daemon[856]: reaped child process 1167, status = succeeded worker1 # [ 67.537806] nix-grpc-daemon[774]: ts=2026-09-20T21:09:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 67.551519] nix-grpc-daemon[774]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker2 # [ 67.562644] nix-grpc-daemon[775]: ts=2026-09-20T21:09:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 67.569812] nix-grpc-daemon[775]: ts=2026-09-20T21:09:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=0 paths=1 nar_bytes_out=232 client # [ 67.657443] nix-daemon[936]: reaped child process 938, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.35 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.06 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 8.49 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.47 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 69.030698] nix-daemon[936]: accepted connection from pid 1019, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker1 # [ 69.309779] nix-grpc-daemon[774]: ts=2026-09-20T21:09:32Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:56404 client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 69.278429] nix-grpc-daemon[775]: ts=2026-09-20T21:09:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker1 # [ 69.335485] nix-grpc-daemon[774]: ts=2026-09-20T21:09:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 69.351520] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 69.573530] nix-daemon[835]: accepted connection from pid 943, user nix-grpc-daemon (trusted) worker1 # [ 69.595664] nix-daemon[835]: reaped child process 946, status = succeeded lb # [ 69.551250] niks3-server[1045]: 2026/09/20 21:09:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 69.620091] nix-grpc-daemon[861]: time=2026-09-20T21:09:33.195Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 69.621676] nix-grpc-daemon[861]: time=2026-09-20T21:09:33.195Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 69.581590] niks3-server[1045]: 2026/09/20 21:09:33 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 69.599703] niks3-server[1045]: 2026/09/20 21:09:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 69.663625] nix-grpc-daemon[861]: time=2026-09-20T21:09:33.239Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.613174] niks3-server[1045]: 2026/09/20 21:09:33 INFO Signed narinfos id=17 count=1 lb # [ 69.620540] niks3-server[1045]: 2026/09/20 21:09:33 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 69.628367] niks3-server[1045]: 2026/09/20 21:09:33 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 69.637782] niks3-server[1045]: 2026/09/20 21:09:33 INFO Completed upload id=17 worker1 # [ 69.694580] nix-grpc-daemon[861]: time=2026-09-20T21:09:33.270Z level=INFO msg="Upload complete. (327ms)" lb # [ 69.640351] niks3-server[1045]: 2026/09/20 21:09:33 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker1 # [ 69.704351] nix-grpc-daemon[774]: ts=2026-09-20T21:09:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56404 duration_s=0 paths=1 nar_bytes_in=120 worker1 # [ 69.716457] nix-daemon[835]: reaped child process 941, status = succeeded worker2 # [ 69.685627] nix-grpc-daemon[775]: ts=2026-09-20T21:09:33Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 69.692633] nix-grpc-daemon[775]: ts=2026-09-20T21:09:33Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 69.770849] nix-grpc-daemon[774]: ts=2026-09-20T21:09:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 69.789366] nix-grpc-daemon[774]: ts=2026-09-20T21:09:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56404 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 69.810713] nix-grpc-daemon[774]: ts=2026-09-20T21:09:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56404 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 69.823859] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 70.037581] nix-daemon[835]: accepted connection from pid 950, user nix-grpc-daemon (trusted) worker1 # [ 70.061315] nix-daemon[835]: reaped child process 953, status = succeeded worker1 # [ 70.247903] nix-daemon[835]: accepted connection from pid 955, user nix-grpc-daemon (trusted) worker1 # [ 70.270921] nix-daemon[835]: reaped child process 958, status = succeeded lb # [ 70.228787] niks3-server[1045]: 2026/09/20 21:09:33 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 70.244783] niks3-server[1045]: 2026/09/20 21:09:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 70.312544] nix-grpc-daemon[861]: time=2026-09-20T21:09:33.888Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 70.315159] nix-grpc-daemon[861]: time=2026-09-20T21:09:33.890Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker1 # [ 70.317299] nix-grpc-daemon[861]: time=2026-09-20T21:09:33.890Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 70.288053] niks3-server[1045]: 2026/09/20 21:09:33 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 70.305966] niks3-server[1045]: 2026/09/20 21:09:33 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 70.318042] niks3-server[1045]: 2026/09/20 21:09:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 70.324201] niks3-server[1045]: 2026/09/20 21:09:33 INFO Signed narinfos id=18 count=1 worker1 # [ 70.381153] nix-grpc-daemon[861]: time=2026-09-20T21:09:33.955Z level=INFO msg="Uploading 3 narinfos" lb # [ 70.326125] niks3-server[1045]: 2026/09/20 21:09:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 70.335614] niks3-server[1045]: 2026/09/20 21:09:33 INFO Signed narinfos id=19 count=2 lb # [ 70.340435] niks3-server[1045]: 2026/09/20 21:09:33 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 70.342655] niks3-server[1045]: 2026/09/20 21:09:33 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 70.359820] niks3-server[1045]: 2026/09/20 21:09:33 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 70.369916] niks3-server[1045]: 2026/09/20 21:09:33 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 70.374822] niks3-server[1045]: 2026/09/20 21:09:33 INFO Completed upload id=18 lb # [ 70.376455] niks3-server[1045]: 2026/09/20 21:09:33 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 70.379017] niks3-server[1045]: 2026/09/20 21:09:33 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 70.382352] niks3-server[1045]: 2026/09/20 21:09:33 INFO Completed upload id=19 worker1 # [ 70.439660] nix-grpc-daemon[861]: time=2026-09-20T21:09:34.015Z level=INFO msg="Upload complete. (592ms)" lb # [ 70.384428] niks3-server[1045]: 2026/09/20 21:09:33 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo worker1 # [ 70.456291] nix-grpc-daemon[774]: ts=2026-09-20T21:09:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56404 duration_s=0 paths=2 nar_bytes_in=984 worker1 # [ 70.473067] nix-grpc-daemon[774]: ts=2026-09-20T21:09:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 70.483949] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 70.489900] nix-daemon[835]: reaped child process 948, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker1 # [ 70.506051] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 71.569065] nix-daemon[835]: reaped child process 962, status = succeeded lb # [ 71.657870] envoy[926]: conn peer=[2001:db8:1::1]:41830 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=334 ms=32 lb # [ 71.663199] envoy[926]: conn peer=[2001:db8:1::1]:48586 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3431 tx=1795 ms=2239 lb # [ 71.668335] envoy[926]: conn peer=[2001:db8:1::1]:41856 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=99 lb # [ 71.674276] envoy[926]: conn peer=[2001:db8:1::1]:41844 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3888 tx=1878 ms=2626 lb # [ 71.679352] envoy[926]: conn peer=[2001:db8:1::1]:41872 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4326 tx=2224 ms=2178 lb # [ 71.684377] envoy[926]: conn peer=[2001:db8:1::1]:41882 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=31 worker1 # [ 71.760702] nix-daemon[835]: accepted connection from pid 977, user nix-grpc-daemon (trusted) worker1 # [ 71.782323] nix-daemon[835]: reaped child process 980, status = succeeded lb # [ 71.741784] niks3-server[1045]: 2026/09/20 21:09:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 71.813930] nix-grpc-daemon[861]: time=2026-09-20T21:09:35.387Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 71.777970] niks3-server[1045]: 2026/09/20 21:09:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker1 # [ 71.845915] nix-grpc-daemon[861]: time=2026-09-20T21:09:35.421Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.794847] niks3-server[1045]: 2026/09/20 21:09:35 INFO Signed narinfos id=20 count=1 lb # [ 71.801118] niks3-server[1045]: 2026/09/20 21:09:35 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 71.807372] niks3-server[1045]: 2026/09/20 21:09:35 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 71.816314] niks3-server[1045]: 2026/09/20 21:09:35 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete worker1 # [ 71.873562] nix-grpc-daemon[861]: time=2026-09-20T21:09:35.449Z level=INFO msg="Upload complete. (350ms)" lb # [ 71.820219] niks3-server[1045]: 2026/09/20 21:09:35 INFO Completed upload id=20 lb # [ 71.822904] niks3-server[1045]: 2026/09/20 21:09:35 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker1 # [ 71.885509] nix-grpc-daemon[774]: ts=2026-09-20T21:09:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56404 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker1 # [ 71.905270] nix-daemon[835]: reaped child process 960, status = succeeded client # copying 1 paths... worker1 # [ 71.931696] nix-grpc-daemon[774]: ts=2026-09-20T21:09:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56404 client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 71.927956] nix-grpc-daemon[775]: ts=2026-09-20T21:09:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 71.947973] nix-grpc-daemon[775]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... worker2 # [ 71.974694] nix-grpc-daemon[775]: ts=2026-09-20T21:09:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=0 paths=1 nar_bytes_out=120 client # [ 72.104922] nix-daemon[936]: reaped child process 1022, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.33 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 72.337390] nix-daemon[936]: accepted connection from pid 1041, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 72.585613] nix-grpc-daemon[775]: ts=2026-09-20T21:09:36Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:40582 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 72.593280] nix-grpc-daemon[775]: ts=2026-09-20T21:09:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 72.623684] nix-grpc-daemon[775]: ts=2026-09-20T21:09:36Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 72.632372] nix-grpc-daemon[775]: ts=2026-09-20T21:09:36Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 72.642646] nix-grpc-daemon[775]: ts=2026-09-20T21:09:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 72.658035] nix-grpc-daemon[775]: ts=2026-09-20T21:09:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40582 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 72.684145] nix-grpc-daemon[775]: ts=2026-09-20T21:09:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 72.700905] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 72.726628] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5) worker2 # [ 72.732062] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 115 ms (attempt 2/5) worker2 # [ 72.842106] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 374 ms (attempt 3/5) worker2 # [ 73.225388] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 288 ms (attempt 4/5) worker2 # [ 73.513480] nix-grpc-daemon[775]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 73.524236] nix-grpc-daemon[775]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 73.792658] nix-daemon[856]: accepted connection from pid 1203, user nix-grpc-daemon (trusted) worker2 # [ 73.813813] nix-daemon[856]: reaped child process 1206, status = succeeded worker2 # [ 74.009974] nix-daemon[856]: accepted connection from pid 1208, user nix-grpc-daemon (trusted) worker2 # [ 74.031744] nix-daemon[856]: reaped child process 1211, status = succeeded lb # [ 74.021414] niks3-server[1045]: 2026/09/20 21:09:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 74.054950] nix-grpc-daemon[868]: time=2026-09-20T21:09:37.640Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 74.056739] nix-grpc-daemon[868]: time=2026-09-20T21:09:37.640Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 74.056551] niks3-server[1045]: 2026/09/20 21:09:37 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst lb # [ 74.074701] niks3-server[1045]: 2026/09/20 21:09:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker2 # [ 74.102203] nix-grpc-daemon[868]: time=2026-09-20T21:09:37.688Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.083597] niks3-server[1045]: 2026/09/20 21:09:37 INFO Signed narinfos id=21 count=1 lb # [ 74.092119] niks3-server[1045]: 2026/09/20 21:09:37 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 74.103360] niks3-server[1045]: 2026/09/20 21:09:37 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 74.110230] niks3-server[1045]: 2026/09/20 21:09:37 INFO Completed upload id=21 worker2 # [ 74.131500] nix-grpc-daemon[868]: time=2026-09-20T21:09:37.718Z level=INFO msg="Upload complete. (570ms)" lb # [ 74.113327] niks3-server[1045]: 2026/09/20 21:09:37 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker2 # [ 74.140539] nix-grpc-daemon[775]: ts=2026-09-20T21:09:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=1 paths=1 nar_bytes_in=568 worker2 # [ 74.153343] nix-grpc-daemon[775]: ts=2026-09-20T21:09:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 worker2 # [ 74.171166] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 74.178213] nix-daemon[856]: reaped child process 1197, status = succeeded worker2 # [ 74.189338] nix-grpc-daemon[775]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 74.206563] nix-daemon[856]: accepted connection from pid 775, user nix-grpc-daemon (trusted) worker2 # [ 75.237516] nix-daemon[856]: reaped child process 1216, status = succeeded worker2 # [ 75.429744] nix-daemon[856]: accepted connection from pid 1231, user nix-grpc-daemon (trusted) worker2 # [ 75.454378] nix-daemon[856]: reaped child process 1234, status = succeeded lb # [ 75.450494] niks3-server[1045]: 2026/09/20 21:09:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 75.480672] nix-grpc-daemon[868]: time=2026-09-20T21:09:39.066Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 75.479584] niks3-server[1045]: 2026/09/20 21:09:39 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 75.496592] niks3-server[1045]: 2026/09/20 21:09:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker2 # [ 75.525481] nix-grpc-daemon[868]: time=2026-09-20T21:09:39.111Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.506225] niks3-server[1045]: 2026/09/20 21:09:39 INFO Signed narinfos id=22 count=1 lb # [ 75.518520] niks3-server[1045]: 2026/09/20 21:09:39 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 75.555742] nix-grpc-daemon[868]: time=2026-09-20T21:09:39.142Z level=INFO msg="Upload complete. (333ms)" lb # [ 75.534783] niks3-server[1045]: 2026/09/20 21:09:39 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 75.541495] niks3-server[1045]: 2026/09/20 21:09:39 INFO Completed upload id=22 lb # [ 75.544226] niks3-server[1045]: 2026/09/20 21:09:39 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker2 # [ 75.567151] nix-grpc-daemon[775]: ts=2026-09-20T21:09:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40582 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 client # copying 1 paths... worker1 # [ 75.612970] nix-grpc-daemon[774]: ts=2026-09-20T21:09:39Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56404 worker2 # [ 75.583412] nix-daemon[856]: reaped child process 1213, status = succeeded worker1 # [ 75.628498] nix-grpc-daemon[774]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 75.682932] nix-grpc-daemon[774]: ts=2026-09-20T21:09:39Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 75.688961] nix-grpc-daemon[774]: ts=2026-09-20T21:09:39Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56404 duration_s=0 paths=1 nar_bytes_out=120 client # [ 75.770430] nix-daemon[936]: reaped child process 1044, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.67 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 76.016843] nix-daemon[936]: accepted connection from pid 1063, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 76.277665] nix-grpc-daemon[775]: ts=2026-09-20T21:09:39Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:40582 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 76.318079] nix-grpc-daemon[774]: ts=2026-09-20T21:09:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 76.334260] nix-grpc-daemon[861]: time=2026-09-20T21:09:39.909Z level=INFO msg="All 1 paths already cached" worker2 # [ 76.319154] nix-grpc-daemon[775]: ts=2026-09-20T21:09:39Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 76.327390] nix-grpc-daemon[775]: ts=2026-09-20T21:09:39Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 76.368570] nix-grpc-daemon[774]: ts=2026-09-20T21:09:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 76.386279] nix-grpc-daemon[774]: ts=2026-09-20T21:09:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 76.405294] nix-grpc-daemon[861]: time=2026-09-20T21:09:39.981Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 76.419008] nix-grpc-daemon[774]: ts=2026-09-20T21:09:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 76.435493] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 76.650076] nix-daemon[835]: accepted connection from pid 985, user nix-grpc-daemon (trusted) worker1 # [ 76.675934] nix-daemon[835]: reaped child process 988, status = succeeded worker1 # [ 76.878346] nix-daemon[835]: accepted connection from pid 990, user nix-grpc-daemon (trusted) worker1 # [ 76.899538] nix-daemon[835]: reaped child process 993, status = succeeded lb # [ 76.858087] niks3-server[1045]: 2026/09/20 21:09:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.926276] nix-grpc-daemon[861]: time=2026-09-20T21:09:40.502Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 76.928760] nix-grpc-daemon[861]: time=2026-09-20T21:09:40.504Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 76.894955] niks3-server[1045]: 2026/09/20 21:09:40 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 76.909521] niks3-server[1045]: 2026/09/20 21:09:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker1 # [ 76.974611] nix-grpc-daemon[861]: time=2026-09-20T21:09:40.550Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.921867] niks3-server[1045]: 2026/09/20 21:09:40 INFO Signed narinfos id=23 count=1 lb # [ 76.928088] niks3-server[1045]: 2026/09/20 21:09:40 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 76.935828] niks3-server[1045]: 2026/09/20 21:09:40 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 76.945718] niks3-server[1045]: 2026/09/20 21:09:40 INFO Completed upload id=23 worker1 # [ 77.003531] nix-grpc-daemon[861]: time=2026-09-20T21:09:40.579Z level=INFO msg="Upload complete. (549ms)" lb # [ 76.948536] niks3-server[1045]: 2026/09/20 21:09:40 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker1 # [ 77.013052] nix-grpc-daemon[774]: ts=2026-09-20T21:09:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56404 duration_s=0 paths=1 nar_bytes_in=568 worker1 # [ 77.025596] nix-grpc-daemon[774]: ts=2026-09-20T21:09:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 77.031725] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 77.037091] nix-daemon[835]: reaped child process 983, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 77.052240] nix-daemon[835]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 78.497648] nix-daemon[835]: reaped child process 997, status = succeeded worker1 # [ 78.692290] nix-daemon[835]: accepted connection from pid 1012, user nix-grpc-daemon (trusted) worker1 # [ 78.712382] nix-daemon[835]: reaped child process 1015, status = succeeded lb # [ 78.672906] niks3-server[1045]: 2026/09/20 21:09:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 78.743325] nix-grpc-daemon[861]: time=2026-09-20T21:09:42.318Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" worker1 # [ 78.777719] nix-grpc-daemon[861]: time=2026-09-20T21:09:42.353Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.710558] niks3-server[1045]: 2026/09/20 21:09:42 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 78.727714] niks3-server[1045]: 2026/09/20 21:09:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 78.736991] niks3-server[1045]: 2026/09/20 21:09:42 INFO Signed narinfos id=24 count=1 lb # [ 78.741653] niks3-server[1045]: 2026/09/20 21:09:42 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 78.753570] niks3-server[1045]: 2026/09/20 21:09:42 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 78.761807] niks3-server[1045]: 2026/09/20 21:09:42 INFO Completed upload id=24 worker1 # [ 78.819792] nix-grpc-daemon[861]: time=2026-09-20T21:09:42.395Z level=INFO msg="Upload complete. (355ms)" lb # [ 78.765427] niks3-server[1045]: 2026/09/20 21:09:42 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker1 # [ 78.833461] nix-grpc-daemon[774]: ts=2026-09-20T21:09:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56404 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker1 # [ 78.851133] nix-daemon[835]: reaped child process 995, status = succeeded client # copying 1 paths... worker1 # [ 78.881682] nix-grpc-daemon[774]: ts=2026-09-20T21:09:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56404 client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 78.912998] nix-grpc-daemon[774]: ts=2026-09-20T21:09:42Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56404 worker1 # [ 78.919683] nix-grpc-daemon[774]: ts=2026-09-20T21:09:42Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56404 duration_s=0 paths=1 nar_bytes_out=120 client # [ 79.001104] nix-daemon[936]: reaped child process 1066, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.23 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 11.20 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.51 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.49 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.21 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds) worker2 # [ 80.564866] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 81.171062] nix-grpc-daemon[775]: ts=2026-09-20T21:09:44Z level=info event=signal_exit worker2 # [ 81.415745] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=scheduler_yield worker1 # [ 81.457482] nix-grpc-daemon[774]: ts=2026-09-20T21:09:45Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 81.421793] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:40580 lb # [ 81.401787] niks3-server[1045]: 2026/09/20 21:09:44 INFO lead: released remote=192.168.1.4:33512 worker2 # [ 81.428369] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 81.432530] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 81.438878] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:40580 worker2 # [ 81.443535] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 81.657099] nix-grpc-daemon[774]: ts=2026-09-20T21:09:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.662533] nix-grpc-daemon[774]: ts=2026-09-20T21:09:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.629524] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.635104] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 81.661345] envoy[926]: conn peer=[2001:db8:1::1]:41884 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4219 tx=1768 ms=2763 lb # [ 81.667258] envoy[926]: conn peer=[2001:db8:1::1]:55158 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=115 lb # [ 81.672231] envoy[926]: conn peer=[2001:db8:1::1]:55168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3697 tx=1919 ms=3123 lb # [ 81.678456] envoy[926]: conn peer=[2001:db8:1::1]:55172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=68 lb # [ 81.683331] envoy[926]: conn peer=[2001:db8:1::1]:55174 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3698 tx=1801 ms=2668 lb # [ 81.688297] envoy[926]: conn peer=[2001:db8:1::1]:55178 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=72 worker1 # [ 81.863497] nix-grpc-daemon[774]: ts=2026-09-20T21:09:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.869273] nix-grpc-daemon[774]: ts=2026-09-20T21:09:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.836546] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.841939] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 81.849843] niks3-server[1045]: 2026/09/20 21:09:45 INFO lead: acquired remote=192.168.1.3:52792 worker1 # [ 81.907970] nix-grpc-daemon[774]: ts=2026-09-20T21:09:45Z level=info event=scheduler_take_over worker1 # [ 82.070082] nix-grpc-daemon[774]: ts=2026-09-20T21:09:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.075596] nix-grpc-daemon[774]: ts=2026-09-20T21:09:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.043547] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.049334] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.276672] nix-grpc-daemon[774]: ts=2026-09-20T21:09:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.282736] nix-grpc-daemon[774]: ts=2026-09-20T21:09:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.252421] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.256646] nix-grpc-daemon[775]: ts=2026-09-20T21:09:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.422248] nix-grpc-daemon[775]: ts=2026-09-20T21:09:46Z level=info event=scheduler_restarting worker1 # [ 82.484351] nix-grpc-daemon[774]: ts=2026-09-20T21:09:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.487418] nix-grpc-daemon[774]: ts=2026-09-20T21:09:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.482908] nix-grpc-daemon[775]: ts=2026-09-20T21:09:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 82.496891] nix-daemon[856]: reaped child process 859, status = succeeded worker1 # [ 82.688932] nix-grpc-daemon[774]: ts=2026-09-20T21:09:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.694656] nix-grpc-daemon[774]: ts=2026-09-20T21:09:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.895512] nix-grpc-daemon[774]: ts=2026-09-20T21:09:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.901332] nix-grpc-daemon[774]: ts=2026-09-20T21:09:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.102240] nix-grpc-daemon[774]: ts=2026-09-20T21:09:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.107928] nix-grpc-daemon[774]: ts=2026-09-20T21:09:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.308804] nix-grpc-daemon[774]: ts=2026-09-20T21:09:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.327947] nix-grpc-daemon[774]: ts=2026-09-20T21:09:46Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53566 worker1 # [ 83.334319] nix-grpc-daemon[774]: ts=2026-09-20T21:09:46Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 83.324873] nix-grpc-daemon[775]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 83.329608] nix-grpc-daemon[775]: E0000 00:00:1789938586.910066 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 83.329796] nix-grpc-daemon[775]: E0000 00:00:1789938586.910419 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 83.406102] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 83.436767] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 83.440874] systemd[1]: nix-grpc-daemon.service: Consumed 3.915s CPU time over 1min 1.569s wall clock time, 62.8M memory peak, 90.8K incoming IP traffic, 226.8K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 83.446783] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 83.448858] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 83.450269] systemd[1]: nix-grpc-daemon.socket: Consumed 618us CPU time over 1min 11.878s wall clock time, 256K memory peak, 93K incoming IP traffic, 73.3K outgoing IP traffic. lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 83.849869] nix-grpc-daemon[774]: ts=2026-09-20T21:09:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56404 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker1 # [ 83.858654] nix-grpc-daemon[774]: ts=2026-09-20T21:09:47Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56404 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.32 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 83.970917] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 84.088738] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 84.393453] systemd[1]: Starting scheduler-token.service... worker2 # [ 84.513003] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 84.520833] systemd[1]: Finished scheduler-token.service. worker2 # [ 84.522738] systemd[1]: scheduler-token.service: Consumed 58ms CPU time over 122ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 84.529474] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 84.721761] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 84.724671] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 84.727955] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 84.736903] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 84.738755] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 84.785566] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.825192] nix-grpc-daemon[774]: ts=2026-09-20T21:09:48Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53566 worker1 # [ 84.831703] nix-grpc-daemon[774]: ts=2026-09-20T21:09:48Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 85.064275] nix-grpc-daemon[774]: ts=2026-09-20T21:09:48Z level=info event=signal_exit worker1 # [ 85.331664] nix-grpc-daemon[774]: ts=2026-09-20T21:09:48Z level=info event=scheduler_yield lb # [ 85.277491] niks3-server[1045]: 2026/09/20 21:09:48 INFO lead: released remote=192.168.1.3:52792 worker2 # [ 85.301264] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:48Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 85.343715] nix-grpc-daemon[774]: ts=2026-09-20T21:09:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53566 worker1 # [ 85.350169] nix-grpc-daemon[774]: ts=2026-09-20T21:09:48Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 85.356183] nix-grpc-daemon[774]: ts=2026-09-20T21:09:48Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 85.360152] nix-grpc-daemon[774]: ts=2026-09-20T21:09:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53566 worker1 # [ 85.364527] nix-grpc-daemon[774]: ts=2026-09-20T21:09:48Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 85.503192] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.509077] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.551057] nix-grpc-daemon[774]: ts=2026-09-20T21:09:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.556765] nix-grpc-daemon[774]: ts=2026-09-20T21:09:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.710186] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.715614] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.757974] nix-grpc-daemon[774]: ts=2026-09-20T21:09:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.763435] nix-grpc-daemon[774]: ts=2026-09-20T21:09:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.919005] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.923341] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.964362] nix-grpc-daemon[774]: ts=2026-09-20T21:09:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.969694] nix-grpc-daemon[774]: ts=2026-09-20T21:09:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.120390] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.125802] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.172723] nix-grpc-daemon[774]: ts=2026-09-20T21:09:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 86.176909] nix-grpc-daemon[774]: ts=2026-09-20T21:09:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.337788] nix-grpc-daemon[774]: ts=2026-09-20T21:09:49Z level=info event=scheduler_restarting worker2 # [ 86.327224] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.332859] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.397918] nix-daemon[835]: reaped child process 837, status = succeeded worker1 # [ 86.400700] nix-grpc-daemon[774]: ts=2026-09-20T21:09:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 86.533992] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.539308] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.740460] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.746572] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.950022] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.954427] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.151498] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.157298] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.237622] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 87.242354] nix-grpc-daemon[774]: E0000 00:00:1789938590.811774 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 87.242516] nix-grpc-daemon[774]: E0000 00:00:1789938590.812318 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 87.364623] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 87.394422] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 87.358592] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 87.401045] systemd[1]: nix-grpc-daemon.service: Consumed 2.117s CPU time over 1min 5.643s wall clock time, 51.7M memory peak, 54.4K incoming IP traffic, 96.9K outgoing IP traffic. worker2 # [ 87.364640] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 87.406465] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 87.408693] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 87.410455] systemd[1]: nix-grpc-daemon.socket: Consumed 625us CPU time over 1min 15.817s wall clock time, 256K memory peak, 69.5K incoming IP traffic, 62.1K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 87.565912] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.572729] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.768885] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 87.781722] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.796508] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.809685] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 87.824693] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 49 ms (attempt 1/5) worker2 # [ 87.879725] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 2/5) worker2 # [ 87.914767] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 182 ms (attempt 3/5) worker2 # [ 87.982188] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.986635] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.105096] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 387 ms (attempt 4/5) worker2 # [ 88.183514] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.189347] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.390692] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.396734] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.500994] nix-grpc-daemon[1260]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 88.530190] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45722 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 88.549565] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 88.583505] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:52Z level=info event=niks3_push_started pid=1316 worker2 # [ 88.601612] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.612480] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.809152] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.813541] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.829705] nix-grpc-daemon[1316]: time=2026-09-20T21:09:52.415Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 89.012627] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.016616] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.022360] nix-daemon[856]: accepted connection from pid 1329, user nix-grpc-daemon (trusted) worker2 # [ 89.043305] nix-daemon[856]: reaped child process 1332, status = succeeded lb # [ 89.035119] niks3-server[1045]: 2026/09/20 21:09:52 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 89.045673] niks3-server[1045]: 2026/09/20 21:09:52 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 89.079288] nix-grpc-daemon[1316]: time=2026-09-20T21:09:52.663Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 89.082132] nix-grpc-daemon[1316]: time=2026-09-20T21:09:52.663Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 89.084426] nix-grpc-daemon[1316]: time=2026-09-20T21:09:52.664Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 89.104700] niks3-server[1045]: 2026/09/20 21:09:52 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 89.119671] niks3-server[1045]: 2026/09/20 21:09:52 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 89.131252] niks3-server[1045]: 2026/09/20 21:09:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign worker2 # [ 89.160337] nix-grpc-daemon[1316]: time=2026-09-20T21:09:52.745Z level=INFO msg="Uploading 3 narinfos" lb # [ 89.141780] niks3-server[1045]: 2026/09/20 21:09:52 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 89.149376] niks3-server[1045]: 2026/09/20 21:09:52 INFO Signed narinfos id=25 count=1 lb # [ 89.151452] niks3-server[1045]: 2026/09/20 21:09:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 89.160325] niks3-server[1045]: 2026/09/20 21:09:52 INFO Signed narinfos id=26 count=2 lb # [ 89.162211] niks3-server[1045]: 2026/09/20 21:09:52 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 89.172563] niks3-server[1045]: 2026/09/20 21:09:52 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 89.183092] niks3-server[1045]: 2026/09/20 21:09:52 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 89.188335] niks3-server[1045]: 2026/09/20 21:09:52 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 89.193584] niks3-server[1045]: 2026/09/20 21:09:52 INFO Completed upload id=25 worker2 # [ 89.216562] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:52Z level=info event=scheduler_connected addr=lb:50051 lb # [ 89.197732] niks3-server[1045]: 2026/09/20 21:09:52 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 89.201185] niks3-server[1045]: 2026/09/20 21:09:52 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 89.203399] niks3-server[1045]: 2026/09/20 21:09:52 INFO Completed upload id=26 worker2 # [ 89.225357] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.236525] nix-grpc-daemon[1316]: time=2026-09-20T21:09:52.809Z level=INFO msg="Upload complete. (389ms)" worker2 # [ 89.251696] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45722 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 89.257470] nix-daemon[856]: reaped child process 1314, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.80 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds) worker1 # [ 89.436822] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 89.444323] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 89.423957] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.429636] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.643717] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 89.646509] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 89.650954] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 89.659878] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 89.668818] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 89.630685] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:53Z level=info event=scheduler_connected addr=lb:50051 lb # [ 89.613853] niks3-server[1045]: 2026/09/20 21:09:53 INFO lead: acquired remote=192.168.1.3:51692 worker1 # [ 89.675982] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=scheduler_take_over worker2 # [ 89.637243] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 89.709611] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.712635] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker2 # [ 89.838523] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.844509] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.913933] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.919452] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.046252] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.049423] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.120656] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.126669] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.250855] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.256755] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.327568] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.333424] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.457607] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.510300] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:54Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 90.515342] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:54Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:53670 worker1 # [ 90.520969] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:54Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 90.534175] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.540299] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:54Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:53670 worker1 # [ 90.545617] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:54Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.19 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.81 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 91.173755] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 91.665636] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:55Z level=info event=signal_exit lb # [ 91.664782] envoy[926]: conn peer=[2001:db8:1::4]:47004 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=43011 tx=2671 ms=60287 lb # [ 91.670161] envoy[926]: conn peer=[2001:db8:1::1]:36710 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=27 lb # [ 91.675053] envoy[926]: conn peer=[2001:db8:1::3]:37840 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9677 tx=2641 ms=64287 lb # [ 91.681040] envoy[926]: conn peer=[2001:db8:1::1]:36714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1006 tx=305 ms=1483 worker1 # [ 91.870696] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:55Z level=info event=scheduler_yield lb # [ 91.817505] niks3-server[1045]: 2026/09/20 21:09:55 INFO lead: released remote=192.168.1.3:51692 worker1 # [ 91.880859] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:55Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 91.886612] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53670 worker2 # [ 91.853210] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:55Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 91.892479] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:55Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 91.896504] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:55Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:53670 worker1 # [ 91.900879] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:55Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 92.082185] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.053158] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.090070] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 92.059128] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 92.291237] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.260571] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.299014] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 92.266208] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 92.500215] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.467808] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.505986] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.473818] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.708888] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.675188] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.713552] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.681037] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.876162] nix-grpc-daemon[1038]: ts=2026-09-20T21:09:56Z level=info event=scheduler_restarting worker2 # [ 92.884123] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.888346] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.085212] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.090684] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.291796] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.297331] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.365190] nix-grpc-daemon[1038]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 93.369924] nix-grpc-daemon[1038]: E0000 00:00:1789938596.940938 1081 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 93.378393] nix-grpc-daemon[1038]: E0000 00:00:1789938596.954246 1081 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 93.498383] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.504134] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.697760] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 93.708272] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 93.710764] systemd[1]: nix-grpc-daemon.service: Consumed 233ms CPU time over 4.252s wall clock time, 13.1M memory peak, 10.1K incoming IP traffic, 9.5K outgoing IP traffic. worker1 # [ 93.726430] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 93.729549] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 93.732565] systemd[1]: nix-grpc-daemon.socket: Consumed 1ms CPU time over 4.301s wall clock time, 256K memory peak, 16.1K incoming IP traffic, 11.5K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 93.705215] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.711989] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.10 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2 # [ 93.913950] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 93.917495] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.115461] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.121192] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.322321] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.327876] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.528953] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.534501] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.735260] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.738573] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.761870] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:58Z level=info event=scheduler_take_over lb # [ 94.741475] niks3-server[1045]: 2026/09/20 21:09:58 INFO lead: acquired remote=192.168.1.4:51924 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 94.941807] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:58Z level=info event=scheduler_connected addr=lb:50051 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds) worker2 # [ 94.972454] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:58Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 94.977360] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:58Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:41616 worker2 # [ 94.981438] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:58Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 96.354806] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 96.359886] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 96.388227] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:59Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker2 # [ 96.391932] nix-grpc-daemon[1260]: ts=2026-09-20T21:09:59Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 96.439446] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 96.453738] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45722 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker2 # [ 96.474468] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 96.489964] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 96.704734] nix-daemon[856]: accepted connection from pid 1356, user nix-grpc-daemon (trusted) worker2 # [ 96.730188] nix-daemon[856]: reaped child process 1359, status = succeeded worker2 # [ 96.941533] nix-daemon[856]: accepted connection from pid 1361, user nix-grpc-daemon (trusted) worker2 # [ 96.965318] nix-daemon[856]: reaped child process 1364, status = succeeded lb # [ 96.954996] niks3-server[1045]: 2026/09/20 21:10:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 96.987085] nix-grpc-daemon[1316]: time=2026-09-20T21:10:00.573Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 96.988896] nix-grpc-daemon[1316]: time=2026-09-20T21:10:00.573Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 96.987651] niks3-server[1045]: 2026/09/20 21:10:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 97.009369] niks3-server[1045]: 2026/09/20 21:10:00 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 97.032217] niks3-server[1045]: 2026/09/20 21:10:00 INFO Signed narinfos id=27 count=1 worker2 # [ 97.054472] nix-grpc-daemon[1316]: time=2026-09-20T21:10:00.640Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.055429] niks3-server[1045]: 2026/09/20 21:10:00 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 97.066515] niks3-server[1045]: 2026/09/20 21:10:00 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 97.076353] niks3-server[1045]: 2026/09/20 21:10:00 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo lb # [ 97.083752] niks3-server[1045]: 2026/09/20 21:10:00 INFO Completed upload id=27 worker2 # [ 97.105495] nix-grpc-daemon[1316]: time=2026-09-20T21:10:00.692Z level=INFO msg="Upload complete. (599ms)" worker2 # [ 97.117187] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45722 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 97.132792] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 97.146323] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 97.154717] nix-daemon[856]: reaped child process 1354, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker2 # [ 97.169737] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-on-standby worker2 # [ 98.617097] nix-daemon[856]: reaped child process 1368, status = succeeded worker2 # [ 98.808688] nix-daemon[856]: accepted connection from pid 1383, user nix-grpc-daemon (trusted) worker2 # [ 98.829605] nix-daemon[856]: reaped child process 1386, status = succeeded lb # [ 98.821840] niks3-server[1045]: 2026/09/20 21:10:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 98.862901] nix-grpc-daemon[1316]: time=2026-09-20T21:10:02.447Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 98.864848] nix-grpc-daemon[1316]: time=2026-09-20T21:10:02.447Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 98.874863] niks3-server[1045]: 2026/09/20 21:10:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker2 # [ 98.905248] nix-grpc-daemon[1316]: time=2026-09-20T21:10:02.491Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.893202] niks3-server[1045]: 2026/09/20 21:10:02 INFO Signed narinfos id=28 count=1 lb # [ 98.899585] niks3-server[1045]: 2026/09/20 21:10:02 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 98.908974] niks3-server[1045]: 2026/09/20 21:10:02 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 98.912906] niks3-server[1045]: 2026/09/20 21:10:02 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 98.921776] niks3-server[1045]: 2026/09/20 21:10:02 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 98.926711] niks3-server[1045]: 2026/09/20 21:10:02 INFO Completed upload id=28 worker2 # [ 98.948455] nix-grpc-daemon[1316]: time=2026-09-20T21:10:02.535Z level=INFO msg="Upload complete. (365ms)" lb # [ 98.929429] niks3-server[1045]: 2026/09/20 21:10:02 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker2 # [ 98.972411] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker2 # [ 98.983781] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:02Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker2 # [ 98.987251] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:02Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 98.991072] nix-daemon[856]: reaped child process 1366, status = succeeded worker2 # [ 99.015175] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 99.032556] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 99.048568] nix-grpc-daemon[1316]: time=2026-09-20T21:10:02.635Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker2 # [ 99.060123] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 99.075441] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 99.293214] nix-daemon[856]: accepted connection from pid 1392, user nix-grpc-daemon (trusted) worker2 # [ 99.316067] nix-daemon[856]: reaped child process 1395, status = succeeded worker2 # [ 99.509207] nix-daemon[856]: accepted connection from pid 1397, user nix-grpc-daemon (trusted) worker2 # [ 99.528651] nix-daemon[856]: reaped child process 1400, status = succeeded lb # [ 99.522126] niks3-server[1045]: 2026/09/20 21:10:03 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 99.556705] nix-grpc-daemon[1316]: time=2026-09-20T21:10:03.142Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 99.559188] nix-grpc-daemon[1316]: time=2026-09-20T21:10:03.142Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 99.555236] niks3-server[1045]: 2026/09/20 21:10:03 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 99.571236] niks3-server[1045]: 2026/09/20 21:10:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign worker2 # [ 99.599004] nix-grpc-daemon[1316]: time=2026-09-20T21:10:03.185Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.586928] niks3-server[1045]: 2026/09/20 21:10:03 INFO Signed narinfos id=29 count=1 lb # [ 99.593783] niks3-server[1045]: 2026/09/20 21:10:03 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 99.606266] niks3-server[1045]: 2026/09/20 21:10:03 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 99.612202] niks3-server[1045]: 2026/09/20 21:10:03 INFO Completed upload id=29 worker2 # [ 99.633860] nix-grpc-daemon[1316]: time=2026-09-20T21:10:03.220Z level=INFO msg="Upload complete. (541ms)" lb # [ 99.615600] niks3-server[1045]: 2026/09/20 21:10:03 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker2 # [ 99.645470] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45722 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 99.659912] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 99.671091] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 99.673568] nix-daemon[856]: reaped child process 1390, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker2 # [ 99.689900] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-on-standby worker2 # [ 100.337730] nix-daemon[856]: reaped child process 1404, status = succeeded worker2 # [ 100.550039] nix-daemon[856]: accepted connection from pid 1419, user nix-grpc-daemon (trusted) worker2 # [ 100.572285] nix-daemon[856]: reaped child process 1422, status = succeeded lb # [ 100.570098] niks3-server[1045]: 2026/09/20 21:10:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 100.603565] nix-grpc-daemon[1316]: time=2026-09-20T21:10:04.189Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 100.605615] nix-grpc-daemon[1316]: time=2026-09-20T21:10:04.189Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 100.610956] niks3-server[1045]: 2026/09/20 21:10:04 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst worker2 # [ 100.649850] nix-grpc-daemon[1316]: time=2026-09-20T21:10:04.236Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.628914] niks3-server[1045]: 2026/09/20 21:10:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 100.641554] niks3-server[1045]: 2026/09/20 21:10:04 INFO Signed narinfos id=30 count=1 lb # [ 100.643779] niks3-server[1045]: 2026/09/20 21:10:04 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 100.652833] niks3-server[1045]: 2026/09/20 21:10:04 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker2 # [ 100.683057] nix-grpc-daemon[1316]: time=2026-09-20T21:10:04.269Z level=INFO msg="Upload complete. (381ms)" lb # [ 100.661424] niks3-server[1045]: 2026/09/20 21:10:04 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 100.665046] niks3-server[1045]: 2026/09/20 21:10:04 INFO Completed upload id=30 lb # [ 100.667538] niks3-server[1045]: 2026/09/20 21:10:04 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker2 # [ 100.693332] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker2 # [ 100.709543] nix-daemon[856]: reaped child process 1402, status = succeeded worker2 # [ 100.740146] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:04Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker2 # [ 100.746557] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:04Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 100.795298] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 100.815162] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 100.834338] nix-grpc-daemon[1316]: time=2026-09-20T21:10:04.421Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker2 # [ 100.845507] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 100.861400] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 101.080101] nix-daemon[856]: accepted connection from pid 1428, user nix-grpc-daemon (trusted) worker2 # [ 101.105385] nix-daemon[856]: reaped child process 1431, status = succeeded worker2 # [ 101.308173] nix-daemon[856]: accepted connection from pid 1433, user nix-grpc-daemon (trusted) worker2 # [ 101.329473] nix-daemon[856]: reaped child process 1436, status = succeeded lb # [ 101.324185] niks3-server[1045]: 2026/09/20 21:10:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 101.357357] nix-grpc-daemon[1316]: time=2026-09-20T21:10:04.943Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 101.359125] nix-grpc-daemon[1316]: time=2026-09-20T21:10:04.943Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 101.357325] niks3-server[1045]: 2026/09/20 21:10:04 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst lb # [ 101.373587] niks3-server[1045]: 2026/09/20 21:10:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker2 # [ 101.403359] nix-grpc-daemon[1316]: time=2026-09-20T21:10:04.989Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.387644] niks3-server[1045]: 2026/09/20 21:10:04 INFO Signed narinfos id=31 count=1 lb # [ 101.395918] niks3-server[1045]: 2026/09/20 21:10:04 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 101.407128] niks3-server[1045]: 2026/09/20 21:10:04 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 101.415693] niks3-server[1045]: 2026/09/20 21:10:04 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo lb # [ 101.424151] niks3-server[1045]: 2026/09/20 21:10:04 INFO Completed upload id=31 worker2 # [ 101.445892] nix-grpc-daemon[1316]: time=2026-09-20T21:10:05.032Z level=INFO msg="Upload complete. (565ms)" worker2 # [ 101.455344] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45722 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 101.472393] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 101.478783] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 101.485127] nix-daemon[856]: reaped child process 1426, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... worker2 # [ 101.498749] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 101.666843] envoy[926]: conn peer=[2001:db8:1::3]:42424 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1568 tx=513 ms=3219 client # farm-top> LOG-farm-top-on-standby worker2 # [ 102.537335] nix-daemon[856]: reaped child process 1440, status = succeeded worker2 # [ 102.717529] nix-daemon[856]: accepted connection from pid 1455, user nix-grpc-daemon (trusted) worker2 # [ 102.739736] nix-daemon[856]: reaped child process 1458, status = succeeded lb # [ 102.734322] niks3-server[1045]: 2026/09/20 21:10:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 102.769860] nix-grpc-daemon[1316]: time=2026-09-20T21:10:06.354Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 102.771776] nix-grpc-daemon[1316]: time=2026-09-20T21:10:06.354Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 102.765236] niks3-server[1045]: 2026/09/20 21:10:06 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 102.781646] niks3-server[1045]: 2026/09/20 21:10:06 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 102.786702] niks3-server[1045]: 2026/09/20 21:10:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker2 # [ 102.813797] nix-grpc-daemon[1316]: time=2026-09-20T21:10:06.400Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.796105] niks3-server[1045]: 2026/09/20 21:10:06 INFO Signed narinfos id=32 count=1 lb # [ 102.798804] niks3-server[1045]: 2026/09/20 21:10:06 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 102.808645] niks3-server[1045]: 2026/09/20 21:10:06 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 102.813758] niks3-server[1045]: 2026/09/20 21:10:06 INFO Completed upload id=32 worker2 # [ 102.835318] nix-grpc-daemon[1316]: time=2026-09-20T21:10:06.422Z level=INFO msg="Upload complete. (320ms)" lb # [ 102.816659] niks3-server[1045]: 2026/09/20 21:10:06 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker2 # [ 102.849208] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker2 # [ 102.863426] nix-daemon[856]: reaped child process 1438, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.86 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.25 seconds) worker1 # [ 103.288995] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 103.296913] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 103.503401] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:07Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 103.506008] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:07Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 103.510087] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:07Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 103.518268] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:07Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 103.525584] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 103.568143] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 103.536176] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:07Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:41616 worker2 # [ 103.542064] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:07Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.09 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 103.992246] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 234799375d4648829ce251ff30a1c973 client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds) worker2 # [ 104.281523] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45722 client # [ 104.276469] nix[1167]: don't know how to build these paths: client # [ 104.277709] nix[1167]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 104.302702] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:07Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker2 # [ 104.310297] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:07Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 104.350243] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 104.368365] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45722 client # [ 104.368413] nix[1167]: copying 1 paths to 'lb:50051'... client # [ 104.374206] nix[1167]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker2 # [ 104.386944] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 104.403544] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 104.624601] nix-daemon[856]: accepted connection from pid 1471, user nix-grpc-daemon (trusted) worker2 # [ 104.647998] nix-daemon[856]: reaped child process 1474, status = succeeded worker2 # [ 104.838478] nix-daemon[856]: accepted connection from pid 1476, user nix-grpc-daemon (trusted) worker2 # [ 104.860720] nix-daemon[856]: reaped child process 1479, status = succeeded lb # [ 104.853601] niks3-server[1045]: 2026/09/20 21:10:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 104.885462] nix-grpc-daemon[1316]: time=2026-09-20T21:10:08.471Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 104.886973] nix-grpc-daemon[1316]: time=2026-09-20T21:10:08.471Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 104.885074] niks3-server[1045]: 2026/09/20 21:10:08 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst worker2 # [ 104.929646] nix-grpc-daemon[1316]: time=2026-09-20T21:10:08.516Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.902568] niks3-server[1045]: 2026/09/20 21:10:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 104.915139] niks3-server[1045]: 2026/09/20 21:10:08 INFO Signed narinfos id=33 count=1 lb # [ 104.921925] niks3-server[1045]: 2026/09/20 21:10:08 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 104.934025] niks3-server[1045]: 2026/09/20 21:10:08 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 104.939923] niks3-server[1045]: 2026/09/20 21:10:08 INFO Completed upload id=33 worker2 # [ 104.961533] nix-grpc-daemon[1316]: time=2026-09-20T21:10:08.548Z level=INFO msg="Upload complete. (540ms)" lb # [ 104.942702] niks3-server[1045]: 2026/09/20 21:10:08 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker2 # [ 104.971639] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45722 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 104.981056] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 worker2 # [ 104.993549] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) worker2 # [ 104.998857] nix-daemon[856]: reaped child process 1469, status = succeeded client # [ 104.997473] nix[1167]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker2 # [ 105.014343] nix-daemon[856]: accepted connection from pid 1260, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 107.050073] systemd-journald[273]: Received client request to rotate journal, rotating. worker1 # [ 107.069960] systemd-journald[273]: Vacuuming done, freed 0B of archived journals from /var/log/journal/5c2d0510de1242d19e1f2d15138c1773. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.08 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 107.091471] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds) client: must succeed: sleep 5.0 worker2 # [ 107.759160] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:11Z level=info event=draining lb # [ 111.667725] envoy[926]: conn peer=[2001:db8:1::1]:60468 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9610 tx=3841 ms=6517 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 112.649657] nix-daemon[856]: reaped child process 1483, status = succeeded worker2 # [ 112.851776] nix-daemon[856]: accepted connection from pid 1523, user nix-grpc-daemon (trusted) worker2 # [ 112.879990] nix-daemon[856]: reaped child process 1526, status = succeeded lb # [ 112.874443] niks3-server[1045]: 2026/09/20 21:10:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 112.908849] nix-grpc-daemon[1316]: time=2026-09-20T21:10:16.495Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 112.914595] nix-grpc-daemon[1316]: time=2026-09-20T21:10:16.497Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 112.937862] niks3-server[1045]: 2026/09/20 21:10:16 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 112.948437] niks3-server[1045]: 2026/09/20 21:10:16 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 112.960923] niks3-server[1045]: 2026/09/20 21:10:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 112.965652] niks3-server[1045]: 2026/09/20 21:10:16 INFO Signed narinfos id=34 count=1 worker2 # [ 112.987573] nix-grpc-daemon[1316]: time=2026-09-20T21:10:16.573Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.969142] niks3-server[1045]: 2026/09/20 21:10:16 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 112.982060] niks3-server[1045]: 2026/09/20 21:10:16 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 112.992152] niks3-server[1045]: 2026/09/20 21:10:16 INFO Completed upload id=34 worker2 # [ 113.014066] nix-grpc-daemon[1316]: time=2026-09-20T21:10:16.600Z level=INFO msg="Upload complete. (382ms)" lb # [ 112.996596] niks3-server[1045]: 2026/09/20 21:10:16 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker2 # [ 113.033745] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45722 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 113.053623] nix-daemon[856]: reaped child process 1481, status = succeeded client # [ 113.071009] systemd[1]: rs.service: Deactivated successfully. client # [ 113.076208] systemd[1]: rs.service: Consumed 200ms CPU time over 9.083s wall clock time, 41.2M memory peak, 6.9K incoming IP traffic, 8.2K outgoing IP traffic. worker2 # [ 113.761463] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:17Z level=info event=signal_exit worker2 # [ 113.998710] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:17Z level=info event=scheduler_yield lb # [ 113.981492] niks3-server[1045]: 2026/09/20 21:10:17 INFO lead: released remote=192.168.1.4:51924 worker2 # [ 114.005248] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:17Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 114.042802] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:17Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 114.017190] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:17Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:41616 worker2 # [ 114.023604] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:17Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 114.028296] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:17Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:41616 worker2 # [ 114.033970] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:17Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 114.206674] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.242958] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.212627] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.248980] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.449855] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.413898] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.419507] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.455517] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.656683] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.620912] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.662357] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.626859] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.25 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.08 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } worker1 # [ 114.863306] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.827804] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.869359] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.833565] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2 # [ 115.005385] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:18Z level=info event=scheduler_restarting worker1 # [ 115.072460] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.076503] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.065975] nix-grpc-daemon[1260]: ts=2026-09-20T21:10:18Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 115.071023] nix-daemon[856]: reaped child process 1309, status = succeeded worker1 # [ 115.272725] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.276341] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 115.476946] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.479440] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 115.681330] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.687711] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.769654] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 115.773423] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 115.780853] systemd[1]: nix-grpc-daemon.service: Consumed 2.237s CPU time over 31.236s wall clock time, 36.4M memory peak, 63.1K incoming IP traffic, 160.1K outgoing IP traffic. worker2 # [ 115.802280] systemd[1]: Starting scheduler-token.service... worker1 # [ 115.889054] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 115.895739] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 115.916745] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 115.920879] systemd[1]: Finished scheduler-token.service. worker2 # [ 115.922297] systemd[1]: scheduler-token.service: Consumed 49ms CPU time over 118ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 115.931852] systemd[1]: Starting Nix worker-protocol over gRPC... lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 116.098009] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:19Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1 # [ 116.103726] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 116.113549] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 116.116443] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 116.120886] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 116.130281] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 116.128528] niks3-server[1045]: 2026/09/20 21:10:19 INFO lead: acquired remote=192.168.1.4:51192 worker2 # [ 116.155121] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 116.165721] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:19Z level=info event=scheduler_take_over worker2 # [ 116.181091] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.190250] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:19Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 116.191869] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:19Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:46204 worker2 # [ 116.194169] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 116.270811] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:19Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:46204 worker1 # [ 116.304986] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 116.272948] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.31 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 117.305773] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: edbbfd23e09a432ba891c9f17afc88ab client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds) worker1 # [ 117.645310] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:51822 worker1 # [ 117.661672] nix-daemon[835]: accepted connection from pid 1102, user nix-grpc-daemon (trusted) client # [ 117.633768] nix[1202]: don't know how to build these paths: client # [ 117.635560] nix[1202]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 117.666721] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:21Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 117.672709] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:21Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 117.729895] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46210 worker2 # [ 117.748259] nix-daemon[856]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker2 # [ 117.780474] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 1/5) worker2 # [ 117.800570] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 147 ms (attempt 2/5) worker2 # [ 117.948193] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 397 ms (attempt 3/5) worker2 # [ 118.353524] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 490 ms (attempt 4/5) worker2 # [ 118.853813] nix-grpc-daemon[1536]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 118.878420] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46210 client # [ 118.880965] nix[1202]: copying 1 paths to 'lb:50051'... worker2 # [ 118.898516] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46210 client # [ 118.887881] nix[1202]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 118.921179] nix-daemon[856]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker2 # [ 118.952757] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:22Z level=info event=niks3_push_started pid=1605 worker2 # [ 119.190110] nix-grpc-daemon[1605]: time=2026-09-20T21:10:22.776Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 119.378588] nix-daemon[856]: accepted connection from pid 1618, user nix-grpc-daemon (trusted) worker2 # [ 119.399767] nix-daemon[856]: reaped child process 1621, status = succeeded worker2 # [ 119.590673] nix-daemon[856]: accepted connection from pid 1623, user nix-grpc-daemon (trusted) worker2 # [ 119.610972] nix-daemon[856]: reaped child process 1626, status = succeeded lb # [ 119.603848] niks3-server[1045]: 2026/09/20 21:10:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 119.636106] nix-grpc-daemon[1605]: time=2026-09-20T21:10:23.222Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 119.637719] nix-grpc-daemon[1605]: time=2026-09-20T21:10:23.222Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 119.648557] niks3-server[1045]: 2026/09/20 21:10:23 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 119.684725] nix-grpc-daemon[1605]: time=2026-09-20T21:10:23.270Z level=INFO msg="Uploading 1 narinfos" lb # [ 119.662217] niks3-server[1045]: 2026/09/20 21:10:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 119.675202] niks3-server[1045]: 2026/09/20 21:10:23 INFO Signed narinfos id=35 count=1 lb # [ 119.684341] niks3-server[1045]: 2026/09/20 21:10:23 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 119.695064] niks3-server[1045]: 2026/09/20 21:10:23 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 119.710344] niks3-server[1045]: 2026/09/20 21:10:23 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo lb # [ 119.719622] niks3-server[1045]: 2026/09/20 21:10:23 INFO Completed upload id=35 worker2 # [ 119.741469] nix-grpc-daemon[1605]: time=2026-09-20T21:10:23.328Z level=INFO msg="Upload complete. (546ms)" worker2 # [ 119.752653] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46210 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 119.768636] nix-grpc-daemon[1536]: ts=2026-09-20T21:10:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46210 worker2 # [ 119.779269] nix-daemon[856]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) worker2 # [ 119.786538] nix-daemon[856]: reaped child process 1603, status = succeeded client # [ 119.790949] nix[1202]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 119.810510] nix-daemon[856]: accepted connection from pid 1536, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 121.392986] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1536 (nix-grpc-daemon) on client request. worker2 # [ 121.394974] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 121.389738] niks3-server[1045]: 2026/09/20 21:10:24 INFO lead: released remote=192.168.1.4:51192 client # [ 121.410289] nix[1202]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker2 # [ 121.429508] systemd[1]: Starting scheduler-token.service... worker1 # [ 121.459595] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 121.416945] nix[1202]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 121.448174] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 121.449864] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 121.456285] systemd[1]: nix-grpc-daemon.service: Consumed 558ms CPU time over 5.513s wall clock time, 34.2M memory peak, 13.6K incoming IP traffic, 17.7K outgoing IP traffic. worker2 # [ 121.479726] nix-daemon[856]: reaped child process 1628, status = succeeded worker2 # [ 121.481725] nix-daemon[856]: reaped child process 1594, status = succeeded worker2 # [ 121.492607] nix-daemon[1633]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 121.504455] nix-daemon[856]: reaped child process 1633, status = failed with exit code 1 worker2 # [ 121.543081] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 121.546240] systemd[1]: Finished scheduler-token.service. worker2 # [ 121.547104] systemd[1]: scheduler-token.service: Consumed 29ms CPU time over 115ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 121.552412] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker2 # [ 121.555522] systemd[1]: Starting scheduler-token.service... worker1 # [ 121.659539] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 121.637434] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 121.642486] systemd[1]: Finished scheduler-token.service. worker2 # [ 121.643805] systemd[1]: scheduler-token.service: Consumed 27ms CPU time over 83ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 121.648512] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 121.667277] envoy[926]: conn peer=[2001:db8:1::1]:59212 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2953 tx=1352 ms=8764 lb # [ 121.672629] envoy[926]: conn peer=[2001:db8:1::4]:34418 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=35491 tx=2101 ms=30262 lb # [ 121.677914] envoy[926]: conn peer=[2001:db8:1::4]:56896 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1101 tx=226 ms=5248 worker2 # [ 121.833077] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 121.836821] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 121.839446] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 121.848070] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 121.849929] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 121.842986] niks3-server[1045]: 2026/09/20 21:10:25 INFO lead: acquired remote=192.168.1.4:53676 worker2 # [ 121.870393] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=info event=scheduler_take_over worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.52 seconds) client: must succeed: sleep 5.0 worker2 # [ 121.884715] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:40902 worker2 # [ 121.886610] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 121.899348] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 121.905386] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 121.907142] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:40902 worker2 # [ 121.909040] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 121.932076] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 121.934174] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:25Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 122.020189] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51822 worker1 # [ 122.041012] nix-grpc-daemon[1102]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 1/5) worker1 # [ 122.051983] nix-grpc-daemon[1102]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 2/5) worker1 # [ 122.112808] nix-grpc-daemon[1102]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 268 ms (attempt 3/5) worker1 # [ 122.388408] nix-grpc-daemon[1102]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 176 ms (attempt 4/5) worker1 # [ 122.566592] nix-grpc-daemon[1102]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 122.588698] nix-grpc-daemon[1102]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'... worker1 # [ 122.627621] nix-daemon[835]: accepted connection from pid 1102, user nix-grpc-daemon (trusted) client # [ 122.597536] nix[1202]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker1 # [ 122.648346] nix-daemon[835]: accepted connection from pid 1102, user nix-grpc-daemon (trusted) client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1 # [ 127.271963] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:30Z level=info event=niks3_push_started pid=1253 worker1 # [ 127.294016] nix-daemon[835]: reaped child process 1229, status = succeeded client: waiting for success: ! systemctl is-active mid worker1 # [ 127.490319] nix-grpc-daemon[1253]: time=2026-09-20T21:10:31.065Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 127.675116] nix-daemon[835]: accepted connection from pid 1266, user nix-grpc-daemon (trusted) worker1 # [ 127.697681] nix-daemon[835]: reaped child process 1269, status = succeeded lb # [ 127.657496] niks3-server[1045]: 2026/09/20 21:10:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 127.728121] nix-grpc-daemon[1253]: time=2026-09-20T21:10:31.302Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 127.729745] nix-grpc-daemon[1253]: time=2026-09-20T21:10:31.302Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 127.722302] niks3-server[1045]: 2026/09/20 21:10:31 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 127.810570] nix-grpc-daemon[1253]: time=2026-09-20T21:10:31.384Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.750602] niks3-server[1045]: 2026/09/20 21:10:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 127.759653] niks3-server[1045]: 2026/09/20 21:10:31 INFO Signed narinfos id=36 count=1 lb # [ 127.769014] niks3-server[1045]: 2026/09/20 21:10:31 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 127.790620] niks3-server[1045]: 2026/09/20 21:10:31 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 127.805592] niks3-server[1045]: 2026/09/20 21:10:31 INFO Completed upload id=36 worker1 # [ 127.863738] nix-grpc-daemon[1253]: time=2026-09-20T21:10:31.439Z level=INFO msg="Upload complete. (368ms)" lb # [ 127.810153] niks3-server[1045]: 2026/09/20 21:10:31 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo lb # [ 127.821670] niks3-server[1045]: 2026/09/20 21:10:31 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls worker1 # [ 127.880281] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51822 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 127.902021] nix-daemon[835]: reaped child process 1227, status = succeeded client # [ 127.882855] systemd[1]: mid.service: Deactivated successfully. client # [ 127.888257] systemd[1]: mid.service: Consumed 216ms CPU time over 10.581s wall clock time, 41.2M memory peak, 8.1K incoming IP traffic, 9.8K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.16 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.24 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 128.517155] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: e84eadf60b194e8d956a74460566c519 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) worker1 # [ 128.818747] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:51822 client # [ 128.778428] nix[1237]: don't know how to build these paths: client # [ 128.779452] nix[1237]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 128.805505] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:32Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker2 # [ 128.812311] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:32Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 128.865103] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 128.880239] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 128.906205] nix-grpc-daemon[1672]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 1/5) worker2 # [ 128.958635] nix-grpc-daemon[1672]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 2/5) worker2 # [ 129.012595] nix-grpc-daemon[1672]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 3/5) worker2 # [ 129.019979] nix-grpc-daemon[1672]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 461 ms (attempt 4/5) worker2 # [ 129.481799] nix-grpc-daemon[1672]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 129.504360] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40924 client # [ 129.508201] nix[1237]: copying 1 paths to 'lb:50051'... worker2 # [ 129.521791] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 client # [ 129.508514] nix[1237]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker2 # [ 129.539733] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 129.571242] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:33Z level=info event=niks3_push_started pid=1744 worker2 # [ 129.790314] nix-grpc-daemon[1744]: time=2026-09-20T21:10:33.376Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 129.988620] nix-daemon[856]: accepted connection from pid 1757, user nix-grpc-daemon (trusted) worker2 # [ 130.007452] nix-daemon[856]: reaped child process 1764, status = succeeded worker2 # [ 130.196323] nix-daemon[856]: accepted connection from pid 1766, user nix-grpc-daemon (trusted) worker2 # [ 130.215980] nix-daemon[856]: reaped child process 1769, status = succeeded lb # [ 130.213808] niks3-server[1045]: 2026/09/20 21:10:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 130.251079] nix-grpc-daemon[1744]: time=2026-09-20T21:10:33.836Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 130.252969] nix-grpc-daemon[1744]: time=2026-09-20T21:10:33.836Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 130.261846] niks3-server[1045]: 2026/09/20 21:10:33 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst worker2 # [ 130.295828] nix-grpc-daemon[1744]: time=2026-09-20T21:10:33.881Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.273365] niks3-server[1045]: 2026/09/20 21:10:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 130.285719] niks3-server[1045]: 2026/09/20 21:10:33 INFO Signed narinfos id=37 count=1 lb # [ 130.292536] niks3-server[1045]: 2026/09/20 21:10:33 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 130.304673] niks3-server[1045]: 2026/09/20 21:10:33 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 130.315449] niks3-server[1045]: 2026/09/20 21:10:33 INFO Completed upload id=37 lb # [ 130.318433] niks3-server[1045]: 2026/09/20 21:10:33 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker2 # [ 130.337107] nix-grpc-daemon[1744]: time=2026-09-20T21:10:33.923Z level=INFO msg="Upload complete. (542ms)" worker2 # [ 130.350510] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 130.367671] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 130.374494] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 130.381747] nix-daemon[856]: reaped child process 1742, status = succeeded client # [ 130.380770] nix[1237]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker2 # [ 130.396210] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) lb # [ 131.666630] envoy[926]: conn peer=[2001:db8:1::1]:35084 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3841 tx=1658 ms=10264 client: must succeed: systemctl kill -s INT intr worker2 # [ 132.275914] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:35Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 132.262319] systemd[1]: intr.service: Sent signal SIGINT to main process 1237 (nix) on client request. client # [ 132.265519] nix[1237]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds) client # [ 132.277127] nix[1237]: error: interrupted by the user client # [ 132.312560] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 132.317509] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 132.319847] systemd[1]: intr.service: Consumed 168ms CPU time over 3.798s wall clock time, 41.2M memory peak, 6.2K incoming IP traffic, 8K outgoing IP traffic. worker2 # [ 132.444496] nix-daemon[1773]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 132.448525] nix-daemon[856]: reaped child process 1771, status = succeeded worker2 # [ 132.456136] nix-daemon[856]: reaped child process 1773, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.98 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 132.514016] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 231b9a5f67f0402895064c1ba1d1a228 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds) client # [ 132.788068] nix[1257]: don't know how to build these paths: client # [ 132.789043] nix[1257]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker1 # [ 132.835371] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:51822 worker2 # [ 132.810171] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:36Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 132.817278] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:36Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 132.898778] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51822 worker1 # [ 132.915556] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51822 client # [ 132.880154] nix[1257]: copying 1 paths to 'lb:50051'... worker1 # [ 132.931594] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51822 client # [ 132.885695] nix[1257]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 132.946995] nix-daemon[835]: accepted connection from pid 1102, user nix-grpc-daemon (trusted) worker1 # [ 133.167169] nix-daemon[835]: accepted connection from pid 1297, user nix-grpc-daemon (trusted) worker1 # [ 133.189072] nix-daemon[835]: reaped child process 1300, status = succeeded worker1 # [ 133.366981] nix-daemon[835]: accepted connection from pid 1302, user nix-grpc-daemon (trusted) worker1 # [ 133.385447] nix-daemon[835]: reaped child process 1305, status = succeeded lb # [ 133.342878] niks3-server[1045]: 2026/09/20 21:10:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.412185] nix-grpc-daemon[1253]: time=2026-09-20T21:10:36.987Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 133.413672] nix-grpc-daemon[1253]: time=2026-09-20T21:10:36.987Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 133.377921] niks3-server[1045]: 2026/09/20 21:10:36 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker1 # [ 133.445534] nix-grpc-daemon[1253]: time=2026-09-20T21:10:37.021Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.390547] niks3-server[1045]: 2026/09/20 21:10:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 133.402264] niks3-server[1045]: 2026/09/20 21:10:36 INFO Signed narinfos id=38 count=1 lb # [ 133.412162] niks3-server[1045]: 2026/09/20 21:10:36 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls worker1 # [ 133.474993] nix-grpc-daemon[1253]: time=2026-09-20T21:10:37.050Z level=INFO msg="Upload complete. (510ms)" lb # [ 133.417789] niks3-server[1045]: 2026/09/20 21:10:36 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 133.422365] niks3-server[1045]: 2026/09/20 21:10:36 INFO Completed upload id=38 lb # [ 133.425566] niks3-server[1045]: 2026/09/20 21:10:36 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker1 # [ 133.483939] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:51822 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 133.495466] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51822 worker1 # [ 133.502994] nix-daemon[835]: accepted connection from pid 1102, user nix-grpc-daemon (trusted) worker1 # [ 133.508717] nix-daemon[835]: reaped child process 1295, status = succeeded client # [ 133.470082] nix[1257]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker1 # [ 133.524265] nix-daemon[835]: accepted connection from pid 1102, user nix-grpc-daemon (trusted) worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 135.293616] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 135.340973] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 worker1 # [ 135.535994] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:39Z level=info event=draining client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 135.676747] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:51822 worker2 # [ 135.636799] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 135.663685] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:39Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 135.671192] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:39Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 135.714498] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 135.731209] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40924 client # copying 1 paths to 'lb:50051'... worker2 # [ 135.749148] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker2 # [ 135.774153] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 135.987098] nix-daemon[856]: accepted connection from pid 1823, user nix-grpc-daemon (trusted) worker2 # [ 136.010165] nix-daemon[856]: reaped child process 1826, status = succeeded worker2 # [ 136.194637] nix-daemon[856]: accepted connection from pid 1828, user nix-grpc-daemon (trusted) worker2 # [ 136.214891] nix-daemon[856]: reaped child process 1831, status = succeeded lb # [ 136.205459] niks3-server[1045]: 2026/09/20 21:10:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 136.238799] nix-grpc-daemon[1744]: time=2026-09-20T21:10:39.824Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 136.240509] nix-grpc-daemon[1744]: time=2026-09-20T21:10:39.824Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 136.239568] niks3-server[1045]: 2026/09/20 21:10:39 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker2 # [ 136.280871] nix-grpc-daemon[1744]: time=2026-09-20T21:10:39.867Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.259099] niks3-server[1045]: 2026/09/20 21:10:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 136.268296] niks3-server[1045]: 2026/09/20 21:10:39 INFO Signed narinfos id=39 count=1 lb # [ 136.277069] niks3-server[1045]: 2026/09/20 21:10:39 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 136.287432] niks3-server[1045]: 2026/09/20 21:10:39 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 136.297409] niks3-server[1045]: 2026/09/20 21:10:39 INFO Completed upload id=39 lb # [ 136.301575] niks3-server[1045]: 2026/09/20 21:10:39 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker2 # [ 136.316781] nix-grpc-daemon[1744]: time=2026-09-20T21:10:39.903Z level=INFO msg="Upload complete. (524ms)" worker2 # [ 136.329679] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 136.343454] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 136.350521] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 136.355931] nix-daemon[856]: reaped child process 1821, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker2 # [ 136.371801] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-during-drain worker2 # [ 137.200289] nix-daemon[856]: reaped child process 1835, status = succeeded worker2 # [ 137.372172] nix-daemon[856]: accepted connection from pid 1850, user nix-grpc-daemon (trusted) worker2 # [ 137.393175] nix-daemon[856]: reaped child process 1853, status = succeeded lb # [ 137.383753] niks3-server[1045]: 2026/09/20 21:10:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 137.419666] nix-grpc-daemon[1744]: time=2026-09-20T21:10:41.003Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 137.422041] nix-grpc-daemon[1744]: time=2026-09-20T21:10:41.003Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 137.450995] niks3-server[1045]: 2026/09/20 21:10:41 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 137.462105] niks3-server[1045]: 2026/09/20 21:10:41 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 137.471214] niks3-server[1045]: 2026/09/20 21:10:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 137.476425] niks3-server[1045]: 2026/09/20 21:10:41 INFO Signed narinfos id=40 count=1 worker2 # [ 137.497870] nix-grpc-daemon[1744]: time=2026-09-20T21:10:41.083Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.480294] niks3-server[1045]: 2026/09/20 21:10:41 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 137.490015] niks3-server[1045]: 2026/09/20 21:10:41 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 137.497142] niks3-server[1045]: 2026/09/20 21:10:41 INFO Completed upload id=40 worker2 # [ 137.516444] nix-grpc-daemon[1744]: time=2026-09-20T21:10:41.103Z level=INFO msg="Upload complete. (333ms)" lb # [ 137.499383] niks3-server[1045]: 2026/09/20 21:10:41 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker2 # [ 137.535460] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker2 # [ 137.552209] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:41Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker2 # [ 137.555941] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:41Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 137.559702] nix-daemon[856]: reaped child process 1833, status = succeeded worker2 # [ 137.588199] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 137.605176] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 137.620559] nix-grpc-daemon[1744]: time=2026-09-20T21:10:41.207Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 137.631682] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker2 # [ 137.655427] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 137.871183] nix-daemon[856]: accepted connection from pid 1859, user nix-grpc-daemon (trusted) worker2 # [ 137.893256] nix-daemon[856]: reaped child process 1862, status = succeeded worker2 # [ 138.072628] nix-daemon[856]: accepted connection from pid 1864, user nix-grpc-daemon (trusted) worker2 # [ 138.094396] nix-daemon[856]: reaped child process 1867, status = succeeded lb # [ 138.083767] niks3-server[1045]: 2026/09/20 21:10:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 138.114084] nix-grpc-daemon[1744]: time=2026-09-20T21:10:41.701Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 138.116353] nix-grpc-daemon[1744]: time=2026-09-20T21:10:41.702Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 138.113090] niks3-server[1045]: 2026/09/20 21:10:41 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst lb # [ 138.128493] niks3-server[1045]: 2026/09/20 21:10:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker2 # [ 138.156080] nix-grpc-daemon[1744]: time=2026-09-20T21:10:41.742Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.141019] niks3-server[1045]: 2026/09/20 21:10:41 INFO Signed narinfos id=41 count=1 lb # [ 138.148547] niks3-server[1045]: 2026/09/20 21:10:41 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 138.159466] niks3-server[1045]: 2026/09/20 21:10:41 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete worker2 # [ 138.186564] nix-grpc-daemon[1744]: time=2026-09-20T21:10:41.773Z level=INFO msg="Upload complete. (512ms)" lb # [ 138.165832] niks3-server[1045]: 2026/09/20 21:10:41 INFO Completed upload id=41 lb # [ 138.170415] niks3-server[1045]: 2026/09/20 21:10:41 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker2 # [ 138.197466] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 138.211878] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 138.218291] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 138.223248] nix-daemon[856]: reaped child process 1857, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... worker2 # [ 138.236962] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv client # farm-b> LOG-farm-b-during-drain worker2 # [ 139.080766] nix-daemon[856]: reaped child process 1871, status = succeeded worker2 # [ 139.259876] nix-daemon[856]: accepted connection from pid 1886, user nix-grpc-daemon (trusted) worker2 # [ 139.280580] nix-daemon[856]: reaped child process 1889, status = succeeded lb # [ 139.270921] niks3-server[1045]: 2026/09/20 21:10:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 139.303283] nix-grpc-daemon[1744]: time=2026-09-20T21:10:42.889Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 139.305050] nix-grpc-daemon[1744]: time=2026-09-20T21:10:42.889Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 139.309954] niks3-server[1045]: 2026/09/20 21:10:42 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 139.322732] niks3-server[1045]: 2026/09/20 21:10:42 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 139.332949] niks3-server[1045]: 2026/09/20 21:10:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker2 # [ 139.361092] nix-grpc-daemon[1744]: time=2026-09-20T21:10:42.947Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.339182] niks3-server[1045]: 2026/09/20 21:10:42 INFO Signed narinfos id=42 count=1 lb # [ 139.343960] niks3-server[1045]: 2026/09/20 21:10:42 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 139.357556] niks3-server[1045]: 2026/09/20 21:10:42 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 139.363774] niks3-server[1045]: 2026/09/20 21:10:42 INFO Completed upload id=42 worker2 # [ 139.384510] nix-grpc-daemon[1744]: time=2026-09-20T21:10:42.971Z level=INFO msg="Upload complete. (334ms)" lb # [ 139.366922] niks3-server[1045]: 2026/09/20 21:10:42 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 139.403153] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker2 # [ 139.418961] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:42Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker2 # [ 139.422939] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:42Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 139.426727] nix-daemon[856]: reaped child process 1869, status = succeeded worker2 # [ 139.450662] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 139.473558] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 139.489840] nix-grpc-daemon[1744]: time=2026-09-20T21:10:43.076Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 139.501374] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker2 # [ 139.525007] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 139.743834] nix-daemon[856]: accepted connection from pid 1895, user nix-grpc-daemon (trusted) worker2 # [ 139.764203] nix-daemon[856]: reaped child process 1898, status = succeeded worker2 # [ 139.941987] nix-daemon[856]: accepted connection from pid 1900, user nix-grpc-daemon (trusted) worker2 # [ 139.962480] nix-daemon[856]: reaped child process 1903, status = succeeded lb # [ 139.952383] niks3-server[1045]: 2026/09/20 21:10:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 139.984067] nix-grpc-daemon[1744]: time=2026-09-20T21:10:43.570Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 139.985724] nix-grpc-daemon[1744]: time=2026-09-20T21:10:43.570Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 139.982759] niks3-server[1045]: 2026/09/20 21:10:43 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst worker2 # [ 140.018860] nix-grpc-daemon[1744]: time=2026-09-20T21:10:43.605Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.998258] niks3-server[1045]: 2026/09/20 21:10:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 140.009474] niks3-server[1045]: 2026/09/20 21:10:43 INFO Signed narinfos id=43 count=1 lb # [ 140.016982] niks3-server[1045]: 2026/09/20 21:10:43 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 140.024491] niks3-server[1045]: 2026/09/20 21:10:43 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete worker2 # [ 140.051969] nix-grpc-daemon[1744]: time=2026-09-20T21:10:43.638Z level=INFO msg="Upload complete. (508ms)" lb # [ 140.033483] niks3-server[1045]: 2026/09/20 21:10:43 INFO Completed upload id=43 lb # [ 140.037757] niks3-server[1045]: 2026/09/20 21:10:43 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker2 # [ 140.058901] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 140.074419] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 140.081254] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 140.086901] nix-daemon[856]: reaped child process 1893, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 140.102262] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-during-drain worker2 # [ 141.351674] nix-daemon[856]: reaped child process 1907, status = succeeded worker2 # [ 141.544570] nix-daemon[856]: accepted connection from pid 1922, user nix-grpc-daemon (trusted) worker2 # [ 141.562646] nix-daemon[856]: reaped child process 1925, status = succeeded lb # [ 141.558492] niks3-server[1045]: 2026/09/20 21:10:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 141.590580] nix-grpc-daemon[1744]: time=2026-09-20T21:10:45.175Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 141.593561] nix-grpc-daemon[1744]: time=2026-09-20T21:10:45.175Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 141.605210] niks3-server[1045]: 2026/09/20 21:10:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker2 # [ 141.636041] nix-grpc-daemon[1744]: time=2026-09-20T21:10:45.222Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.614980] niks3-server[1045]: 2026/09/20 21:10:45 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 141.621637] niks3-server[1045]: 2026/09/20 21:10:45 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 141.630030] niks3-server[1045]: 2026/09/20 21:10:45 INFO Signed narinfos id=44 count=1 lb # [ 141.633649] niks3-server[1045]: 2026/09/20 21:10:45 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 141.640701] niks3-server[1045]: 2026/09/20 21:10:45 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 141.647933] niks3-server[1045]: 2026/09/20 21:10:45 INFO Completed upload id=44 worker2 # [ 141.668844] nix-grpc-daemon[1744]: time=2026-09-20T21:10:45.255Z level=INFO msg="Upload complete. (354ms)" lb # [ 141.651127] niks3-server[1045]: 2026/09/20 21:10:45 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker2 # [ 141.680639] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 lb # [ 141.666652] envoy[926]: conn peer=[2001:db8:1::1]:47166 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2931 tx=733 ms=3523 lb # [ 141.670873] envoy[926]: conn peer=[2001:db8:1::1]:46796 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9569 tx=3877 ms=6062 worker2 # [ 141.696954] nix-daemon[856]: reaped child process 1905, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.37 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 142.158954] nix-daemon[835]: reaped child process 1309, status = succeeded worker1 # [ 142.323345] nix-daemon[835]: accepted connection from pid 1350, user nix-grpc-daemon (trusted) worker1 # [ 142.343891] nix-daemon[835]: reaped child process 1353, status = succeeded lb # [ 142.297394] niks3-server[1045]: 2026/09/20 21:10:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 142.365962] nix-grpc-daemon[1253]: time=2026-09-20T21:10:45.941Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 142.368387] nix-grpc-daemon[1253]: time=2026-09-20T21:10:45.943Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 142.339910] niks3-server[1045]: 2026/09/20 21:10:45 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 142.349572] niks3-server[1045]: 2026/09/20 21:10:45 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst worker1 # [ 142.419126] nix-grpc-daemon[1253]: time=2026-09-20T21:10:45.994Z level=INFO msg="Uploading 1 narinfos" lb # [ 142.363376] niks3-server[1045]: 2026/09/20 21:10:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 142.370833] niks3-server[1045]: 2026/09/20 21:10:45 INFO Signed narinfos id=45 count=1 lb # [ 142.373797] niks3-server[1045]: 2026/09/20 21:10:45 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 142.379860] niks3-server[1045]: 2026/09/20 21:10:45 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 142.384254] niks3-server[1045]: 2026/09/20 21:10:45 INFO Completed upload id=45 worker1 # [ 142.441541] nix-grpc-daemon[1253]: time=2026-09-20T21:10:46.017Z level=INFO msg="Upload complete. (299ms)" lb # [ 142.386834] niks3-server[1045]: 2026/09/20 21:10:45 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker1 # [ 142.453012] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:51822 duration_s=8 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 142.468794] nix-daemon[835]: reaped child process 1307, status = succeeded client # [ 142.446342] systemd[1]: sw.service: Deactivated successfully. client # [ 142.450926] systemd[1]: sw.service: Consumed 189ms CPU time over 9.935s wall clock time, 41.2M memory peak, 6.7K incoming IP traffic, 8.1K outgoing IP traffic. worker1 # [ 142.537305] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:46Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.13 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker1 # [ 143.777670] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:47Z level=info event=scheduler_restarting worker2 # [ 143.740664] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:47Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:40902 worker2 # [ 143.741045] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:47Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 143.802487] nix-grpc-daemon[1102]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 143.809015] nix-grpc-daemon[1102]: E0000 00:00:1789938647.378026 1145 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 143.816420] nix-grpc-daemon[1102]: E0000 00:00:1789938647.378217 1145 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 143.823770] nix-grpc-daemon[1102]: ts=2026-09-20T21:10:47Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 143.846272] nix-daemon[835]: reaped child process 1205, status = succeeded worker1 # [ 144.044947] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 144.047950] systemd[1]: nix-grpc-daemon.service: Consumed 983ms CPU time over 40.746s wall clock time, 33M memory peak, 23.9K incoming IP traffic, 34K outgoing IP traffic. worker1 # [ 144.071495] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 144.276593] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 144.278670] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 144.282970] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 144.290735] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 144.298679] systemd[1]: Started Nix worker-protocol over gRPC. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.04 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 144.337848] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.303952] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:47Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:40902 worker2 # [ 144.306738] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.13 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 145.905296] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 145.920873] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker2 # [ 145.907322] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 145.954198] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:49Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker2 # [ 145.960367] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:49Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 145.966268] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:49Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker2 # [ 145.971959] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:49Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 146.038075] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 146.058498] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 27 ms (attempt 1/5) worker1 # [ 146.093104] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 2/5) worker1 # [ 146.198155] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 3/5) worker1 # [ 146.304767] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 775 ms (attempt 4/5) worker1 # [ 147.081915] nix-grpc-daemon[1367]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 147.104874] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 147.120148] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 147.137025] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 147.166770] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:50Z level=info event=niks3_push_started pid=1423 worker1 # [ 147.379908] nix-grpc-daemon[1423]: time=2026-09-20T21:10:50.955Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 147.559267] nix-daemon[835]: accepted connection from pid 1436, user nix-grpc-daemon (trusted) worker1 # [ 147.576722] nix-daemon[835]: reaped child process 1439, status = succeeded worker1 # [ 147.760208] nix-daemon[835]: accepted connection from pid 1441, user nix-grpc-daemon (trusted) worker1 # [ 147.777606] nix-daemon[835]: reaped child process 1444, status = succeeded lb # [ 147.735688] niks3-server[1045]: 2026/09/20 21:10:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.806013] nix-grpc-daemon[1423]: time=2026-09-20T21:10:51.380Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 147.807754] nix-grpc-daemon[1423]: time=2026-09-20T21:10:51.380Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 147.773797] niks3-server[1045]: 2026/09/20 21:10:51 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 147.846526] nix-grpc-daemon[1423]: time=2026-09-20T21:10:51.422Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.788671] niks3-server[1045]: 2026/09/20 21:10:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 147.800267] niks3-server[1045]: 2026/09/20 21:10:51 INFO Signed narinfos id=46 count=1 lb # [ 147.807633] niks3-server[1045]: 2026/09/20 21:10:51 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 147.822451] niks3-server[1045]: 2026/09/20 21:10:51 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete worker1 # [ 147.886023] nix-grpc-daemon[1423]: time=2026-09-20T21:10:51.461Z level=INFO msg="Upload complete. (502ms)" lb # [ 147.830285] niks3-server[1045]: 2026/09/20 21:10:51 INFO Completed upload id=46 lb # [ 147.833116] niks3-server[1045]: 2026/09/20 21:10:51 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 147.896388] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 147.908907] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 147.920762] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 147.926016] nix-daemon[835]: reaped child process 1421, status = succeeded worker1 # [ 147.939715] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 149.191545] nix-daemon[835]: reaped child process 1448, status = succeeded worker1 # [ 149.379324] nix-daemon[835]: accepted connection from pid 1463, user nix-grpc-daemon (trusted) worker1 # [ 149.399630] nix-daemon[835]: reaped child process 1466, status = succeeded lb # [ 149.355066] niks3-server[1045]: 2026/09/20 21:10:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.424425] nix-grpc-daemon[1423]: time=2026-09-20T21:10:52.998Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 149.425939] nix-grpc-daemon[1423]: time=2026-09-20T21:10:52.998Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 149.402824] niks3-server[1045]: 2026/09/20 21:10:52 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 149.419479] niks3-server[1045]: 2026/09/20 21:10:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 149.485155] nix-grpc-daemon[1423]: time=2026-09-20T21:10:53.059Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.430527] niks3-server[1045]: 2026/09/20 21:10:52 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 149.439331] niks3-server[1045]: 2026/09/20 21:10:52 INFO Signed narinfos id=47 count=1 lb # [ 149.443888] niks3-server[1045]: 2026/09/20 21:10:53 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls worker1 # [ 149.511007] nix-grpc-daemon[1423]: time=2026-09-20T21:10:53.086Z level=INFO msg="Upload complete. (359ms)" lb # [ 149.453859] niks3-server[1045]: 2026/09/20 21:10:53 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 149.458145] niks3-server[1045]: 2026/09/20 21:10:53 INFO Completed upload id=47 lb # [ 149.461724] niks3-server[1045]: 2026/09/20 21:10:53 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker2 # [ 149.485325] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:53Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 149.525079] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=1 worker2 # [ 149.499628] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:53Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 149.541423] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 149.547479] nix-daemon[835]: reaped child process 1446, status = succeeded worker1 # [ 149.555886] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 149.569281] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 149.582121] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 149.777167] nix-daemon[835]: accepted connection from pid 1470, user nix-grpc-daemon (trusted) worker1 # [ 149.796777] nix-daemon[835]: reaped child process 1473, status = succeeded worker1 # [ 149.972385] nix-daemon[835]: accepted connection from pid 1475, user nix-grpc-daemon (trusted) worker1 # [ 149.990424] nix-daemon[835]: reaped child process 1478, status = succeeded lb # [ 149.945630] niks3-server[1045]: 2026/09/20 21:10:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.012061] nix-grpc-daemon[1423]: time=2026-09-20T21:10:53.588Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.014173] nix-grpc-daemon[1423]: time=2026-09-20T21:10:53.589Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 149.976151] niks3-server[1045]: 2026/09/20 21:10:53 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 150.048132] nix-grpc-daemon[1423]: time=2026-09-20T21:10:53.623Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.992315] niks3-server[1045]: 2026/09/20 21:10:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 150.005052] niks3-server[1045]: 2026/09/20 21:10:53 INFO Signed narinfos id=48 count=1 lb # [ 150.012089] niks3-server[1045]: 2026/09/20 21:10:53 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 150.021009] niks3-server[1045]: 2026/09/20 21:10:53 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete worker1 # [ 150.083169] nix-grpc-daemon[1423]: time=2026-09-20T21:10:53.659Z level=INFO msg="Upload complete. (487ms)" lb # [ 150.026113] niks3-server[1045]: 2026/09/20 21:10:53 INFO Completed upload id=48 lb # [ 150.030150] niks3-server[1045]: 2026/09/20 21:10:53 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 150.092290] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 150.104831] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 150.111055] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 150.116578] nix-daemon[835]: reaped child process 1468, status = succeeded worker1 # [ 150.131009] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 151.184671] nix-daemon[835]: reaped child process 1482, status = succeeded worker1 # [ 151.366325] nix-daemon[835]: accepted connection from pid 1497, user nix-grpc-daemon (trusted) worker1 # [ 151.384534] nix-daemon[835]: reaped child process 1500, status = succeeded lb # [ 151.339101] niks3-server[1045]: 2026/09/20 21:10:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.407556] nix-grpc-daemon[1423]: time=2026-09-20T21:10:54.983Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.410079] nix-grpc-daemon[1423]: time=2026-09-20T21:10:54.985Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 151.385156] niks3-server[1045]: 2026/09/20 21:10:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 151.454629] nix-grpc-daemon[1423]: time=2026-09-20T21:10:55.030Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.402589] niks3-server[1045]: 2026/09/20 21:10:54 INFO Signed narinfos id=49 count=1 lb # [ 151.411416] niks3-server[1045]: 2026/09/20 21:10:54 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 151.425858] niks3-server[1045]: 2026/09/20 21:10:54 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker1 # [ 151.488342] nix-grpc-daemon[1423]: time=2026-09-20T21:10:55.064Z level=INFO msg="Upload complete. (345ms)" lb # [ 151.431383] niks3-server[1045]: 2026/09/20 21:10:54 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 151.435253] niks3-server[1045]: 2026/09/20 21:10:54 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 151.439791] niks3-server[1045]: 2026/09/20 21:10:54 INFO Completed upload id=49 lb # [ 151.442786] niks3-server[1045]: 2026/09/20 21:10:54 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker2 # [ 151.463547] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:55Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 151.502059] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=1 worker2 # [ 151.477339] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:55Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 151.523291] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 151.529672] nix-daemon[835]: reaped child process 1480, status = succeeded worker1 # [ 151.533333] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 151.545807] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 151.559481] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) lb # [ 151.667123] envoy[926]: conn peer=[2001:db8:1::1]:46782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2935 tx=1309 ms=9632 lb # [ 151.672405] envoy[926]: conn peer=[2001:db8:1::3]:60328 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2527 tx=862 ms=40232 worker1 # [ 151.753990] nix-daemon[835]: accepted connection from pid 1504, user nix-grpc-daemon (trusted) worker1 # [ 151.773029] nix-daemon[835]: reaped child process 1507, status = succeeded worker1 # [ 151.954376] nix-daemon[835]: accepted connection from pid 1509, user nix-grpc-daemon (trusted) worker1 # [ 151.973130] nix-daemon[835]: reaped child process 1512, status = succeeded lb # [ 151.926729] niks3-server[1045]: 2026/09/20 21:10:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.996965] nix-grpc-daemon[1423]: time=2026-09-20T21:10:55.572Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.998473] nix-grpc-daemon[1423]: time=2026-09-20T21:10:55.572Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 151.957522] niks3-server[1045]: 2026/09/20 21:10:55 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 151.973725] niks3-server[1045]: 2026/09/20 21:10:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker1 # [ 152.038207] nix-grpc-daemon[1423]: time=2026-09-20T21:10:55.613Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.987304] niks3-server[1045]: 2026/09/20 21:10:55 INFO Signed narinfos id=50 count=1 lb # [ 151.994904] niks3-server[1045]: 2026/09/20 21:10:55 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 152.005836] niks3-server[1045]: 2026/09/20 21:10:55 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 152.010591] niks3-server[1045]: 2026/09/20 21:10:55 INFO Completed upload id=50 worker1 # [ 152.068002] nix-grpc-daemon[1423]: time=2026-09-20T21:10:55.643Z level=INFO msg="Upload complete. (495ms)" lb # [ 152.013438] niks3-server[1045]: 2026/09/20 21:10:55 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 152.076368] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 152.090638] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 152.098354] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 152.103442] nix-daemon[835]: reaped child process 1502, status = succeeded worker1 # [ 152.118262] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 153.163087] nix-daemon[835]: reaped child process 1516, status = succeeded worker1 # [ 153.354856] nix-daemon[835]: accepted connection from pid 1531, user nix-grpc-daemon (trusted) worker1 # [ 153.372914] nix-daemon[835]: reaped child process 1534, status = succeeded lb # [ 153.327972] niks3-server[1045]: 2026/09/20 21:10:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.399888] nix-grpc-daemon[1423]: time=2026-09-20T21:10:56.973Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 153.401815] nix-grpc-daemon[1423]: time=2026-09-20T21:10:56.973Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 153.366734] niks3-server[1045]: 2026/09/20 21:10:56 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 153.381823] niks3-server[1045]: 2026/09/20 21:10:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 153.444994] nix-grpc-daemon[1423]: time=2026-09-20T21:10:57.020Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.392875] niks3-server[1045]: 2026/09/20 21:10:56 INFO Signed narinfos id=51 count=1 lb # [ 153.394960] niks3-server[1045]: 2026/09/20 21:10:56 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker1 # [ 153.464000] nix-grpc-daemon[1423]: time=2026-09-20T21:10:57.039Z level=INFO msg="Upload complete. (335ms)" lb # [ 153.407357] niks3-server[1045]: 2026/09/20 21:10:56 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 153.410070] niks3-server[1045]: 2026/09/20 21:10:56 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 153.414708] niks3-server[1045]: 2026/09/20 21:10:56 INFO Completed upload id=51 lb # [ 153.416776] niks3-server[1045]: 2026/09/20 21:10:56 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker2 # [ 153.437276] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:57Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 153.476926] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=1 worker2 # [ 153.451074] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:57Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 153.492165] nix-daemon[835]: reaped child process 1514, status = succeeded worker1 # [ 153.530685] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 153.550032] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 153.566538] nix-grpc-daemon[1423]: time=2026-09-20T21:10:57.142Z level=INFO msg="All 1 paths already cached" worker1 # [ 153.576097] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 153.590571] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 153.800779] nix-daemon[835]: accepted connection from pid 1538, user nix-grpc-daemon (trusted) worker1 # [ 153.819092] nix-daemon[835]: reaped child process 1541, status = succeeded worker1 # [ 154.000602] nix-daemon[835]: accepted connection from pid 1543, user nix-grpc-daemon (trusted) worker1 # [ 154.019652] nix-daemon[835]: reaped child process 1546, status = succeeded lb # [ 153.974808] niks3-server[1045]: 2026/09/20 21:10:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.045176] nix-grpc-daemon[1423]: time=2026-09-20T21:10:57.620Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 154.046675] nix-grpc-daemon[1423]: time=2026-09-20T21:10:57.620Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 154.008164] niks3-server[1045]: 2026/09/20 21:10:57 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 154.073561] nix-grpc-daemon[1423]: time=2026-09-20T21:10:57.649Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.017052] niks3-server[1045]: 2026/09/20 21:10:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 154.019828] niks3-server[1045]: 2026/09/20 21:10:57 INFO Signed narinfos id=52 count=1 lb # [ 154.028669] niks3-server[1045]: 2026/09/20 21:10:57 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 154.037327] niks3-server[1045]: 2026/09/20 21:10:57 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 154.042130] niks3-server[1045]: 2026/09/20 21:10:57 INFO Completed upload id=52 worker1 # [ 154.099440] nix-grpc-daemon[1423]: time=2026-09-20T21:10:57.675Z level=INFO msg="Upload complete. (490ms)" lb # [ 154.044158] niks3-server[1045]: 2026/09/20 21:10:57 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 154.106946] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 154.118611] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 154.123757] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 154.128451] nix-daemon[835]: reaped child process 1536, status = succeeded worker1 # [ 154.141285] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 155.362761] nix-daemon[835]: reaped child process 1550, status = succeeded worker1 # [ 155.525578] nix-daemon[835]: accepted connection from pid 1565, user nix-grpc-daemon (trusted) worker1 # [ 155.543336] nix-daemon[835]: reaped child process 1568, status = succeeded lb # [ 155.498108] niks3-server[1045]: 2026/09/20 21:10:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.568047] nix-grpc-daemon[1423]: time=2026-09-20T21:10:59.141Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 155.569513] nix-grpc-daemon[1423]: time=2026-09-20T21:10:59.141Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 155.541586] niks3-server[1045]: 2026/09/20 21:10:59 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst worker1 # [ 155.611404] nix-grpc-daemon[1423]: time=2026-09-20T21:10:59.187Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.556236] niks3-server[1045]: 2026/09/20 21:10:59 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 155.566797] niks3-server[1045]: 2026/09/20 21:10:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 155.571293] niks3-server[1045]: 2026/09/20 21:10:59 INFO Signed narinfos id=53 count=1 lb # [ 155.578182] niks3-server[1045]: 2026/09/20 21:10:59 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 155.582926] niks3-server[1045]: 2026/09/20 21:10:59 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete worker1 # [ 155.646377] nix-grpc-daemon[1423]: time=2026-09-20T21:10:59.222Z level=INFO msg="Upload complete. (295ms)" lb # [ 155.590554] niks3-server[1045]: 2026/09/20 21:10:59 INFO Completed upload id=53 lb # [ 155.594772] niks3-server[1045]: 2026/09/20 21:10:59 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker2 # [ 155.618197] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:59Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 155.656935] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=1 worker2 # [ 155.631379] nix-grpc-daemon[1672]: ts=2026-09-20T21:10:59Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 155.673931] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 155.679374] nix-daemon[835]: reaped child process 1548, status = succeeded worker1 # [ 155.686944] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 155.698635] nix-grpc-daemon[1423]: time=2026-09-20T21:10:59.274Z level=INFO msg="All 1 paths already cached" worker1 # [ 155.706321] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 155.717590] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 155.906697] nix-daemon[835]: accepted connection from pid 1572, user nix-grpc-daemon (trusted) worker1 # [ 155.924370] nix-daemon[835]: reaped child process 1575, status = succeeded worker1 # [ 156.098784] nix-daemon[835]: accepted connection from pid 1577, user nix-grpc-daemon (trusted) worker1 # [ 156.115871] nix-daemon[835]: reaped child process 1580, status = succeeded lb # [ 156.069790] niks3-server[1045]: 2026/09/20 21:10:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.136669] nix-grpc-daemon[1423]: time=2026-09-20T21:10:59.712Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 156.138154] nix-grpc-daemon[1423]: time=2026-09-20T21:10:59.712Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 156.099185] niks3-server[1045]: 2026/09/20 21:10:59 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 156.115132] niks3-server[1045]: 2026/09/20 21:10:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 156.179043] nix-grpc-daemon[1423]: time=2026-09-20T21:10:59.754Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.127641] niks3-server[1045]: 2026/09/20 21:10:59 INFO Signed narinfos id=54 count=1 lb # [ 156.136098] niks3-server[1045]: 2026/09/20 21:10:59 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 156.142642] niks3-server[1045]: 2026/09/20 21:10:59 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 156.148345] niks3-server[1045]: 2026/09/20 21:10:59 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo lb # [ 156.153018] niks3-server[1045]: 2026/09/20 21:10:59 INFO Completed upload id=54 worker1 # [ 156.210875] nix-grpc-daemon[1423]: time=2026-09-20T21:10:59.786Z level=INFO msg="Upload complete. (480ms)" worker1 # [ 156.219117] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 156.233663] nix-grpc-daemon[1367]: ts=2026-09-20T21:10:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 156.240502] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 156.246010] nix-daemon[835]: reaped child process 1570, status = succeeded worker1 # [ 156.258314] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 157.687411] nix-daemon[835]: reaped child process 1584, status = succeeded worker1 # [ 157.847233] nix-daemon[835]: accepted connection from pid 1599, user nix-grpc-daemon (trusted) worker1 # [ 157.865780] nix-daemon[835]: reaped child process 1602, status = succeeded lb # [ 157.823144] niks3-server[1045]: 2026/09/20 21:11:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.894958] nix-grpc-daemon[1423]: time=2026-09-20T21:11:01.467Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 157.896551] nix-grpc-daemon[1423]: time=2026-09-20T21:11:01.467Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 157.863764] niks3-server[1045]: 2026/09/20 21:11:01 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 157.874323] niks3-server[1045]: 2026/09/20 21:11:01 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 157.888549] niks3-server[1045]: 2026/09/20 21:11:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 157.952520] nix-grpc-daemon[1423]: time=2026-09-20T21:11:01.528Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.899173] niks3-server[1045]: 2026/09/20 21:11:01 INFO Signed narinfos id=55 count=1 lb # [ 157.904665] niks3-server[1045]: 2026/09/20 21:11:01 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 157.912482] niks3-server[1045]: 2026/09/20 21:11:01 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 157.918227] niks3-server[1045]: 2026/09/20 21:11:01 INFO Completed upload id=55 worker1 # [ 157.976104] nix-grpc-daemon[1423]: time=2026-09-20T21:11:01.552Z level=INFO msg="Upload complete. (303ms)" lb # [ 157.920744] niks3-server[1045]: 2026/09/20 21:11:01 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker2 # [ 157.951872] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:01Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 157.988616] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=1 worker2 # [ 157.961077] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:01Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 158.005628] nix-daemon[835]: reaped child process 1582, status = succeeded worker1 # [ 158.034195] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 158.049318] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 158.063859] nix-grpc-daemon[1423]: time=2026-09-20T21:11:01.639Z level=INFO msg="All 1 paths already cached" worker1 # [ 158.072904] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 158.087195] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 158.288054] nix-daemon[835]: accepted connection from pid 1606, user nix-grpc-daemon (trusted) worker1 # [ 158.305846] nix-daemon[835]: reaped child process 1609, status = succeeded worker1 # [ 158.476917] nix-daemon[835]: accepted connection from pid 1611, user nix-grpc-daemon (trusted) worker1 # [ 158.494032] nix-daemon[835]: reaped child process 1614, status = succeeded lb # [ 158.448694] niks3-server[1045]: 2026/09/20 21:11:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.515534] nix-grpc-daemon[1423]: time=2026-09-20T21:11:02.091Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.517146] nix-grpc-daemon[1423]: time=2026-09-20T21:11:02.091Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 158.478057] niks3-server[1045]: 2026/09/20 21:11:02 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 158.491109] niks3-server[1045]: 2026/09/20 21:11:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker1 # [ 158.554325] nix-grpc-daemon[1423]: time=2026-09-20T21:11:02.130Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.502671] niks3-server[1045]: 2026/09/20 21:11:02 INFO Signed narinfos id=56 count=1 lb # [ 158.508604] niks3-server[1045]: 2026/09/20 21:11:02 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 158.515233] niks3-server[1045]: 2026/09/20 21:11:02 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 158.521631] niks3-server[1045]: 2026/09/20 21:11:02 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo lb # [ 158.526914] niks3-server[1045]: 2026/09/20 21:11:02 INFO Completed upload id=56 worker1 # [ 158.584700] nix-grpc-daemon[1423]: time=2026-09-20T21:11:02.160Z level=INFO msg="Upload complete. (478ms)" worker1 # [ 158.592937] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 158.605748] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 158.611765] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 158.616837] nix-daemon[835]: reaped child process 1604, status = succeeded worker1 # [ 158.630587] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 159.477008] nix-daemon[835]: reaped child process 1618, status = succeeded worker1 # [ 159.661806] nix-daemon[835]: accepted connection from pid 1633, user nix-grpc-daemon (trusted) worker1 # [ 159.678565] nix-daemon[835]: reaped child process 1636, status = succeeded lb # [ 159.633260] niks3-server[1045]: 2026/09/20 21:11:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.703472] nix-grpc-daemon[1423]: time=2026-09-20T21:11:03.276Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 159.705343] nix-grpc-daemon[1423]: time=2026-09-20T21:11:03.276Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 159.671418] niks3-server[1045]: 2026/09/20 21:11:03 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 159.681584] niks3-server[1045]: 2026/09/20 21:11:03 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 159.691357] niks3-server[1045]: 2026/09/20 21:11:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 159.753811] nix-grpc-daemon[1423]: time=2026-09-20T21:11:03.329Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.700592] niks3-server[1045]: 2026/09/20 21:11:03 INFO Signed narinfos id=57 count=1 lb # [ 159.702722] niks3-server[1045]: 2026/09/20 21:11:03 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 159.710682] niks3-server[1045]: 2026/09/20 21:11:03 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 159.716926] niks3-server[1045]: 2026/09/20 21:11:03 INFO Completed upload id=57 worker1 # [ 159.774649] nix-grpc-daemon[1423]: time=2026-09-20T21:11:03.350Z level=INFO msg="Upload complete. (333ms)" lb # [ 159.719380] niks3-server[1045]: 2026/09/20 21:11:03 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker2 # [ 159.747497] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:03Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.787332] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=1 worker2 # [ 159.761447] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:03Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 159.807462] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 159.812945] nix-daemon[835]: reaped child process 1616, status = succeeded worker1 # [ 159.821121] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 159.834588] nix-grpc-daemon[1423]: time=2026-09-20T21:11:03.410Z level=INFO msg="All 2 paths already cached" worker1 # [ 159.843073] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 159.855906] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 160.055358] nix-daemon[835]: accepted connection from pid 1640, user nix-grpc-daemon (trusted) worker1 # [ 160.075125] nix-daemon[835]: reaped child process 1643, status = succeeded worker1 # [ 160.248532] nix-daemon[835]: accepted connection from pid 1645, user nix-grpc-daemon (trusted) worker1 # [ 160.265266] nix-daemon[835]: reaped child process 1648, status = succeeded lb # [ 160.218625] niks3-server[1045]: 2026/09/20 21:11:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.285359] nix-grpc-daemon[1423]: time=2026-09-20T21:11:03.861Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 160.286811] nix-grpc-daemon[1423]: time=2026-09-20T21:11:03.861Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 160.248652] niks3-server[1045]: 2026/09/20 21:11:03 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 160.322290] nix-grpc-daemon[1423]: time=2026-09-20T21:11:03.898Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.264769] niks3-server[1045]: 2026/09/20 21:11:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 160.276929] niks3-server[1045]: 2026/09/20 21:11:03 INFO Signed narinfos id=58 count=1 lb # [ 160.283308] niks3-server[1045]: 2026/09/20 21:11:03 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls worker1 # [ 160.349894] nix-grpc-daemon[1423]: time=2026-09-20T21:11:03.925Z level=INFO msg="Upload complete. (480ms)" lb # [ 160.294218] niks3-server[1045]: 2026/09/20 21:11:03 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete worker1 # [ 160.356055] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 160.300323] niks3-server[1045]: 2026/09/20 21:11:03 INFO Completed upload id=58 lb # [ 160.304153] niks3-server[1045]: 2026/09/20 21:11:03 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 160.369678] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 160.377998] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 160.380732] nix-daemon[835]: reaped child process 1638, status = succeeded worker1 # [ 160.393786] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 161.438215] nix-daemon[835]: reaped child process 1652, status = succeeded worker1 # [ 161.621961] nix-daemon[835]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker1 # [ 161.639517] nix-daemon[835]: reaped child process 1670, status = succeeded lb # [ 161.594503] niks3-server[1045]: 2026/09/20 21:11:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.662957] nix-grpc-daemon[1423]: time=2026-09-20T21:11:05.237Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.665163] nix-grpc-daemon[1423]: time=2026-09-20T21:11:05.237Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 161.631946] niks3-server[1045]: 2026/09/20 21:11:05 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 161.644592] niks3-server[1045]: 2026/09/20 21:11:05 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 161.654407] niks3-server[1045]: 2026/09/20 21:11:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker1 # [ 161.718104] nix-grpc-daemon[1423]: time=2026-09-20T21:11:05.293Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.663922] niks3-server[1045]: 2026/09/20 21:11:05 INFO Signed narinfos id=59 count=1 lb # [ 161.670766] niks3-server[1045]: 2026/09/20 21:11:05 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 161.678251] niks3-server[1045]: 2026/09/20 21:11:05 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 161.686346] niks3-server[1045]: 2026/09/20 21:11:05 INFO Completed upload id=59 worker1 # [ 161.743283] nix-grpc-daemon[1423]: time=2026-09-20T21:11:05.319Z level=INFO msg="Upload complete. (339ms)" lb # [ 161.689359] niks3-server[1045]: 2026/09/20 21:11:05 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker2 # [ 161.717200] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:05Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 161.757142] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=1 worker1 # [ 161.773906] nix-daemon[835]: reaped child process 1650, status = succeeded worker1 # [ 161.805932] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 161.821589] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 161.836617] nix-grpc-daemon[1423]: time=2026-09-20T21:11:05.412Z level=INFO msg="All 2 paths already cached" worker1 # [ 161.845903] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 161.860145] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 162.054921] nix-daemon[835]: accepted connection from pid 1674, user nix-grpc-daemon (trusted) worker1 # [ 162.073630] nix-daemon[835]: reaped child process 1677, status = succeeded worker1 # [ 162.248329] nix-daemon[835]: accepted connection from pid 1679, user nix-grpc-daemon (trusted) worker1 # [ 162.263735] nix-daemon[835]: reaped child process 1682, status = succeeded lb # [ 162.220261] niks3-server[1045]: 2026/09/20 21:11:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.287929] nix-grpc-daemon[1423]: time=2026-09-20T21:11:05.863Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 162.289639] nix-grpc-daemon[1423]: time=2026-09-20T21:11:05.863Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 162.249181] niks3-server[1045]: 2026/09/20 21:11:05 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst lb # [ 162.262802] niks3-server[1045]: 2026/09/20 21:11:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign worker1 # [ 162.326689] nix-grpc-daemon[1423]: time=2026-09-20T21:11:05.902Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.273099] niks3-server[1045]: 2026/09/20 21:11:05 INFO Signed narinfos id=60 count=1 lb # [ 162.275864] niks3-server[1045]: 2026/09/20 21:11:05 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 162.286078] niks3-server[1045]: 2026/09/20 21:11:05 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 162.293289] niks3-server[1045]: 2026/09/20 21:11:05 INFO Completed upload id=60 worker1 # [ 162.350987] nix-grpc-daemon[1423]: time=2026-09-20T21:11:05.926Z level=INFO msg="Upload complete. (474ms)" lb # [ 162.296256] niks3-server[1045]: 2026/09/20 21:11:05 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 162.360241] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 162.371327] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 162.378434] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 162.383234] nix-daemon[835]: reaped child process 1672, status = succeeded worker1 # [ 162.394638] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 163.442352] nix-daemon[835]: reaped child process 1686, status = succeeded worker1 # [ 163.615912] nix-daemon[835]: accepted connection from pid 1701, user nix-grpc-daemon (trusted) worker1 # [ 163.631300] nix-daemon[835]: reaped child process 1704, status = succeeded lb # [ 163.589624] niks3-server[1045]: 2026/09/20 21:11:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.657778] nix-grpc-daemon[1423]: time=2026-09-20T21:11:07.232Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.659609] nix-grpc-daemon[1423]: time=2026-09-20T21:11:07.232Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 163.626733] niks3-server[1045]: 2026/09/20 21:11:07 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 163.638843] niks3-server[1045]: 2026/09/20 21:11:07 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 163.648190] niks3-server[1045]: 2026/09/20 21:11:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 163.711186] nix-grpc-daemon[1423]: time=2026-09-20T21:11:07.286Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.655555] niks3-server[1045]: 2026/09/20 21:11:07 INFO Signed narinfos id=61 count=1 lb # [ 163.661475] niks3-server[1045]: 2026/09/20 21:11:07 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 163.668099] niks3-server[1045]: 2026/09/20 21:11:07 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 163.676686] niks3-server[1045]: 2026/09/20 21:11:07 INFO Completed upload id=61 worker1 # [ 163.733888] nix-grpc-daemon[1423]: time=2026-09-20T21:11:07.309Z level=INFO msg="Upload complete. (327ms)" lb # [ 163.679605] niks3-server[1045]: 2026/09/20 21:11:07 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker2 # [ 163.708859] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:07Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 163.745127] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=1 worker1 # [ 163.765410] nix-daemon[835]: reaped child process 1684, status = succeeded worker1 # [ 163.789776] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 163.804873] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 163.819836] nix-grpc-daemon[1423]: time=2026-09-20T21:11:07.395Z level=INFO msg="All 2 paths already cached" worker1 # [ 163.828795] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 163.842211] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 164.037554] nix-daemon[835]: accepted connection from pid 1708, user nix-grpc-daemon (trusted) worker1 # [ 164.055551] nix-daemon[835]: reaped child process 1711, status = succeeded worker1 # [ 164.231942] nix-daemon[835]: accepted connection from pid 1713, user nix-grpc-daemon (trusted) worker1 # [ 164.250130] nix-daemon[835]: reaped child process 1716, status = succeeded lb # [ 164.208438] niks3-server[1045]: 2026/09/20 21:11:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.277018] nix-grpc-daemon[1423]: time=2026-09-20T21:11:07.852Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 164.278511] nix-grpc-daemon[1423]: time=2026-09-20T21:11:07.852Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 164.238476] niks3-server[1045]: 2026/09/20 21:11:07 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst lb # [ 164.253348] niks3-server[1045]: 2026/09/20 21:11:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 164.317380] nix-grpc-daemon[1423]: time=2026-09-20T21:11:07.893Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.264346] niks3-server[1045]: 2026/09/20 21:11:07 INFO Signed narinfos id=62 count=1 lb # [ 164.267511] niks3-server[1045]: 2026/09/20 21:11:07 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 164.279488] niks3-server[1045]: 2026/09/20 21:11:07 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 164.285885] niks3-server[1045]: 2026/09/20 21:11:07 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo lb # [ 164.291505] niks3-server[1045]: 2026/09/20 21:11:07 INFO Completed upload id=62 worker1 # [ 164.349326] nix-grpc-daemon[1423]: time=2026-09-20T21:11:07.925Z level=INFO msg="Upload complete. (491ms)" worker1 # [ 164.357893] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 164.371953] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 worker1 # [ 164.378566] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 164.383338] nix-daemon[835]: reaped child process 1706, status = succeeded worker1 # [ 164.397091] nix-daemon[835]: accepted connection from pid 1367, user nix-grpc-daemon (trusted) worker1 # [ 165.634174] nix-daemon[835]: reaped child process 1720, status = succeeded worker1 # [ 165.813186] nix-daemon[835]: accepted connection from pid 1735, user nix-grpc-daemon (trusted) worker1 # [ 165.831198] nix-daemon[835]: reaped child process 1738, status = succeeded lb # [ 165.786131] niks3-server[1045]: 2026/09/20 21:11:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.856426] nix-grpc-daemon[1423]: time=2026-09-20T21:11:09.429Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.857905] nix-grpc-daemon[1423]: time=2026-09-20T21:11:09.429Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 165.821523] niks3-server[1045]: 2026/09/20 21:11:09 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 165.834609] niks3-server[1045]: 2026/09/20 21:11:09 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst worker1 # [ 165.906474] nix-grpc-daemon[1423]: time=2026-09-20T21:11:09.482Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.848518] niks3-server[1045]: 2026/09/20 21:11:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 165.858134] niks3-server[1045]: 2026/09/20 21:11:09 INFO Signed narinfos id=63 count=1 lb # [ 165.864447] niks3-server[1045]: 2026/09/20 21:11:09 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 165.871782] niks3-server[1045]: 2026/09/20 21:11:09 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 165.878662] niks3-server[1045]: 2026/09/20 21:11:09 INFO Completed upload id=63 worker1 # [ 165.936570] nix-grpc-daemon[1423]: time=2026-09-20T21:11:09.512Z level=INFO msg="Upload complete. (328ms)" lb # [ 165.882662] niks3-server[1045]: 2026/09/20 21:11:09 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 165.949023] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42762 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=1 worker1 # [ 165.962745] nix-daemon[835]: reaped child process 1718, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.44 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 166.162408] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 35de7de818d4444bb76a5aaa99ebf7ee client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client # [ 166.417134] nix[1336]: don't know how to build these paths: client # [ 166.418096] nix[1336]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker2 # [ 166.429258] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 166.435814] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40924 client # [ 166.446145] nix[1336]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker worker2 # [ 166.458544] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:10Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 171.669544] envoy[926]: conn peer=[2001:db8:1::1]:47116 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27088 tx=10830 ms=20107 client # [ 196.450232] nix[1336]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu} client # [ 196.467814] nix[1336]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 196.509399] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 196.517114] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 196.520368] systemd[1]: gpu.service: Consumed 184ms CPU time over 30.352s wall clock time, 37.5M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.26 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 51.55 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.13 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 198.321682] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:41Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 worker1 # [ 198.625400] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42762 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 198.637662] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42762 worker2 # [ 198.634509] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:42Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 198.635397] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:42Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 198.679138] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 198.695265] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40924 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 198.710723] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 198.726539] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 198.944555] nix-daemon[856]: accepted connection from pid 1959, user nix-grpc-daemon (trusted) worker2 # [ 198.962430] nix-daemon[856]: reaped child process 1962, status = succeeded worker2 # [ 199.137124] nix-daemon[856]: accepted connection from pid 1964, user nix-grpc-daemon (trusted) worker2 # [ 199.153349] nix-daemon[856]: reaped child process 1967, status = succeeded lb # [ 199.146684] niks3-server[1045]: 2026/09/20 21:11:42 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 199.179974] nix-grpc-daemon[1744]: time=2026-09-20T21:11:42.765Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 199.181642] nix-grpc-daemon[1744]: time=2026-09-20T21:11:42.766Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 199.178618] niks3-server[1045]: 2026/09/20 21:11:42 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 199.198993] niks3-server[1045]: 2026/09/20 21:11:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker2 # [ 199.226014] nix-grpc-daemon[1744]: time=2026-09-20T21:11:42.812Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.208703] niks3-server[1045]: 2026/09/20 21:11:42 INFO Signed narinfos id=64 count=1 lb # [ 199.215399] niks3-server[1045]: 2026/09/20 21:11:42 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 199.223355] niks3-server[1045]: 2026/09/20 21:11:42 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 199.229374] niks3-server[1045]: 2026/09/20 21:11:42 INFO Completed upload id=64 worker2 # [ 199.249541] nix-grpc-daemon[1744]: time=2026-09-20T21:11:42.836Z level=INFO msg="Upload complete. (500ms)" lb # [ 199.231510] niks3-server[1045]: 2026/09/20 21:11:42 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 199.259284] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 199.271398] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 199.280975] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 199.283845] nix-daemon[856]: reaped child process 1957, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 199.297803] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 200.118380] nix-daemon[856]: reaped child process 1971, status = succeeded client # farm-a> LOG-farm-a-drain worker2 # [ 200.282630] nix-daemon[856]: accepted connection from pid 1986, user nix-grpc-daemon (trusted) worker2 # [ 200.298551] nix-daemon[856]: reaped child process 1989, status = succeeded lb # [ 200.290105] niks3-server[1045]: 2026/09/20 21:11:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.324377] nix-grpc-daemon[1744]: time=2026-09-20T21:11:43.909Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 200.325865] nix-grpc-daemon[1744]: time=2026-09-20T21:11:43.909Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 200.340289] niks3-server[1045]: 2026/09/20 21:11:43 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 200.370091] nix-grpc-daemon[1744]: time=2026-09-20T21:11:43.956Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.350934] niks3-server[1045]: 2026/09/20 21:11:43 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 200.364145] niks3-server[1045]: 2026/09/20 21:11:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 200.366853] niks3-server[1045]: 2026/09/20 21:11:43 INFO Signed narinfos id=65 count=1 worker2 # [ 200.393786] nix-grpc-daemon[1744]: time=2026-09-20T21:11:43.980Z level=INFO msg="Upload complete. (286ms)" lb # [ 200.372810] niks3-server[1045]: 2026/09/20 21:11:43 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 200.376850] niks3-server[1045]: 2026/09/20 21:11:43 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 200.381148] niks3-server[1045]: 2026/09/20 21:11:43 INFO Completed upload id=65 lb # [ 200.382972] niks3-server[1045]: 2026/09/20 21:11:43 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 200.404931] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=1 worker2 # [ 200.417327] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:44Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker2 # [ 200.424320] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:44Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 200.429484] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 200.434136] nix-daemon[856]: reaped child process 1969, status = succeeded worker2 # [ 200.435845] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 200.442970] nix-grpc-daemon[1744]: time=2026-09-20T21:11:44.029Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 200.450584] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 200.465292] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 200.652551] nix-daemon[856]: accepted connection from pid 1995, user nix-grpc-daemon (trusted) worker2 # [ 200.669923] nix-daemon[856]: reaped child process 1998, status = succeeded worker2 # [ 200.853097] nix-daemon[856]: accepted connection from pid 2000, user nix-grpc-daemon (trusted) worker2 # [ 200.869054] nix-daemon[856]: reaped child process 2003, status = succeeded lb # [ 200.859240] niks3-server[1045]: 2026/09/20 21:11:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.889493] nix-grpc-daemon[1744]: time=2026-09-20T21:11:44.476Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 200.891008] nix-grpc-daemon[1744]: time=2026-09-20T21:11:44.476Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 200.883909] niks3-server[1045]: 2026/09/20 21:11:44 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 200.919070] nix-grpc-daemon[1744]: time=2026-09-20T21:11:44.505Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.899210] niks3-server[1045]: 2026/09/20 21:11:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 200.910734] niks3-server[1045]: 2026/09/20 21:11:44 INFO Signed narinfos id=66 count=1 lb # [ 200.917032] niks3-server[1045]: 2026/09/20 21:11:44 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls worker2 # [ 200.946396] nix-grpc-daemon[1744]: time=2026-09-20T21:11:44.533Z level=INFO msg="Upload complete. (470ms)" lb # [ 200.925589] niks3-server[1045]: 2026/09/20 21:11:44 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 200.930609] niks3-server[1045]: 2026/09/20 21:11:44 INFO Completed upload id=66 worker2 # [ 200.951800] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=0 paths=1 nar_bytes_in=632 lb # [ 200.933534] niks3-server[1045]: 2026/09/20 21:11:44 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 200.963252] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 200.966569] nix-daemon[856]: reaped child process 1993, status = succeeded worker2 # [ 200.974283] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 200.988214] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) lb # [ 201.670290] envoy[926]: conn peer=[2001:db8:1::1]:53242 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=30061 client # farm-b> LOG-farm-b-drain worker2 # [ 202.425962] nix-daemon[856]: reaped child process 2007, status = succeeded worker2 # [ 202.612448] nix-daemon[856]: accepted connection from pid 2022, user nix-grpc-daemon (trusted) worker2 # [ 202.628246] nix-daemon[856]: reaped child process 2025, status = succeeded lb # [ 202.623242] niks3-server[1045]: 2026/09/20 21:11:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 202.656396] nix-grpc-daemon[1744]: time=2026-09-20T21:11:46.240Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 202.657911] nix-grpc-daemon[1744]: time=2026-09-20T21:11:46.240Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 202.662870] niks3-server[1045]: 2026/09/20 21:11:46 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 202.674813] niks3-server[1045]: 2026/09/20 21:11:46 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 202.688113] niks3-server[1045]: 2026/09/20 21:11:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 202.716930] nix-grpc-daemon[1744]: time=2026-09-20T21:11:46.303Z level=INFO msg="Uploading 1 narinfos" lb # [ 202.700198] niks3-server[1045]: 2026/09/20 21:11:46 INFO Signed narinfos id=67 count=1 lb # [ 202.708089] niks3-server[1045]: 2026/09/20 21:11:46 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 202.717257] niks3-server[1045]: 2026/09/20 21:11:46 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 202.721998] niks3-server[1045]: 2026/09/20 21:11:46 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo lb # [ 202.725971] niks3-server[1045]: 2026/09/20 21:11:46 INFO Completed upload id=67 worker2 # [ 202.747198] nix-grpc-daemon[1744]: time=2026-09-20T21:11:46.334Z level=INFO msg="Upload complete. (342ms)" worker2 # [ 202.768328] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=1 worker2 # [ 202.780354] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:46Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 202.786079] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:46Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 202.790528] nix-daemon[856]: reaped child process 2005, status = succeeded worker2 # [ 202.809539] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 202.824672] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 202.838771] nix-grpc-daemon[1744]: time=2026-09-20T21:11:46.425Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 202.848943] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 202.860181] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 203.068195] nix-daemon[856]: accepted connection from pid 2031, user nix-grpc-daemon (trusted) worker2 # [ 203.084004] nix-daemon[856]: reaped child process 2034, status = succeeded worker2 # [ 203.262259] nix-daemon[856]: accepted connection from pid 2036, user nix-grpc-daemon (trusted) worker2 # [ 203.277659] nix-daemon[856]: reaped child process 2039, status = succeeded lb # [ 203.268178] niks3-server[1045]: 2026/09/20 21:11:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 203.299490] nix-grpc-daemon[1744]: time=2026-09-20T21:11:46.886Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 203.301070] nix-grpc-daemon[1744]: time=2026-09-20T21:11:46.886Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 203.300239] niks3-server[1045]: 2026/09/20 21:11:46 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 203.328984] nix-grpc-daemon[1744]: time=2026-09-20T21:11:46.915Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.314041] niks3-server[1045]: 2026/09/20 21:11:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 203.328170] niks3-server[1045]: 2026/09/20 21:11:46 INFO Signed narinfos id=68 count=1 worker2 # [ 203.353536] nix-grpc-daemon[1744]: time=2026-09-20T21:11:46.940Z level=INFO msg="Upload complete. (472ms)" lb # [ 203.331066] niks3-server[1045]: 2026/09/20 21:11:46 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls worker2 # [ 203.360121] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=0 paths=1 nar_bytes_in=760 lb # [ 203.342154] niks3-server[1045]: 2026/09/20 21:11:46 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 203.345938] niks3-server[1045]: 2026/09/20 21:11:46 INFO Completed upload id=68 lb # [ 203.348115] niks3-server[1045]: 2026/09/20 21:11:46 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 203.370169] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 worker2 # [ 203.375771] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker2 # [ 203.380331] nix-daemon[856]: reaped child process 2029, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... worker2 # [ 203.389845] nix-daemon[856]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 204.813022] nix-daemon[856]: reaped child process 2043, status = succeeded client # farm-top> LOG-farm-top-drain worker2 # [ 204.974875] nix-daemon[856]: accepted connection from pid 2058, user nix-grpc-daemon (trusted) worker2 # [ 204.991354] nix-daemon[856]: reaped child process 2061, status = succeeded lb # [ 204.986173] niks3-server[1045]: 2026/09/20 21:11:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.017616] nix-grpc-daemon[1744]: time=2026-09-20T21:11:48.603Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 205.019066] nix-grpc-daemon[1744]: time=2026-09-20T21:11:48.603Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 205.022569] niks3-server[1045]: 2026/09/20 21:11:48 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 205.034286] niks3-server[1045]: 2026/09/20 21:11:48 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 205.066017] nix-grpc-daemon[1744]: time=2026-09-20T21:11:48.652Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.044679] niks3-server[1045]: 2026/09/20 21:11:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 205.051505] niks3-server[1045]: 2026/09/20 21:11:48 INFO Signed narinfos id=69 count=1 lb # [ 205.056573] niks3-server[1045]: 2026/09/20 21:11:48 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 205.063187] niks3-server[1045]: 2026/09/20 21:11:48 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete worker2 # [ 205.089041] nix-grpc-daemon[1744]: time=2026-09-20T21:11:48.675Z level=INFO msg="Upload complete. (288ms)" lb # [ 205.068362] niks3-server[1045]: 2026/09/20 21:11:48 INFO Completed upload id=69 lb # [ 205.071413] niks3-server[1045]: 2026/09/20 21:11:48 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 205.099269] nix-grpc-daemon[1672]: ts=2026-09-20T21:11:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:40924 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=1 worker2 # [ 205.114184] nix-daemon[856]: reaped child process 2041, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.83 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.22 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 206.326297] nix-grpc-daemon[1367]: ts=2026-09-20T21:11:49Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 9.60 seconds) (finished: run the VM test script, in 207.64 seconds) test script finished in 207.93s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.13 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh