tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm lb # Disk image does not exist, creating the virtualisation disk image... client # Disk image does not exist, creating the virtualisation disk image... lb # Formatting '/build/vm-state-lb/tmp.xVeMw2ahYp', fmt=raw size=1073741824 worker2: QEMU running (pid 52) worker2 # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 50) lb # mke2fs 1.47.4 (6-Mar-2025) worker1: QEMU running (pid 51) worker2 # Formatting '/build/vm-state-worker2/tmp.XyX5gpLYng', fmt=raw size=1073741824 worker1 # Disk image does not exist, creating the virtualisation disk image... client # Formatting '/build/vm-state-client/tmp.1motHJCeyK', fmt=raw size=1073741824 worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # Formatting '/build/vm-state-worker1/tmp.j9mpZC42KH', fmt=raw size=1073741824 client # mke2fs 1.47.4 (6-Mar-2025) worker2 # Discarding device blocks: 0/262144 done worker1 # mke2fs 1.47.4 (6-Mar-2025) client # Discarding device blocks: 0/262144 done worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Discarding device blocks: 0/262144 done client # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Filesystem UUID: 97bd670e-dfd6-452b-b95d-333e56646b54 worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Filesystem UUID: d8120e89-9010-4664-aa39-806ccbc94f11 client # Superblock backups stored on blocks: worker2 # Superblock backups stored on blocks: lb # Discarding device blocks: 0/262144 done client # 32768, 98304, 163840, 229376 worker2 # 32768, 98304, 163840, 229376 lb # Creating filesystem with 262144 4k blocks and 65536 inodes client # worker2 # lb # Filesystem UUID: 354440ba-1f96-4418-b8f3-d4670856c558 client # Allocating group tables: 0/8 done worker2 # Allocating group tables: 0/8 done lb # Superblock backups stored on blocks: client # Writing inode tables: 0/8 done worker2 # Writing inode tables: 0/8 done lb # 32768, 98304, 163840, 229376 client # Creating journal (8192 blocks): done worker2 # Creating journal (8192 blocks): done lb # client # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Writing superblocks and filesystem accounting information: 0/8 done lb # Allocating group tables: 0/8 done client # worker2 # lb # Writing inode tables: 0/8 done client # Virtualisation disk image created. worker2 # Virtualisation disk image created. lb # Creating journal (8192 blocks): done client: QEMU running (pid 49) lb # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Filesystem UUID: 081bd967-e28b-42b1-aa39-a7d26f23863b lb # worker1 # Superblock backups stored on blocks: (finished: start all VMs, in 0.52 seconds) worker1 # 32768, 98304, 163840, 229376 client: waiting for unit network-addresses-eth1.service worker1 # client: waiting for the VM to finish booting worker1 # Allocating group tables: 0/8 done lb # Virtualisation disk image created. worker1 # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # worker1 # Virtualisation disk image created. lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] KASLR enabled lb # [ 0.000000] random: crng init done lb # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Zone ranges: lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA32 empty lb # [ 0.000000] Normal empty lb # [ 0.000000] Device empty lb # [ 0.000000] Movable zone start for each node lb # [ 0.000000] Early memory node ranges lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/168cy51b13gm4gbaddwdhrwvcvzdxbrq-nixos-system-lb-test/init regInfo=/nix/store/mnw4siin8g9mlnyg6j8vpnpyazygjysc-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] Zone ranges: client # [ 0.000000] KASLR enabled worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] random: crng init done worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] DMA32 empty lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/mnw4siin8g9mlnyg6j8vpnpyazygjysc-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] Normal empty client # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] Device empty worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Early memory node ranges lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] Zone ranges: worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] DMA32 empty worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] Normal empty worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] Device empty lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] Zone ranges: client # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] DMA32 empty client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Normal empty worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] Device empty lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Movable zone start for each node lb # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] Early memory node ranges client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jzf4xkwa8xmlj8vk00ys4gir3nz7fy8j-nixos-system-worker2-test/init regInfo=/nix/store/8vck4wm0zxi7gd9ibf4y3jhycpzbwnl6-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/8vck4wm0zxi7gd9ibf4y3jhycpzbwnl6-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/p6p9342ifnppad60sm4s8zcrc0dk790i-nixos-system-client-test/init regInfo=/nix/store/mfi7s969scingkrqknkvk3lldv44xdhn-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/mfi7s969scingkrqknkvk3lldv44xdhn-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/143xd0r0k7bpy3hb59k6jhcv7f9kn0pn-nixos-system-worker1-test/init regInfo=/nix/store/kyyw7i260gz287j3y494hm7f7ygzcgmp-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/kyyw7i260gz287j3y494hm7f7ygzcgmp-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] Policy zone: DMA lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] Policy zone: DMA lb # [ 0.000035] arm-pv: using stolen time PV client # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000651] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000816] Console: colour dummy device 80x25 worker1 # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000824] printk: legacy console [tty0] enabled client # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.001016] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.001023] pid_max: default: 32768 minimum: 301 client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.001092] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.001258] landlock: Up and running. client # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.001261] Yama: becoming mindful. worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.001893] LSM support for eBPF active client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.002044] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.002077] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.003244] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.004023] rcu: Hierarchical SRCU implementation. worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.004027] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.005247] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.005347] EFI services will not be available. worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.005415] smp: Bringing up secondary CPUs ... worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.005423] smp: Brought up 1 node, 1 CPU worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.005426] SMP: Total of 1 processors activated. client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.005431] CPU: All CPU(s) started at EL1 worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.005442] CPU features: detected: Branch Target Identification worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.005447] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.005450] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.005454] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.005458] CPU features: detected: Common not Private translations worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.005461] CPU features: detected: CRC32 instructions client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.005464] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.000030] arm-pv: using stolen time PV client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.005467] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.000395] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.005470] CPU features: detected: Data independent timing control (DIT) client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000560] Console: colour dummy device 80x25 lb # [ 0.005473] CPU features: detected: E0PD worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000569] printk: legacy console [tty0] enabled lb # [ 0.005476] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.005479] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000768] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.005482] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.000774] pid_max: default: 32768 minimum: 301 client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.005485] CPU features: detected: Fine Grained Traps client # [ 0.000029] arm-pv: using stolen time PV worker2 # [ 0.000842] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000986] landlock: Up and running. lb # [ 0.005489] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.000988] Yama: becoming mindful. worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000399] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.001435] LSM support for eBPF active lb # [ 0.005493] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.000045] arm-pv: using stolen time PV client # [ 0.000554] Console: colour dummy device 80x25 lb # [ 0.005496] CPU features: detected: LSE atomic instructions worker2 # [ 0.001579] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000561] printk: legacy console [tty0] enabled lb # [ 0.005499] CPU features: detected: Privileged Access Never worker1 # [ 0.000421] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.001612] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.005502] CPU features: detected: PMUv3 worker1 # [ 0.000604] Console: colour dummy device 80x25 client # [ 0.000750] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.002785] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.005505] CPU features: detected: RAS Extension Support worker1 # [ 0.000612] printk: legacy console [tty0] enabled client # [ 0.000756] pid_max: default: 32768 minimum: 301 worker2 # [ 0.003654] rcu: Hierarchical SRCU implementation. lb # [ 0.005507] CPU features: detected: RASv1p1 Extension Support client # [ 0.000826] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.003658] rcu: Max phase no-delay instances is 1000. lb # [ 0.005510] CPU features: detected: Random Number Generator client # [ 0.000977] landlock: Up and running. worker1 # [ 0.000800] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.004857] fsl-mc MSI: its@8080000 domain created client # [ 0.000979] Yama: becoming mindful. worker1 # [ 0.000807] pid_max: default: 32768 minimum: 301 lb # [ 0.005513] CPU features: detected: Speculation barrier (SB) client # [ 0.001466] LSM support for eBPF active worker2 # [ 0.004947] EFI services will not be available. worker1 # [ 0.000885] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.005012] smp: Bringing up secondary CPUs ... lb # [ 0.005515] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.001008] landlock: Up and running. client # [ 0.001638] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.005020] smp: Brought up 1 node, 1 CPU worker1 # [ 0.001010] Yama: becoming mindful. lb # [ 0.005518] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.005023] SMP: Total of 1 processors activated. worker1 # [ 0.001447] LSM support for eBPF active client # [ 0.001672] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.005028] CPU: All CPU(s) started at EL1 lb # [ 0.005522] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.002793] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.001578] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.005040] CPU features: detected: Branch Target Identification lb # [ 0.005563] alternatives: applying system-wide alternatives client # [ 0.003478] rcu: Hierarchical SRCU implementation. worker1 # [ 0.001610] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.005045] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.003482] rcu: Max phase no-delay instances is 1000. lb # [ 0.008596] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.002694] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.004643] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.005048] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.003447] rcu: Hierarchical SRCU implementation. client # [ 0.004730] EFI services will not be available. worker1 # [ 0.003451] rcu: Max phase no-delay instances is 1000. lb # [ 0.008779] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) client # [ 0.004793] smp: Bringing up secondary CPUs ... worker2 # [ 0.005051] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.009191] devtmpfs: initialized client # [ 0.004801] smp: Brought up 1 node, 1 CPU worker1 # [ 0.004682] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.005055] CPU features: detected: Common not Private translations worker1 # [ 0.004773] EFI services will not be available. client # [ 0.004804] SMP: Total of 1 processors activated. lb # [ 0.011069] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.004809] CPU: All CPU(s) started at EL1 worker2 # [ 0.005058] CPU features: detected: CRC32 instructions worker1 # [ 0.004854] smp: Bringing up secondary CPUs ... worker1 # [ 0.004862] smp: Brought up 1 node, 1 CPU client # [ 0.004819] CPU features: detected: Branch Target Identification lb # [ 0.011099] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.005061] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.004865] SMP: Total of 1 processors activated. client # [ 0.004824] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.011302] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.004871] CPU: All CPU(s) started at EL1 worker2 # [ 0.005065] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.011306] 0 pages in range for non-PLT usage worker1 # [ 0.004882] CPU features: detected: Branch Target Identification client # [ 0.004827] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.005068] CPU features: detected: Data independent timing control (DIT) lb # [ 0.011307] 508288 pages in range for PLT usage worker2 # [ 0.005071] CPU features: detected: E0PD worker1 # [ 0.004887] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.011419] pinctrl core: initialized pinctrl subsystem client # [ 0.004830] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.005073] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.012198] DMI not present or invalid. worker1 # [ 0.004890] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.004834] CPU features: detected: Common not Private translations lb # [ 0.015822] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.005076] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.004837] CPU features: detected: CRC32 instructions worker1 # [ 0.004894] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.005080] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.018037] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.004840] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.005083] CPU features: detected: Fine Grained Traps worker1 # [ 0.004897] CPU features: detected: Common not Private translations lb # [ 0.018226] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.004901] CPU features: detected: CRC32 instructions client # [ 0.004843] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.005087] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.018421] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.004904] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.004847] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.005092] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.004850] CPU features: detected: E0PD lb # [ 0.018442] audit: initializing netlink subsys (disabled) worker1 # [ 0.004907] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.005095] CPU features: detected: LSE atomic instructions lb # [ 0.019059] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.004852] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.005098] CPU features: detected: Privileged Access Never worker1 # [ 0.004910] CPU features: detected: Data independent timing control (DIT) lb # [ 0.019061] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.005101] CPU features: detected: PMUv3 worker1 # [ 0.004914] CPU features: detected: E0PD client # [ 0.004855] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.005103] CPU features: detected: RAS Extension Support lb # [ 0.019065] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.004858] CPU features: detected: Enhanced Virtualization Traps worker1 # [ 0.004916] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.005106] CPU features: detected: RASv1p1 Extension Support lb # [ 0.019070] thermal_sys: Registered thermal governor 'user_space' client # [ 0.004862] CPU features: detected: Fine Grained Traps worker1 # [ 0.004919] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.005109] CPU features: detected: Random Number Generator client # [ 0.004865] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.004922] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.005111] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.004925] CPU features: detected: Fine Grained Traps client # [ 0.004869] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.005114] CPU features: detected: Stage-2 Force Write-Back client # [ 0.004872] CPU features: detected: LSE atomic instructions worker1 # [ 0.004929] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.005117] CPU features: detected: TLB range maintenance instructions client # [ 0.004876] CPU features: detected: Privileged Access Never worker1 # [ 0.004933] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.004878] CPU features: detected: PMUv3 worker2 # [ 0.005122] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.004936] CPU features: detected: LSE atomic instructions client # [ 0.004881] CPU features: detected: RAS Extension Support worker2 # [ 0.005160] alternatives: applying system-wide alternatives worker1 # [ 0.004939] CPU features: detected: Privileged Access Never client # [ 0.004884] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.008199] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.004942] CPU features: detected: PMUv3 client # [ 0.004886] CPU features: detected: Random Number Generator worker1 # [ 0.004945] CPU features: detected: RAS Extension Support client # [ 0.004889] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.004947] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.008345] Memory: 1406536K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) client # [ 0.004891] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.004950] CPU features: detected: Random Number Generator worker2 # [ 0.008722] devtmpfs: initialized client # [ 0.004894] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.004952] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.010809] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.004955] CPU features: detected: Stage-2 Force Write-Back client # [ 0.004899] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.019073] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.010831] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.004934] alternatives: applying system-wide alternatives worker1 # [ 0.004958] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.011031] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.019097] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.007857] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.004962] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.019105] cpuidle: using governor ladder lb # [ 0.019111] cpuidle: using governor menu worker1 # [ 0.004999] alternatives: applying system-wide alternatives lb # [ 0.019291] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.008083] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.019306] ASID allocator initialised with 65536 entries lb # [ 0.020524] Serial: AMBA PL011 UART driver worker1 # [ 0.008293] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) lb # [ 0.025690] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.008672] devtmpfs: initialized lb # [ 0.025839] printk: console [ttyAMA0] enabled worker1 # [ 0.010519] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.145901] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.010541] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.145924] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.010735] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker1 # [ 0.010740] 0 pages in range for non-PLT usage lb # [ 0.145930] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.010741] 508288 pages in range for PLT usage lb # [ 0.145935] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.011036] 0 pages in range for non-PLT usage lb # [ 0.145939] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.011037] 508288 pages in range for PLT usage worker2 # [ 0.011158] pinctrl core: initialized pinctrl subsystem lb # [ 0.145943] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.008075] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker2 # [ 0.011998] DMI not present or invalid. client # [ 0.008484] devtmpfs: initialized lb # [ 0.145948] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.015222] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.010264] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.145952] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.017444] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.010290] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.017636] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.010509] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.010513] 0 pages in range for non-PLT usage worker2 # [ 0.017831] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.153375] fbcon: Taking over console client # [ 0.010514] 508288 pages in range for PLT usage lb # [ 0.153391] ACPI: Interpreter disabled. worker2 # [ 0.017852] audit: initializing netlink subsys (disabled) client # [ 0.010624] pinctrl core: initialized pinctrl subsystem lb # [ 0.155197] iommu: Default domain type: Translated worker2 # [ 0.018405] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.011376] DMI not present or invalid. lb # [ 0.155206] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.018407] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.014408] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.018411] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.156859] SCSI subsystem initialized client # [ 0.016716] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.010852] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.011574] DMI not present or invalid. worker2 # [ 0.018416] thermal_sys: Registered thermal governor 'user_space' client # [ 0.016884] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.014797] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.018419] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.017077] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.017041] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.018449] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.017098] audit: initializing netlink subsys (disabled) worker2 # [ 0.018457] cpuidle: using governor ladder worker1 # [ 0.017225] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.018463] cpuidle: using governor menu client # [ 0.017641] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.017424] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.017643] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.018660] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.018674] ASID allocator initialised with 65536 entries worker1 # [ 0.017446] audit: initializing netlink subsys (disabled) client # [ 0.017647] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.019860] Serial: AMBA PL011 UART driver worker1 # [ 0.018024] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.017652] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.018026] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.024973] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.017655] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.025088] printk: console [ttyAMA0] enabled worker1 # [ 0.018030] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.017677] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.018036] thermal_sys: Registered thermal governor 'user_space' client # [ 0.017686] cpuidle: using governor ladder client # [ 0.017692] cpuidle: using governor menu worker2 # [ 0.144403] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.164335] usbcore: registered new interface driver usbfs worker1 # [ 0.018039] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.164367] usbcore: registered new interface driver hub worker2 # [ 0.144424] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.017879] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.018064] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.164385] usbcore: registered new device driver usb client # [ 0.017894] ASID allocator initialised with 65536 entries worker1 # [ 0.018072] cpuidle: using governor ladder worker2 # [ 0.144430] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.164702] pps_core: LinuxPPS API ver. 1 registered client # [ 0.019041] Serial: AMBA PL011 UART driver worker1 # [ 0.018078] cpuidle: using governor menu worker2 # [ 0.144434] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.018276] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.164708] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.024121] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.144438] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.018292] ASID allocator initialised with 65536 entries lb # [ 0.164718] PTP clock support registered client # [ 0.024239] printk: console [ttyAMA0] enabled worker2 # [ 0.144443] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.164759] EDAC MC: Ver: 3.0.0 worker1 # [ 0.019432] Serial: AMBA PL011 UART driver worker2 # [ 0.144447] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.169222] scmi_core: SCMI protocol bus registered worker1 # [ 0.024665] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.144192] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.144451] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.024782] printk: console [ttyAMA0] enabled client # [ 0.144211] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.170154] FPGA manager framework lb # [ 0.171108] vgaarb: loaded client # [ 0.144216] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.144459] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.144220] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.144481] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.151649] fbcon: Taking over console lb # [ 0.171756] clocksource: Switched to clocksource arch_sys_counter client # [ 0.144225] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.151665] ACPI: Interpreter disabled. worker1 # [ 0.144487] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.172361] VFS: Disk quotas dquot_6.6.0 client # [ 0.144229] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.153495] iommu: Default domain type: Translated lb # [ 0.172395] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.144491] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.144233] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.153505] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.144495] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.174658] netfs: FS-Cache loaded client # [ 0.144237] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.174787] pnp: PnP ACPI: disabled worker2 # [ 0.155209] SCSI subsystem initialized worker1 # [ 0.144499] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.144504] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.144508] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.151501] fbcon: Taking over console client # [ 0.151515] ACPI: Interpreter disabled. client # [ 0.153311] iommu: Default domain type: Translated client # [ 0.153320] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.151886] fbcon: Taking over console worker1 # [ 0.151901] ACPI: Interpreter disabled. client # [ 0.155033] SCSI subsystem initialized worker1 # [ 0.153750] iommu: Default domain type: Translated worker1 # [ 0.153760] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.155714] usbcore: registered new interface driver usbfs client # [ 0.155749] usbcore: registered new interface driver hub worker1 # [ 0.155484] SCSI subsystem initialized client # [ 0.155768] usbcore: registered new device driver usb client # [ 0.156029] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.162695] usbcore: registered new interface driver usbfs lb # [ 0.180580] NET: Registered PF_INET protocol family worker2 # [ 0.162745] usbcore: registered new interface driver hub client # [ 0.156035] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.162763] usbcore: registered new device driver usb lb # [ 0.180869] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.156045] PTP clock support registered worker2 # [ 0.163033] pps_core: LinuxPPS API ver. 1 registered client # [ 0.156105] EDAC MC: Ver: 3.0.0 worker2 # [ 0.163038] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.163048] PTP clock support registered worker2 # [ 0.163097] EDAC MC: Ver: 3.0.0 worker2 # [ 0.167762] scmi_core: SCMI protocol bus registered worker2 # [ 0.168760] FPGA manager framework worker2 # [ 0.169728] vgaarb: loaded worker1 # [ 0.163094] usbcore: registered new interface driver usbfs worker1 # [ 0.163129] usbcore: registered new interface driver hub worker2 # [ 0.170402] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.163148] usbcore: registered new device driver usb worker2 # [ 0.171036] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.163423] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.171068] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.167540] scmi_core: SCMI protocol bus registered worker1 # [ 0.163430] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.173499] netfs: FS-Cache loaded worker1 # [ 0.163440] PTP clock support registered worker2 # [ 0.173598] pnp: PnP ACPI: disabled client # [ 0.168603] FPGA manager framework worker1 # [ 0.163488] EDAC MC: Ver: 3.0.0 client # [ 0.169555] vgaarb: loaded worker1 # [ 0.168119] scmi_core: SCMI protocol bus registered worker1 # [ 0.169081] FPGA manager framework client # [ 0.170208] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.170018] vgaarb: loaded client # [ 0.170817] VFS: Disk quotas dquot_6.6.0 client # [ 0.170849] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.170661] clocksource: Switched to clocksource arch_sys_counter client # [ 0.173284] netfs: FS-Cache loaded worker1 # [ 0.171253] VFS: Disk quotas dquot_6.6.0 client # [ 0.173610] pnp: PnP ACPI: disabled worker1 # [ 0.171278] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.173613] netfs: FS-Cache loaded worker1 # [ 0.173728] pnp: PnP ACPI: disabled worker2 # [ 0.179704] NET: Registered PF_INET protocol family worker2 # [ 0.179964] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.179466] NET: Registered PF_INET protocol family client # [ 0.179738] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.179635] NET: Registered PF_INET protocol family worker1 # [ 0.179900] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.210371] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.210423] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.210455] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.210528] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.210671] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.210775] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.210812] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.210848] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.210953] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.210976] NET: Registered PF_XDP protocol family lb # [ 0.210994] PCI: CLS 0 bytes, default 64 lb # [ 0.211252] Trying to unpack rootfs image as initramfs... lb # [ 0.229440] kvm [1]: HYP mode not available worker2 # [ 0.209520] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.209575] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.209610] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.209692] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.209834] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.209923] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.209387] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.209959] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.209450] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.209997] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.209485] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.210088] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.209735] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.210133] NET: Registered PF_XDP protocol family client # [ 0.209577] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.209790] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.210151] PCI: CLS 0 bytes, default 64 client # [ 0.209743] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.210429] Trying to unpack rootfs image as initramfs... worker1 # [ 0.209820] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.209833] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.209910] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.209868] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.210054] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.209903] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.210147] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.210013] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.210185] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.210053] NET: Registered PF_XDP protocol family client # [ 0.210071] PCI: CLS 0 bytes, default 64 worker1 # [ 0.210222] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.210305] Trying to unpack rootfs image as initramfs... worker1 # [ 0.210321] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.210351] NET: Registered PF_XDP protocol family worker1 # [ 0.210369] PCI: CLS 0 bytes, default 64 worker2 # [ 0.228094] kvm [1]: HYP mode not available worker1 # [ 0.210639] Trying to unpack rootfs image as initramfs... client # [ 0.228084] kvm [1]: HYP mode not available worker1 # [ 0.228643] kvm [1]: HYP mode not available lb # [ 0.324381] Initialise system trusted keyrings lb # [ 0.325131] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.326332] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.327099] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.326829] Initialise system trusted keyrings worker2 # [ 0.327600] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.328941] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.329706] 9p: Installing v9fs 9p2000 file system support client # [ 0.325932] Initialise system trusted keyrings lb # [ 0.351017] Key type asymmetric registered lb # [ 0.351048] Asymmetric key parser 'x509' registered client # [ 0.326748] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.351126] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.328019] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.328770] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.328966] Initialise system trusted keyrings worker1 # [ 0.329738] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.331045] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.331813] 9p: Installing v9fs 9p2000 file system support lb # [ 0.359818] io scheduler mq-deadline registered lb # [ 0.359840] io scheduler kyber registered lb # [ 0.365000] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.350387] Key type asymmetric registered lb # [ 0.366278] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.366639] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.366655] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.366676] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.366685] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.366736] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.352744] Key type asymmetric registered lb # [ 0.366758] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.352776] Asymmetric key parser 'x509' registered worker2 # [ 0.358442] Asymmetric key parser 'x509' registered lb # [ 0.366836] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.358529] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.352857] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.366846] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.360129] io scheduler mq-deadline registered lb # [ 0.366852] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.360141] io scheduler kyber registered lb # [ 0.366857] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.366862] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.366919] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.367365] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.367548] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.367564] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.367593] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.359763] Key type asymmetric registered lb # [ 0.367610] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.358258] io scheduler mq-deadline registered worker1 # [ 0.359791] Asymmetric key parser 'x509' registered client # [ 0.358275] io scheduler kyber registered lb # [ 0.368070] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.359866] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.368251] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.361968] io scheduler mq-deadline registered lb # [ 0.368267] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.361980] io scheduler kyber registered lb # [ 0.368296] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.368742] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.370558] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.368921] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.366350] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.368937] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.368965] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.369407] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.372004] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.369586] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.372403] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.369602] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.369634] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.372420] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.370089] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.372439] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.370268] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.370283] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.372448] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.367708] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.370312] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.372469] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.368076] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.370791] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.372494] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.370974] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.368092] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.372574] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.370990] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.368104] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.372584] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.374943] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.371019] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.372590] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.368112] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.371458] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.372595] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.371641] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.368139] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.372600] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.371656] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.368161] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.376343] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.372693] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.371686] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.368258] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.371702] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.376725] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.373136] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.368267] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.373324] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.376742] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.368273] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.373341] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.376754] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.368278] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.373370] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.368283] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.376763] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.373387] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.368384] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.373844] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.376784] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.374029] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.368820] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.376806] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.374045] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.369006] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.376897] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.374075] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.369022] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.376907] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.369051] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.376912] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.369067] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.376917] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.393177] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.369520] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.376923] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.393365] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.369733] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.393381] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.412289] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.377017] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.369750] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.393410] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.412500] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.377450] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.369779] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.412532] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.377635] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.393871] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.370262] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.394053] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.377651] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.412993] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.370447] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.394069] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.377681] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.413180] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.370462] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.394100] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.377697] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.413210] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.370492] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.378163] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.413604] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.370948] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.378348] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.413786] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.371134] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.378363] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.371150] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.414029] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.378393] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.414330] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.371182] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.414347] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.371667] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.414378] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.371854] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.371870] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.397045] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.414858] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.415043] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.397236] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.371899] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.397252] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.415058] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.372350] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.397281] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.415088] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.372533] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.372549] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.415672] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.397733] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.397916] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.372578] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.415683] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.397931] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.415689] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.373027] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.397963] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.373211] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.415735] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.373227] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.398420] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.398604] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.373257] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.398620] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.373273] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.398649] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.373790] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.406637] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.373979] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.406849] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.374008] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.406867] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.406897] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.407355] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.407541] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.407556] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.435831] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.407586] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.435887] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.408051] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.408237] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.435934] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.408253] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.435982] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.408282] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.436031] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.408299] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.436083] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.408791] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.408985] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.436130] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.409015] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.436178] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.418586] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.409476] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.436277] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.409664] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.418796] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.436324] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.409694] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.418826] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.436347] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.415166] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.410083] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.419227] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.415366] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.436372] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.419409] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.410269] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.415382] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.436395] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.410534] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.419657] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.415411] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.436421] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.410828] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.419962] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.415867] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.436443] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.410846] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.419979] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.416057] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.436465] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.410875] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.420008] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.416073] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.436487] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.411333] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.420468] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.416102] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.436509] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.411526] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.420652] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.416118] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.436532] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.411542] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.420668] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.416605] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.436555] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.411572] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.420698] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.416792] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.436577] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.412177] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.421286] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.416822] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.436599] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.421297] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.412189] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.436620] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.417269] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.412195] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.421303] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.436642] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.417455] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.436664] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.412240] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.417484] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.421349] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.436685] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.412289] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.421396] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.417868] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.436707] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.418052] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.412337] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.421443] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.436728] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.418299] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.412386] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.436750] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.421490] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.418598] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.436772] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.412433] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.421537] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.418615] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.436800] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.412479] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.418645] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.421585] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.436810] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.412527] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.436815] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.421651] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.419115] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.437973] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.419297] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.412574] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.421699] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.419312] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412621] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.421745] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.419342] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.412695] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.421821] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.419942] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.412741] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.421866] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.419953] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.412763] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.421888] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.419959] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.412785] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.421909] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.420003] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.412807] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.421931] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.420061] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.412833] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.421955] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.412855] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.420108] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.421977] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.412877] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.421998] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.420154] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.412903] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.422020] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.420200] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.412925] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.422042] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.420246] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.412949] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.422063] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.412972] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.420292] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.422086] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.412995] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.420338] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.422108] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.413017] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.422129] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.420384] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.413039] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.422151] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.420446] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.413061] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.422171] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.413084] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.420491] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.422193] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.413106] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.420513] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.413128] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.420533] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.413149] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.420555] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.413171] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.420579] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.413193] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.420600] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.413220] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.420621] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.413230] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.420643] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.413235] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.414398] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.420664] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.420686] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.420708] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.420730] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.462255] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.420751] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.462289] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker1 # [ 0.420773] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.490180] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.462312] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker1 # [ 0.420794] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.462334] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.420815] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.462357] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.420836] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.462387] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.420857] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.462396] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.420879] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.462401] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.420900] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker2 # [ 0.475000] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 59186 usecs client # [ 0.463593] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.420921] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.420948] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.420957] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.420962] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.422143] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.500446] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.503045] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker1 # [ 0.478738] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 55272 usecs lb # [ 0.506909] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.513079] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.495971] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.490272] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.498348] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.492494] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.524353] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.526679] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.498947] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.501228] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.509306] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.502454] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.505052] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.515461] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.517541] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.538018] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.511752] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker1 # [ 0.513831] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.515155] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.517221] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.527880] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.530048] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.524207] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker1 # [ 0.526324] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.528787] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.548027] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.551359] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.554194] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.531844] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.534011] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.541640] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.537806] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.541012] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.548210] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.543676] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.546093] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.550256] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.572569] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.575332] msm_serial: driver initialized lb # [ 0.575489] SuperH (H)SCI(F) driver initialized lb # [ 0.575546] STM32 USART driver initialized worker1 # [ 0.546848] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.549996] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.559944] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.563429] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.573535] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.568320] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.576504] msm_serial: driver initialized worker2 # [ 0.576666] SuperH (H)SCI(F) driver initialized client # [ 0.571169] msm_serial: driver initialized worker2 # [ 0.576724] STM32 USART driver initialized client # [ 0.571319] SuperH (H)SCI(F) driver initialized client # [ 0.571371] STM32 USART driver initialized worker1 # [ 0.574217] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.606490] loop: module loaded lb # [ 0.606721] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.580037] msm_serial: driver initialized lb # [ 0.607489] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.580207] SuperH (H)SCI(F) driver initialized worker1 # [ 0.580260] STM32 USART driver initialized lb # [ 0.615904] megasas: 07.734.00.00-rc1 lb # [ 0.616738] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.619082] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.619108] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.620738] Using buffer write method client # [ 0.600959] loop: module loaded client # [ 0.601151] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.620804] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.601902] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.622640] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.622672] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.606864] megasas: 07.734.00.00-rc1 client # [ 0.607551] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.616224] loop: module loaded worker2 # [ 0.616431] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.617279] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.641254] Using buffer write method lb # [ 0.641296] Concatenating MTD devices: lb # [ 0.641300] (0): "0.flash" lb # [ 0.641305] (1): "0.flash" lb # [ 0.641308] into device "0.flash" worker1 # [ 0.614953] loop: module loaded worker1 # [ 0.615150] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.615962] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.618927] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.618961] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.620528] Using buffer write method client # [ 0.620604] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.627240] megasas: 07.734.00.00-rc1 worker2 # [ 0.628121] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.630455] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.630480] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.623331] megasas: 07.734.00.00-rc1 worker2 # [ 0.632063] Using buffer write method worker1 # [ 0.624090] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.632133] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.625963] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.625990] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.633808] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.633833] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.627678] Using buffer write method worker1 # [ 0.627750] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.634958] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.635000] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.629651] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.636780] Using buffer write method client # [ 0.636810] Concatenating MTD devices: worker1 # [ 0.629675] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.636814] (0): "0.flash" client # [ 0.636818] (1): "0.flash" client # [ 0.636821] into device "0.flash" worker2 # [ 0.647438] Using buffer write method worker2 # [ 0.647479] Concatenating MTD devices: worker2 # [ 0.647484] (0): "0.flash" worker2 # [ 0.647488] (1): "0.flash" worker2 # [ 0.647491] into device "0.flash" worker1 # [ 0.649338] Using buffer write method worker1 # [ 0.649381] Concatenating MTD devices: worker1 # [ 0.649386] (0): "0.flash" worker1 # [ 0.649391] (1): "0.flash" worker1 # [ 0.649394] into device "0.flash" lb # [ 0.884932] Freeing initrd memory: 26140K lb # [ 0.890959] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.894657] thunder_xcv, ver 1.0 lb # [ 0.894717] thunder_bgx, ver 1.0 lb # [ 0.894740] nicpf, ver 1.0 lb # [ 0.895293] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.895300] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.895323] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.895332] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.895360] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.895366] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.895389] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.895395] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.895529] sky2: driver version 1.30 lb # [ 0.904284] usbcore: registered new interface driver usb-storage client # [ 0.879134] Freeing initrd memory: 26160K lb # [ 0.904380] usbcore: registered new interface driver usbserial_generic lb # [ 0.904394] usbserial: USB Serial support registered for generic lb # [ 0.904994] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.906227] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.885087] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.906252] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 0.906451] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.911938] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.911969] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:13:10 UTC (1789981990) lb # [ 0.912316] i2c_dev: i2c /dev entries driver client # [ 0.888711] thunder_xcv, ver 1.0 client # [ 0.888757] thunder_bgx, ver 1.0 client # [ 0.888780] nicpf, ver 1.0 client # [ 0.889317] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.889325] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.889349] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.889358] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.889387] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.889393] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.917294] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.891925] Freeing initrd memory: 26148K lb # [ 0.917306] sdhci: Copyright(c) Pierre Ossman client # [ 0.889416] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.917579] Synopsys Designware Multimedia Card Interface Driver client # [ 0.889422] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.889553] sky2: driver version 1.30 lb # [ 0.917960] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.902385] Freeing initrd memory: 26148K lb # [ 0.919691] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.923035] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.898848] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.923427] hub 1-0:1.0: USB hub found worker1 # [ 0.898005] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.923446] hub 1-0:1.0: 6 ports detected client # [ 0.898895] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.899087] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.925607] usbcore: registered new interface driver usbhid lb # [ 0.925619] usbhid: USB HID core driver client # [ 0.901540] usbcore: registered new interface driver usb-storage client # [ 0.901757] usbcore: registered new interface driver usbserial_generic client # [ 0.901776] usbserial: USB Serial support registered for generic worker2 # [ 0.908991] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.901788] thunder_xcv, ver 1.0 worker1 # [ 0.901833] thunder_bgx, ver 1.0 worker1 # [ 0.901855] nicpf, ver 1.0 client # [ 0.904608] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.927962] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.902383] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.929516] drop_monitor: Initializing network drop monitor service worker1 # [ 0.902391] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.906074] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.929705] NET: Registered PF_INET6 protocol family worker1 # [ 0.902415] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.906101] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:13:10 UTC (1789981990) worker1 # [ 0.902424] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.932707] Segment Routing with IPv6 worker1 # [ 0.902452] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.932726] In-situ OAM (IOAM) with IPv6 lb # [ 0.932769] NET: Registered PF_PACKET protocol family worker1 # [ 0.902458] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.908110] i2c_dev: i2c /dev entries driver worker2 # [ 0.912916] thunder_xcv, ver 1.0 worker1 # [ 0.902481] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.912972] thunder_bgx, ver 1.0 worker2 # [ 0.913000] nicpf, ver 1.0 worker1 # [ 0.902487] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.913663] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.934396] 9pnet: Installing 9P2000 support worker1 # [ 0.902614] sky2: driver version 1.30 worker2 # [ 0.913670] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.913700] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.913709] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.913744] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.913750] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.911351] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.937097] Key type dns_resolver registered worker2 # [ 0.913778] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.911360] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.911217] usbcore: registered new interface driver usb-storage worker2 # [ 0.913784] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.911619] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.913943] sky2: driver version 1.30 worker1 # [ 0.911365] usbcore: registered new interface driver usbserial_generic client # [ 0.911986] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.911380] usbserial: USB Serial support registered for generic client # [ 0.913669] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.911955] hv_vmbus: registering driver hyperv_keyboard client # [ 0.913932] usbcore: registered new interface driver usbhid worker1 # [ 0.913180] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.913938] usbhid: USB HID core driver lb # [ 0.943502] registered taskstats version 1 worker1 # [ 0.913205] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.918733] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.943662] Loading compiled-in X.509 certificates worker1 # [ 0.913411] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.923107] usbcore: registered new interface driver usb-storage client # [ 0.919927] hub 1-0:1.0: USB hub found client # [ 0.920402] hub 1-0:1.0: 6 ports detected worker2 # [ 0.923233] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.923251] usbserial: USB Serial support registered for generic worker1 # [ 0.918824] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.923961] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.918856] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:13:10 UTC (1789981990) client # [ 0.922062] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.919197] i2c_dev: i2c /dev entries driver worker2 # [ 0.928414] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.928447] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.924614] drop_monitor: Initializing network drop monitor service worker2 # [ 0.928767] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.924794] NET: Registered PF_INET6 protocol family client # [ 0.926792] Segment Routing with IPv6 client # [ 0.926810] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.931474] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.952288] Demotion targets for Node 0: null client # [ 0.926840] NET: Registered PF_PACKET protocol family lb # [ 0.952395] Key type .fscrypt registered worker1 # [ 0.923985] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.931506] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T09:13:10 UTC (1789981990) lb # [ 0.952402] Key type fscrypt-provisioning registered worker1 # [ 0.923995] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.931877] i2c_dev: i2c /dev entries driver lb # [ 0.952499] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.924283] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.952519] ima: Allocated hash algorithm: sha1 client # [ 0.928479] 9pnet: Installing 9P2000 support worker1 # [ 0.924638] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.952544] ima: No architecture policies found worker1 # [ 0.926294] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.926548] usbcore: registered new interface driver usbhid worker1 # [ 0.926555] usbhid: USB HID core driver lb # [ 0.956879] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.931096] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.932144] hub 1-0:1.0: USB hub found worker1 # [ 0.932626] hub 1-0:1.0: 6 ports detected client # [ 0.931191] Key type dns_resolver registered worker2 # [ 0.936812] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.936823] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.937098] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.937479] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.934515] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.938434] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.938812] hub 1-0:1.0: USB hub found worker2 # [ 0.938835] hub 1-0:1.0: 6 ports detected client # [ 0.937334] registered taskstats version 1 client # [ 0.937474] Loading compiled-in X.509 certificates worker1 # [ 0.937121] drop_monitor: Initializing network drop monitor service worker1 # [ 0.937272] NET: Registered PF_INET6 protocol family worker1 # [ 0.939217] Segment Routing with IPv6 worker1 # [ 0.939237] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.944759] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.939265] NET: Registered PF_PACKET protocol family worker2 # [ 0.945094] usbcore: registered new interface driver usbhid worker2 # [ 0.945101] usbhid: USB HID core driver worker1 # [ 0.940921] 9pnet: Installing 9P2000 support worker2 # [ 0.948263] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.950060] drop_monitor: Initializing network drop monitor service client # [ 0.946206] Demotion targets for Node 0: null worker2 # [ 0.950243] NET: Registered PF_INET6 protocol family client # [ 0.946376] Key type .fscrypt registered client # [ 0.946406] Key type fscrypt-provisioning registered worker1 # [ 0.943662] Key type dns_resolver registered worker2 # [ 0.953304] Segment Routing with IPv6 client # [ 0.946521] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.953326] In-situ OAM (IOAM) with IPv6 client # [ 0.946565] ima: Allocated hash algorithm: sha1 worker2 # [ 0.953353] NET: Registered PF_PACKET protocol family client # [ 0.946630] ima: No architecture policies found lb # [ 0.974568] clk: Disabling unused clocks client # [ 0.950652] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.974601] PM: genpd: Disabling unused power domains worker1 # [ 0.949735] registered taskstats version 1 worker1 # [ 0.949897] Loading compiled-in X.509 certificates worker2 # [ 0.955057] 9pnet: Installing 9P2000 support worker2 # [ 0.957227] Key type dns_resolver registered lb # [ 0.978938] Freeing unused kernel memory: 4736K lb # [ 0.979130] Run /init as init process worker1 # [ 0.958897] Demotion targets for Node 0: null worker2 # [ 0.965437] registered taskstats version 1 worker1 # [ 0.959015] Key type .fscrypt registered worker1 # [ 0.959021] Key type fscrypt-provisioning registered worker2 # [ 0.965643] Loading compiled-in X.509 certificates worker1 # [ 0.959118] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.959137] ima: Allocated hash algorithm: sha1 worker1 # [ 0.959159] ima: No architecture policies found worker1 # [ 0.963173] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.994021] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 0.974556] Demotion targets for Node 0: null client # [ 0.968243] clk: Disabling unused clocks worker2 # [ 0.974667] Key type .fscrypt registered client # [ 0.968275] PM: genpd: Disabling unused power domains worker2 # [ 0.974674] Key type fscrypt-provisioning registered worker2 # [ 0.974794] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.974814] ima: Allocated hash algorithm: sha1 worker2 # [ 0.974838] ima: No architecture policies found client # [ 0.972504] Freeing unused kernel memory: 4736K client # [ 0.972724] Run /init as init process worker2 # [ 0.979076] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.982154] clk: Disabling unused clocks worker1 # [ 0.982184] PM: genpd: Disabling unused power domains worker1 # [ 0.986448] Freeing unused kernel memory: 4736K client # [ 0.988475] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 0.987244] Run /init as init process worker2 # [ 0.997512] clk: Disabling unused clocks worker2 # [ 0.997544] PM: genpd: Disabling unused power domains worker2 # [ 1.001917] Freeing unused kernel memory: 4736K worker2 # [ 1.002107] Run /init as init process worker1 # [ 1.000998] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.016799] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.167808] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.166251] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.186482] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.182705] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.319758] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.328743] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.336310] systemd[1]: Detected virtualization qemu. lb # [ 1.336377] systemd[1]: Detected architecture arm64. lb # [ 1.336391] systemd[1]: Running in initrd. lb # [ 1.337006] systemd[1]: Initializing machine ID from random generator. lb # [ 1.337174] systemd[1]: Hostname set to . client # [ 1.318487] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.336031] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.323886] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.332586] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.323939] systemd[1]: Detected virtualization qemu. client # [ 1.324006] systemd[1]: Detected architecture arm64. client # [ 1.324027] systemd[1]: Running in initrd. client # [ 1.324893] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.335435] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.325237] systemd[1]: Hostname set to . worker1 # [ 1.335464] systemd[1]: Detected virtualization qemu. worker1 # [ 1.335507] systemd[1]: Detected architecture arm64. worker1 # [ 1.335518] systemd[1]: Running in initrd. worker1 # [ 1.336034] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.336171] systemd[1]: Hostname set to . worker2 # [ 1.351533] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.360302] systemd[1]: Detected virtualization qemu. worker2 # [ 1.362538] systemd[1]: Detected architecture arm64. worker2 # [ 1.364499] systemd[1]: Running in initrd. worker2 # [ 1.367170] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.369978] systemd[1]: Hostname set to . lb # [ 1.399952] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.406450] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.414851] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.422610] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.519809] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.526299] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.534786] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.542446] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.623448] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.612563] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.618220] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.638383] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.675936] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.680039] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.669012] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.676660] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.677697] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.678960] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.679864] systemd[1]: Reached target Path Units. worker2 # [ 1.680604] systemd[1]: Reached target Slice Units. worker2 # [ 1.681310] systemd[1]: Reached target Swaps. worker2 # [ 1.681944] systemd[1]: Reached target Timer Units. worker2 # [ 1.682909] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.683996] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.684966] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.685788] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.686851] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.687788] systemd[1]: Reached target Socket Units. client # [ 1.680254] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.690735] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.686443] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.694214] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.698652] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker1 # [ 1.693439] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.722163] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.702611] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.693614] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.703598] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.710034] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.704666] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.734977] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.736203] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.737504] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.738554] systemd[1]: Reached target Path Units. lb # [ 1.739382] systemd[1]: Reached target Slice Units. lb # [ 1.740264] systemd[1]: Reached target Swaps. worker1 # [ 1.713314] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.741022] systemd[1]: Reached target Timer Units. lb # [ 1.742114] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.743383] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.714722] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.744590] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.714769] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.745594] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.714804] systemd[1]: Reached target Path Units. lb # [ 1.746621] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.714828] systemd[1]: Reached target Slice Units. lb # [ 1.747562] systemd[1]: Reached target Socket Units. worker1 # [ 1.714851] systemd[1]: Reached target Swaps. worker1 # [ 1.714876] systemd[1]: Reached target Timer Units. worker1 # [ 1.715084] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.715252] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.715421] systemd[1]: Listening on Journal Sockets. lb # [ 1.750221] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.715569] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.715689] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.715714] systemd[1]: Reached target Socket Units. worker2 # [ 1.734630] systemd[1]: Starting Journal Service... worker1 # [ 1.728915] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.759960] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.742681] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.735968] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.760055] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.743526] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.737105] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.768054] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.744034] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.746859] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.756146] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.752481] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.753674] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.755125] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.756229] systemd[1]: Reached target Path Units. client # [ 1.757072] systemd[1]: Reached target Slice Units. worker1 # [ 1.756249] systemd[1]: Starting Journal Service... client # [ 1.757950] systemd[1]: Reached target Swaps. client # [ 1.758791] systemd[1]: Reached target Timer Units. client # [ 1.759826] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.761186] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.762432] systemd[1]: Listening on Journal Sockets. client # [ 1.763464] systemd[1]: Listening on udev Control Socket. client # [ 1.764515] systemd[1]: Listening on udev Kernel Socket. client # [ 1.765441] systemd[1]: Reached target Socket Units. client # [ 1.768081] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.774562] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.775701] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.800040] systemd[1]: Starting Journal Service... client # [ 1.775079] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.776278] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.783192] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.783594] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.779461] systemd[1]: Starting Load Kernel Modules... lb # [ 1.807998] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.781041] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.808890] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.786425] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.792052] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.795695] systemd[1]: Starting Journal Service... worker1 # [ 1.794879] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.798909] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.824172] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.811927] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.812823] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.838657] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.811067] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.840701] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.811929] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.812251] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.812489] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.826776] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker2 # [ 1.827012] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.827022] [drm] features: -context_init worker2 # [ 1.827723] [drm] number of scanouts: 1 worker2 # [ 1.827740] [drm] number of cap sets: 0 lb # [ 1.852356] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.852748] systemd[1]: Mounted Kernel Configuration File System. client # [ 1.830478] systemd[1]: Starting Load Kernel Modules... client # [ 1.830609] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.827165] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.831379] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.860167] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.838409] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.843635] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 1.843664] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.869871] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.847168] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.851113] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.848128] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.853837] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.874133] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.849804] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.849699] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.861407] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.861794] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.887926] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.862713] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.867403] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.867639] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.867649] [drm] features: -context_init worker1 # [ 1.868365] [drm] number of scanouts: 1 worker1 # [ 1.868383] [drm] number of cap sets: 0 lb # [ 1.899643] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.875282] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.905452] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.878721] Console: switching to colour frame buffer device 160x50 worker2 # [ 1.885475] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 1.911987] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 1.912006] [drm] features: -context_init lb # [ 1.912761] [drm] number of scanouts: 1 lb # [ 1.912779] [drm] number of cap sets: 0 worker1 # [ 1.887058] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.887083] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 1.895372] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.920123] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.898167] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.901271] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.924984] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 1.911461] systemd[1]: Finished Load Kernel Modules. lb # [ 1.925005] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 1.910264] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.918955] systemd[1]: Starting Apply Kernel Variables... client # [ 1.919544] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.919779] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.919789] [drm] features: -context_init client # [ 1.920503] [drm] number of scanouts: 1 client # [ 1.920520] [drm] number of cap sets: 0 worker2 # [ 1.934546] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.923068] Console: switching to colour frame buffer device 160x50 worker2 # [ 1.936886] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.952687] Console: switching to colour frame buffer device 160x50 lb # [ 1.959280] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.942559] systemd[1]: Reached target Local File Systems. client # [ 1.938974] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.941507] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.950851] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 1.947505] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 1.946581] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.946602] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.984448] systemd[1]: Finished Load Kernel Modules. lb # [ 1.988233] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.961474] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.964725] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.004024] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 2.004463] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.004503] systemd[1]: Reached target Local File Systems. worker2 # [ 1.986564] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.983627] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.985971] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.986016] systemd[1]: Reached target Local File Systems. client # [ 1.982541] Console: switching to colour frame buffer device 160x50 client # [ 1.989225] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.994240] systemd[1]: Started Journal Service. lb # [ 2.020137] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.002906] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.996327] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.003307] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.997476] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.003344] systemd[1]: Reached target Local File Systems. worker2 # [ 1.998609] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 1.999667] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.003043] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.008565] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.009309] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.010356] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.004417] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.005547] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.021391] systemd[1]: Started Journal Service. lb # [ 2.052143] systemd[1]: Finished Apply Kernel Variables. client # [ 2.030409] systemd[1]: Finished Load Kernel Modules. lb # [ 2.055188] systemd[1]: Started Journal Service. worker1 # [ 2.016450] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.044420] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.045680] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.020545] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.024283] systemd-modules-load[74]: Module 'virtio_rng' is built in worker1 # [ 2.025321] systemd[1]: Finished Apply Kernel Variables. lb # [ 2.052305] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.039559] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.028386] systemd[1]: Starting Create System Files and Directories... client # [ 2.026383] systemd-modules-load[75]: Inserted module 'dm_mod' client # [ 2.027655] systemd-modules-load[75]: Module 'virtio_balloon' is built in lb # [ 2.056334] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.028858] systemd-modules-load[75]: Module 'virtio_console' is built in client # [ 2.029923] systemd-modules-load[75]: Inserted module 'virtio_gpu' client # [ 2.030875] systemd-modules-load[75]: Module 'virtio_rng' is built in worker2 # [ 2.041444] systemd-udevd[81]: Using default interface naming scheme 'v261'. client # [ 2.050431] systemd[1]: Started Journal Service. worker2 # [ 2.044730] systemd[1]: Finished Create System Files and Directories. lb # [ 2.064310] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.069671] systemd[1]: Starting Create System Files and Directories... client # [ 2.062605] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.065620] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.073529] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.077788] systemd-udevd[81]: Using default interface naming scheme 'v261'. lb # [ 2.103544] systemd[1]: Finished Create System Files and Directories. lb # [ 2.106232] systemd-udevd[81]: Using default interface naming scheme 'v261'. client # [ 2.086806] systemd-udevd[79]: Using default interface naming scheme 'v261'. client # [ 2.093429] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.109377] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.108765] systemd[1]: Finished Create System Files and Directories. lb # [ 2.138202] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.129280] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.140251] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.168813] systemd[1]: Starting Virtual Console Setup... lb # [ 2.198462] systemd[1]: Starting Virtual Console Setup... client # [ 2.192106] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.212815] systemd-vconsole-setup[105]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.216069] systemd[1]: Finished Virtual Console Setup. lb # [ 2.244539] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.220556] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.248215] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.224163] systemd[1]: Finished Virtual Console Setup. client # [ 2.240513] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.244043] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.832374] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.833595] systemd[1]: Reached target System Initialization. worker1 # [ 2.834450] systemd[1]: Reached target Basic System. worker2 # [ 2.845204] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.846217] systemd[1]: Reached target System Initialization. worker2 # [ 2.847080] systemd[1]: Reached target Basic System. lb # [ 2.869086] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.870244] systemd[1]: Reached target System Initialization. lb # [ 2.871094] systemd[1]: Reached target Basic System. client # [ 2.861472] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.864133] systemd[1]: Reached target System Initialization. client # [ 2.864989] systemd[1]: Reached target Basic System. worker1 # [ 2.959897] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.983901] (udev-worker)[104]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.032276] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.036566] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.039155] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.025935] (udev-worker)[104]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.022654] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.033554] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.028309] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.031446] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.049443] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.054316] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.087866] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.092228] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.090413] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.097294] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.092254] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.095696] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.127846] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.137413] systemd[1]: Reached target Initrd Root Device. lb # [ 3.142258] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.116125] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.117584] systemd[1]: Reached target Initrd Root Device. client # [ 3.120686] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.153729] systemd-fsck[114]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.160244] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.155410] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.168369] systemd[1]: Mounting /sysroot... worker1 # [ 3.161823] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.196514] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.176205] systemd[1]: Mounting /sysroot... client # [ 3.175558] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.204106] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.181621] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.211337] systemd[1]: Mounting /sysroot... client # [ 3.188551] systemd[1]: Mounting /sysroot... worker2 # [ 3.218344] EXT4-fs (vda): mounted filesystem 97bd670e-dfd6-452b-b95d-333e56646b54 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.211120] systemd[1]: Mounted /sysroot. worker2 # [ 3.213512] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.219160] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.228719] EXT4-fs (vda): mounted filesystem 081bd967-e28b-42b1-aa39-a7d26f23863b r/w with ordered data mode. Quota mode: none. lb # [ 3.258920] EXT4-fs (vda): mounted filesystem 354440ba-1f96-4418-b8f3-d4670856c558 r/w with ordered data mode. Quota mode: none. worker1 # [ 3.221094] systemd[1]: Mounted /sysroot. worker1 # [ 3.222215] systemd[1]: Reached target Initrd Root File System. lb # [ 3.248923] systemd[1]: Mounted /sysroot. lb # [ 3.249964] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.225998] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.241094] EXT4-fs (vda): mounted filesystem d8120e89-9010-4664-aa39-806ccbc94f11 r/w with ordered data mode. Quota mode: none. lb # [ 3.255931] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.232796] systemd[1]: Mounted /sysroot. client # [ 3.233925] systemd[1]: Reached target Initrd Root File System. client # [ 3.238509] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.248316] systemd-sysroot-fstab-check[122]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.255138] systemd[1]: Reload requested from client PID 122 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.252267] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.260232] systemd[1]: Reloading... worker1 # [ 3.257757] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.284252] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.262628] systemd[1]: Reloading... lb # [ 3.291052] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.263806] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.296665] systemd[1]: Reloading... client # [ 3.270505] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.275242] systemd[1]: Reloading... worker2 # [ 3.474202] systemd[1]: Reloading finished in 214 ms. worker1 # [ 3.478954] systemd[1]: Reloading finished in 217 ms. lb # [ 3.511620] systemd[1]: Reloading finished in 216 ms. client # [ 3.488116] systemd[1]: Reloading finished in 212 ms. worker2 # [ 3.499992] systemd-sysroot-fstab-check[122]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.506663] systemd-sysroot-fstab-check[122]: Requesting swap.target/start/replace... worker2 # [ 3.515424] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.513666] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.522686] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.517485] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker2 # [ 3.524850] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.516337] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... lb # [ 3.543837] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... client # [ 3.520528] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.523376] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.550100] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker2 # [ 3.532156] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.526636] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.526380] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.554392] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.528986] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.535878] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.534565] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.537294] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.545684] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.537114] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.547226] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.567560] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.577307] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.578380] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.557733] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.559271] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.586324] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.560266] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.588638] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.563203] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.744849] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.761734] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.767522] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.789316] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.818419] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.799399] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.809442] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.836121] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.810975] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.841892] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.821664] systemd[1]: Mounting /sysroot/run... lb # [ 3.852140] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.827646] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.845366] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.843314] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.844600] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.874305] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.857416] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.871775] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.883077] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.879047] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.887421] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.890692] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.882583] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.885327] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.903101] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.923920] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.930411] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.914039] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.946282] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.922146] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.930623] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.924644] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.933744] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.927490] systemd[1]: Mounted /sysroot/run. client # [ 3.927198] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.936245] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.957621] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.960314] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.967783] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.947470] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.954917] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.958497] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.959203] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.963049] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.977014] systemd[1]: Mounted /sysroot/nix/store. lb # [ 3.997885] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.979679] systemd[1]: Reached target Initrd File Systems. lb # [ 3.999371] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.984506] systemd[1]: Starting Find NixOS closure... worker1 # [ 3.982065] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.983563] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.985628] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.989425] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 4.001847] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 3.998481] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.999637] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.031776] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.050455] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.051321] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.053595] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.086283] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.089276] systemd[1]: Stopped target Basic System. worker2 # [ 4.090391] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.092781] systemd[1]: Stopped target Path Units. worker2 # [ 4.096940] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.098615] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.102263] systemd[1]: Stopped target Slice Units. worker2 # [ 4.104750] systemd[1]: Stopped target Socket Units. worker2 # [ 4.109098] systemd[1]: Stopped target System Initialization. worker2 # [ 4.111409] systemd[1]: Stopped target Swaps. worker2 # [ 4.113223] systemd[1]: Stopped target Timer Units. worker2 # [ 4.115221] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.122125] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.123041] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.126268] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.128211] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 4.132936] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.135214] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.137318] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.141117] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.142949] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.148265] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.150442] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.151548] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.164496] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.165424] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.166332] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.167329] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 4.177434] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.179730] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 4.182735] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.186051] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.187831] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.190648] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.192303] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 4.196536] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 4.197472] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.198446] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.200340] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.202190] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.203294] systemd[1]: systemd-udevd.service: Consumed 1.065s CPU time over 2.251s wall clock time, 17.2M memory peak. worker2 # [ 4.204860] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.205836] systemd[1]: Closed udev Control Socket. worker2 # [ 4.206529] systemd[1]: Starting Cleanup udev Database... worker2 # [ 4.207287] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.212256] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.216368] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.217843] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.220251] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 4.224132] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 4.242785] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.245865] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.246939] systemd[1]: Reached target Switch Root. worker2 # [ 4.252423] systemd[1]: Starting NixOS Activation... worker1 # [ 4.405533] (udev-worker)[94]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.411105] (udev-worker)[94]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.412282] (udev-worker)[93]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker2 # [ 4.426744] initrd-nixos-activation-start[174]: booting system configuration /nix/store/jzf4xkwa8xmlj8vk00ys4gir3nz7fy8j-nixos-system-worker2-test lb # [ 4.446247] (udev-worker)[97]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.419943] (udev-worker)[93]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory lb # [ 4.454376] (udev-worker)[97]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.437949] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.440148] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.444168] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.471863] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.444783] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.473140] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.448178] systemd[1]: Starting Virtual Console Setup... lb # [ 4.474751] systemd[1]: Stopping Virtual Console Setup... client # [ 4.447896] systemd[1]: Stopped Virtual Console Setup. client # [ 4.449618] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.478982] systemd[1]: Starting Virtual Console Setup... client # [ 4.452243] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.458271] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.460528] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.487014] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.489032] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.463688] systemd[1]: Starting Virtual Console Setup... lb # [ 4.494319] systemd[1]: Starting Virtual Console Setup... client # [ 4.470209] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.472179] systemd[1]: Stopped Virtual Console Setup. client # [ 4.476181] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.494992] initrd-nixos-activation-start[174]: running activation script... worker1 # [ 4.493991] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.521605] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.497472] systemd[1]: Finished Virtual Console Setup. client # [ 4.494903] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.525097] systemd[1]: Finished Virtual Console Setup. client # [ 4.498483] systemd[1]: Finished Virtual Console Setup. lb # [ 4.819505] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.799771] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.830876] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.858089] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.862272] systemd[1]: Reached target Initrd File Systems. lb # [ 4.889068] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.864757] systemd[1]: Starting Find NixOS closure... lb # [ 4.895022] systemd[1]: Reached target Initrd File Systems. lb # [ 4.897940] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.876418] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.906774] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.891986] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.896819] systemd[1]: Reached target Initrd File Systems. client # [ 4.904471] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.910670] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.918826] initrd-nixos-activation-start[197]: setting up /etc... client # [ 4.908606] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.913427] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.926231] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.928265] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.930312] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.960165] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.963485] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 4.974468] systemd[1]: Finished Find NixOS closure. lb # [ 4.978618] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.955672] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.980941] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.957634] systemd[1]: Stopped target Basic System. worker1 # [ 4.958623] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.959640] systemd[1]: Stopped target Path Units. worker1 # [ 4.960710] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.964345] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.962684] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.966664] systemd[1]: Stopped target Slice Units. worker1 # [ 4.967442] systemd[1]: Stopped target Socket Units. worker1 # [ 4.969504] systemd[1]: Stopped target System Initialization. client # [ 4.967156] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.972162] systemd[1]: Stopped target Swaps. worker1 # [ 4.972894] systemd[1]: Stopped target Timer Units. worker1 # [ 4.974226] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.975728] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.980314] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.981390] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.982095] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 4.982967] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.983816] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 4.983131] systemd[1]: Finished Find NixOS closure. client # [ 4.986658] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.991127] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.988793] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.991918] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.994919] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.021334] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.024423] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.999157] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 5.028270] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.029560] systemd[1]: Stopped target Basic System. worker1 # [ 5.005231] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.006398] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 5.032393] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 5.007548] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.034937] systemd[1]: Stopped target Path Units. lb # [ 5.036455] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 5.039735] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.017129] systemd[1]: Stopped target Local File Systems. client # [ 5.015862] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.044452] systemd[1]: Stopped target Slice Units. client # [ 5.017354] systemd[1]: Stopped target Basic System. worker1 # [ 5.019419] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 5.045374] systemd[1]: Stopped target Socket Units. lb # [ 5.046206] systemd[1]: Stopped target System Initialization. lb # [ 5.047161] systemd[1]: Stopped target Swaps. lb # [ 5.047879] systemd[1]: Stopped target Timer Units. client # [ 5.020581] systemd[1]: Stopped target Initrd Root Device. client # [ 5.021454] systemd[1]: Stopped target Path Units. client # [ 5.023444] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 5.052526] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.028411] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 5.027111] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 5.055020] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.058679] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.033624] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.032214] systemd[1]: Stopped target Slice Units. client # [ 5.032962] systemd[1]: Stopped target Socket Units. worker1 # [ 5.034657] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.033681] systemd[1]: Stopped target System Initialization. client # [ 5.034464] systemd[1]: Stopped target Swaps. client # [ 5.035092] systemd[1]: Stopped target Timer Units. lb # [ 5.063084] systemd[1]: Stopped Find NixOS closure. client # [ 5.035804] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.037905] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.039464] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.065155] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.040245] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.042522] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.041133] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.069110] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.043513] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.042763] systemd[1]: Stopped Find NixOS closure. client # [ 5.044400] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 5.048394] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 5.049477] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.047946] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.050341] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.051252] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.051973] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 5.080260] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.054543] systemd[1]: systemd-udevd.service: Consumed 1.437s CPU time over 3.044s wall clock time, 25.4M memory peak. worker1 # [ 5.056232] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.055151] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.057256] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.083222] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.058101] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.059091] systemd[1]: Closed udev Control Socket. lb # [ 5.084467] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.059791] systemd[1]: Starting Cleanup udev Database... lb # [ 5.085611] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.060664] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.086345] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.059253] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.061721] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.087477] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.062575] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.063658] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.068275] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.070211] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.072278] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.100187] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.073187] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.074362] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.075454] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 5.103542] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.106134] systemd[1]: Stopped target Local File Systems. lb # [ 5.107597] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 5.110853] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.113507] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.086413] systemd[1]: Stopped Create System Files and Directories. client # [ 5.088411] systemd[1]: Stopped target Local File Systems. lb # [ 5.116412] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 5.117568] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.090183] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.092375] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.120286] systemd[1]: Stopped Virtual Console Setup. client # [ 5.094832] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.122257] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.123440] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.096459] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 5.124412] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.125440] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.126236] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.127164] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.100185] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.101259] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.104708] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.103918] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.105190] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 5.132267] systemd[1]: systemd-udevd.service: Consumed 1.445s CPU time over 3.098s wall clock time, 22.3M memory peak. client # [ 5.106116] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 5.108501] systemd[1]: Finished Cleanup udev Database. client # [ 5.107105] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.109373] systemd[1]: Reached target Switch Root. client # [ 5.107976] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.110596] systemd[1]: Starting NixOS Activation... lb # [ 5.136354] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.109089] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 5.137697] systemd[1]: Closed udev Control Socket. client # [ 5.110061] systemd[1]: systemd-udevd.service: Consumed 1.421s CPU time over 3.097s wall clock time, 22.3M memory peak. client # [ 5.111502] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.140251] systemd[1]: Starting Cleanup udev Database... lb # [ 5.141067] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.116220] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.144158] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.145060] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.120193] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.148154] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.121543] systemd[1]: Closed udev Control Socket. lb # [ 5.149149] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.122412] systemd[1]: Starting Cleanup udev Database... client # [ 5.123191] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.152268] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.128247] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.129135] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.130240] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.132093] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.136311] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.178819] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.182269] systemd[1]: Finished Cleanup udev Database. lb # [ 5.183148] systemd[1]: Reached target Switch Root. client # [ 5.159813] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.188352] systemd[1]: Starting NixOS Activation... client # [ 5.163281] systemd[1]: Finished Cleanup udev Database. client # [ 5.164504] systemd[1]: Reached target Switch Root. client # [ 5.165587] systemd[1]: Starting NixOS Activation... worker2 # [ 5.184587] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.187366] systemd[1]: Finished NixOS Activation. worker2 # [ 5.192322] systemd[1]: Starting Switch Root... worker2 # [ 5.208178] systemd[1]: Switching root. worker1 # [ 5.291440] initrd-nixos-activation-start[180]: booting system configuration /nix/store/143xd0r0k7bpy3hb59k6jhcv7f9kn0pn-nixos-system-worker1-test lb # [ 5.353202] initrd-nixos-activation-start[180]: booting system configuration /nix/store/168cy51b13gm4gbaddwdhrwvcvzdxbrq-nixos-system-lb-test client # [ 5.341879] initrd-nixos-activation-start[180]: booting system configuration /nix/store/p6p9342ifnppad60sm4s8zcrc0dk790i-nixos-system-client-test worker1 # [ 5.358283] initrd-nixos-activation-start[180]: running activation script... worker2 # [ 5.394110] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 5.420657] initrd-nixos-activation-start[180]: running activation script... client # [ 5.409943] initrd-nixos-activation-start[180]: running activation script... worker1 # [ 5.781441] initrd-nixos-activation-start[203]: setting up /etc... lb # [ 5.838333] initrd-nixos-activation-start[203]: setting up /etc... client # [ 5.839645] initrd-nixos-activation-start[203]: setting up /etc... worker2 # [ 6.001732] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.014554] systemd[1]: Detected virtualization qemu. worker2 # [ 6.017686] systemd[1]: Detected architecture arm64. worker2 # [ 6.021617] systemd[1]: Detected first boot. worker2 # [ 6.029338] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.059156] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.062172] systemd[1]: Finished NixOS Activation. worker1 # [ 6.063290] systemd[1]: Starting Switch Root... lb # [ 6.097746] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 6.101099] systemd[1]: Finished NixOS Activation. lb # [ 6.102467] systemd[1]: Starting Switch Root... worker1 # [ 6.084948] systemd[1]: Switching root. lb # [ 6.130535] systemd[1]: Switching root. client # [ 6.109728] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.112157] systemd[1]: Finished NixOS Activation. client # [ 6.113734] systemd[1]: Starting Switch Root... client # [ 6.135748] systemd[1]: Switching root. worker1 # [ 6.266417] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.314719] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 6.317988] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.357513] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.548795] systemd[1]: Applying preset policy. worker1 # [ 6.832202] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.842831] systemd[1]: Detected virtualization qemu. worker1 # [ 6.845494] systemd[1]: Detected architecture arm64. worker1 # [ 6.849078] systemd[1]: Detected first boot. worker1 # [ 6.855183] systemd[1]: Initializing machine ID from random generator. lb # [ 6.879376] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.892371] systemd[1]: Detected virtualization qemu. lb # [ 6.895312] systemd[1]: Detected architecture arm64. lb # [ 6.898531] systemd[1]: Detected first boot. lb # [ 6.904966] systemd[1]: Initializing machine ID from random generator. client # [ 6.901112] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.913727] systemd[1]: Detected virtualization qemu. client # [ 6.916896] systemd[1]: Detected architecture arm64. client # [ 6.921067] systemd[1]: Detected first boot. client # [ 6.928364] systemd[1]: Initializing machine ID from random generator. worker2 # [ 7.029547] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.181885] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 7.227551] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.260045] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 7.378818] systemd[1]: Applying preset policy. lb # [ 7.423697] systemd[1]: Applying preset policy. client # [ 7.452723] systemd[1]: Applying preset policy. worker2 # [ 7.499114] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.500418] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 7.503862] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 7.507989] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.510050] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.511642] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.513388] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.516121] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 7.517134] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.519656] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.520794] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.522318] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.523937] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.525643] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.527677] systemd[1]: Reached target Path Units. worker2 # [ 7.528664] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.529940] systemd[1]: Reached target Slice Units. worker2 # [ 7.531282] systemd[1]: Reached target Swaps. worker2 # [ 7.535360] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.540582] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.544598] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.548731] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.549932] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.556123] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 7.558503] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.563378] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.565146] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.567030] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.570229] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.581759] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.582242] systemd[1]: Listening on udev Control Socket. worker2 # [ 7.584304] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.588780] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.593198] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 7.601019] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.611142] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 7.628509] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 7.635215] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 7.639654] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 7.652517] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.652939] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.653211] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.679829] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 7.683207] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.705363] systemd[1]: Starting Journal Service... worker2 # [ 7.764417] systemd[1]: Starting Load Kernel Modules... worker2 # [ 7.794716] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.807886] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.808285] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.823075] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 7.828704] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 7.832876] systemd[1]: Mounted Huge Pages File System. worker2 # [ 7.836033] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 7.838356] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 7.841200] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 7.841678] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.901564] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.876305] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.903245] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 7.909312] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 7.926647] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.957451] systemd-journald[269]: Collecting audit messages is enabled. worker2 # [ 7.967331] systemd[1]: Finished Load Kernel Modules. worker2 # [ 7.976870] systemd[1]: Starting Firewall... worker2 # [ 7.979236] EXT4-fs (vda): re-mounted 97bd670e-dfd6-452b-b95d-333e56646b54. worker2 # [ 7.990894] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 7.998945] systemd[1]: Started Journal Service. worker2 # [ 7.988975] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 7.996626] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.008755] systemd-modules-load[270]: Module 'atkbd' is built in worker2 # [ 8.017693] systemd-modules-load[270]: Module 'loop' is built in worker2 # [ 8.037669] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.048686] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.059139] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 8.080815] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.094265] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 8.106837] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os[ 8.133842] fuse: init (API version 7.45) worker2 # worker2 # [ 8.123793] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 8.133486] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 8.156556] systemd-oomd[271]: No swap; memory pressure usage will be degraded worker2 # [ 8.182854] systemd-journald[269]: Received client request to flush runtime journal. worker2 # [ 8.238569] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 8.242872] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 8.244320] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.247320] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 8.251179] systemd[1]: Reached target First Boot Complete. worker2 # [ 8.255061] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 8.258591] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 8.263719] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 8.268648] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 8.349502] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 8.352223] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 8.355885] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.389113] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 8.390467] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.393830] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 8.398136] systemd[1]: Created slice Slice /system/getty. worker1 # [ 8.400140] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.401451] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 8.430437] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 8.403431] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 8.432070] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.405176] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 8.406709] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.408254] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.435017] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 8.409841] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.438941] systemd[1]: Created slice Slice /system/getty. worker1 # [ 8.411445] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.441214] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.413804] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 8.442495] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 8.415957] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.444299] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.418040] systemd[1]: Reached target Path Units. lb # [ 8.445782] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.447014] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.420013] systemd[1]: Reached target Remote File Systems. lb # [ 8.448504] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 8.421972] systemd[1]: Reached target Slice Units. lb # [ 8.450437] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 8.423925] systemd[1]: Reached target Swaps. lb # [ 8.451493] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.452842] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.429302] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 8.454300] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.428421] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.430929] systemd[1]: Stopped initrd-switch-root.service. lb # [ 8.456152] systemd[1]: Reached target Path Units. lb # [ 8.457624] systemd[1]: Reached target Remote File Systems. client # [ 8.434029] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 8.459193] systemd[1]: Reached target Slice Units. worker1 # [ 8.433535] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.460845] systemd[1]: Reached target Swaps. client # [ 8.437805] systemd[1]: Created slice Slice /system/getty. client # [ 8.439529] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.437958] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 8.465319] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.440836] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.442988] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.442286] systemd[1]: Listening on Factory Reset Management. client # [ 8.445492] systemd[1]: Expecting device /dev/hvc0... lb # [ 8.470666] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.444470] systemd[1]: Listening on Hostname Service Socket. client # [ 8.446593] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.448894] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.450040] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.475258] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.451566] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 8.450436] systemd[1]: Starting Journal Log Access Socket... client # [ 8.453930] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 8.479636] systemd[1]: Listening on Factory Reset Management. lb # [ 8.480955] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.453652] systemd[1]: Listening on Journal Audit Socket. client # [ 8.455134] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.457573] systemd[1]: Reached target Path Units. worker1 # [ 8.458281] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.459465] systemd[1]: Reached target Remote File Systems. lb # [ 8.487018] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.460056] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.461356] systemd[1]: Reached target Slice Units. client # [ 8.463273] systemd[1]: Reached target Swaps. lb # [ 8.489248] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.461961] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.464120] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.492898] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.467558] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 8.494394] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 8.495824] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.472527] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.498044] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.476725] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 8.476213] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.476707] systemd[1]: Listening on udev Control Socket. client # [ 8.480904] systemd[1]: Listening on Factory Reset Management. worker1 # [ 8.477072] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.507865] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.482682] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.483361] systemd[1]: Mounting Huge Pages File System... lb # [ 8.509788] systemd[1]: Listening on udev Control Socket. lb # [ 8.511430] systemd[1]: Listening on udev Varlink Socket. client # [ 8.488641] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.487806] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.490821] systemd[1]: Listening on Journal Audit Socket. lb # [ 8.516044] systemd[1]: Mounting Huge Pages File System... client # [ 8.495451] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.498024] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 8.524432] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 8.497731] systemd[1]: Mounting Kernel Debug File System... client # [ 8.500395] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.503325] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.499249] systemd[1]: Mounting /run/wrappers... lb # [ 8.535754] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 8.501485] systemd[1]: Mounting FUSE Control File System... worker1 # [ 8.512438] systemd[1]: Mounting Kernel Trace File System... client # [ 8.516299] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.516877] systemd[1]: Listening on udev Control Socket. client # [ 8.517299] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.549127] systemd[1]: Mounting Kernel Trace File System... client # [ 8.523424] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.526237] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.529352] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 8.562259] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.537194] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 8.536293] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 8.539249] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.540865] systemd[1]: Mounted FUSE Control File System. client # [ 8.551518] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.551503] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.580116] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 8.553996] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 8.581629] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.558994] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 8.564865] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.581389] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 8.579234] systemd[1]: Starting Load Kernel Module fuse... lb # [ 8.607927] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.583507] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.609462] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 8.579367] systemd[1]: Mounted /run/wrappers. worker1 # [ 8.584623] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.584636] systemd[1]: Reached target Local File Systems. lb # [ 8.618262] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.592302] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 8.596147] systemd[1]: Starting register-nix-paths.service... client # [ 8.605997] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.607797] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 8.611680] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.605730] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 8.639371] systemd[1]: Starting Load Kernel Module fuse... lb # [ 8.644972] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.616510] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.620833] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 8.671929] systemd[1]: Starting Journal Service... worker2 # [ 8.635271] systemd[1]: Starting Create System Files and Directories... worker1 # [ 8.652122] systemd[1]: Starting Journal Service... lb # [ 8.691727] systemd[1]: Starting Load Kernel Modules... worker1 # [ 8.671281] systemd[1]: Starting Load Kernel Modules... client # [ 8.679242] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.680856] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 8.712193] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 8.700371] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 8.706767] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.709568] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.741863] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 8.720935] systemd[1]: Starting Journal Service... lb # [ 8.745788] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.720933] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 8.729259] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 8.724184] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 8.731825] systemd[1]: Mounted Huge Pages File System. worker1 # [ 8.735060] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 8.762607] fuse: init (API version 7.45) worker1 # [ 8.737497] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 8.740984] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 8.737551] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 8.744621] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.747215] systemd[1]: Starting Load Kernel Modules... lb # [ 8.777476] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.785484] systemd-journald[274]: Collecting audit messages is enabled. lb # [ 8.791444] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.783071] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.811680] systemd[1]: Started Journal Service. lb # [ 8.794522] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 8.792930] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.805848] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.808615] systemd[1]: Mounted Huge Pages File System. worker1 # [ 8.800619] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.817035] systemd[1]: Mounted POSIX Message Queue File System. client # [ 8.807936] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 8.821958] systemd[1]: Mounted Kernel Debug File System. client # [ 8.811368] fuse: init (API version 7.45) client # [ 8.814698] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.829848] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.830830] systemd[1]: Finished Create List of Static Device Nodes. client # [ 8.822544] systemd-journald[274]: Collecting audit messages is enabled. lb # [ 8.831988] systemd-modules-load[275]: Module 'atkbd' is built in lb # [ 8.844614] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.845641] systemd-modules-load[275]: Module 'loop' is built in lb # [ 8.846471] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 8.847325] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.824817] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.826995] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 8.848071] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.860372] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 8.861338] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.862103] systemd[1]: Finished Load Kernel Modules. worker2 # [ 8.843122] systemd-udevd[307]: Using default interface naming scheme 'v261'. lb # [ 8.879904] EXT4-fs (vda): re-mounted 354440ba-1f96-4418-b8f3-d4670856c558. lb # [ 8.872399] systemd[1]: Mounting FUSE Control File System... worker1 # [ 8.862963] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 8.865930] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 8.862950] systemd[1]: Finished Create System Files and Directories. lb # [ 8.883474] systemd[1]: Starting Firewall... worker1 # [ 8.876315] EXT4-fs (vda): re-mounted 081bd967-e28b-42b1-aa39-a7d26f23863b. client # [ 8.883218] systemd[1]: Started Journal Service. worker2 # [ 8.872289] systemd[1]: Starting Rebuild Journal Catalog... client # [ 8.872124] systemd-modules-load[275]: Module 'atkbd' is built in worker2 # [ 8.881205] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 8.902292] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 8.890520] systemd[1]: Finished Load Kernel Modules. client # [ 8.878496] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 8.898423] systemd[1]: Starting Firewall... client # [ 8.886201] systemd[1]: Mounted Huge Pages File System. client # [ 8.886993] systemd[1]: Mounted POSIX Message Queue File System. client # [ 8.887847] systemd[1]: Mounted Kernel Debug File System. lb # [ 8.918120] systemd-oomd[277]: No swap; memory pressure usage will be degraded worker1 # [ 8.911711] systemd[1]: Starting Apply Kernel Variables... client # [ 8.897825] systemd[1]: Mounted Kernel Trace File System. client # [ 8.898655] systemd-modules-load[275]: Module 'loop' is built in client # [ 8.899503] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.932197] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 8.919906] fuse: init (API version 7.45) worker1 # [ 8.920660] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 8.921342] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 8.921672] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 8.927392] EXT4-fs (vda): re-mounted d8120e89-9010-4664-aa39-806ccbc94f11. lb # [ 8.940107] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 8.912678] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 8.913747] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.914596] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.915446] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.922836] systemd[1]: Finished Load Kernel Module fuse. worker1 # [ 8.942891] systemd[1]: Starting Load/Save OS Random Seed... client # [ 8.929434] systemd[1]: Finished Load Kernel Modules. lb # [ 8.955453] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 8.945489] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.932323] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 8.938220] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 8.942275] systemd[1]: Mounting FUSE Control File System... worker1 # [ 8.958937] systemd-journald[274]: Collecting audit messages is enabled. lb # [ 8.984665] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 8.961688] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 8.979114] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 8.982935] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.967044] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 9.008537] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 8.981290] systemd-oomd[277]: No swap; memory pressure usage will be degraded worker1 # [ 8.997089] systemd[1]: Started Journal Service. worker1 # [ 8.986816] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.983720] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 8.990563] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 9.001946] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.013562] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 9.027227] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 9.028434] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.009977] systemd-modules-load[275]: Module 'atkbd' is built in client # [ 9.003654] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 9.018141] systemd-modules-load[275]: Module 'loop' is built in client # [ 9.026671] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 9.029356] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.031127] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 9.056070] systemd-journald[274]: Received client request to flush runtime journal. worker1 # [ 9.061113] systemd-oomd[276]: No swap; memory pressure usage will be degraded lb # [ 9.094850] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.079539] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 9.125203] systemd-journald[274]: Received client request to flush runtime journal. worker1 # [ 9.087541] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 9.100745] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 9.095049] systemd[1]: Reached target First Boot Complete. worker2 # [ 9.104871] systemd[1]: Starting Update is Completed... worker1 # [ 9.117269] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.134394] systemd-journald[274]: Received client request to flush runtime journal. client # [ 9.133804] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 9.139654] systemd[1]: Mounted FUSE Control File System. client # [ 9.146361] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.153093] systemd[1]: Reached target First Boot Complete. client # [ 9.156685] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 9.191558] systemd[1]: Mounted FUSE Control File System. client # [ 9.170067] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.200747] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 9.204388] systemd[1]: Reached target First Boot Complete. lb # [ 9.205337] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 9.190808] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.213452] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.214382] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 9.190861] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 9.200365] systemd[1]: Finished Update is Completed. worker1 # [ 9.203409] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.208513] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 9.218289] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 9.224927] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.305526] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 9.307667] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 9.315047] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 9.295208] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.296725] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 9.298939] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.322864] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.324108] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.326913] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 9.383815] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.393726] systemd[1]: Mounting FUSE Control File System... lb # [ 9.427202] systemd[1]: Mounting /run/wrappers... client # [ 9.416088] systemd[1]: Mounting /run/wrappers... lb # [ 9.449275] systemd-udevd[318]: Using default interface naming scheme 'v261'. worker1 # [ 9.428225] systemd[1]: Mounted FUSE Control File System. client # [ 9.448263] systemd-udevd[307]: Using default interface naming scheme 'v261'. worker1 # [ 9.462679] systemd-udevd[315]: Using default interface naming scheme 'v261'. client # [ 9.462365] systemd[1]: Mounted /run/wrappers. client # [ 9.463305] systemd[1]: Reached target Local File Systems. lb # [ 9.493843] systemd[1]: Mounted /run/wrappers. lb # [ 9.495017] systemd[1]: Reached target Local File Systems. client # [ 9.468179] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 9.470726] systemd[1]: Mounted /run/wrappers. worker1 # [ 9.472175] systemd[1]: Reached target Local File Systems. client # [ 9.472215] systemd[1]: Starting register-nix-paths.service... lb # [ 9.500461] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.505087] systemd[1]: Starting register-nix-paths.service... worker1 # [ 9.480658] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 9.484208] systemd[1]: Starting register-nix-paths.service... client # [ 9.485268] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 9.490664] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.487407] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.496297] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.497412] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.508863] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 9.534730] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.513591] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.515724] systemd[1]: Starting Create System Files and Directories... lb # [ 9.535818] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 9.544593] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 9.579569] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.600388] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.608425] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 9.612880] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.615595] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.707753] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.738573] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.712291] systemd[1]: Finished Create System Files and Directories. lb # [ 9.747204] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.726319] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 9.741477] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 9.744604] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 9.741827] systemd[1]: Finished Create System Files and Directories. client # [ 9.740168] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.752189] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 9.754388] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.823643] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.840493] systemd[1]: Finished Create System Files and Directories. lb # [ 9.863084] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 9.840995] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.838359] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.869527] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.895334] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.894707] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.903284] systemd[1]: Starting Update is Completed... client # [ 9.966659] systemd[1]: Finished Update is Completed. lb # [ 10.006447] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.991221] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 9.994895] systemd[1]: Starting Update is Completed... worker1 # [ 10.061986] systemd[1]: Finished Update is Completed. lb # [ 10.091123] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 10.095803] systemd[1]: Starting Update is Completed... lb # [ 10.183209] systemd[1]: Finished Update is Completed. worker2 # [ 10.285356] systemd[1]: Finished Firewall. client # [ 10.400727] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.406540] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.475444] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 10.528795] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 10.532765] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 10.663726] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.640110] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.674089] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.708927] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 10.777325] systemd[1]: Finished register-nix-paths.service. worker2 # [ 10.779520] systemd[1]: Reached target System Initialization. worker2 # [ 10.781367] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 10.783887] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 10.789613] systemd[1]: Reached target Timer Units. worker2 # [ 10.790472] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 10.794920] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 10.796838] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 10.800335] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 10.809175] systemd[1]: Reached target Socket Units. worker2 # [ 10.816482] systemd[1]: Reached target Basic System. worker2 # [ 10.824911] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 10.828645] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 10.843286] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.854285] systemd[1]: Started Reset console on configuration changes. worker2 # [ 10.859603] systemd[1]: Starting resolvconf update... worker2 # [ 10.865679] systemd[1]: Starting D-Bus System Message Bus... client # [ 10.906179] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 10.933276] systemd[1]: Finished Post-Boot Actions. lb # [ 10.974354] systemd[1]: Finished register-nix-paths.service. worker2 # [ 10.989149] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 10.968876] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 10.986965] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.990752] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.000341] nsncd[492]: Sep 21 09:13:20.571 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.007713] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.032848] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 11.018128] systemd[1]: Starting User Login Management... lb # [ 11.035395] systemd[1]: Reached target System Initialization. lb # [ 11.039210] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 11.023557] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 11.045274] systemd[1]: Started niks3 garbage collection timer. lb # [ 11.046957] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 11.055239] systemd[1]: Reached target Timer Units. lb # [ 11.056425] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 11.057362] systemd[1]: Listening on niks3 server socket. lb # [ 11.058135] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.058916] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 11.065218] systemd[1]: Reached target Socket Units. lb # [ 11.072736] systemd[1]: Reached target Basic System. lb # [ 11.073540] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.074526] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.086336] systemd[1]: Starting Post-Boot Actions... worker1 # [ 11.077755] systemd[1]: Finished Firewall. worker2 # [ 11.100459] dbus-broker-launch[496]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.120246] systemd[1]: Started Reset console on configuration changes. worker2 # [ 11.115362] dbus-broker-launch[496]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.118677] dbus-broker-launch[496]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.157131] systemd[1]: Starting resolvconf update... client # [ 11.148073] systemd[1]: Finished register-nix-paths.service. client # [ 11.149068] systemd[1]: Reached target System Initialization. lb # [ 11.178468] systemd[1]: Started rustfs.service. client # [ 11.152256] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.154141] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 11.163428] systemd[1]: Started D-Bus System Message Bus. client # [ 11.156410] systemd[1]: Reached target Timer Units. client # [ 11.158490] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.164226] systemd[1]: Listening on Nix Daemon Socket. client # [ 11.165974] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.169189] systemd[1]: Reached target Socket Units. client # [ 11.172737] systemd[1]: Reached target Basic System. client # [ 11.173689] systemd[1]: Started backdoor.service. client # [ 11.176164] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 11.178262] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 11.182240] systemd-logind[504]: New seat seat0. worker2 # [ 11.187716] systemd[1]: Started User Login Management. client # [ 11.181700] systemd[1]: Starting nftables firewall... worker2 # [ 11.193182] systemd[1]: Starting linger-users.service... lb # [ 11.218363] nsncd[484]: Sep 21 09:13:20.821 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 11.234734] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 11.217367] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 11.218767] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.239499] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.225692] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.215407] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.226047] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.238664] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 11.232834] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 11.241933] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.263154] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.253611] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.261253] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 11.262262] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.266077] dbus-broker-launch[496]: Ready client # [ 11.265608] systemd[1]: Started Reset console on configuration changes. client # [ 11.289040] systemd[1]: Starting resolvconf update... lb # [ 11.325401] systemd[1]: Reached target Host and Network Name Lookups. client # connecting to host... lb # [ 11.332493] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.315107] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.320480] systemd[1]: Finished linger-users.service. lb # [ 11.345352] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.349166] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 11.337536] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.339076] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.344961] nsncd[562]: Sep 21 09:13:20.918 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.347054] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.379565] systemd[1]: Starting User Login Management... lb # [ 11.389558] systemd[1]: Finished Import lastlog data into lastlog2 database. client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 11.383710] systemd[1]: Finished resolvconf update. worker2 # [ 11.388508] systemd[1]: Reached target Preparation for Network. client # [ 11.383410] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.392459] systemd[1]: Starting DHCP Client... client # [ 11.403267] nsncd[399]: Sep 21 09:13:21.014 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 11.438072] systemd[1]: Finished Firewall. client # [ 11.412943] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.394879] systemd[1]: Starting Extra networking commands.... client # [ 11.417558] systemd[1]: Finished Import lastlog data into lastlog2 database. client: connected to guest root shell client # [ 11.425015] (udev-worker)[334]: Network interface NamePolicy= disabled on kernel command line. client: (connecting took 11.88 seconds) client # [ 11.430729] systemd[1]: Reached target Host and Network Name Lookups. client: (finished: waiting for the VM to finish booting, in 11.88 seconds) client # [ 11.434896] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.422713] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 11.444492] systemd[1]: Starting D-Bus System Message Bus... client # [ 11.477444] systemd[1]: Starting User Login Management... worker1 # [ 11.485695] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client # [ 11.485373] (udev-worker)[377]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 11.500082] systemd[1]: Finished register-nix-paths.service. client # [ 11.496538] (udev-worker)[377]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 11.503313] systemd[1]: Reached target System Initialization. worker1 # [ 11.506712] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 11.508708] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 11.510966] systemd[1]: Reached target Timer Units. worker1 # [ 11.513554] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 11.518094] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 11.522433] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 11.530457] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.542618] systemd[1]: Reached target Socket Units. worker1 # [ 11.554455] systemd[1]: Reached target Basic System. worker1 # [ 11.557568] systemd[1]: Started backdoor.service. worker1 # [ 11.564840] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.594246] dbus-broker-launch[520]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 11.577288] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.604469] dbus-broker-launch[520]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.584626] systemd[1]: Starting Post-Boot Actions... lb # [ 11.612249] dbus-broker-launch[520]: Invalid user-name in /nix/store/r3k08synkldj3yxnxmc97ljig0y68d44-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 11.591645] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.603940] systemd[1]: Starting resolvconf update... worker2 # [ 11.617097] dhcpcd[594]: dhcpcd-10.3.2 starting worker1 # [ 11.615881] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.653954] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 11.637454] dhcpcd[626]: dev: loaded udev worker2 # [ 11.643235] dhcpcd[626]: no valid interfaces found worker2 # [ 11.645943] dhcpcd[626]: no valid interfaces found lb # [ 11.683018] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.690024] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.700196] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 11.706861] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.692436] systemd[1]: Finished Extra networking commands.. worker2 # [ 11.694260] systemd[1]: Reached target Network. worker1 # [ 11.688471] systemd[1]: Finished Post-Boot Actions. lb # [ 11.714219] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 11.697548] systemd[1]: Starting Permit User Sessions... lb # [ 11.720778] systemd[1]: nscd.service: Deactivated successfully. lb # [ 11.729772] systemd-logind[523]: New seat seat0. client # [ 11.705367] dbus-broker-launch[427]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.742649] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.751460] systemd[1]: Started User Login Management. client # [ 11.722678] dbus-broker-launch[427]: NSS returned no entry for 'systemd-timesync' lb # [ 11.757854] dbus-broker-launch[520]: Ready client # [ 11.731844] dbus-broker-launch[427]: Invalid user-name in /nix/store/i87y3v12qnxz4jgnndbs0w0ih92vmmjw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.767200] systemd[1]: Starting linger-users.service... worker1 # [ 11.744573] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.751408] systemd[1]: Finished Permit User Sessions. worker2 # [ 11.756274] systemd[1]: Started Getty on tty1. worker1 # connecting to host... worker2 # [ 11.757763] systemd[1]: Reached target Login Prompts. worker1 # [ 11.753515] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.754870] nsncd[497]: Sep 21 09:13:21.342 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.755050] systemd-logind[433]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 11.787254] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.765684] systemd-logind[433]: New seat seat0. client # [ 11.766410] systemd[1]: Started User Login Management. client # [ 11.773275] systemd[1]: Starting linger-users.service... worker1 # [ 11.776196] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.777171] systemd[1]: Starting User Login Management... worker1 # [ 11.804763] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.805712] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 11.830739] systemd[1]: Starting Virtual Console Setup... client # [ 11.857001] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 11.858042] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.858884] systemd[1]: Stopped target User and Group Name Lookups. client # [ 11.859746] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 11.865815] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.872488] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.876592] dbus-broker-launch[427]: Ready lb # [ 11.908692] systemd[1]: Finished resolvconf update. worker1 # [ 11.886022] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync' lb # [ 11.912487] systemd[1]: linger-users.service: Deactivated successfully. client # [ 11.885630] systemd[1]: nscd.service: Deactivated successfully. client # [ 11.889906] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.918273] systemd[1]: Finished linger-users.service. lb # [ 11.924696] nsncd[585]: Sep 21 09:13:21.521 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.895255] dbus-broker-launch[501]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.902411] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 11.933703] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.908795] systemd[1]: Finished linger-users.service. lb # [ 11.937037] systemd[1]: Reached target Preparation for Network. lb # [ 11.940953] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.946358] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.951354] systemd[1]: Starting DHCP Client... lb # [ 11.958379] systemd[1]: Starting Extra networking commands.... client # [ 11.931342] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.937816] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.999501] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 11.980526] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 11.979755] systemd-logind[511]: New seat seat0. worker1 # [ 11.986731] systemd[1]: Started User Login Management. worker1 # [ 11.994579] systemd[1]: Starting linger-users.service... worker1 # [ 12.010481] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 12.011536] systemd[1]: Stopping Host and Network Name Lookups... client # [ 12.015286] systemd[1]: Finished resolvconf update. client # [ 12.020977] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 12.024425] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 12.025349] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 12.026166] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 12.027037] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 12.027842] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 12.027940] nsncd[504]: Sep 21 09:13:21.632 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 12.033525] systemd[1]: Reached target Host and Network Name Lookups. client # [ 12.038152] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 12.043127] dbus-broker-launch[501]: Ready client # [ 12.044332] systemd[1]: Starting DHCP Client... worker1 # [ 12.047175] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 12.080692] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 12.091555] systemd[1]: Started backdoor.service. client # [ 12.064569] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.105765] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 12.106806] systemd[1]: Finished linger-users.service. worker1 # [ 12.124786] (udev-worker)[387]: Network interface NamePolicy= disabled on kernel command line. client # [ 12.141867] mousedev: PS/2 mouse device common for all mice worker1 # [ 12.137107] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 12.138122] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 12.139006] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 12.151211] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 12.146420] nsncd[568]: Sep 21 09:13:21.731 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 12.156908] (udev-worker)[375]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 12.159142] (udev-worker)[375]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.180497] systemd[1]: Finished resolvconf update. worker1 # [ 12.181343] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.187474] systemd[1]: Starting DHCP Client... worker1 # [ 12.191675] systemd[1]: Starting Extra networking commands.... worker2 # [ 12.221161] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 12.229907] systemd[1]: Started backdoor.service. lb # connecting to host... worker2 # [ 12.261898] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.261130] dhcpcd[534]: dhcpcd-10.3.2 starting client # [ 12.264294] systemd-logind[433]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 12.281496] dhcpcd[543]: dev: loaded udev client # [ 12.293749] systemd[1]: Finished nftables firewall. client # [ 12.297188] systemd[1]: Reached target Preparation for Network. client # [ 12.303725] systemd[1]: Starting Address configuration of eth1... client # [ 12.310586] systemd[1]: Starting Extra networking commands.... lb # [ 12.342152] dhcpcd[618]: dhcpcd-10.3.2 starting lb # [ 12.357040] dhcpcd[662]: dev: loaded udev worker2 # [ 12.352403] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.357427] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.385947] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.388368] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.392865] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.393205] cfg80211: failed to load regulatory.db worker2 # connecting to host... lb # [ 12.429414] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.425614] systemd[1]: Finished Extra networking commands.. worker2 # [ 12.408328] (udev-worker)[661]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 12.430432] systemd[1]: Reached target Network. worker2 # [ 12.415159] (udev-worker)[653]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.419202] (udev-worker)[661]: Network interface NamePolicy= disabled on kernel command line. lb # [ 12.443297] systemd[1]: Starting PostgreSQL Server... worker1 # [ 12.433212] dhcpcd[604]: dhcpcd-10.3.2 starting lb # [ 12.458947] systemd[1]: Starting Permit User Sessions... worker1 # [ 12.437516] systemd-logind[511]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 12.451885] dhcpcd[644]: dev: loaded udev worker2 # [ 12.459855] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 12.481788] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.466832] systemd[1]: Finished Virtual Console Setup. client # [ 12.479736] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.487068] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 12.483054] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.488537] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.509821] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.495876] network-addresses-eth1-start[547]: adding address 192.168.1.1/24... done client # [ 12.537191] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.537721] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 12.525162] network-addresses-eth1-start[547]: adding address 2001:db8:1::1/64... done worker1 # [ 12.529455] systemd[1]: Finished Extra networking commands.. client # [ 12.544703] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.545025] cfg80211: failed to load regulatory.db worker1 # [ 12.535972] systemd[1]: Reached target Network. lb # [ 12.564760] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.542004] systemd[1]: Starting Permit User Sessions... client # [ 12.557445] systemd[1]: Finished Address configuration of eth1. lb # [ 12.585286] systemd[1]: Started Getty on tty1. lb # [ 12.587469] systemd[1]: Reached target Login Prompts. worker2 # [ 12.584810] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 12.618733] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 12.589583] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.610564] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.605544] dhcpcd[593]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (550) - Operation not permitted client # [ 12.607435] dhcpcd[593]: .resolvconf-wrapped: clearing stale lock pid 550 lb # [ 12.665175] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 12.665688] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 12.670447] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 12.670807] cfg80211: failed to load regulatory.db worker1 # [ 12.634688] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.638032] systemd[1]: Started Getty on tty1. worker1 # [ 12.656244] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.656772] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.646797] systemd[1]: Reached target Login Prompts. worker1 # [ 12.663028] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 12.663361] cfg80211: failed to load regulatory.db client # [ 12.669905] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.656000] dhcpcd[543]: eth0: waiting for carrier client # [ 12.660262] dhcpcd[543]: eth0: carrier acquired client # [ 12.663161] systemd[1]: Finished Extra networking commands.. client # [ 12.668468] systemd[1]: Reached target Network. worker2 # [ 12.694151] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.673273] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.682998] dhcpcd[626]: eth0: waiting for carrier worker2 # [ 12.686409] dhcpcd[626]: eth0: carrier acquired client # [ 12.685742] dhcpcd[543]: DUID 00:01:00:01:32:43:b1:b2:52:54:00:12:34:56 worker1 # [ 12.701118] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 12.686694] dhcpcd[543]: eth0: IAID 00:12:34:56 client # [ 12.687365] dhcpcd[543]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.705220] dhcpcd[626]: DUID 00:01:00:01:32:43:b1:b2:52:54:00:12:34:56 worker2 # [ 12.706214] dhcpcd[626]: eth0: IAID 00:12:34:56 worker2 # [ 12.706869] dhcpcd[626]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.726750] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 12.715113] network-addresses-eth1-start[654]: adding address 192.168.1.3/24... done worker2 # [ 12.732832] network-addresses-eth1-start[681]: adding address 192.168.1.4/24... done client # [ 12.726905] systemd[1]: Finished Permit User Sessions. client # [ 12.733806] systemd[1]: Started Getty on tty1. worker1 # [ 12.735710] network-addresses-eth1-start[654]: adding address 2001:db8:1::3/64... done client # [ 12.736861] systemd[1]: Reached target Login Prompts. lb # [ 12.778329] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 12.766756] dhcpcd[662]: eth0: waiting for carrier worker2 # [ 12.748935] network-addresses-eth1-start[681]: adding address 2001:db8:1::4/64... done lb # [ 12.771041] dhcpcd[662]: eth0: waiting for carrier lb # [ 12.772830] dhcpcd[662]: eth0: carrier acquired worker2 # [ 12.754222] systemd-logind[504]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 12.776599] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 12.764451] dhcpcd[644]: eth0: waiting for carrier worker2 # [ 12.771255] systemd[1]: Finished Address configuration of eth1. worker1 # [ 12.768655] systemd[1]: Finished Address configuration of eth1. lb # [ 12.796853] dhcpcd[662]: DUID 00:01:00:01:32:43:b1:b2:52:54:00:12:34:56 worker1 # [ 12.772220] dhcpcd[644]: eth0: waiting for carrier worker1 # [ 12.772950] dhcpcd[644]: eth0: carrier acquired lb # [ 12.800339] dhcpcd[662]: eth0: IAID 00:12:34:56 lb # [ 12.802321] dhcpcd[662]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 12.789626] dhcpcd[644]: DUID 00:01:00:01:32:43:b1:b2:52:54:00:12:34:56 worker1 # [ 12.790629] dhcpcd[644]: eth0: IAID 00:12:34:56 worker1 # [ 12.791284] dhcpcd[644]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.823346] mousedev: PS/2 mouse device common for all mice lb # [ 12.846696] (udev-worker)[701]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 12.857134] (udev-worker)[701]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.860442] mousedev: PS/2 mouse device common for all mice lb # [ 12.910060] postgresql-pre-start[698]: The files belonging to this database system will be owned by user "postgres". lb # [ 12.913533] postgresql-pre-start[698]: This user must also own the server process. worker1 # [ 12.888444] systemd-logind[511]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 12.924352] postgresql-pre-start[698]: The database cluster will be initialized with locale "en_US.UTF-8". client: (finished: waiting for unit network-addresses-eth1.service, in 13.33 seconds) lb # [ 12.927149] postgresql-pre-start[698]: The default database encoding has accordingly been set to "UTF8". client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 12.930293] postgresql-pre-start[698]: The default text search configuration will be set to "english". lb # [ 12.933774] postgresql-pre-start[698]: Data page checksums are enabled. lb # [ 12.938283] postgresql-pre-start[698]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.939577] postgresql-pre-start[698]: creating subdirectories ... ok lb # [ 12.945975] postgresql-pre-start[698]: selecting dynamic shared memory implementation ... posix worker2 # [ 12.929200] systemd-logind[504]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 12.947164] dhcpcd[626]: eth0: soliciting a DHCP lease worker2 # [ 12.952580] dhcpcd[626]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 12.960271] dhcpcd[626]: eth0: probing address 10.0.2.15/24 client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 13.172231] postgresql-pre-start[698]: selecting default "max_connections" ... 100 lb # [ 13.261561] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 13.277838] systemd[1]: Starting Address configuration of eth1... lb # [ 13.319228] systemd-logind[523]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 13.391386] postgresql-pre-start[698]: selecting default "shared_buffers" ... 128MB lb # [ 13.437914] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 13.450544] network-addresses-eth1-start[736]: adding address 192.168.1.2/24... done lb # [ 13.470470] network-addresses-eth1-start[736]: adding address 2001:db8:1::2/64... done client # [ 13.484745] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.497308] systemd[1]: Finished Address configuration of eth1. worker1 # [ 13.576588] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.690454] mousedev: PS/2 mouse device common for all mice client # [ 13.766580] systemd[1]: Starting Virtual Console Setup... lb # [ 13.818789] systemd-logind[523]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 13.802391] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 13.858943] systemd-logind[433]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 13.882931] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 13.902138] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.919945] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 13.921634] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.922668] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.923370] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 13.920241] dhcpcd[644]: eth0: soliciting a DHCP lease worker2 # [ 13.928350] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.929192] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.930337] dhcpcd[644]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 13.931144] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 13.931863] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.947094] systemd-logind[504]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 13.943549] dhcpcd[644]: eth0: probing address 10.0.2.15/24 worker2 # [ 13.952403] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.953497] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.957980] systemd[1]: Starting Virtual Console Setup... client # [ 13.980476] dhcpcd[543]: eth0: soliciting a DHCP lease client # [ 13.984459] dhcpcd[543]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 13.987546] systemd-logind[511]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 13.992184] dhcpcd[543]: eth0: probing address 10.0.2.15/24 client # [ 14.192997] systemd-vconsole-setup[648]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 14.197074] systemd[1]: Finished Virtual Console Setup. lb: (finished: waiting for unit network-addresses-eth1.service, in 1.30 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb # [ 14.280153] dhcpcd[662]: eth0: soliciting a DHCP lease lb # [ 14.284555] dhcpcd[662]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 14.270081] systemd-vconsole-setup[704]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 14.292515] dhcpcd[662]: eth0: probing address 10.0.2.15/24 worker2 # [ 14.274189] systemd[1]: Finished Virtual Console Setup. lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 14.336152] dhcpcd[644]: eth0: soliciting an IPv6 router worker1 # [ 14.337186] dhcpcd[644]: eth0: Router Advertisement from fe80::2 worker1 # [ 14.338046] dhcpcd[644]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 14.339067] dhcpcd[644]: eth0: adding route to fec0::/64 worker1 # [ 14.339835] dhcpcd[644]: eth0: adding default route via fe80::2 worker1 # [ 14.388739] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.396436] systemd[1]: Finished Virtual Console Setup. worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) client # [ 14.495003] dhcpcd[543]: eth0: soliciting an IPv6 router client # [ 14.498880] dhcpcd[543]: eth0: Router Advertisement from fe80::2 client # [ 14.501759] dhcpcd[543]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 14.504565] dhcpcd[543]: eth0: adding route to fec0::/64 client # [ 14.506765] dhcpcd[543]: eth0: adding default route via fe80::2 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds) lb: waiting for unit niks3.service lb # [ 14.656750] dhcpcd[662]: eth0: soliciting an IPv6 router lb # [ 14.657665] dhcpcd[662]: eth0: Router Advertisement from fe80::2 lb # [ 14.658476] dhcpcd[662]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 14.659376] dhcpcd[662]: eth0: adding route to fec0::/64 lb # [ 14.666213] dhcpcd[662]: eth0: adding default route via fe80::2 lb # [ 14.832774] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker2 # [ 15.229253] dhcpcd[626]: eth0: soliciting an IPv6 router worker2 # [ 15.232678] dhcpcd[626]: eth0: Router Advertisement from fe80::2 worker2 # [ 15.235207] dhcpcd[626]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 15.238271] dhcpcd[626]: eth0: adding route to fec0::/64 worker2 # [ 15.240569] dhcpcd[626]: eth0: adding default route via fe80::2 lb # [ 15.332703] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 15.343707] systemd[1]: Starting Virtual Console Setup... lb # [ 15.389415] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.393317] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.407762] systemd[1]: Starting Virtual Console Setup... lb # [ 15.464946] systemd-logind[523]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 15.848580] systemd-vconsole-setup[775]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 15.856407] systemd[1]: Finished Virtual Console Setup. lb # [ 16.010868] postgresql-pre-start[698]: selecting default time zone ... UTC lb # [ 16.017155] postgresql-pre-start[698]: creating configuration files ... ok lb # [ 16.282820] postgresql-pre-start[698]: running bootstrap script ... ok lb # [ 16.905596] postgresql-pre-start[698]: performing post-bootstrap initialization ... ok lb # [ 17.094665] postgresql-pre-start[698]: syncing data to disk ... ok lb # [ 17.096937] postgresql-pre-start[698]: initdb: warning: enabling "trust" authentication for local connections lb # [ 17.098241] postgresql-pre-start[698]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 17.100272] postgresql-pre-start[698]: Success. You can now start the database server using: lb # [ 17.101428] postgresql-pre-start[698]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 17.234079] postgres[809]: [809] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.240051] postgres[809]: [809] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.241130] postgres[809]: [809] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.243605] postgres[809]: [809] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.259559] postgres[818]: [818] LOG: database system was shut down at 2026-09-21 09:13:26 GMT lb # [ 17.264937] postgres[809]: [809] LOG: database system is ready to accept connections lb # [ 17.271672] systemd[1]: Started PostgreSQL Server. lb # [ 17.279556] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 17.522411] postgresql-setup-start[829]: CREATE DATABASE lb # [ 17.581628] postgresql-setup-start[834]: CREATE ROLE lb # [ 17.614571] postgresql-setup-start[836]: ALTER DATABASE lb # [ 17.625493] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 17.628797] systemd[1]: Reached target PostgreSQL. worker2 # [ 17.911512] dhcpcd[626]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 17.916820] dhcpcd[626]: eth0: adding route to 10.0.2.0/24 worker2 # [ 17.920419] dhcpcd[626]: eth0: adding default route via 10.0.2.2 worker2 # [ 18.092959] systemd[1]: Started DHCP Client. worker2 # [ 18.095017] systemd[1]: Reached target Multi-User System. worker2 # [ 18.095816] systemd[1]: Startup finished in 992ms (kernel) + 4.513s (initrd) + 12.589s (userspace) = 18.094s. client # [ 18.665811] dhcpcd[543]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 18.669588] dhcpcd[543]: eth0: adding route to 10.0.2.0/24 client # [ 18.669783] dhcpcd[543]: eth0: adding default route via 10.0.2.2 client # [ 18.853415] systemd[1]: Started DHCP Client. client # [ 18.857625] systemd[1]: Reached target Multi-User System. client # [ 18.858567] systemd[1]: Startup finished in 959ms (kernel) + 5.445s (initrd) + 12.452s (userspace) = 18.856s. worker1 # [ 19.139612] dhcpcd[644]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 19.145700] dhcpcd[644]: eth0: adding route to 10.0.2.0/24 worker1 # [ 19.148416] dhcpcd[644]: eth0: adding default route via 10.0.2.2 worker1 # [ 19.366484] systemd[1]: Started DHCP Client. worker1 # [ 19.369047] systemd[1]: Reached target Multi-User System. worker1 # [ 19.369958] systemd[1]: Startup finished in 976ms (kernel) + 5.368s (initrd) + 13.023s (userspace) = 19.368s. lb # [ 19.556758] dhcpcd[662]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 19.561829] dhcpcd[662]: eth0: adding route to 10.0.2.0/24 lb # [ 19.562036] dhcpcd[662]: eth0: adding default route via 10.0.2.2 lb # [ 19.749802] systemd[1]: Started DHCP Client. lb # [ 19.756442] systemd[1]: Reached target Network is Online. lb # [ 19.760853] systemd[1]: Started Envoy reverse proxy. lb # [ 19.768818] systemd[1]: Started mock-oidc.service. lb # [ 19.876865] mock-oidc-server[914]: Mock OIDC Server running lb # [ 19.877830] mock-oidc-server[914]: OIDC Address: 192.168.1.2:8080 lb # [ 19.878666] mock-oidc-server[914]: Issue Address: 0.0.0.0:8081 lb # [ 19.879465] mock-oidc-server[914]: Issuer: http://192.168.1.2:8080/oidc lb # [ 19.880840] mock-oidc-server[914]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 19.882562] mock-oidc-server[914]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 19.884407] mock-oidc-server[914]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 20.485626] envoy[913]: [2026-09-21 09:13:30.087][913][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 20.487540] envoy[913]: [2026-09-21 09:13:30.087][913][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 20.489134] envoy[913]: [2026-09-21 09:13:30.087][913][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 20.491091] envoy[913]: [2026-09-21 09:13:30.087][913][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 20.496747] envoy[913]: [2026-09-21 09:13:30.087][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 20.499807] envoy[913]: [2026-09-21 09:13:30.087][913][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 20.504619] envoy[913]: [2026-09-21 09:13:30.087][913][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 20.506558] envoy[913]: [2026-09-21 09:13:30.087][913][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 20.511581] envoy[913]: [2026-09-21 09:13:30.087][913][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 20.515368] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 20.556612] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 20.559625] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 20.562523] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 20.564997] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 20.567027] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 20.574586] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 20.579253] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 20.581900] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 20.583709] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 20.586221] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 20.587987] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 20.590585] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 20.592823] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 20.598988] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 20.601281] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 20.605767] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 20.608403] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 20.611690] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 20.619006] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 20.621809] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.623943] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 20.625970] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 20.631089] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 20.634455] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 20.639894] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 20.643164] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 20.645052] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 20.646894] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 20.650060] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 20.653320] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 20.656679] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 20.659521] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 20.661805] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 20.663839] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 20.668120] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 20.669927] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 20.674925] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 20.677094] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 20.681880] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 20.688203] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 20.690700] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 20.692667] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 20.694875] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 20.709920] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 20.717708] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 20.720715] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 20.722888] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 20.725422] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 20.727306] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 20.729984] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 20.736732] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 20.738353] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 20.746219] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 20.751401] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.754350] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 20.756661] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 20.759412] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 20.766775] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 20.769652] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 20.775657] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 20.778236] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 20.782754] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 20.785866] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 20.787609] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 20.798881] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 20.801156] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 20.803131] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 20.805354] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 20.808776] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 20.810609] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 20.812863] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 20.815661] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 20.818664] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 20.820829] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 20.822805] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 20.826174] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 20.828742] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 20.831232] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.833688] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 20.837525] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 20.839399] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 20.841459] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 20.844378] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 20.847007] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 20.849544] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 20.851402] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 20.854647] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 20.857122] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 20.859093] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 20.861719] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 20.867276] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 20.870500] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 20.872696] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 20.874373] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 20.877172] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 20.886235] envoy[913]: [2026-09-21 09:13:30.088][913][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 20.888463] envoy[913]: [2026-09-21 09:13:30.157][913][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 20.889996] envoy[913]: [2026-09-21 09:13:30.160][913][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 20.905981] envoy[913]: [2026-09-21 09:13:30.160][913][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 20.907594] envoy[913]: [2026-09-21 09:13:30.160][913][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 20.918529] envoy[913]: [2026-09-21 09:13:30.160][913][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 20.920566] envoy[913]: [2026-09-21 09:13:30.412][913][info][main] [source/server/server.cc:968] runtime: {} lb # [ 20.921850] envoy[913]: [2026-09-21 09:13:30.431][913][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 20.923730] envoy[913]: [2026-09-21 09:13:30.431][913][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 20.925752] envoy[913]: [2026-09-21 09:13:30.432][913][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 20.927378] envoy[913]: [2026-09-21 09:13:30.440][913][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 20.929514] envoy[913]: [2026-09-21 09:13:30.440][913][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 20.931454] envoy[913]: [2026-09-21 09:13:30.440][913][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 20.960633] envoy[913]: [2026-09-21 09:13:30.564][913][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 20.969703] envoy[913]: [2026-09-21 09:13:30.573][913][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 20.972436] envoy[913]: [2026-09-21 09:13:30.575][913][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. worker2 # [ 20.951189] systemd[1]: Reached target Network is Online. lb # [ 20.975786] envoy[913]: [2026-09-21 09:13:30.575][913][info][main] [source/server/server.cc:1077] starting main dispatch loop worker1 # [ 20.951174] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 20.967482] systemd[1]: Starting scheduler-token.service... worker2 # [ 21.127655] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 21.132360] systemd[1]: Finished scheduler-token.service. worker2 # [ 21.133700] systemd[1]: scheduler-token.service: Consumed 73ms CPU time over 163ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 21.143230] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 21.235513] nix-grpc-daemon[774]: ts=2026-09-21T09:13:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 21.249820] nix-grpc-daemon[774]: ts=2026-09-21T09:13:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 21.252331] nix-grpc-daemon[774]: ts=2026-09-21T09:13:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 21.291743] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 21.293698] nix-grpc-daemon[774]: E0000 00:00:1789982010.887234 774 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 21.307972] nix-grpc-daemon[774]: E0000 00:00:1789982010.903540 774 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 21.311770] nix-grpc-daemon[774]: ts=2026-09-21T09:13:30Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 21.316518] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 21.351246] nix-grpc-daemon[774]: E0000 00:00:1789982010.945687 816 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 21.374378] envoy[913]: [2026-09-21 09:13:30.977][913][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 21.380557] envoy[913]: [2026-09-21 09:13:30.983][913][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 21.387610] envoy[913]: [2026-09-21 09:13:30.983][913][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker1 # [ 21.370943] nix-grpc-daemon[774]: E0000 00:00:1789982010.966478 816 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 21.376070] nix-grpc-daemon[774]: E0000 00:00:1789982010.969972 816 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 21.398267] envoy[913]: [2026-09-21 09:13:31.001][913][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 21.393765] nix-grpc-daemon[781]: ts=2026-09-21T09:13:30Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 21.395027] nix-grpc-daemon[774]: E0000 00:00:1789982010.989827 816 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 21.406740] nix-grpc-daemon[781]: ts=2026-09-21T09:13:30Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 21.409419] nix-grpc-daemon[781]: ts=2026-09-21T09:13:30Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 21.411258] nix-grpc-daemon[774]: ts=2026-09-21T09:13:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.416204] nix-grpc-daemon[774]: ts=2026-09-21T09:13:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.450128] nix-grpc-daemon[781]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 21.451877] nix-grpc-daemon[781]: E0000 00:00:1789982011.032726 781 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 21.467632] nix-grpc-daemon[781]: E0000 00:00:1789982011.050299 781 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 21.471789] nix-grpc-daemon[781]: ts=2026-09-21T09:13:31Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 21.478196] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 21.514242] nix-grpc-daemon[781]: E0000 00:00:1789982011.095769 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 21.533436] nix-grpc-daemon[781]: E0000 00:00:1789982011.116040 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 21.540094] nix-grpc-daemon[781]: E0000 00:00:1789982011.119383 823 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 21.557373] nix-grpc-daemon[781]: E0000 00:00:1789982011.138508 823 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 21.567428] nix-grpc-daemon[781]: ts=2026-09-21T09:13:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.569409] nix-grpc-daemon[781]: ts=2026-09-21T09:13:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.617977] nix-grpc-daemon[774]: ts=2026-09-21T09:13:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.623420] nix-grpc-daemon[774]: ts=2026-09-21T09:13:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.771541] nix-grpc-daemon[781]: ts=2026-09-21T09:13:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.777183] nix-grpc-daemon[781]: ts=2026-09-21T09:13:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.824472] nix-grpc-daemon[774]: ts=2026-09-21T09:13:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.830144] nix-grpc-daemon[774]: ts=2026-09-21T09:13:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.978643] nix-grpc-daemon[781]: ts=2026-09-21T09:13:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.985261] nix-grpc-daemon[781]: ts=2026-09-21T09:13:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.031151] nix-grpc-daemon[774]: ts=2026-09-21T09:13:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.037151] nix-grpc-daemon[774]: ts=2026-09-21T09:13:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.186709] nix-grpc-daemon[781]: ts=2026-09-21T09:13:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.192136] nix-grpc-daemon[781]: ts=2026-09-21T09:13:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.241042] nix-grpc-daemon[774]: ts=2026-09-21T09:13:31Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.245505] nix-grpc-daemon[774]: ts=2026-09-21T09:13:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.392798] nix-grpc-daemon[781]: ts=2026-09-21T09:13:31Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.396129] nix-grpc-daemon[781]: ts=2026-09-21T09:13:31Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.440823] nix-grpc-daemon[774]: ts=2026-09-21T09:13:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.446759] nix-grpc-daemon[774]: ts=2026-09-21T09:13:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.597301] nix-grpc-daemon[781]: ts=2026-09-21T09:13:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.602637] nix-grpc-daemon[781]: ts=2026-09-21T09:13:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.647747] nix-grpc-daemon[774]: ts=2026-09-21T09:13:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.652823] nix-grpc-daemon[774]: ts=2026-09-21T09:13:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.804232] nix-grpc-daemon[781]: ts=2026-09-21T09:13:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.809778] nix-grpc-daemon[781]: ts=2026-09-21T09:13:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.854667] nix-grpc-daemon[774]: ts=2026-09-21T09:13:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.861195] nix-grpc-daemon[774]: ts=2026-09-21T09:13:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.011371] nix-grpc-daemon[781]: ts=2026-09-21T09:13:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.017311] nix-grpc-daemon[781]: ts=2026-09-21T09:13:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.062276] nix-grpc-daemon[774]: ts=2026-09-21T09:13:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.068165] nix-grpc-daemon[774]: ts=2026-09-21T09:13:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.219069] nix-grpc-daemon[781]: ts=2026-09-21T09:13:32Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.224624] nix-grpc-daemon[781]: ts=2026-09-21T09:13:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.272595] nix-grpc-daemon[774]: ts=2026-09-21T09:13:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.276986] nix-grpc-daemon[774]: ts=2026-09-21T09:13:32Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.430929] nix-grpc-daemon[781]: ts=2026-09-21T09:13:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.435418] nix-grpc-daemon[781]: ts=2026-09-21T09:13:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.473010] nix-grpc-daemon[774]: ts=2026-09-21T09:13:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.478797] nix-grpc-daemon[774]: ts=2026-09-21T09:13:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.631158] nix-grpc-daemon[781]: ts=2026-09-21T09:13:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.636856] nix-grpc-daemon[781]: ts=2026-09-21T09:13:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.680217] nix-grpc-daemon[774]: ts=2026-09-21T09:13:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.685949] nix-grpc-daemon[774]: ts=2026-09-21T09:13:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.838816] nix-grpc-daemon[781]: ts=2026-09-21T09:13:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.844453] nix-grpc-daemon[781]: ts=2026-09-21T09:13:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.887268] nix-grpc-daemon[774]: ts=2026-09-21T09:13:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.893201] nix-grpc-daemon[774]: ts=2026-09-21T09:13:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.042156] nix-grpc-daemon[781]: ts=2026-09-21T09:13:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.048249] nix-grpc-daemon[781]: ts=2026-09-21T09:13:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.094889] nix-grpc-daemon[774]: ts=2026-09-21T09:13:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.100606] nix-grpc-daemon[774]: ts=2026-09-21T09:13:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.249899] nix-grpc-daemon[781]: ts=2026-09-21T09:13:33Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.255439] nix-grpc-daemon[781]: ts=2026-09-21T09:13:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.304795] nix-grpc-daemon[774]: ts=2026-09-21T09:13:33Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.309421] nix-grpc-daemon[774]: ts=2026-09-21T09:13:33Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.459931] nix-grpc-daemon[781]: ts=2026-09-21T09:13:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.464525] nix-grpc-daemon[781]: ts=2026-09-21T09:13:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.505324] nix-grpc-daemon[774]: ts=2026-09-21T09:13:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.511291] nix-grpc-daemon[774]: ts=2026-09-21T09:13:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.660947] nix-grpc-daemon[781]: ts=2026-09-21T09:13:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.666557] nix-grpc-daemon[781]: ts=2026-09-21T09:13:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.712336] nix-grpc-daemon[774]: ts=2026-09-21T09:13:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.718141] nix-grpc-daemon[774]: ts=2026-09-21T09:13:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.868088] nix-grpc-daemon[781]: ts=2026-09-21T09:13:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.873616] nix-grpc-daemon[781]: ts=2026-09-21T09:13:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.919253] nix-grpc-daemon[774]: ts=2026-09-21T09:13:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.925240] nix-grpc-daemon[774]: ts=2026-09-21T09:13:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.075564] nix-grpc-daemon[781]: ts=2026-09-21T09:13:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.081468] nix-grpc-daemon[781]: ts=2026-09-21T09:13:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.126687] nix-grpc-daemon[774]: ts=2026-09-21T09:13:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.132325] nix-grpc-daemon[774]: ts=2026-09-21T09:13:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.282869] nix-grpc-daemon[781]: ts=2026-09-21T09:13:34Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.288594] nix-grpc-daemon[781]: ts=2026-09-21T09:13:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.336634] nix-grpc-daemon[774]: ts=2026-09-21T09:13:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.341001] nix-grpc-daemon[774]: ts=2026-09-21T09:13:34Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.493436] nix-grpc-daemon[781]: ts=2026-09-21T09:13:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.497746] nix-grpc-daemon[781]: ts=2026-09-21T09:13:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.537242] nix-grpc-daemon[774]: ts=2026-09-21T09:13:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.542811] nix-grpc-daemon[774]: ts=2026-09-21T09:13:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.694220] nix-grpc-daemon[781]: ts=2026-09-21T09:13:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.698024] nix-grpc-daemon[781]: ts=2026-09-21T09:13:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.744042] nix-grpc-daemon[774]: ts=2026-09-21T09:13:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.749857] nix-grpc-daemon[774]: ts=2026-09-21T09:13:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.899829] nix-grpc-daemon[781]: ts=2026-09-21T09:13:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.905516] nix-grpc-daemon[781]: ts=2026-09-21T09:13:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.950692] nix-grpc-daemon[774]: ts=2026-09-21T09:13:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.954617] nix-grpc-daemon[774]: ts=2026-09-21T09:13:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.107027] nix-grpc-daemon[781]: ts=2026-09-21T09:13:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.112837] nix-grpc-daemon[781]: ts=2026-09-21T09:13:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.155567] nix-grpc-daemon[774]: ts=2026-09-21T09:13:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.161557] nix-grpc-daemon[774]: ts=2026-09-21T09:13:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.314770] nix-grpc-daemon[781]: ts=2026-09-21T09:13:35Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.320723] nix-grpc-daemon[781]: ts=2026-09-21T09:13:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.365357] nix-grpc-daemon[774]: ts=2026-09-21T09:13:35Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.369799] nix-grpc-daemon[774]: ts=2026-09-21T09:13:35Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.525356] nix-grpc-daemon[781]: ts=2026-09-21T09:13:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.533685] nix-grpc-daemon[781]: ts=2026-09-21T09:13:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.566250] nix-grpc-daemon[774]: ts=2026-09-21T09:13:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.571934] nix-grpc-daemon[774]: ts=2026-09-21T09:13:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.726594] nix-grpc-daemon[781]: ts=2026-09-21T09:13:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.732440] nix-grpc-daemon[781]: ts=2026-09-21T09:13:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.773401] nix-grpc-daemon[774]: ts=2026-09-21T09:13:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.779572] nix-grpc-daemon[774]: ts=2026-09-21T09:13:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.933952] nix-grpc-daemon[781]: ts=2026-09-21T09:13:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.939424] nix-grpc-daemon[781]: ts=2026-09-21T09:13:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.980565] nix-grpc-daemon[774]: ts=2026-09-21T09:13:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.985900] nix-grpc-daemon[774]: ts=2026-09-21T09:13:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.140632] nix-grpc-daemon[781]: ts=2026-09-21T09:13:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.145631] nix-grpc-daemon[781]: ts=2026-09-21T09:13:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.186786] nix-grpc-daemon[774]: ts=2026-09-21T09:13:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.192164] nix-grpc-daemon[774]: ts=2026-09-21T09:13:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.346917] nix-grpc-daemon[781]: ts=2026-09-21T09:13:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.352244] nix-grpc-daemon[781]: ts=2026-09-21T09:13:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.394782] nix-grpc-daemon[774]: ts=2026-09-21T09:13:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.399028] nix-grpc-daemon[774]: ts=2026-09-21T09:13:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.555851] nix-grpc-daemon[781]: ts=2026-09-21T09:13:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.560226] nix-grpc-daemon[781]: ts=2026-09-21T09:13:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.595341] nix-grpc-daemon[774]: ts=2026-09-21T09:13:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.600866] nix-grpc-daemon[774]: ts=2026-09-21T09:13:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.756527] nix-grpc-daemon[781]: ts=2026-09-21T09:13:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.761873] nix-grpc-daemon[781]: ts=2026-09-21T09:13:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.801926] nix-grpc-daemon[774]: ts=2026-09-21T09:13:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.807362] nix-grpc-daemon[774]: ts=2026-09-21T09:13:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.963210] nix-grpc-daemon[781]: ts=2026-09-21T09:13:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.968569] nix-grpc-daemon[781]: ts=2026-09-21T09:13:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.008277] nix-grpc-daemon[774]: ts=2026-09-21T09:13:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.013416] nix-grpc-daemon[774]: ts=2026-09-21T09:13:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.169704] nix-grpc-daemon[781]: ts=2026-09-21T09:13:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.174780] nix-grpc-daemon[781]: ts=2026-09-21T09:13:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.214351] nix-grpc-daemon[774]: ts=2026-09-21T09:13:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.219608] nix-grpc-daemon[774]: ts=2026-09-21T09:13:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.376046] nix-grpc-daemon[781]: ts=2026-09-21T09:13:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.381112] nix-grpc-daemon[781]: ts=2026-09-21T09:13:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.422226] nix-grpc-daemon[774]: ts=2026-09-21T09:13:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.426441] nix-grpc-daemon[774]: ts=2026-09-21T09:13:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.583866] nix-grpc-daemon[781]: ts=2026-09-21T09:13:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.588171] nix-grpc-daemon[781]: ts=2026-09-21T09:13:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.622754] nix-grpc-daemon[774]: ts=2026-09-21T09:13:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.628117] nix-grpc-daemon[774]: ts=2026-09-21T09:13:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.784991] nix-grpc-daemon[781]: ts=2026-09-21T09:13:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.790353] nix-grpc-daemon[781]: ts=2026-09-21T09:13:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.829209] nix-grpc-daemon[774]: ts=2026-09-21T09:13:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.834748] nix-grpc-daemon[774]: ts=2026-09-21T09:13:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.991391] nix-grpc-daemon[781]: ts=2026-09-21T09:13:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.995260] nix-grpc-daemon[781]: ts=2026-09-21T09:13:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.035467] nix-grpc-daemon[774]: ts=2026-09-21T09:13:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.038618] nix-grpc-daemon[774]: ts=2026-09-21T09:13:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.196766] nix-grpc-daemon[781]: ts=2026-09-21T09:13:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.201946] nix-grpc-daemon[781]: ts=2026-09-21T09:13:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.239510] nix-grpc-daemon[774]: ts=2026-09-21T09:13:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.243329] nix-grpc-daemon[774]: ts=2026-09-21T09:13:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.403089] nix-grpc-daemon[781]: ts=2026-09-21T09:13:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.408697] nix-grpc-daemon[781]: ts=2026-09-21T09:13:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.446040] nix-grpc-daemon[774]: ts=2026-09-21T09:13:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.450519] nix-grpc-daemon[774]: ts=2026-09-21T09:13:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.611586] nix-grpc-daemon[781]: ts=2026-09-21T09:13:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.615804] nix-grpc-daemon[781]: ts=2026-09-21T09:13:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.646812] nix-grpc-daemon[774]: ts=2026-09-21T09:13:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.652348] nix-grpc-daemon[774]: ts=2026-09-21T09:13:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.812440] nix-grpc-daemon[781]: ts=2026-09-21T09:13:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.817535] nix-grpc-daemon[781]: ts=2026-09-21T09:13:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.853431] nix-grpc-daemon[774]: ts=2026-09-21T09:13:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.858607] nix-grpc-daemon[774]: ts=2026-09-21T09:13:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.018886] nix-grpc-daemon[781]: ts=2026-09-21T09:13:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.024335] nix-grpc-daemon[781]: ts=2026-09-21T09:13:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.059478] nix-grpc-daemon[774]: ts=2026-09-21T09:13:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.065217] nix-grpc-daemon[774]: ts=2026-09-21T09:13:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.225312] nix-grpc-daemon[781]: ts=2026-09-21T09:13:39Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.230390] nix-grpc-daemon[781]: ts=2026-09-21T09:13:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.266085] nix-grpc-daemon[774]: ts=2026-09-21T09:13:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.271536] nix-grpc-daemon[774]: ts=2026-09-21T09:13:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.431720] nix-grpc-daemon[781]: ts=2026-09-21T09:13:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.437814] nix-grpc-daemon[781]: ts=2026-09-21T09:13:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.474621] nix-grpc-daemon[774]: ts=2026-09-21T09:13:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.478834] nix-grpc-daemon[774]: ts=2026-09-21T09:13:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.640370] nix-grpc-daemon[781]: ts=2026-09-21T09:13:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.644588] nix-grpc-daemon[781]: ts=2026-09-21T09:13:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.675460] nix-grpc-daemon[774]: ts=2026-09-21T09:13:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.681032] nix-grpc-daemon[774]: ts=2026-09-21T09:13:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.841091] nix-grpc-daemon[781]: ts=2026-09-21T09:13:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.846420] nix-grpc-daemon[781]: ts=2026-09-21T09:13:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.881937] nix-grpc-daemon[774]: ts=2026-09-21T09:13:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.887289] nix-grpc-daemon[774]: ts=2026-09-21T09:13:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.047587] nix-grpc-daemon[781]: ts=2026-09-21T09:13:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.053088] nix-grpc-daemon[781]: ts=2026-09-21T09:13:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.088542] nix-grpc-daemon[774]: ts=2026-09-21T09:13:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.093772] nix-grpc-daemon[774]: ts=2026-09-21T09:13:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.254328] nix-grpc-daemon[781]: ts=2026-09-21T09:13:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.259754] nix-grpc-daemon[781]: ts=2026-09-21T09:13:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.294558] nix-grpc-daemon[774]: ts=2026-09-21T09:13:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.299748] nix-grpc-daemon[774]: ts=2026-09-21T09:13:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.461356] nix-grpc-daemon[781]: ts=2026-09-21T09:13:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.466799] nix-grpc-daemon[781]: ts=2026-09-21T09:13:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.502400] nix-grpc-daemon[774]: ts=2026-09-21T09:13:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.506717] nix-grpc-daemon[774]: ts=2026-09-21T09:13:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.670010] nix-grpc-daemon[781]: ts=2026-09-21T09:13:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.674148] nix-grpc-daemon[781]: ts=2026-09-21T09:13:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.702861] nix-grpc-daemon[774]: ts=2026-09-21T09:13:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.708212] nix-grpc-daemon[774]: ts=2026-09-21T09:13:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.870694] nix-grpc-daemon[781]: ts=2026-09-21T09:13:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.875880] nix-grpc-daemon[781]: ts=2026-09-21T09:13:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.908935] nix-grpc-daemon[774]: ts=2026-09-21T09:13:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.914028] nix-grpc-daemon[774]: ts=2026-09-21T09:13:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.077129] nix-grpc-daemon[781]: ts=2026-09-21T09:13:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.082209] nix-grpc-daemon[781]: ts=2026-09-21T09:13:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.114819] nix-grpc-daemon[774]: ts=2026-09-21T09:13:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.120119] nix-grpc-daemon[774]: ts=2026-09-21T09:13:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.284378] nix-grpc-daemon[781]: ts=2026-09-21T09:13:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.295511] nix-grpc-daemon[781]: ts=2026-09-21T09:13:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.321056] nix-grpc-daemon[774]: ts=2026-09-21T09:13:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.326380] nix-grpc-daemon[774]: ts=2026-09-21T09:13:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.492713] nix-grpc-daemon[781]: ts=2026-09-21T09:13:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.498030] nix-grpc-daemon[781]: ts=2026-09-21T09:13:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.529686] nix-grpc-daemon[774]: ts=2026-09-21T09:13:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.537063] nix-grpc-daemon[774]: ts=2026-09-21T09:13:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.700885] nix-grpc-daemon[781]: ts=2026-09-21T09:13:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.705343] nix-grpc-daemon[781]: ts=2026-09-21T09:13:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.729648] nix-grpc-daemon[774]: ts=2026-09-21T09:13:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.734913] nix-grpc-daemon[774]: ts=2026-09-21T09:13:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.902469] nix-grpc-daemon[781]: ts=2026-09-21T09:13:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.907983] nix-grpc-daemon[781]: ts=2026-09-21T09:13:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.935716] nix-grpc-daemon[774]: ts=2026-09-21T09:13:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.941149] nix-grpc-daemon[774]: ts=2026-09-21T09:13:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.109191] nix-grpc-daemon[781]: ts=2026-09-21T09:13:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.114480] nix-grpc-daemon[781]: ts=2026-09-21T09:13:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.142017] nix-grpc-daemon[774]: ts=2026-09-21T09:13:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.147469] nix-grpc-daemon[774]: ts=2026-09-21T09:13:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.315874] nix-grpc-daemon[781]: ts=2026-09-21T09:13:42Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.321132] nix-grpc-daemon[781]: ts=2026-09-21T09:13:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.348270] nix-grpc-daemon[774]: ts=2026-09-21T09:13:42Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.353413] nix-grpc-daemon[774]: ts=2026-09-21T09:13:42Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.522210] nix-grpc-daemon[781]: ts=2026-09-21T09:13:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.527492] nix-grpc-daemon[781]: ts=2026-09-21T09:13:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.556194] nix-grpc-daemon[774]: ts=2026-09-21T09:13:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.560299] nix-grpc-daemon[774]: ts=2026-09-21T09:13:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.730654] nix-grpc-daemon[781]: ts=2026-09-21T09:13:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.734863] nix-grpc-daemon[781]: ts=2026-09-21T09:13:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.756548] nix-grpc-daemon[774]: ts=2026-09-21T09:13:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.761658] nix-grpc-daemon[774]: ts=2026-09-21T09:13:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.931668] nix-grpc-daemon[781]: ts=2026-09-21T09:13:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.937356] nix-grpc-daemon[781]: ts=2026-09-21T09:13:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.962498] nix-grpc-daemon[774]: ts=2026-09-21T09:13:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.967731] nix-grpc-daemon[774]: ts=2026-09-21T09:13:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.138631] nix-grpc-daemon[781]: ts=2026-09-21T09:13:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.144506] nix-grpc-daemon[781]: ts=2026-09-21T09:13:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.168553] nix-grpc-daemon[774]: ts=2026-09-21T09:13:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.173707] nix-grpc-daemon[774]: ts=2026-09-21T09:13:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.345195] nix-grpc-daemon[781]: ts=2026-09-21T09:13:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.350327] nix-grpc-daemon[781]: ts=2026-09-21T09:13:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.374855] nix-grpc-daemon[774]: ts=2026-09-21T09:13:43Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.380254] nix-grpc-daemon[774]: ts=2026-09-21T09:13:43Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.551528] nix-grpc-daemon[781]: ts=2026-09-21T09:13:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.556879] nix-grpc-daemon[781]: ts=2026-09-21T09:13:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.582713] nix-grpc-daemon[774]: ts=2026-09-21T09:13:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.586891] nix-grpc-daemon[774]: ts=2026-09-21T09:13:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.760221] nix-grpc-daemon[781]: ts=2026-09-21T09:13:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.764325] nix-grpc-daemon[781]: ts=2026-09-21T09:13:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.783568] nix-grpc-daemon[774]: ts=2026-09-21T09:13:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.788830] nix-grpc-daemon[774]: ts=2026-09-21T09:13:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.961249] nix-grpc-daemon[781]: ts=2026-09-21T09:13:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.966506] nix-grpc-daemon[781]: ts=2026-09-21T09:13:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.989675] nix-grpc-daemon[774]: ts=2026-09-21T09:13:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.994886] nix-grpc-daemon[774]: ts=2026-09-21T09:13:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.167691] nix-grpc-daemon[781]: ts=2026-09-21T09:13:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.173119] nix-grpc-daemon[781]: ts=2026-09-21T09:13:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.195694] nix-grpc-daemon[774]: ts=2026-09-21T09:13:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.200953] nix-grpc-daemon[774]: ts=2026-09-21T09:13:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.374322] nix-grpc-daemon[781]: ts=2026-09-21T09:13:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.379683] nix-grpc-daemon[781]: ts=2026-09-21T09:13:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.401591] nix-grpc-daemon[774]: ts=2026-09-21T09:13:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.406700] nix-grpc-daemon[774]: ts=2026-09-21T09:13:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.582359] nix-grpc-daemon[781]: ts=2026-09-21T09:13:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.593003] nix-grpc-daemon[781]: ts=2026-09-21T09:13:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.609708] nix-grpc-daemon[774]: ts=2026-09-21T09:13:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.614058] nix-grpc-daemon[774]: ts=2026-09-21T09:13:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.791037] nix-grpc-daemon[781]: ts=2026-09-21T09:13:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.795242] nix-grpc-daemon[781]: ts=2026-09-21T09:13:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.810481] nix-grpc-daemon[774]: ts=2026-09-21T09:13:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.819142] nix-grpc-daemon[774]: ts=2026-09-21T09:13:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.992069] nix-grpc-daemon[781]: ts=2026-09-21T09:13:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.997114] nix-grpc-daemon[781]: ts=2026-09-21T09:13:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.019561] nix-grpc-daemon[774]: ts=2026-09-21T09:13:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.025134] nix-grpc-daemon[774]: ts=2026-09-21T09:13:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.198183] nix-grpc-daemon[781]: ts=2026-09-21T09:13:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.203401] nix-grpc-daemon[781]: ts=2026-09-21T09:13:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.225982] nix-grpc-daemon[774]: ts=2026-09-21T09:13:45Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.231441] nix-grpc-daemon[774]: ts=2026-09-21T09:13:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.404600] nix-grpc-daemon[781]: ts=2026-09-21T09:13:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.409690] nix-grpc-daemon[781]: ts=2026-09-21T09:13:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.432225] nix-grpc-daemon[774]: ts=2026-09-21T09:13:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.437853] nix-grpc-daemon[774]: ts=2026-09-21T09:13:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.610878] nix-grpc-daemon[781]: ts=2026-09-21T09:13:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.616375] nix-grpc-daemon[781]: ts=2026-09-21T09:13:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.640369] nix-grpc-daemon[774]: ts=2026-09-21T09:13:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.644515] nix-grpc-daemon[774]: ts=2026-09-21T09:13:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.819366] nix-grpc-daemon[781]: ts=2026-09-21T09:13:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.823653] nix-grpc-daemon[781]: ts=2026-09-21T09:13:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.840910] nix-grpc-daemon[774]: ts=2026-09-21T09:13:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.846291] nix-grpc-daemon[774]: ts=2026-09-21T09:13:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.020411] nix-grpc-daemon[781]: ts=2026-09-21T09:13:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.025726] nix-grpc-daemon[781]: ts=2026-09-21T09:13:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.047081] nix-grpc-daemon[774]: ts=2026-09-21T09:13:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.052606] nix-grpc-daemon[774]: ts=2026-09-21T09:13:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.226795] nix-grpc-daemon[781]: ts=2026-09-21T09:13:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.232190] nix-grpc-daemon[781]: ts=2026-09-21T09:13:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.253490] nix-grpc-daemon[774]: ts=2026-09-21T09:13:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.258842] nix-grpc-daemon[774]: ts=2026-09-21T09:13:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.433350] nix-grpc-daemon[781]: ts=2026-09-21T09:13:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.438710] nix-grpc-daemon[781]: ts=2026-09-21T09:13:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.459595] nix-grpc-daemon[774]: ts=2026-09-21T09:13:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.465159] nix-grpc-daemon[774]: ts=2026-09-21T09:13:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.639607] nix-grpc-daemon[781]: ts=2026-09-21T09:13:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.645119] nix-grpc-daemon[781]: ts=2026-09-21T09:13:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.667738] nix-grpc-daemon[774]: ts=2026-09-21T09:13:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.672150] nix-grpc-daemon[774]: ts=2026-09-21T09:13:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.848387] nix-grpc-daemon[781]: ts=2026-09-21T09:13:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.852544] nix-grpc-daemon[781]: ts=2026-09-21T09:13:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.868107] nix-grpc-daemon[774]: ts=2026-09-21T09:13:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.873374] nix-grpc-daemon[774]: ts=2026-09-21T09:13:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.049390] nix-grpc-daemon[781]: ts=2026-09-21T09:13:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.054669] nix-grpc-daemon[781]: ts=2026-09-21T09:13:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.074323] nix-grpc-daemon[774]: ts=2026-09-21T09:13:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.079669] nix-grpc-daemon[774]: ts=2026-09-21T09:13:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.255846] nix-grpc-daemon[781]: ts=2026-09-21T09:13:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.261548] nix-grpc-daemon[781]: ts=2026-09-21T09:13:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.280294] nix-grpc-daemon[774]: ts=2026-09-21T09:13:47Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.285605] nix-grpc-daemon[774]: ts=2026-09-21T09:13:47Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.462192] nix-grpc-daemon[781]: ts=2026-09-21T09:13:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.467790] nix-grpc-daemon[781]: ts=2026-09-21T09:13:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.486208] nix-grpc-daemon[774]: ts=2026-09-21T09:13:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.491642] nix-grpc-daemon[774]: ts=2026-09-21T09:13:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.552135] nix-grpc-daemon[774]: ts=2026-09-21T09:13:48Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached" worker2 # [ 38.669064] nix-grpc-daemon[781]: ts=2026-09-21T09:13:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.674264] nix-grpc-daemon[781]: ts=2026-09-21T09:13:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.694293] nix-grpc-daemon[774]: ts=2026-09-21T09:13:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.698605] nix-grpc-daemon[774]: ts=2026-09-21T09:13:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.706541] nix-grpc-daemon[781]: ts=2026-09-21T09:13:48Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Timeout was reached" worker2 # [ 38.877016] nix-grpc-daemon[781]: ts=2026-09-21T09:13:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.885830] nix-grpc-daemon[781]: ts=2026-09-21T09:13:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.894939] nix-grpc-daemon[774]: ts=2026-09-21T09:13:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.900589] nix-grpc-daemon[774]: ts=2026-09-21T09:13:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.083090] nix-grpc-daemon[781]: ts=2026-09-21T09:13:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.088646] nix-grpc-daemon[781]: ts=2026-09-21T09:13:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.101408] nix-grpc-daemon[774]: ts=2026-09-21T09:13:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.106735] nix-grpc-daemon[774]: ts=2026-09-21T09:13:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.289732] nix-grpc-daemon[781]: ts=2026-09-21T09:13:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.295105] nix-grpc-daemon[781]: ts=2026-09-21T09:13:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.307938] nix-grpc-daemon[774]: ts=2026-09-21T09:13:48Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.313453] nix-grpc-daemon[774]: ts=2026-09-21T09:13:48Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.496426] nix-grpc-daemon[781]: ts=2026-09-21T09:13:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.502092] nix-grpc-daemon[781]: ts=2026-09-21T09:13:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.513990] nix-grpc-daemon[774]: ts=2026-09-21T09:13:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.519666] nix-grpc-daemon[774]: ts=2026-09-21T09:13:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.702962] nix-grpc-daemon[781]: ts=2026-09-21T09:13:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.710572] nix-grpc-daemon[781]: ts=2026-09-21T09:13:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.722591] nix-grpc-daemon[774]: ts=2026-09-21T09:13:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.726841] nix-grpc-daemon[774]: ts=2026-09-21T09:13:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.912149] nix-grpc-daemon[781]: ts=2026-09-21T09:13:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.916294] nix-grpc-daemon[781]: ts=2026-09-21T09:13:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.922745] nix-grpc-daemon[774]: ts=2026-09-21T09:13:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.928082] nix-grpc-daemon[774]: ts=2026-09-21T09:13:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.112843] nix-grpc-daemon[781]: ts=2026-09-21T09:13:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.118052] nix-grpc-daemon[781]: ts=2026-09-21T09:13:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.128902] nix-grpc-daemon[774]: ts=2026-09-21T09:13:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.134067] nix-grpc-daemon[774]: ts=2026-09-21T09:13:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.319352] nix-grpc-daemon[781]: ts=2026-09-21T09:13:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.324832] nix-grpc-daemon[781]: ts=2026-09-21T09:13:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.334888] nix-grpc-daemon[774]: ts=2026-09-21T09:13:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.340086] nix-grpc-daemon[774]: ts=2026-09-21T09:13:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.525981] nix-grpc-daemon[781]: ts=2026-09-21T09:13:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.531313] nix-grpc-daemon[781]: ts=2026-09-21T09:13:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.541044] nix-grpc-daemon[774]: ts=2026-09-21T09:13:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.546619] nix-grpc-daemon[774]: ts=2026-09-21T09:13:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.732723] nix-grpc-daemon[781]: ts=2026-09-21T09:13:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.738063] nix-grpc-daemon[781]: ts=2026-09-21T09:13:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.749090] nix-grpc-daemon[774]: ts=2026-09-21T09:13:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.753230] nix-grpc-daemon[774]: ts=2026-09-21T09:13:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 40.940861] nix-grpc-daemon[781]: ts=2026-09-21T09:13:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 40.945652] nix-grpc-daemon[781]: ts=2026-09-21T09:13:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 40.949502] nix-grpc-daemon[774]: ts=2026-09-21T09:13:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 40.954623] nix-grpc-daemon[774]: ts=2026-09-21T09:13:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.146888] nix-grpc-daemon[781]: ts=2026-09-21T09:13:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.152344] nix-grpc-daemon[781]: ts=2026-09-21T09:13:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.155404] nix-grpc-daemon[774]: ts=2026-09-21T09:13:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.160691] nix-grpc-daemon[774]: ts=2026-09-21T09:13:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.353544] nix-grpc-daemon[781]: ts=2026-09-21T09:13:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.358862] nix-grpc-daemon[781]: ts=2026-09-21T09:13:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.361663] nix-grpc-daemon[774]: ts=2026-09-21T09:13:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.366978] nix-grpc-daemon[774]: ts=2026-09-21T09:13:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.560743] nix-grpc-daemon[781]: ts=2026-09-21T09:13:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.566213] nix-grpc-daemon[781]: ts=2026-09-21T09:13:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.567997] nix-grpc-daemon[774]: ts=2026-09-21T09:13:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.573439] nix-grpc-daemon[774]: ts=2026-09-21T09:13:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.767341] nix-grpc-daemon[781]: ts=2026-09-21T09:13:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.772913] nix-grpc-daemon[781]: ts=2026-09-21T09:13:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.775800] nix-grpc-daemon[774]: ts=2026-09-21T09:13:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.780127] nix-grpc-daemon[774]: ts=2026-09-21T09:13:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 41.975115] nix-grpc-daemon[781]: ts=2026-09-21T09:13:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 41.980540] nix-grpc-daemon[781]: ts=2026-09-21T09:13:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 41.976251] nix-grpc-daemon[774]: ts=2026-09-21T09:13:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 41.981338] nix-grpc-daemon[774]: ts=2026-09-21T09:13:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 42.086647] rustfs-bucket-start[1117]: mb s3://farm lb # [ 42.101390] systemd[1]: Finished rustfs-bucket.service. lb # [ 42.110250] systemd[1]: Starting niks3 server... worker2 # [ 42.181700] nix-grpc-daemon[781]: ts=2026-09-21T09:13:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 42.187051] nix-grpc-daemon[781]: ts=2026-09-21T09:13:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 42.182188] nix-grpc-daemon[774]: ts=2026-09-21T09:13:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 42.187307] nix-grpc-daemon[774]: ts=2026-09-21T09:13:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 42.332160] postgres[1134]: [1134] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 42.333524] postgres[1134]: [1134] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 42.362369] niks3-server[1127]: 2026/09/21 09:13:51 OK 20241026095416_initial_model.sql (19.09ms) lb # [ 42.366140] niks3-server[1127]: 2026/09/21 09:13:51 OK 20251210153512_drop_unused_gin_index.sql (4.15ms) lb # [ 42.371500] niks3-server[1127]: 2026/09/21 09:13:51 OK 20251218171726_add_pins.sql (5.31ms) lb # [ 42.376304] niks3-server[1127]: 2026/09/21 09:13:51 OK 20260628120000_add_object_size_and_stats.sql (4.77ms) lb # [ 42.381613] niks3-server[1127]: 2026/09/21 09:13:51 OK 20260905000000_add_claims.sql (5.28ms) lb # [ 42.386087] niks3-server[1127]: 2026/09/21 09:13:51 OK 20260920000000_drop_claims.sql (4.35ms) lb # [ 42.388150] niks3-server[1127]: 2026/09/21 09:13:51 goose: successfully migrated database to version: 20260920000000 lb # [ 42.392733] niks3-server[1127]: 2026/09/21 09:13:51 OK 1_commit_pending_closure.sql (6.63ms) lb # [ 42.395262] niks3-server[1127]: 2026/09/21 09:13:51 OK 2_object_stats_trigger.sql (2.4ms) lb # [ 42.396791] niks3-server[1127]: 2026/09/21 09:13:51 goose: up to current file version: 2 lb # [ 42.400343] niks3-server[1127]: 2026/09/21 09:13:52 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key worker2 # [ 42.388494] nix-grpc-daemon[781]: ts=2026-09-21T09:13:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 42.393671] nix-grpc-daemon[781]: ts=2026-09-21T09:13:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 42.389475] nix-grpc-daemon[774]: ts=2026-09-21T09:13:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 42.394209] nix-grpc-daemon[774]: ts=2026-09-21T09:13:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 42.443837] niks3-server[1127]: 2026/09/21 09:13:52 INFO Read proxy enabled — serving cache objects from S3 lb # [ 42.446681] niks3-server[1127]: 2026/09/21 09:13:52 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 42.449687] niks3-server[1127]: 2026/09/21 09:13:52 INFO systemd watchdog enabled interval=15s lb # [ 42.454276] systemd[1]: Started niks3 server. lb # [ 42.455454] niks3-server[1127]: 2026/09/21 09:13:52 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 42.461379] systemd[1]: Reached target Multi-User System. lb # [ 42.462169] systemd[1]: Startup finished in 967ms (kernel) + 5.427s (initrd) + 36.057s (userspace) = 42.452s. worker2 # [ 42.454691] nix-grpc-daemon[781]: ts=2026-09-21T09:13:52Z level=info event=scheduler_take_over lb # [ 42.475050] niks3-server[1127]: 2026/09/21 09:13:52 INFO lead: acquired remote=192.168.1.4:48576 worker2 # [ 42.594629] nix-grpc-daemon[781]: ts=2026-09-21T09:13:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 42.595564] nix-grpc-daemon[774]: ts=2026-09-21T09:13:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 42.606452] nix-grpc-daemon[781]: ts=2026-09-21T09:13:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:34474 worker2 # [ 42.612582] nix-grpc-daemon[781]: ts=2026-09-21T09:13:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 42.625992] nix-grpc-daemon[781]: ts=2026-09-21T09:13:52Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 42.630465] nix-grpc-daemon[781]: ts=2026-09-21T09:13:52Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:34474 worker2 # [ 42.635861] nix-grpc-daemon[781]: ts=2026-09-21T09:13:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: waiting for unit niks3.service, in 28.26 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.07 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 43.064775] envoy[913]: conn peer=[::1]:57190 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) worker2 # [ 43.235768] systemd[1]: Starting scheduler-token.service... worker2 # [ 43.333702] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 43.337721] systemd[1]: Finished scheduler-token.service. worker2 # [ 43.341885] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 101ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.88 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 44.713327] nix-grpc-daemon[774]: ts=2026-09-21T09:13:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 44.733041] systemd[1]: Started Nix Daemon. worker1 # [ 45.032635] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 45.068630] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 1/5) worker1 # [ 45.096577] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 109 ms (attempt 2/5) worker1 # [ 45.208858] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 3/5) worker1 # [ 45.306622] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 4/5) worker1 # [ 45.337874] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 45.385255] nix-grpc-daemon[781]: ts=2026-09-21T09:13:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 45.402321] systemd[1]: Started Nix Daemon. worker2 # [ 45.770406] nix-daemon[870]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 45.802862] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 1/5) worker2 # [ 45.852178] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 173 ms (attempt 2/5) worker2 # [ 46.025696] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 204 ms (attempt 3/5) worker2 # [ 46.237445] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 217 ms (attempt 4/5) worker2 # [ 46.465816] nix-grpc-daemon[781]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 46.481658] nix-grpc-daemon[781]: ts=2026-09-21T09:13:56Z level=debug event=path_info_miss path=p6p9342ifnppad60sm4s8zcrc0dk790i-nixos-system-client-test error="error: path '/nix/store/p6p9342ifnppad60sm4s8zcrc0dk790i-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 46.495351] nix-grpc-daemon[781]: ts=2026-09-21T09:13:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 46.507839] nix-grpc-daemon[781]: ts=2026-09-21T09:13:56Z level=debug event=path_info_miss path=p6p9342ifnppad60sm4s8zcrc0dk790i-nixos-system-client-test error="error: path '/nix/store/p6p9342ifnppad60sm4s8zcrc0dk790i-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds) client: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds) worker1 # [ 46.957897] nix-grpc-daemon[774]: ts=2026-09-21T09:13:56Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 46.958258] nix-grpc-daemon[774]: ts=2026-09-21T09:13:56Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:35350 worker1 # [ 46.972547] nix-grpc-daemon[774]: ts=2026-09-21T09:13:56Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:35350 worker1 # [ 46.987030] nix-grpc-daemon[774]: ts=2026-09-21T09:13:56Z level=debug event=path_info_miss path=p6p9342ifnppad60sm4s8zcrc0dk790i-nixos-system-client-test error="error: path '/nix/store/p6p9342ifnppad60sm4s8zcrc0dk790i-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 47.002098] nix-grpc-daemon[774]: ts=2026-09-21T09:13:56Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:35350 worker1 # [ 47.009708] nix-grpc-daemon[774]: ts=2026-09-21T09:13:56Z level=debug event=path_info_miss path=p6p9342ifnppad60sm4s8zcrc0dk790i-nixos-system-client-test error="error: path '/nix/store/p6p9342ifnppad60sm4s8zcrc0dk790i-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds) worker2 # [ 47.324128] nix-grpc-daemon[781]: ts=2026-09-21T09:13:56Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 47.581583] nix-grpc-daemon[774]: ts=2026-09-21T09:13:57Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.29 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 47.850927] nix-grpc-daemon[774]: ts=2026-09-21T09:13:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35350 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 47.873455] nix-grpc-daemon[781]: ts=2026-09-21T09:13:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 47.913344] nix-grpc-daemon[781]: ts=2026-09-21T09:13:57Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 47.919402] nix-grpc-daemon[781]: ts=2026-09-21T09:13:57Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 47.964553] nix-grpc-daemon[774]: ts=2026-09-21T09:13:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 47.981416] nix-grpc-daemon[774]: ts=2026-09-21T09:13:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 client # copying 1 paths to 'lb:50051'... worker1 # [ 47.998484] nix-grpc-daemon[774]: ts=2026-09-21T09:13:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 48.029730] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 48.063978] nix-grpc-daemon[774]: ts=2026-09-21T09:13:57Z level=info event=niks3_push_started pid=853 worker1 # [ 48.345675] nix-grpc-daemon[853]: time=2026-09-21T09:13:57.939Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 48.542506] nix-daemon[843]: accepted connection from pid 866, user nix-grpc-daemon (trusted) worker1 # [ 48.561238] nix-daemon[843]: reaped child process 869, status = succeeded worker1 # [ 48.734692] nix-daemon[843]: accepted connection from pid 871, user nix-grpc-daemon (trusted) worker1 # [ 48.755022] nix-daemon[843]: reaped child process 874, status = succeeded lb # [ 48.793792] niks3-server[1127]: 2026/09/21 09:13:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 48.794194] nix-grpc-daemon[853]: time=2026-09-21T09:13:58.389Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 48.797872] nix-grpc-daemon[853]: time=2026-09-21T09:13:58.391Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 48.873656] niks3-server[1127]: 2026/09/21 09:13:58 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 48.884314] niks3-server[1127]: 2026/09/21 09:13:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 48.891762] niks3-server[1127]: 2026/09/21 09:13:58 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls worker1 # [ 48.866657] nix-grpc-daemon[853]: time=2026-09-21T09:13:58.461Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.897891] niks3-server[1127]: 2026/09/21 09:13:58 INFO Signed narinfos id=1 count=1 lb # [ 48.906914] niks3-server[1127]: 2026/09/21 09:13:58 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 48.915071] niks3-server[1127]: 2026/09/21 09:13:58 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo lb # [ 48.927971] niks3-server[1127]: 2026/09/21 09:13:58 INFO Completed upload id=1 worker1 # [ 48.902909] nix-grpc-daemon[853]: time=2026-09-21T09:13:58.498Z level=INFO msg="Upload complete. (549ms)" worker1 # [ 48.916667] nix-grpc-daemon[774]: ts=2026-09-21T09:13:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 48.933122] nix-grpc-daemon[774]: ts=2026-09-21T09:13:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 48.943706] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 48.955903] nix-daemon[843]: reaped child process 851, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker1 # [ 48.966091] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-t1 worker1 # [ 49.988231] nix-daemon[843]: reaped child process 878, status = succeeded worker1 # [ 50.152961] nix-daemon[843]: accepted connection from pid 893, user nix-grpc-daemon (trusted) worker1 # [ 50.171025] nix-daemon[843]: reaped child process 896, status = succeeded lb # [ 50.208694] niks3-server[1127]: 2026/09/21 09:13:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 50.196728] nix-grpc-daemon[853]: time=2026-09-21T09:13:59.791Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 50.198617] nix-grpc-daemon[853]: time=2026-09-21T09:13:59.791Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 50.257403] niks3-server[1127]: 2026/09/21 09:13:59 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 50.269246] niks3-server[1127]: 2026/09/21 09:13:59 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 50.278906] niks3-server[1127]: 2026/09/21 09:13:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 50.285152] niks3-server[1127]: 2026/09/21 09:13:59 INFO Signed narinfos id=2 count=1 worker1 # [ 50.260995] nix-grpc-daemon[853]: time=2026-09-21T09:13:59.855Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.288292] niks3-server[1127]: 2026/09/21 09:13:59 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 50.299620] niks3-server[1127]: 2026/09/21 09:13:59 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 50.312250] niks3-server[1127]: 2026/09/21 09:13:59 INFO Completed upload id=2 worker1 # [ 50.287037] nix-grpc-daemon[853]: time=2026-09-21T09:13:59.882Z level=INFO msg="Upload complete. (309ms)" lb # [ 50.315824] niks3-server[1127]: 2026/09/21 09:13:59 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 50.300124] nix-grpc-daemon[774]: ts=2026-09-21T09:13:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 50.317470] nix-grpc-daemon[781]: ts=2026-09-21T09:13:59Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker1 # [ 50.315219] nix-daemon[843]: reaped child process 876, status = succeeded worker2 # [ 50.317856] nix-grpc-daemon[781]: ts=2026-09-21T09:13:59Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 50.355218] nix-grpc-daemon[774]: ts=2026-09-21T09:13:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 50.370928] nix-grpc-daemon[774]: ts=2026-09-21T09:13:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 50.386267] nix-grpc-daemon[853]: time=2026-09-21T09:13:59.981Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 50.396421] nix-grpc-daemon[774]: ts=2026-09-21T09:13:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 50.418706] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 50.644248] nix-daemon[843]: accepted connection from pid 900, user nix-grpc-daemon (trusted) worker1 # [ 50.663881] nix-daemon[843]: reaped child process 903, status = succeeded worker1 # [ 50.845556] nix-daemon[843]: accepted connection from pid 905, user nix-grpc-daemon (trusted) worker1 # [ 50.864418] nix-daemon[843]: reaped child process 908, status = succeeded lb # [ 50.906366] niks3-server[1127]: 2026/09/21 09:14:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 50.891416] nix-grpc-daemon[853]: time=2026-09-21T09:14:00.486Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 50.893223] nix-grpc-daemon[853]: time=2026-09-21T09:14:00.486Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 50.936503] niks3-server[1127]: 2026/09/21 09:14:00 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 50.948864] niks3-server[1127]: 2026/09/21 09:14:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker1 # [ 50.930589] nix-grpc-daemon[853]: time=2026-09-21T09:14:00.526Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.961240] niks3-server[1127]: 2026/09/21 09:14:00 INFO Signed narinfos id=3 count=1 lb # [ 50.967475] niks3-server[1127]: 2026/09/21 09:14:00 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 50.979141] envoy[913]: conn peer=[2001:db8:1::1]:46030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=430 ms=1842 lb # [ 50.983845] envoy[913]: conn peer=[2001:db8:1::1]:46036 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=73 worker1 # [ 50.957887] nix-grpc-daemon[853]: time=2026-09-21T09:14:00.553Z level=INFO msg="Upload complete. (520ms)" lb # [ 50.987216] envoy[913]: conn peer=[2001:db8:1::1]:46048 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=12 lb # [ 50.990729] envoy[913]: conn peer=[2001:db8:1::1]:46054 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=13 lb # [ 50.994564] niks3-server[1127]: 2026/09/21 09:14:00 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete worker1 # [ 50.968250] nix-grpc-daemon[774]: ts=2026-09-21T09:14:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 50.997661] niks3-server[1127]: 2026/09/21 09:14:00 INFO Completed upload id=3 lb # [ 50.999655] niks3-server[1127]: 2026/09/21 09:14:00 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker1 # [ 50.979610] nix-grpc-daemon[774]: ts=2026-09-21T09:14:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 50.990146] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 50.994128] nix-daemon[843]: reaped child process 898, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker1 # [ 51.007917] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-t1 worker1 # [ 52.455688] nix-daemon[843]: reaped child process 912, status = succeeded worker1 # [ 52.638496] nix-daemon[843]: accepted connection from pid 927, user nix-grpc-daemon (trusted) worker1 # [ 52.656233] nix-daemon[843]: reaped child process 930, status = succeeded lb # [ 52.694400] niks3-server[1127]: 2026/09/21 09:14:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 52.679972] nix-grpc-daemon[853]: time=2026-09-21T09:14:02.274Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 52.681555] nix-grpc-daemon[853]: time=2026-09-21T09:14:02.274Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 52.727097] niks3-server[1127]: 2026/09/21 09:14:02 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 52.741430] niks3-server[1127]: 2026/09/21 09:14:02 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst worker1 # [ 52.736164] nix-grpc-daemon[853]: time=2026-09-21T09:14:02.331Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.755966] niks3-server[1127]: 2026/09/21 09:14:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 52.766913] niks3-server[1127]: 2026/09/21 09:14:02 INFO Signed narinfos id=4 count=1 lb # [ 52.772892] niks3-server[1127]: 2026/09/21 09:14:02 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 52.779685] niks3-server[1127]: 2026/09/21 09:14:02 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 52.787634] niks3-server[1127]: 2026/09/21 09:14:02 INFO Completed upload id=4 worker1 # [ 52.762462] nix-grpc-daemon[853]: time=2026-09-21T09:14:02.358Z level=INFO msg="Upload complete. (343ms)" lb # [ 52.790550] niks3-server[1127]: 2026/09/21 09:14:02 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker1 # [ 52.777260] nix-grpc-daemon[774]: ts=2026-09-21T09:14:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 52.786733] nix-grpc-daemon[781]: ts=2026-09-21T09:14:02Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker1 # [ 52.794049] nix-daemon[843]: reaped child process 910, status = succeeded worker1 # [ 52.827150] nix-grpc-daemon[774]: ts=2026-09-21T09:14:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 52.842964] nix-grpc-daemon[774]: ts=2026-09-21T09:14:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 52.858469] nix-grpc-daemon[853]: time=2026-09-21T09:14:02.454Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 52.869027] nix-grpc-daemon[774]: ts=2026-09-21T09:14:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 52.893064] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 53.099590] nix-daemon[843]: accepted connection from pid 934, user nix-grpc-daemon (trusted) worker1 # [ 53.120609] nix-daemon[843]: reaped child process 937, status = succeeded worker1 # [ 53.297804] nix-daemon[843]: accepted connection from pid 939, user nix-grpc-daemon (trusted) worker1 # [ 53.316395] nix-daemon[843]: reaped child process 942, status = succeeded lb # [ 53.354438] niks3-server[1127]: 2026/09/21 09:14:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.339592] nix-grpc-daemon[853]: time=2026-09-21T09:14:02.934Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 53.341265] nix-grpc-daemon[853]: time=2026-09-21T09:14:02.935Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 53.382318] niks3-server[1127]: 2026/09/21 09:14:02 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst worker1 # [ 53.371312] nix-grpc-daemon[853]: time=2026-09-21T09:14:02.966Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.397941] niks3-server[1127]: 2026/09/21 09:14:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 53.409282] niks3-server[1127]: 2026/09/21 09:14:02 INFO Signed narinfos id=5 count=1 lb # [ 53.415198] niks3-server[1127]: 2026/09/21 09:14:03 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 53.422672] niks3-server[1127]: 2026/09/21 09:14:03 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 53.429264] niks3-server[1127]: 2026/09/21 09:14:03 INFO Completed upload id=5 worker1 # [ 53.403920] nix-grpc-daemon[853]: time=2026-09-21T09:14:02.999Z level=INFO msg="Upload complete. (492ms)" worker2 # [ 52.792809] nix-grpc-daemon[781]: ts=2026-09-21T09:14:02Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 lb # [ 53.433797] niks3-server[1127]: 2026/09/21 09:14:03 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 53.413846] nix-grpc-daemon[774]: ts=2026-09-21T09:14:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 53.420761] nix-grpc-daemon[774]: ts=2026-09-21T09:14:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 53.431509] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 53.436329] nix-daemon[843]: reaped child process 932, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 53.449950] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1 worker1 # [ 54.295516] nix-daemon[843]: reaped child process 946, status = succeeded worker1 # [ 54.475722] nix-daemon[843]: accepted connection from pid 961, user nix-grpc-daemon (trusted) worker1 # [ 54.494360] nix-daemon[843]: reaped child process 964, status = succeeded lb # [ 54.534085] niks3-server[1127]: 2026/09/21 09:14:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 54.518928] nix-grpc-daemon[853]: time=2026-09-21T09:14:04.112Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 54.521076] nix-grpc-daemon[853]: time=2026-09-21T09:14:04.112Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 54.572563] niks3-server[1127]: 2026/09/21 09:14:04 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 54.584986] niks3-server[1127]: 2026/09/21 09:14:04 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst worker1 # [ 54.573171] nix-grpc-daemon[853]: time=2026-09-21T09:14:04.168Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.592961] niks3-server[1127]: 2026/09/21 09:14:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 54.605072] niks3-server[1127]: 2026/09/21 09:14:04 INFO Signed narinfos id=6 count=1 lb # [ 54.607500] niks3-server[1127]: 2026/09/21 09:14:04 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 54.616856] niks3-server[1127]: 2026/09/21 09:14:04 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 54.628320] niks3-server[1127]: 2026/09/21 09:14:04 INFO Completed upload id=6 worker1 # [ 54.603097] nix-grpc-daemon[853]: time=2026-09-21T09:14:04.198Z level=INFO msg="Upload complete. (343ms)" lb # [ 54.631564] niks3-server[1127]: 2026/09/21 09:14:04 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker1 # [ 54.617258] nix-grpc-daemon[774]: ts=2026-09-21T09:14:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker1 # [ 54.634813] nix-daemon[843]: reaped child process 944, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.06 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.04 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.74 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 56.183083] nix-grpc-daemon[774]: ts=2026-09-21T09:14:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35350 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # [ 56.202989] nix-grpc-daemon[774]: ts=2026-09-21T09:14:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 56.214359] nix-grpc-daemon[853]: time=2026-09-21T09:14:05.809Z level=INFO msg="All 2 paths already cached" worker2 # [ 56.240748] nix-grpc-daemon[781]: ts=2026-09-21T09:14:05Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.35 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.46 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 worker1 # [ 57.273154] nix-grpc-daemon[774]: ts=2026-09-21T09:14:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35350 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 57.283937] nix-grpc-daemon[774]: ts=2026-09-21T09:14:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 57.295135] nix-grpc-daemon[853]: time=2026-09-21T09:14:06.889Z level=INFO msg="All 2 paths already cached" worker2 # [ 57.320713] nix-grpc-daemon[781]: ts=2026-09-21T09:14:06Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 57.321092] nix-grpc-daemon[781]: ts=2026-09-21T09:14:06Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 57.358997] nix-grpc-daemon[774]: ts=2026-09-21T09:14:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 57.374597] nix-grpc-daemon[774]: ts=2026-09-21T09:14:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 57.389973] nix-grpc-daemon[853]: time=2026-09-21T09:14:06.985Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker1 # [ 57.400656] nix-grpc-daemon[774]: ts=2026-09-21T09:14:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 57.420955] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 57.626435] nix-daemon[843]: accepted connection from pid 981, user nix-grpc-daemon (trusted) worker1 # [ 57.647604] nix-daemon[843]: reaped child process 984, status = succeeded worker1 # [ 57.822239] nix-daemon[843]: accepted connection from pid 986, user nix-grpc-daemon (trusted) worker1 # [ 57.842167] nix-daemon[843]: reaped child process 989, status = succeeded lb # [ 57.881855] niks3-server[1127]: 2026/09/21 09:14:07 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 57.866111] nix-grpc-daemon[853]: time=2026-09-21T09:14:07.461Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 57.867693] nix-grpc-daemon[853]: time=2026-09-21T09:14:07.461Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 57.908420] niks3-server[1127]: 2026/09/21 09:14:07 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 57.924253] niks3-server[1127]: 2026/09/21 09:14:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker1 # [ 57.904518] nix-grpc-daemon[853]: time=2026-09-21T09:14:07.499Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.936322] niks3-server[1127]: 2026/09/21 09:14:07 INFO Signed narinfos id=7 count=1 lb # [ 57.943653] niks3-server[1127]: 2026/09/21 09:14:07 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 57.953881] niks3-server[1127]: 2026/09/21 09:14:07 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 57.959073] niks3-server[1127]: 2026/09/21 09:14:07 INFO Completed upload id=7 worker1 # [ 57.933706] nix-grpc-daemon[853]: time=2026-09-21T09:14:07.529Z level=INFO msg="Upload complete. (494ms)" lb # [ 57.961891] niks3-server[1127]: 2026/09/21 09:14:07 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker1 # [ 57.940331] nix-grpc-daemon[774]: ts=2026-09-21T09:14:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 57.954807] nix-grpc-daemon[774]: ts=2026-09-21T09:14:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 57.962422] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 57.967638] nix-daemon[843]: reaped child process 979, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... worker1 # [ 57.980134] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv client # farm-top> LOG-farm-top-t1b worker1 # [ 59.631073] nix-daemon[843]: reaped child process 993, status = succeeded worker1 # [ 59.819105] nix-daemon[843]: accepted connection from pid 1008, user nix-grpc-daemon (trusted) worker1 # [ 59.838069] nix-daemon[843]: reaped child process 1011, status = succeeded lb # [ 59.878155] niks3-server[1127]: 2026/09/21 09:14:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 59.864579] nix-grpc-daemon[853]: time=2026-09-21T09:14:09.458Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 59.866646] nix-grpc-daemon[853]: time=2026-09-21T09:14:09.458Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 59.922257] niks3-server[1127]: 2026/09/21 09:14:09 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 59.934021] niks3-server[1127]: 2026/09/21 09:14:09 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst worker1 # [ 59.925204] nix-grpc-daemon[853]: time=2026-09-21T09:14:09.520Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.949951] niks3-server[1127]: 2026/09/21 09:14:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 59.958928] niks3-server[1127]: 2026/09/21 09:14:09 INFO Signed narinfos id=8 count=1 lb # [ 59.964561] niks3-server[1127]: 2026/09/21 09:14:09 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 59.975550] niks3-server[1127]: 2026/09/21 09:14:09 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 59.979614] niks3-server[1127]: 2026/09/21 09:14:09 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo lb # [ 59.984394] niks3-server[1127]: 2026/09/21 09:14:09 INFO Completed upload id=8 worker1 # [ 59.958834] nix-grpc-daemon[853]: time=2026-09-21T09:14:09.554Z level=INFO msg="Upload complete. (364ms)" worker1 # [ 59.973347] nix-grpc-daemon[774]: ts=2026-09-21T09:14:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=2 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker1 # [ 59.989507] nix-daemon[843]: reaped child process 991, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 3.01 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.25 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.67 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 60.565449] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: f0210f4699484edb8affbe14f1ed545a client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 60.849720] nix[879]: don't know how to build these paths: client # [ 60.852083] nix[879]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 60.849764] nix-grpc-daemon[774]: ts=2026-09-21T09:14:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35350 worker2 # [ 60.874750] nix-grpc-daemon[781]: ts=2026-09-21T09:14:10Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 60.884978] nix-grpc-daemon[781]: ts=2026-09-21T09:14:10Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 60.893972] nix-grpc-daemon[781]: ts=2026-09-21T09:14:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 60.917022] nix-grpc-daemon[781]: ts=2026-09-21T09:14:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34490 client # [ 60.924160] nix[879]: copying 1 paths to 'lb:50051'... client # [ 60.928325] nix[879]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 60.935667] nix-grpc-daemon[781]: ts=2026-09-21T09:14:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34490 lb # [ 60.966007] envoy[913]: conn peer=[2001:db8:1::1]:46068 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9523 tx=3839 ms=6790 lb # [ 60.971234] envoy[913]: conn peer=[2001:db8:1::1]:60170 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=476 ms=74 worker2 # [ 60.955593] nix-daemon[870]: accepted connection from pid 781, user nix-grpc-daemon (trusted) lb # [ 60.978275] envoy[913]: conn peer=[2001:db8:1::1]:60184 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4215 tx=1745 ms=2709 worker2 # [ 60.985148] nix-grpc-daemon[781]: ts=2026-09-21T09:14:10Z level=info event=niks3_push_started pid=918 worker2 # [ 61.301123] nix-grpc-daemon[918]: time=2026-09-21T09:14:10.881Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 61.508821] nix-daemon[870]: accepted connection from pid 931, user nix-grpc-daemon (trusted) worker2 # [ 61.529196] nix-daemon[870]: reaped child process 934, status = succeeded worker2 # [ 61.711073] nix-daemon[870]: accepted connection from pid 936, user nix-grpc-daemon (trusted) client # [ 61.693915] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. worker2 # [ 61.729459] nix-daemon[870]: reaped child process 939, status = succeeded client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds) lb # [ 61.762758] niks3-server[1127]: 2026/09/21 09:14:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 61.756218] nix-grpc-daemon[918]: time=2026-09-21T09:14:11.338Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 61.759886] nix-grpc-daemon[918]: time=2026-09-21T09:14:11.340Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 61.806203] niks3-server[1127]: 2026/09/21 09:14:11 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst lb # [ 61.818771] niks3-server[1127]: 2026/09/21 09:14:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker2 # [ 61.807355] nix-grpc-daemon[918]: time=2026-09-21T09:14:11.389Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.830368] niks3-server[1127]: 2026/09/21 09:14:11 INFO Signed narinfos id=9 count=1 lb # [ 61.838793] niks3-server[1127]: 2026/09/21 09:14:11 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 61.853786] niks3-server[1127]: 2026/09/21 09:14:11 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 61.860979] niks3-server[1127]: 2026/09/21 09:14:11 INFO Completed upload id=9 lb # [ 61.864449] niks3-server[1127]: 2026/09/21 09:14:11 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 61.841727] nix-grpc-daemon[918]: time=2026-09-21T09:14:11.424Z level=INFO msg="Upload complete. (530ms)" worker2 # [ 61.852786] nix-grpc-daemon[781]: ts=2026-09-21T09:14:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34490 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 61.874256] nix-grpc-daemon[781]: ts=2026-09-21T09:14:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 61.887118] nix-daemon[870]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 61.895497] nix-daemon[870]: reaped child process 916, status = succeeded client # Running as unit: dedup2.service; invocation ID: e6e3990c82424225ad1e3dc253765c7f worker2 # [ 61.907813] nix-daemon[870]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # [ 61.898015] nix[879]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client # [ 62.088064] nix[895]: don't know how to build these paths: client # [ 62.089008] nix[895]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 62.089598] nix-grpc-daemon[774]: ts=2026-09-21T09:14:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35350 worker2 # [ 62.110485] nix-grpc-daemon[781]: ts=2026-09-21T09:14:11Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 62.123091] nix-grpc-daemon[781]: ts=2026-09-21T09:14:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34490 client # [ 62.121729] nix[895]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.06 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 65.559124] nix-daemon[870]: reaped child process 947, status = succeeded worker2 # [ 65.744596] nix-daemon[870]: accepted connection from pid 974, user nix-grpc-daemon (trusted) worker2 # [ 65.762575] nix-daemon[870]: reaped child process 977, status = succeeded lb # [ 65.793700] niks3-server[1127]: 2026/09/21 09:14:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 65.787649] nix-grpc-daemon[918]: time=2026-09-21T09:14:15.369Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 65.789712] nix-grpc-daemon[918]: time=2026-09-21T09:14:15.369Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 65.842328] niks3-server[1127]: 2026/09/21 09:14:15 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 65.853555] niks3-server[1127]: 2026/09/21 09:14:15 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst worker2 # [ 65.849445] nix-grpc-daemon[918]: time=2026-09-21T09:14:15.430Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.867974] niks3-server[1127]: 2026/09/21 09:14:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 65.872793] niks3-server[1127]: 2026/09/21 09:14:15 INFO Signed narinfos id=10 count=1 lb # [ 65.875160] niks3-server[1127]: 2026/09/21 09:14:15 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 65.886760] niks3-server[1127]: 2026/09/21 09:14:15 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 65.893934] niks3-server[1127]: 2026/09/21 09:14:15 INFO Completed upload id=10 worker2 # [ 65.875692] nix-grpc-daemon[918]: time=2026-09-21T09:14:15.458Z level=INFO msg="Upload complete. (349ms)" lb # [ 65.897331] niks3-server[1127]: 2026/09/21 09:14:15 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 65.893178] nix-grpc-daemon[781]: ts=2026-09-21T09:14:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34490 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 65.907217] nix-grpc-daemon[781]: ts=2026-09-21T09:14:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34490 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 65.913063] nix-daemon[870]: reaped child process 944, status = succeeded client # [ 65.926175] systemd[1]: dedup2.service: Deactivated successfully. client # [ 65.934777] systemd[1]: dedup2.service: Consumed 230ms CPU time over 4.241s wall clock time, 33.2M memory peak, 5.9K incoming IP traffic, 5.6K outgoing IP traffic. client # [ 65.978232] systemd[1]: dedup1.service: Deactivated successfully. client # [ 65.982413] systemd[1]: dedup1.service: Consumed 184ms CPU time over 5.416s wall clock time, 41.3M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.35 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 67.062332] systemd[1]: Started Nix Daemon. client # [ 67.248424] nix-daemon[937]: accepted connection from pid 934, user root (trusted) worker1 # [ 67.470767] nix-grpc-daemon[774]: ts=2026-09-21T09:14:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:35350 worker2 # [ 67.482175] nix-grpc-daemon[781]: ts=2026-09-21T09:14:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 67.501548] nix-grpc-daemon[781]: ts=2026-09-21T09:14:17Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 67.507576] nix-grpc-daemon[781]: ts=2026-09-21T09:14:17Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 67.542986] nix-grpc-daemon[774]: ts=2026-09-21T09:14:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 67.559610] nix-grpc-daemon[774]: ts=2026-09-21T09:14:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 67.576123] nix-grpc-daemon[774]: ts=2026-09-21T09:14:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 67.591687] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 67.807500] nix-daemon[843]: accepted connection from pid 1036, user nix-grpc-daemon (trusted) worker1 # [ 67.829947] nix-daemon[843]: reaped child process 1039, status = succeeded worker1 # [ 68.006556] nix-daemon[843]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker1 # [ 68.024126] nix-daemon[843]: reaped child process 1044, status = succeeded lb # [ 68.062748] niks3-server[1127]: 2026/09/21 09:14:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 68.047193] nix-grpc-daemon[853]: time=2026-09-21T09:14:17.642Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 68.048812] nix-grpc-daemon[853]: time=2026-09-21T09:14:17.642Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 68.089465] niks3-server[1127]: 2026/09/21 09:14:17 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 68.104453] niks3-server[1127]: 2026/09/21 09:14:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker1 # [ 68.084536] nix-grpc-daemon[853]: time=2026-09-21T09:14:17.680Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.116680] niks3-server[1127]: 2026/09/21 09:14:17 INFO Signed narinfos id=11 count=1 lb # [ 68.123746] niks3-server[1127]: 2026/09/21 09:14:17 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 68.131809] niks3-server[1127]: 2026/09/21 09:14:17 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete worker1 # [ 68.111649] nix-grpc-daemon[853]: time=2026-09-21T09:14:17.707Z level=INFO msg="Upload complete. (501ms)" lb # [ 68.139049] niks3-server[1127]: 2026/09/21 09:14:17 INFO Completed upload id=11 lb # [ 68.142465] niks3-server[1127]: 2026/09/21 09:14:17 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker1 # [ 68.120235] nix-grpc-daemon[774]: ts=2026-09-21T09:14:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 68.130897] nix-grpc-daemon[774]: ts=2026-09-21T09:14:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 68.137624] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 68.142751] nix-daemon[843]: reaped child process 1034, status = succeeded worker1 # [ 68.155964] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 69.399111] nix-daemon[843]: reaped child process 1048, status = succeeded worker1 # [ 69.591690] nix-daemon[843]: accepted connection from pid 1063, user nix-grpc-daemon (trusted) worker1 # [ 69.609649] nix-daemon[843]: reaped child process 1066, status = succeeded lb # [ 69.648956] niks3-server[1127]: 2026/09/21 09:14:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 69.636460] nix-grpc-daemon[853]: time=2026-09-21T09:14:19.229Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 69.638107] nix-grpc-daemon[853]: time=2026-09-21T09:14:19.229Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 69.693624] niks3-server[1127]: 2026/09/21 09:14:19 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 69.709584] niks3-server[1127]: 2026/09/21 09:14:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker1 # [ 69.690478] nix-grpc-daemon[853]: time=2026-09-21T09:14:19.285Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.725840] niks3-server[1127]: 2026/09/21 09:14:19 INFO Signed narinfos id=12 count=1 lb # [ 69.732597] niks3-server[1127]: 2026/09/21 09:14:19 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 69.744249] niks3-server[1127]: 2026/09/21 09:14:19 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 69.753205] niks3-server[1127]: 2026/09/21 09:14:19 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 69.757761] niks3-server[1127]: 2026/09/21 09:14:19 INFO Completed upload id=12 lb # [ 69.760540] niks3-server[1127]: 2026/09/21 09:14:19 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker1 # [ 69.731769] nix-grpc-daemon[853]: time=2026-09-21T09:14:19.327Z level=INFO msg="Upload complete. (365ms)" worker1 # [ 69.745399] nix-grpc-daemon[774]: ts=2026-09-21T09:14:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker2 # [ 69.754741] nix-grpc-daemon[781]: ts=2026-09-21T09:14:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34490 worker1 # [ 69.762544] nix-daemon[843]: reaped child process 1046, status = succeeded worker2 # [ 69.770631] nix-grpc-daemon[781]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 69.809804] nix-grpc-daemon[774]: ts=2026-09-21T09:14:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 69.816792] nix-grpc-daemon[774]: ts=2026-09-21T09:14:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 70.089486] nix-grpc-daemon[774]: ts=2026-09-21T09:14:19Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 70.098340] nix-grpc-daemon[774]: ts=2026-09-21T09:14:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 70.107948] nix-grpc-daemon[853]: time=2026-09-21T09:14:19.703Z level=INFO msg="All 1 paths already cached" worker2 # [ 70.133407] nix-grpc-daemon[781]: ts=2026-09-21T09:14:19Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 70.139895] nix-grpc-daemon[781]: ts=2026-09-21T09:14:19Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 70.135880] nix-grpc-daemon[774]: ts=2026-09-21T09:14:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 70.151340] nix-grpc-daemon[774]: ts=2026-09-21T09:14:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 70.165844] nix-grpc-daemon[853]: time=2026-09-21T09:14:19.761Z level=INFO msg="All 1 paths already cached" worker1 # [ 70.175305] nix-grpc-daemon[774]: ts=2026-09-21T09:14:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 70.189867] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 70.410289] nix-daemon[843]: accepted connection from pid 1070, user nix-grpc-daemon (trusted) worker1 # [ 70.429758] nix-daemon[843]: reaped child process 1073, status = succeeded worker1 # [ 70.604849] nix-daemon[843]: accepted connection from pid 1075, user nix-grpc-daemon (trusted) worker1 # [ 70.622484] nix-daemon[843]: reaped child process 1078, status = succeeded lb # [ 70.659868] niks3-server[1127]: 2026/09/21 09:14:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 70.644478] nix-grpc-daemon[853]: time=2026-09-21T09:14:20.239Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 70.645968] nix-grpc-daemon[853]: time=2026-09-21T09:14:20.239Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 70.687068] niks3-server[1127]: 2026/09/21 09:14:20 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst lb # [ 70.702076] niks3-server[1127]: 2026/09/21 09:14:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker1 # [ 70.683182] nix-grpc-daemon[853]: time=2026-09-21T09:14:20.278Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.714409] niks3-server[1127]: 2026/09/21 09:14:20 INFO Signed narinfos id=13 count=1 lb # [ 70.720653] niks3-server[1127]: 2026/09/21 09:14:20 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 70.729627] niks3-server[1127]: 2026/09/21 09:14:20 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 70.734610] niks3-server[1127]: 2026/09/21 09:14:20 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo lb # [ 70.738638] niks3-server[1127]: 2026/09/21 09:14:20 INFO Completed upload id=13 worker1 # [ 70.713461] nix-grpc-daemon[853]: time=2026-09-21T09:14:20.309Z level=INFO msg="Upload complete. (505ms)" worker1 # [ 70.723080] nix-grpc-daemon[774]: ts=2026-09-21T09:14:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 70.736246] nix-grpc-daemon[774]: ts=2026-09-21T09:14:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 70.742062] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 70.746917] nix-daemon[843]: reaped child process 1068, status = succeeded worker1 # [ 70.760103] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) lb # [ 70.968477] envoy[913]: conn peer=[2001:db8:1::1]:48960 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1085 ms=3811 lb # [ 70.974371] envoy[913]: conn peer=[2001:db8:1::1]:48948 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1374 ms=5093 lb # [ 70.979207] envoy[913]: conn peer=[2001:db8:1::1]:48988 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=30 lb # [ 70.983884] envoy[913]: conn peer=[2001:db8:1::1]:48974 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3407 tx=1774 ms=2365 worker1 # [ 71.580128] nix-daemon[843]: reaped child process 1082, status = succeeded worker1 # [ 71.733776] nix-daemon[843]: accepted connection from pid 1097, user nix-grpc-daemon (trusted) worker1 # [ 71.752337] nix-daemon[843]: reaped child process 1100, status = succeeded lb # [ 71.791543] niks3-server[1127]: 2026/09/21 09:14:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 71.775534] nix-grpc-daemon[853]: time=2026-09-21T09:14:21.370Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 71.778731] nix-grpc-daemon[853]: time=2026-09-21T09:14:21.372Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 71.835432] niks3-server[1127]: 2026/09/21 09:14:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign worker1 # [ 71.820991] nix-grpc-daemon[853]: time=2026-09-21T09:14:21.416Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.850523] niks3-server[1127]: 2026/09/21 09:14:21 INFO Signed narinfos id=14 count=1 lb # [ 71.860443] niks3-server[1127]: 2026/09/21 09:14:21 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 71.872254] niks3-server[1127]: 2026/09/21 09:14:21 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 71.875788] niks3-server[1127]: 2026/09/21 09:14:21 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst worker1 # [ 71.854964] nix-grpc-daemon[853]: time=2026-09-21T09:14:21.450Z level=INFO msg="Upload complete. (285ms)" lb # [ 71.880769] niks3-server[1127]: 2026/09/21 09:14:21 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 71.885445] niks3-server[1127]: 2026/09/21 09:14:21 INFO Completed upload id=14 worker1 # [ 71.863832] nix-grpc-daemon[774]: ts=2026-09-21T09:14:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker2 # [ 71.875481] nix-grpc-daemon[781]: ts=2026-09-21T09:14:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34490 worker1 # [ 71.878350] nix-grpc-daemon[853]: time=2026-09-21T09:14:21.454Z level=WARN msg="Failed to register uploaded object" key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 71.884092] nix-daemon[843]: reaped child process 1080, status = succeeded worker2 # [ 71.890292] nix-grpc-daemon[781]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker2 # [ 71.933155] nix-grpc-daemon[781]: ts=2026-09-21T09:14:21Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 71.939643] nix-grpc-daemon[781]: ts=2026-09-21T09:14:21Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34490 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 72.245853] nix-grpc-daemon[774]: ts=2026-09-21T09:14:21Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 72.253526] nix-grpc-daemon[774]: ts=2026-09-21T09:14:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 72.260549] nix-grpc-daemon[853]: time=2026-09-21T09:14:21.854Z level=INFO msg="All 2 paths already cached" worker2 # [ 72.279434] nix-grpc-daemon[781]: ts=2026-09-21T09:14:21Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 72.285567] nix-grpc-daemon[781]: ts=2026-09-21T09:14:21Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 72.318605] nix-grpc-daemon[774]: ts=2026-09-21T09:14:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 72.333961] nix-grpc-daemon[774]: ts=2026-09-21T09:14:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 72.348660] nix-grpc-daemon[853]: time=2026-09-21T09:14:21.944Z level=INFO msg="All 2 paths already cached" worker1 # [ 72.354798] nix-grpc-daemon[774]: ts=2026-09-21T09:14:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 72.369018] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 72.574469] nix-daemon[843]: accepted connection from pid 1104, user nix-grpc-daemon (trusted) worker1 # [ 72.592581] nix-daemon[843]: reaped child process 1107, status = succeeded worker1 # [ 72.766327] nix-daemon[843]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker1 # [ 72.783773] nix-daemon[843]: reaped child process 1112, status = succeeded lb # [ 72.821368] niks3-server[1127]: 2026/09/21 09:14:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 72.806113] nix-grpc-daemon[853]: time=2026-09-21T09:14:22.401Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 72.807619] nix-grpc-daemon[853]: time=2026-09-21T09:14:22.401Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 72.850129] niks3-server[1127]: 2026/09/21 09:14:22 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker1 # [ 72.837319] nix-grpc-daemon[853]: time=2026-09-21T09:14:22.432Z level=INFO msg="Uploading 1 narinfos" lb # [ 72.866974] niks3-server[1127]: 2026/09/21 09:14:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign lb # [ 72.877104] niks3-server[1127]: 2026/09/21 09:14:22 INFO Signed narinfos id=15 count=1 worker1 # [ 72.862260] nix-grpc-daemon[853]: time=2026-09-21T09:14:22.457Z level=INFO msg="Upload complete. (475ms)" lb # [ 72.887724] niks3-server[1127]: 2026/09/21 09:14:22 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 72.892395] niks3-server[1127]: 2026/09/21 09:14:22 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 72.896617] niks3-server[1127]: 2026/09/21 09:14:22 INFO Completed upload id=15 worker1 # [ 72.871963] nix-grpc-daemon[774]: ts=2026-09-21T09:14:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 72.899014] niks3-server[1127]: 2026/09/21 09:14:22 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker1 # [ 72.882836] nix-grpc-daemon[774]: ts=2026-09-21T09:14:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 72.888830] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 72.893396] nix-daemon[843]: reaped child process 1102, status = succeeded worker1 # [ 72.906158] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 74.133261] nix-daemon[843]: reaped child process 1116, status = succeeded worker1 # [ 74.304772] nix-daemon[843]: accepted connection from pid 1131, user nix-grpc-daemon (trusted) worker1 # [ 74.324868] nix-daemon[843]: reaped child process 1134, status = succeeded lb # [ 74.362544] niks3-server[1127]: 2026/09/21 09:14:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 74.348398] nix-grpc-daemon[853]: time=2026-09-21T09:14:23.942Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 74.349945] nix-grpc-daemon[853]: time=2026-09-21T09:14:23.942Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 74.410975] niks3-server[1127]: 2026/09/21 09:14:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker1 # [ 74.394431] nix-grpc-daemon[853]: time=2026-09-21T09:14:23.989Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.429312] niks3-server[1127]: 2026/09/21 09:14:24 INFO Signed narinfos id=16 count=1 lb # [ 74.431715] niks3-server[1127]: 2026/09/21 09:14:24 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 74.440939] niks3-server[1127]: 2026/09/21 09:14:24 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst worker1 # [ 74.424446] nix-grpc-daemon[853]: time=2026-09-21T09:14:24.020Z level=INFO msg="Upload complete. (308ms)" lb # [ 74.450497] niks3-server[1127]: 2026/09/21 09:14:24 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 74.454172] niks3-server[1127]: 2026/09/21 09:14:24 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 74.457660] niks3-server[1127]: 2026/09/21 09:14:24 INFO Completed upload id=16 lb # [ 74.460495] niks3-server[1127]: 2026/09/21 09:14:24 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 74.436944] nix-grpc-daemon[774]: ts=2026-09-21T09:14:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker1 # [ 74.451227] nix-grpc-daemon[774]: ts=2026-09-21T09:14:24Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 74.455639] nix-daemon[843]: reaped child process 1114, status = succeeded worker2 # [ 74.476717] nix-grpc-daemon[781]: ts=2026-09-21T09:14:24Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 74.490826] nix-grpc-daemon[781]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker2 # [ 74.507056] nix-grpc-daemon[781]: ts=2026-09-21T09:14:24Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34490 duration_s=0 paths=1 nar_bytes_out=232 client # [ 74.640511] nix-daemon[937]: reaped child process 939, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.82 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.95 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.25 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 75.934015] nix-daemon[937]: accepted connection from pid 1018, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 76.162339] nix-grpc-daemon[781]: ts=2026-09-21T09:14:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:34490 worker1 # [ 76.161382] nix-grpc-daemon[774]: ts=2026-09-21T09:14:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 76.376465] nix-daemon[843]: accepted connection from pid 1141, user nix-grpc-daemon (trusted) worker1 # [ 76.394576] nix-daemon[843]: reaped child process 1144, status = succeeded lb # [ 76.433753] niks3-server[1127]: 2026/09/21 09:14:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 76.420498] nix-grpc-daemon[853]: time=2026-09-21T09:14:26.015Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 76.422124] nix-grpc-daemon[853]: time=2026-09-21T09:14:26.015Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 76.466802] niks3-server[1127]: 2026/09/21 09:14:26 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker1 # [ 76.456239] nix-grpc-daemon[853]: time=2026-09-21T09:14:26.051Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.484298] niks3-server[1127]: 2026/09/21 09:14:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign lb # [ 76.494102] niks3-server[1127]: 2026/09/21 09:14:26 INFO Signed narinfos id=17 count=1 lb # [ 76.498995] niks3-server[1127]: 2026/09/21 09:14:26 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 76.508412] niks3-server[1127]: 2026/09/21 09:14:26 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 76.513896] niks3-server[1127]: 2026/09/21 09:14:26 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo lb # [ 76.517882] niks3-server[1127]: 2026/09/21 09:14:26 INFO Completed upload id=17 worker1 # [ 76.492706] nix-grpc-daemon[853]: time=2026-09-21T09:14:26.088Z level=INFO msg="Upload complete. (332ms)" worker2 # [ 76.524282] nix-grpc-daemon[781]: ts=2026-09-21T09:14:26Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 76.531976] nix-grpc-daemon[781]: ts=2026-09-21T09:14:26Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 76.579238] nix-grpc-daemon[781]: ts=2026-09-21T09:14:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 76.595516] nix-grpc-daemon[781]: ts=2026-09-21T09:14:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34490 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 76.615799] nix-grpc-daemon[781]: ts=2026-09-21T09:14:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34490 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 76.632118] nix-daemon[870]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 76.856302] nix-daemon[870]: accepted connection from pid 1004, user nix-grpc-daemon (trusted) worker2 # [ 76.875862] nix-daemon[870]: reaped child process 1007, status = succeeded worker2 # [ 77.054669] nix-daemon[870]: accepted connection from pid 1009, user nix-grpc-daemon (trusted) worker2 # [ 77.071142] nix-daemon[870]: reaped child process 1012, status = succeeded lb # [ 77.104707] niks3-server[1127]: 2026/09/21 09:14:26 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 77.118959] niks3-server[1127]: 2026/09/21 09:14:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 77.113484] nix-grpc-daemon[918]: time=2026-09-21T09:14:26.695Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 77.114973] nix-grpc-daemon[918]: time=2026-09-21T09:14:26.695Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker2 # [ 77.116812] nix-grpc-daemon[918]: time=2026-09-21T09:14:26.695Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 77.160047] niks3-server[1127]: 2026/09/21 09:14:26 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 77.172201] niks3-server[1127]: 2026/09/21 09:14:26 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 77.186499] niks3-server[1127]: 2026/09/21 09:14:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign worker2 # [ 77.176127] nix-grpc-daemon[918]: time=2026-09-21T09:14:26.757Z level=INFO msg="Uploading 3 narinfos" lb # [ 77.196368] niks3-server[1127]: 2026/09/21 09:14:26 INFO Signed narinfos id=18 count=1 lb # [ 77.198329] niks3-server[1127]: 2026/09/21 09:14:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 77.207053] niks3-server[1127]: 2026/09/21 09:14:26 INFO Signed narinfos id=19 count=2 lb # [ 77.211045] niks3-server[1127]: 2026/09/21 09:14:26 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 77.214945] niks3-server[1127]: 2026/09/21 09:14:26 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 77.226182] niks3-server[1127]: 2026/09/21 09:14:26 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 77.234221] niks3-server[1127]: 2026/09/21 09:14:26 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 77.240514] niks3-server[1127]: 2026/09/21 09:14:26 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 77.245018] niks3-server[1127]: 2026/09/21 09:14:26 INFO Completed upload id=18 lb # [ 77.247048] niks3-server[1127]: 2026/09/21 09:14:26 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 77.250775] niks3-server[1127]: 2026/09/21 09:14:26 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 77.253772] niks3-server[1127]: 2026/09/21 09:14:26 INFO Completed upload id=19 worker2 # [ 77.235484] nix-grpc-daemon[918]: time=2026-09-21T09:14:26.818Z level=INFO msg="Upload complete. (580ms)" worker2 # [ 77.247208] nix-grpc-daemon[781]: ts=2026-09-21T09:14:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34490 duration_s=0 paths=2 nar_bytes_in=984 worker2 # [ 77.267477] nix-grpc-daemon[781]: ts=2026-09-21T09:14:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 77.277613] nix-daemon[870]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 77.287142] nix-daemon[870]: reaped child process 1002, status = succeeded worker2 # [ 77.298872] nix-grpc-daemon[781]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker2 # [ 77.319015] nix-daemon[870]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 78.369276] nix-daemon[870]: reaped child process 1017, status = succeeded worker2 # [ 78.540971] nix-daemon[870]: accepted connection from pid 1032, user nix-grpc-daemon (trusted) worker2 # [ 78.560737] nix-daemon[870]: reaped child process 1035, status = succeeded lb # [ 78.591734] niks3-server[1127]: 2026/09/21 09:14:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 78.583759] nix-grpc-daemon[918]: time=2026-09-21T09:14:28.165Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 78.621220] niks3-server[1127]: 2026/09/21 09:14:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker2 # [ 78.614759] nix-grpc-daemon[918]: time=2026-09-21T09:14:28.197Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.636446] niks3-server[1127]: 2026/09/21 09:14:28 INFO Signed narinfos id=20 count=1 lb # [ 78.648644] niks3-server[1127]: 2026/09/21 09:14:28 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 78.755326] niks3-server[1127]: 2026/09/21 09:14:28 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 78.762567] niks3-server[1127]: 2026/09/21 09:14:28 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 78.769746] niks3-server[1127]: 2026/09/21 09:14:28 INFO Completed upload id=20 worker2 # [ 78.750962] nix-grpc-daemon[918]: time=2026-09-21T09:14:28.333Z level=INFO msg="Upload complete. (413ms)" lb # [ 78.773708] niks3-server[1127]: 2026/09/21 09:14:28 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker2 # [ 78.763129] nix-grpc-daemon[781]: ts=2026-09-21T09:14:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34490 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker2 # [ 78.783314] nix-daemon[870]: reaped child process 1014, status = succeeded client # copying 1 paths... worker1 # [ 78.805228] nix-grpc-daemon[774]: ts=2026-09-21T09:14:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 78.823947] nix-grpc-daemon[774]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 78.876126] nix-grpc-daemon[774]: ts=2026-09-21T09:14:28Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 78.881591] nix-grpc-daemon[774]: ts=2026-09-21T09:14:28Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=0 paths=1 nar_bytes_out=120 client # [ 79.007051] nix-daemon[937]: reaped child process 1021, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.31 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 79.228913] nix-daemon[937]: accepted connection from pid 1040, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 79.445118] nix-grpc-daemon[774]: ts=2026-09-21T09:14:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:35350 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 79.457450] nix-grpc-daemon[781]: ts=2026-09-21T09:14:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 79.469680] nix-grpc-daemon[918]: time=2026-09-21T09:14:29.052Z level=INFO msg="All 1 paths already cached" worker2 # [ 79.487011] nix-grpc-daemon[781]: ts=2026-09-21T09:14:29Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker1 # [ 79.482753] nix-grpc-daemon[774]: ts=2026-09-21T09:14:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker2 # [ 79.493635] nix-grpc-daemon[781]: ts=2026-09-21T09:14:29Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 79.498533] nix-grpc-daemon[774]: ts=2026-09-21T09:14:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 79.519296] nix-grpc-daemon[774]: ts=2026-09-21T09:14:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 79.534390] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 79.556731] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 1/5) worker1 # [ 79.646057] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 161 ms (attempt 2/5) worker1 # [ 79.815774] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 3/5) worker1 # [ 80.020575] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 689 ms (attempt 4/5) worker1 # [ 80.717829] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 80.725805] nix-grpc-daemon[774]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... lb # [ 80.965401] envoy[913]: conn peer=[2001:db8:1::1]:47356 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=69 lb # [ 80.970351] envoy[913]: conn peer=[2001:db8:1::1]:48994 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3860 tx=1989 ms=1900 lb # [ 80.975397] envoy[913]: conn peer=[2001:db8:1::1]:47368 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4338 tx=2109 ms=2315 lb # [ 80.981337] envoy[913]: conn peer=[2001:db8:1::1]:47384 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=407 ms=95 lb # [ 80.986015] envoy[913]: conn peer=[2001:db8:1::1]:47390 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3861 tx=1877 ms=2781 worker1 # [ 80.965691] nix-daemon[843]: accepted connection from pid 1153, user nix-grpc-daemon (trusted) lb # [ 80.990883] envoy[913]: conn peer=[2001:db8:1::1]:47404 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=64 worker1 # [ 80.985155] nix-daemon[843]: reaped child process 1156, status = succeeded worker1 # [ 81.158782] nix-daemon[843]: accepted connection from pid 1158, user nix-grpc-daemon (trusted) worker1 # [ 81.179305] nix-daemon[843]: reaped child process 1161, status = succeeded lb # [ 81.218087] niks3-server[1127]: 2026/09/21 09:14:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 81.241196] nix-grpc-daemon[853]: time=2026-09-21T09:14:30.836Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 81.243481] nix-grpc-daemon[853]: time=2026-09-21T09:14:30.838Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 81.285892] niks3-server[1127]: 2026/09/21 09:14:30 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst lb # [ 81.299969] niks3-server[1127]: 2026/09/21 09:14:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker1 # [ 81.283725] nix-grpc-daemon[853]: time=2026-09-21T09:14:30.879Z level=INFO msg="Uploading 1 narinfos" lb # [ 81.309053] niks3-server[1127]: 2026/09/21 09:14:30 INFO Signed narinfos id=21 count=1 lb # [ 81.315871] niks3-server[1127]: 2026/09/21 09:14:30 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 81.330000] niks3-server[1127]: 2026/09/21 09:14:30 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 81.338080] niks3-server[1127]: 2026/09/21 09:14:30 INFO Completed upload id=21 worker1 # [ 81.312084] nix-grpc-daemon[853]: time=2026-09-21T09:14:30.907Z level=INFO msg="Upload complete. (556ms)" lb # [ 81.341711] niks3-server[1127]: 2026/09/21 09:14:30 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker1 # [ 81.324178] nix-grpc-daemon[774]: ts=2026-09-21T09:14:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=1 paths=1 nar_bytes_in=568 worker1 # [ 81.343529] nix-grpc-daemon[774]: ts=2026-09-21T09:14:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 81.353092] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 81.359178] nix-daemon[843]: reaped child process 1147, status = succeeded client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 81.373846] nix-daemon[843]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 82.404178] nix-daemon[843]: reaped child process 1165, status = succeeded worker1 # [ 82.573509] nix-daemon[843]: accepted connection from pid 1180, user nix-grpc-daemon (trusted) worker1 # [ 82.590730] nix-daemon[843]: reaped child process 1183, status = succeeded lb # [ 82.630670] niks3-server[1127]: 2026/09/21 09:14:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 82.612384] nix-grpc-daemon[853]: time=2026-09-21T09:14:32.206Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 82.658276] niks3-server[1127]: 2026/09/21 09:14:32 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 82.644914] nix-grpc-daemon[853]: time=2026-09-21T09:14:32.240Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.674097] niks3-server[1127]: 2026/09/21 09:14:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 82.683693] niks3-server[1127]: 2026/09/21 09:14:32 INFO Signed narinfos id=22 count=1 lb # [ 82.691574] niks3-server[1127]: 2026/09/21 09:14:32 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls worker1 # [ 82.670513] nix-grpc-daemon[853]: time=2026-09-21T09:14:32.266Z level=INFO msg="Upload complete. (282ms)" lb # [ 82.696485] niks3-server[1127]: 2026/09/21 09:14:32 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 82.702303] niks3-server[1127]: 2026/09/21 09:14:32 INFO Completed upload id=22 lb # [ 82.704746] niks3-server[1127]: 2026/09/21 09:14:32 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker1 # [ 82.679863] nix-grpc-daemon[774]: ts=2026-09-21T09:14:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker1 # [ 82.690866] nix-daemon[843]: reaped child process 1163, status = succeeded client # copying 1 paths... worker1 # [ 82.727054] nix-grpc-daemon[774]: ts=2026-09-21T09:14:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:35350 client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 82.770549] nix-grpc-daemon[781]: ts=2026-09-21T09:14:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 82.785246] nix-grpc-daemon[781]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... worker2 # [ 82.802320] nix-grpc-daemon[781]: ts=2026-09-21T09:14:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:34490 duration_s=0 paths=1 nar_bytes_out=120 client # [ 82.918566] nix-daemon[937]: reaped child process 1043, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.92 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 83.145299] nix-daemon[937]: accepted connection from pid 1062, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 83.369944] nix-grpc-daemon[781]: ts=2026-09-21T09:14:32Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:34490 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 83.367155] nix-grpc-daemon[774]: ts=2026-09-21T09:14:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 83.378513] nix-grpc-daemon[853]: time=2026-09-21T09:14:32.974Z level=INFO msg="All 1 paths already cached" worker2 # [ 83.403545] nix-grpc-daemon[781]: ts=2026-09-21T09:14:32Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 83.411651] nix-grpc-daemon[781]: ts=2026-09-21T09:14:32Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 83.421179] nix-grpc-daemon[781]: ts=2026-09-21T09:14:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 83.433041] nix-grpc-daemon[781]: ts=2026-09-21T09:14:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 83.444441] nix-grpc-daemon[918]: time=2026-09-21T09:14:33.026Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 83.454347] nix-grpc-daemon[781]: ts=2026-09-21T09:14:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 83.469355] nix-daemon[870]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 83.669778] nix-daemon[870]: accepted connection from pid 1044, user nix-grpc-daemon (trusted) worker2 # [ 83.688861] nix-daemon[870]: reaped child process 1047, status = succeeded worker2 # [ 83.862651] nix-daemon[870]: accepted connection from pid 1049, user nix-grpc-daemon (trusted) worker2 # [ 83.879642] nix-daemon[870]: reaped child process 1052, status = succeeded lb # [ 83.911420] niks3-server[1127]: 2026/09/21 09:14:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 83.902225] nix-grpc-daemon[918]: time=2026-09-21T09:14:33.484Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 83.903758] nix-grpc-daemon[918]: time=2026-09-21T09:14:33.484Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 83.938247] niks3-server[1127]: 2026/09/21 09:14:33 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 83.953911] niks3-server[1127]: 2026/09/21 09:14:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker2 # [ 83.941259] nix-grpc-daemon[918]: time=2026-09-21T09:14:33.523Z level=INFO msg="Uploading 1 narinfos" lb # [ 83.966306] niks3-server[1127]: 2026/09/21 09:14:33 INFO Signed narinfos id=23 count=1 lb # [ 83.972259] niks3-server[1127]: 2026/09/21 09:14:33 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 83.979064] niks3-server[1127]: 2026/09/21 09:14:33 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 83.985439] niks3-server[1127]: 2026/09/21 09:14:33 INFO Completed upload id=23 worker2 # [ 83.967065] nix-grpc-daemon[918]: time=2026-09-21T09:14:33.549Z level=INFO msg="Upload complete. (480ms)" lb # [ 83.987893] niks3-server[1127]: 2026/09/21 09:14:33 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker2 # [ 83.977697] nix-grpc-daemon[781]: ts=2026-09-21T09:14:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34490 duration_s=0 paths=1 nar_bytes_in=568 worker2 # [ 83.984994] nix-grpc-daemon[781]: ts=2026-09-21T09:14:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34490 worker2 # [ 83.995157] nix-daemon[870]: accepted connection from pid 781, user nix-grpc-daemon (trusted) worker2 # [ 83.999685] nix-daemon[870]: reaped child process 1042, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker2 # [ 84.011507] nix-daemon[870]: accepted connection from pid 781, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 85.048543] nix-daemon[870]: reaped child process 1056, status = succeeded worker2 # [ 85.219239] nix-daemon[870]: accepted connection from pid 1071, user nix-grpc-daemon (trusted) worker2 # [ 85.236984] nix-daemon[870]: reaped child process 1074, status = succeeded lb # [ 85.269410] niks3-server[1127]: 2026/09/21 09:14:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 85.261284] nix-grpc-daemon[918]: time=2026-09-21T09:14:34.842Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 85.297537] niks3-server[1127]: 2026/09/21 09:14:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker2 # [ 85.287811] nix-grpc-daemon[918]: time=2026-09-21T09:14:34.870Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.311447] niks3-server[1127]: 2026/09/21 09:14:34 INFO Signed narinfos id=24 count=1 lb # [ 85.319318] niks3-server[1127]: 2026/09/21 09:14:34 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 85.327135] niks3-server[1127]: 2026/09/21 09:14:34 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 85.337815] niks3-server[1127]: 2026/09/21 09:14:34 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 85.344312] niks3-server[1127]: 2026/09/21 09:14:34 INFO Completed upload id=24 worker2 # [ 85.329358] nix-grpc-daemon[918]: time=2026-09-21T09:14:34.911Z level=INFO msg="Upload complete. (305ms)" lb # [ 85.347971] niks3-server[1127]: 2026/09/21 09:14:34 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker2 # [ 85.341024] nix-grpc-daemon[781]: ts=2026-09-21T09:14:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34490 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker2 # [ 85.354998] nix-daemon[870]: reaped child process 1054, status = succeeded client # copying 1 paths... worker2 # [ 85.385474] nix-grpc-daemon[781]: ts=2026-09-21T09:14:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:34490 client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 85.409099] nix-grpc-daemon[774]: ts=2026-09-21T09:14:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 85.422245] nix-grpc-daemon[774]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... worker1 # [ 85.440685] nix-grpc-daemon[774]: ts=2026-09-21T09:14:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:35350 duration_s=0 paths=1 nar_bytes_out=120 client # [ 85.571911] nix-daemon[937]: reaped child process 1065, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.65 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 10.80 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.45 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.24 seconds) worker2 # [ 86.990901] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 87.524980] nix-grpc-daemon[781]: ts=2026-09-21T09:14:37Z level=info event=signal_exit worker2 # [ 87.975396] nix-grpc-daemon[781]: ts=2026-09-21T09:14:37Z level=info event=scheduler_yield lb # [ 87.998301] niks3-server[1127]: 2026/09/21 09:14:37 INFO lead: released remote=192.168.1.4:48576 worker2 # [ 87.981037] nix-grpc-daemon[781]: ts=2026-09-21T09:14:37Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 87.986639] nix-grpc-daemon[781]: ts=2026-09-21T09:14:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34474 worker1 # [ 87.982620] nix-grpc-daemon[774]: ts=2026-09-21T09:14:37Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 87.991356] nix-grpc-daemon[781]: ts=2026-09-21T09:14:37Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 87.997015] nix-grpc-daemon[781]: ts=2026-09-21T09:14:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34474 worker2 # [ 88.001480] nix-grpc-daemon[781]: ts=2026-09-21T09:14:37Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 88.182051] nix-grpc-daemon[781]: ts=2026-09-21T09:14:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.187110] nix-grpc-daemon[781]: ts=2026-09-21T09:14:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.182851] nix-grpc-daemon[774]: ts=2026-09-21T09:14:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.188086] nix-grpc-daemon[774]: ts=2026-09-21T09:14:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.388412] nix-grpc-daemon[781]: ts=2026-09-21T09:14:37Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.393366] nix-grpc-daemon[781]: ts=2026-09-21T09:14:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.388930] nix-grpc-daemon[774]: ts=2026-09-21T09:14:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.393900] nix-grpc-daemon[774]: ts=2026-09-21T09:14:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.596188] nix-grpc-daemon[781]: ts=2026-09-21T09:14:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.600231] nix-grpc-daemon[781]: ts=2026-09-21T09:14:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.594610] nix-grpc-daemon[774]: ts=2026-09-21T09:14:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.599906] nix-grpc-daemon[774]: ts=2026-09-21T09:14:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.796953] nix-grpc-daemon[781]: ts=2026-09-21T09:14:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 88.802287] nix-grpc-daemon[781]: ts=2026-09-21T09:14:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 88.800966] nix-grpc-daemon[774]: ts=2026-09-21T09:14:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 88.805971] nix-grpc-daemon[774]: ts=2026-09-21T09:14:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 88.981290] nix-grpc-daemon[781]: ts=2026-09-21T09:14:38Z level=info event=scheduler_restarting worker1 # [ 89.008508] nix-grpc-daemon[774]: ts=2026-09-21T09:14:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.012540] nix-grpc-daemon[774]: ts=2026-09-21T09:14:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.025839] nix-grpc-daemon[781]: ts=2026-09-21T09:14:38Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 89.042014] nix-daemon[870]: reaped child process 873, status = succeeded worker1 # [ 89.208989] nix-grpc-daemon[774]: ts=2026-09-21T09:14:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.214156] nix-grpc-daemon[774]: ts=2026-09-21T09:14:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.414879] nix-grpc-daemon[774]: ts=2026-09-21T09:14:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.420067] nix-grpc-daemon[774]: ts=2026-09-21T09:14:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.620950] nix-grpc-daemon[774]: ts=2026-09-21T09:14:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.625949] nix-grpc-daemon[774]: ts=2026-09-21T09:14:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.657805] nix-grpc-daemon[781]: E0000 00:00:1789982079.239181 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 89.669759] nix-grpc-daemon[781]: E0000 00:00:1789982079.252348 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 89.826734] nix-grpc-daemon[774]: ts=2026-09-21T09:14:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.831661] nix-grpc-daemon[774]: ts=2026-09-21T09:14:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.034305] nix-grpc-daemon[774]: ts=2026-09-21T09:14:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.038490] nix-grpc-daemon[774]: ts=2026-09-21T09:14:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.234872] nix-grpc-daemon[774]: ts=2026-09-21T09:14:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.239971] nix-grpc-daemon[774]: ts=2026-09-21T09:14:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.440845] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.445895] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.646550] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.651579] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.852532] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.857630] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.915018] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 90.918218] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 90.922745] systemd[1]: nix-grpc-daemon.service: Consumed 2.111s CPU time over 1min 9.765s wall clock time, 55.2M memory peak, 65.5K incoming IP traffic, 205.7K outgoing IP traffic. worker2 # [ 90.933780] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 90.935851] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 90.940612] systemd[1]: nix-grpc-daemon.socket: Consumed 544us CPU time over 1min 20.154s wall clock time, 256K memory peak, 78.4K incoming IP traffic, 67K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb # [ 90.963872] envoy[913]: conn peer=[2001:db8:1::1]:40524 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=96 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 91.060179] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.064106] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.260749] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.265760] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.285247] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:35350 worker1 # [ 91.293472] nix-grpc-daemon[774]: ts=2026-09-21T09:14:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:35350 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.30 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.03 seconds) worker2 # [ 91.438149] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 91.468681] nix-grpc-daemon[774]: ts=2026-09-21T09:14:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.473866] nix-grpc-daemon[774]: ts=2026-09-21T09:14:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.520749] systemd[1]: Stopping Nix worker-protocol over gRPC... lb # [ 90.968861] envoy[913]: conn peer=[2001:db8:1::1]:47408 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3713 tx=1804 ms=3409 lb # [ 90.969019] envoy[913]: conn peer=[2001:db8:1::1]:40534 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3713 tx=1805 ms=2137 lb # [ 90.969125] envoy[913]: conn peer=[2001:db8:1::1]:40542 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=97 lb # [ 90.969225] envoy[913]: conn peer=[2001:db8:1::4]:37328 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=82395 tx=3985 ms=67446 worker1 # [ 91.669609] nix-grpc-daemon[774]: ts=2026-09-21T09:14:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.674872] nix-grpc-daemon[774]: ts=2026-09-21T09:14:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.875630] nix-grpc-daemon[774]: ts=2026-09-21T09:14:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.881028] nix-grpc-daemon[774]: ts=2026-09-21T09:14:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.904163] systemd[1]: Starting scheduler-token.service... worker2 # [ 92.008810] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 92.015058] systemd[1]: Finished scheduler-token.service. worker2 # [ 92.019362] systemd[1]: scheduler-token.service: Consumed 49ms CPU time over 107ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 92.024169] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 92.083470] nix-grpc-daemon[774]: ts=2026-09-21T09:14:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.087723] nix-grpc-daemon[774]: ts=2026-09-21T09:14:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.210839] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:41Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 92.213357] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:41Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 92.217388] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:41Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 92.224055] nix-grpc-daemon[1098]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 92.225494] nix-grpc-daemon[1098]: E0000 00:00:1789982081.806624 1098 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 92.239791] nix-grpc-daemon[1098]: E0000 00:00:1789982081.812862 1098 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 92.243989] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:41Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 92.246504] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 92.262388] niks3-server[1127]: 2026/09/21 09:14:41 INFO lead: acquired remote=192.168.1.4:58126 worker2 # [ 92.247773] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:41Z level=info event=scheduler_take_over worker2 # [ 92.250901] nix-grpc-daemon[1098]: E0000 00:00:1789982081.833082 1140 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 92.280139] nix-grpc-daemon[1098]: E0000 00:00:1789982081.852715 1140 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 92.282445] nix-grpc-daemon[1098]: E0000 00:00:1789982081.852862 1140 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 92.290022] nix-grpc-daemon[1098]: E0000 00:00:1789982081.872035 1140 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 92.284541] nix-grpc-daemon[774]: ts=2026-09-21T09:14:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.300672] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:41Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:39880 worker2 # [ 92.304926] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 92.307002] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:41Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.311440] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:41Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 92.312993] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:41Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:39880 worker2 # [ 92.314631] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 92.353606] nix-grpc-daemon[774]: ts=2026-09-21T09:14:41Z level=info event=signal_exit worker2 # [ 93.455101] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39880 worker2 # [ 93.459776] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:43Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 93.469261] nix-grpc-daemon[774]: ts=2026-09-21T09:14:43Z level=info event=scheduler_restarting worker1 # [ 93.484649] nix-grpc-daemon[774]: ts=2026-09-21T09:14:43Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 93.501429] nix-daemon[843]: reaped child process 845, status = succeeded worker1 # [ 93.504296] nix-grpc-daemon[774]: E0000 00:00:1789982083.099546 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 93.515344] nix-grpc-daemon[774]: E0000 00:00:1789982083.110883 819 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 94.827194] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 94.830481] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 94.836518] systemd[1]: nix-grpc-daemon.service: Consumed 3.873s CPU time over 1min 13.873s wall clock time, 63M memory peak, 103.5K incoming IP traffic, 190K outgoing IP traffic. worker1 # [ 94.851617] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 94.857630] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 94.860315] systemd[1]: nix-grpc-daemon.socket: Consumed 696us CPU time over 1min 23.347s wall clock time, 256K memory peak, 86.3K incoming IP traffic, 69.7K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 95.241936] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39890 worker2 # [ 95.265843] nix-daemon[870]: accepted connection from pid 1098, user nix-grpc-daemon (trusted) worker2 # [ 95.296234] nix-grpc-daemon[1098]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5) worker2 # [ 95.352382] nix-grpc-daemon[1098]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 2/5) worker2 # [ 95.486193] nix-grpc-daemon[1098]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 261 ms (attempt 3/5) worker2 # [ 95.747692] nix-grpc-daemon[1098]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 635 ms (attempt 4/5) worker2 # [ 96.392909] nix-grpc-daemon[1098]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 96.431846] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39890 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 96.461066] nix-daemon[870]: accepted connection from pid 1098, user nix-grpc-daemon (trusted) worker2 # [ 96.498991] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:46Z level=info event=niks3_push_started pid=1157 worker2 # [ 96.785169] nix-grpc-daemon[1157]: time=2026-09-21T09:14:46.367Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 97.000190] nix-daemon[870]: accepted connection from pid 1170, user nix-grpc-daemon (trusted) worker2 # [ 97.021884] nix-daemon[870]: reaped child process 1173, status = succeeded lb # [ 97.055829] niks3-server[1127]: 2026/09/21 09:14:46 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 97.069867] niks3-server[1127]: 2026/09/21 09:14:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 97.068166] nix-grpc-daemon[1157]: time=2026-09-21T09:14:46.647Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 97.070099] nix-grpc-daemon[1157]: time=2026-09-21T09:14:46.647Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 97.073646] nix-grpc-daemon[1157]: time=2026-09-21T09:14:46.648Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 97.144155] niks3-server[1127]: 2026/09/21 09:14:46 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 97.168818] niks3-server[1127]: 2026/09/21 09:14:46 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 97.184482] niks3-server[1127]: 2026/09/21 09:14:46 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 97.192237] niks3-server[1127]: 2026/09/21 09:14:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign worker2 # [ 97.174775] nix-grpc-daemon[1157]: time=2026-09-21T09:14:46.755Z level=INFO msg="Uploading 3 narinfos" lb # [ 97.200660] niks3-server[1127]: 2026/09/21 09:14:46 INFO Signed narinfos id=26 count=2 lb # [ 97.203001] niks3-server[1127]: 2026/09/21 09:14:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 97.213008] niks3-server[1127]: 2026/09/21 09:14:46 INFO Signed narinfos id=25 count=1 lb # [ 97.215056] niks3-server[1127]: 2026/09/21 09:14:46 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 97.225225] niks3-server[1127]: 2026/09/21 09:14:46 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 97.233293] niks3-server[1127]: 2026/09/21 09:14:46 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 97.242105] niks3-server[1127]: 2026/09/21 09:14:46 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 97.247161] niks3-server[1127]: 2026/09/21 09:14:46 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 97.262163] niks3-server[1127]: 2026/09/21 09:14:46 INFO Completed upload id=25 lb # [ 97.265107] niks3-server[1127]: 2026/09/21 09:14:46 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 97.268001] niks3-server[1127]: 2026/09/21 09:14:46 INFO Completed upload id=26 worker2 # [ 97.249934] nix-grpc-daemon[1157]: time=2026-09-21T09:14:46.832Z level=INFO msg="Upload complete. (458ms)" worker2 # [ 97.260417] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39890 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 97.281356] nix-daemon[870]: reaped child process 1155, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 2.35 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds) worker1 # [ 97.433276] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 97.442252] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 97.641453] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 97.643703] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 97.648093] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 97.656073] nix-grpc-daemon[1207]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 97.657579] nix-grpc-daemon[1207]: E0000 00:00:1789982087.250347 1207 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 97.668679] nix-grpc-daemon[1207]: E0000 00:00:1789982087.256954 1207 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 97.673780] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 97.675998] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 97.678493] nix-grpc-daemon[1207]: E0000 00:00:1789982087.273422 1246 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 97.708221] nix-grpc-daemon[1207]: E0000 00:00:1789982087.291781 1246 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 97.710508] nix-grpc-daemon[1207]: E0000 00:00:1789982087.291976 1246 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 97.716755] nix-grpc-daemon[1207]: E0000 00:00:1789982087.311438 1246 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 97.740288] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 97.750493] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:47Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:39880 worker2 # [ 97.755533] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.19 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 13.29 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 99.148813] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 99.236686] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:48Z level=info event=signal_exit worker2 # [ 99.446733] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=scheduler_yield lb # [ 99.471142] niks3-server[1127]: 2026/09/21 09:14:49 INFO lead: released remote=192.168.1.4:58126 worker1 # [ 99.447310] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:49Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 99.454098] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39880 worker2 # [ 99.460693] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 99.466697] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 99.470896] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:39880 worker2 # [ 99.475476] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 99.646551] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.653547] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 99.662022] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 99.667178] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 99.854364] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 99.859818] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 99.868286] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 99.873542] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 100.060714] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.066077] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 100.074498] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 100.079576] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 100.266952] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.272413] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 100.282127] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 100.286299] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 100.451965] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:50Z level=info event=scheduler_restarting worker1 # [ 100.475184] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.479666] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 100.502699] nix-daemon[870]: reaped child process 1150, status = succeeded worker2 # [ 100.505734] nix-grpc-daemon[1098]: ts=2026-09-21T09:14:50Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 100.675862] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.681384] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 100.881974] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 100.887196] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 100.969385] envoy[913]: conn peer=[2001:db8:1::1]:55286 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=519 ms=28 lb # [ 100.974280] envoy[913]: conn peer=[2001:db8:1::3]:58994 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=18805 tx=4953 ms=72048 lb # [ 100.979418] envoy[913]: conn peer=[2001:db8:1::1]:55302 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1011 tx=304 ms=2041 lb # [ 100.987737] envoy[913]: conn peer=[2001:db8:1::4]:35538 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4158 tx=349 ms=8190 worker1 # [ 101.088147] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.093344] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 101.267956] nix-grpc-daemon[1098]: E0000 00:00:1789982090.850401 1143 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 101.268601] nix-grpc-daemon[1098]: E0000 00:00:1789982090.850674 1143 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 101.294058] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.298858] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 101.501593] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.505668] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 101.702115] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.707396] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 101.908126] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 101.913312] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 102.115797] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.121346] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 102.271305] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 102.277726] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 102.283383] systemd[1]: nix-grpc-daemon.service: Consumed 582ms CPU time over 10.250s wall clock time, 34.2M memory peak, 19.2K incoming IP traffic, 25.4K outgoing IP traffic. worker2 # [ 102.299165] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 102.301429] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 102.304472] systemd[1]: nix-grpc-daemon.socket: Consumed 841us CPU time over 10.867s wall clock time, 256K memory peak, 21.4K incoming IP traffic, 16K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 102.322110] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.330108] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 102.531746] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.535937] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 102.675098] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:52Z level=info event=scheduler_take_over lb # [ 102.701308] niks3-server[1127]: 2026/09/21 09:14:52 INFO lead: acquired remote=192.168.1.3:59142 worker1 # [ 102.732628] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.737874] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 102.938739] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.948194] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:52Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:60388 worker1 # [ 102.954286] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.19 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker1 # [ 103.818840] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 103.833124] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 103.857096] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 103.872756] nix-grpc-daemon[1207]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 1/5) worker1 # [ 103.944994] nix-grpc-daemon[1207]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 137 ms (attempt 2/5) worker1 # [ 104.089634] nix-grpc-daemon[1207]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 3/5) worker1 # [ 104.149143] nix-grpc-daemon[1207]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 773 ms (attempt 4/5) worker1 # [ 104.931566] nix-grpc-daemon[1207]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 104.965185] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:54Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 104.971722] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:54Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 105.013214] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 105.028358] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60396 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 105.042387] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 105.060210] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker1 # [ 105.088209] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:54Z level=info event=niks3_push_started pid=1283 worker1 # [ 105.310864] nix-grpc-daemon[1283]: time=2026-09-21T09:14:54.905Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 105.486980] nix-daemon[843]: accepted connection from pid 1296, user nix-grpc-daemon (trusted) worker1 # [ 105.505006] nix-daemon[843]: reaped child process 1299, status = succeeded worker1 # [ 105.684105] nix-daemon[843]: accepted connection from pid 1301, user nix-grpc-daemon (trusted) worker1 # [ 105.699910] nix-daemon[843]: reaped child process 1304, status = succeeded lb # [ 105.740643] niks3-server[1127]: 2026/09/21 09:14:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 105.728068] nix-grpc-daemon[1283]: time=2026-09-21T09:14:55.323Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 105.729582] nix-grpc-daemon[1283]: time=2026-09-21T09:14:55.323Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 105.787182] niks3-server[1127]: 2026/09/21 09:14:55 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst worker1 # [ 105.772622] nix-grpc-daemon[1283]: time=2026-09-21T09:14:55.367Z level=INFO msg="Uploading 1 narinfos" lb # [ 105.797498] niks3-server[1127]: 2026/09/21 09:14:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 105.810898] niks3-server[1127]: 2026/09/21 09:14:55 INFO Signed narinfos id=27 count=1 lb # [ 105.817886] niks3-server[1127]: 2026/09/21 09:14:55 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 105.833117] niks3-server[1127]: 2026/09/21 09:14:55 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 105.838036] niks3-server[1127]: 2026/09/21 09:14:55 INFO Completed upload id=27 worker1 # [ 105.812512] nix-grpc-daemon[1283]: time=2026-09-21T09:14:55.408Z level=INFO msg="Upload complete. (497ms)" lb # [ 105.841404] niks3-server[1127]: 2026/09/21 09:14:55 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker1 # [ 105.823942] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60396 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 105.838166] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 105.844638] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker1 # [ 105.851193] nix-daemon[843]: reaped child process 1281, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker1 # [ 105.864212] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-on-standby worker1 # [ 107.509022] nix-daemon[843]: reaped child process 1308, status = succeeded worker1 # [ 107.701759] nix-daemon[843]: accepted connection from pid 1323, user nix-grpc-daemon (trusted) worker1 # [ 107.719400] nix-daemon[843]: reaped child process 1326, status = succeeded lb # [ 107.757331] niks3-server[1127]: 2026/09/21 09:14:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 107.744347] nix-grpc-daemon[1283]: time=2026-09-21T09:14:57.336Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 107.746076] nix-grpc-daemon[1283]: time=2026-09-21T09:14:57.336Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 107.790579] niks3-server[1127]: 2026/09/21 09:14:57 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 107.802592] niks3-server[1127]: 2026/09/21 09:14:57 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 107.820167] niks3-server[1127]: 2026/09/21 09:14:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker1 # [ 107.802997] nix-grpc-daemon[1283]: time=2026-09-21T09:14:57.397Z level=INFO msg="Uploading 1 narinfos" lb # [ 107.831831] niks3-server[1127]: 2026/09/21 09:14:57 INFO Signed narinfos id=28 count=1 lb # [ 107.839033] niks3-server[1127]: 2026/09/21 09:14:57 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 107.846930] niks3-server[1127]: 2026/09/21 09:14:57 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 107.855440] niks3-server[1127]: 2026/09/21 09:14:57 INFO Completed upload id=28 worker1 # [ 107.829558] nix-grpc-daemon[1283]: time=2026-09-21T09:14:57.425Z level=INFO msg="Upload complete. (351ms)" lb # [ 107.858735] niks3-server[1127]: 2026/09/21 09:14:57 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker1 # [ 107.854030] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 duration_s=2 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 107.873589] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:57Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 107.878331] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:57Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 107.883217] nix-daemon[843]: reaped child process 1306, status = succeeded worker1 # [ 107.898983] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 107.913714] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 107.928770] nix-grpc-daemon[1283]: time=2026-09-21T09:14:57.524Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 107.937085] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60396 client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 107.952143] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker1 # [ 108.157596] nix-daemon[843]: accepted connection from pid 1332, user nix-grpc-daemon (trusted) worker1 # [ 108.177268] nix-daemon[843]: reaped child process 1335, status = succeeded worker1 # [ 108.351525] nix-daemon[843]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker1 # [ 108.371294] nix-daemon[843]: reaped child process 1340, status = succeeded lb # [ 108.407841] niks3-server[1127]: 2026/09/21 09:14:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 108.395979] nix-grpc-daemon[1283]: time=2026-09-21T09:14:57.991Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 108.397531] nix-grpc-daemon[1283]: time=2026-09-21T09:14:57.991Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 108.441619] niks3-server[1127]: 2026/09/21 09:14:58 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 108.455663] niks3-server[1127]: 2026/09/21 09:14:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign worker1 # [ 108.438125] nix-grpc-daemon[1283]: time=2026-09-21T09:14:58.033Z level=INFO msg="Uploading 1 narinfos" lb # [ 108.469320] niks3-server[1127]: 2026/09/21 09:14:58 INFO Signed narinfos id=29 count=1 lb # [ 108.475777] niks3-server[1127]: 2026/09/21 09:14:58 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 108.486159] niks3-server[1127]: 2026/09/21 09:14:58 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 108.491405] niks3-server[1127]: 2026/09/21 09:14:58 INFO Completed upload id=29 worker1 # [ 108.465667] nix-grpc-daemon[1283]: time=2026-09-21T09:14:58.061Z level=INFO msg="Upload complete. (498ms)" lb # [ 108.494633] niks3-server[1127]: 2026/09/21 09:14:58 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker1 # [ 108.472470] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60396 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 108.488288] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 108.494387] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker1 # [ 108.499406] nix-daemon[843]: reaped child process 1330, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker1 # [ 108.515481] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-on-standby worker1 # [ 109.351016] nix-daemon[843]: reaped child process 1344, status = succeeded worker1 # [ 109.524295] nix-daemon[843]: accepted connection from pid 1359, user nix-grpc-daemon (trusted) worker1 # [ 109.544562] nix-daemon[843]: reaped child process 1362, status = succeeded lb # [ 109.581605] niks3-server[1127]: 2026/09/21 09:14:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 109.566712] nix-grpc-daemon[1283]: time=2026-09-21T09:14:59.162Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 109.569847] nix-grpc-daemon[1283]: time=2026-09-21T09:14:59.164Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 109.621671] niks3-server[1127]: 2026/09/21 09:14:59 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 109.632930] niks3-server[1127]: 2026/09/21 09:14:59 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker1 # [ 109.619521] nix-grpc-daemon[1283]: time=2026-09-21T09:14:59.214Z level=INFO msg="Uploading 1 narinfos" lb # [ 109.644570] niks3-server[1127]: 2026/09/21 09:14:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 109.650482] niks3-server[1127]: 2026/09/21 09:14:59 INFO Signed narinfos id=30 count=1 lb # [ 109.655758] niks3-server[1127]: 2026/09/21 09:14:59 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 109.668185] niks3-server[1127]: 2026/09/21 09:14:59 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 109.673854] niks3-server[1127]: 2026/09/21 09:14:59 INFO Completed upload id=30 worker1 # [ 109.648773] nix-grpc-daemon[1283]: time=2026-09-21T09:14:59.244Z level=INFO msg="Upload complete. (323ms)" lb # [ 109.677604] niks3-server[1127]: 2026/09/21 09:14:59 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker1 # [ 109.668966] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 109.684650] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:59Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 109.689745] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:59Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 109.693700] nix-daemon[843]: reaped child process 1342, status = succeeded worker1 # [ 109.710954] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 109.727152] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60396 client # copying 1 paths to 'lb:50051'... worker1 # [ 109.741854] nix-grpc-daemon[1283]: time=2026-09-21T09:14:59.337Z level=INFO msg="All 2 paths already cached" client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 109.748359] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 109.761778] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker1 # [ 109.959604] nix-daemon[843]: accepted connection from pid 1368, user nix-grpc-daemon (trusted) worker1 # [ 109.977145] nix-daemon[843]: reaped child process 1371, status = succeeded worker1 # [ 110.154514] nix-daemon[843]: accepted connection from pid 1373, user nix-grpc-daemon (trusted) worker1 # [ 110.171359] nix-daemon[843]: reaped child process 1376, status = succeeded lb # [ 110.212100] niks3-server[1127]: 2026/09/21 09:14:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 110.196097] nix-grpc-daemon[1283]: time=2026-09-21T09:14:59.791Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 110.197582] nix-grpc-daemon[1283]: time=2026-09-21T09:14:59.791Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 110.243393] niks3-server[1127]: 2026/09/21 09:14:59 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker1 # [ 110.231296] nix-grpc-daemon[1283]: time=2026-09-21T09:14:59.826Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.260273] niks3-server[1127]: 2026/09/21 09:14:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 110.271127] niks3-server[1127]: 2026/09/21 09:14:59 INFO Signed narinfos id=31 count=1 lb # [ 110.278633] niks3-server[1127]: 2026/09/21 09:14:59 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 110.289167] niks3-server[1127]: 2026/09/21 09:14:59 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete worker1 # [ 110.269310] nix-grpc-daemon[1283]: time=2026-09-21T09:14:59.865Z level=INFO msg="Upload complete. (492ms)" lb # [ 110.294826] niks3-server[1127]: 2026/09/21 09:14:59 INFO Completed upload id=31 lb # [ 110.298070] niks3-server[1127]: 2026/09/21 09:14:59 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker1 # [ 110.276273] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60396 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 110.290272] nix-grpc-daemon[1207]: ts=2026-09-21T09:14:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 110.300177] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker1 # [ 110.303125] nix-daemon[843]: reaped child process 1366, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... worker1 # [ 110.316643] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv client # farm-top> LOG-farm-top-on-standby worker1 # [ 111.542506] nix-daemon[843]: reaped child process 1380, status = succeeded worker1 # [ 111.709107] nix-daemon[843]: accepted connection from pid 1395, user nix-grpc-daemon (trusted) worker1 # [ 111.729257] nix-daemon[843]: reaped child process 1398, status = succeeded lb # [ 111.769717] niks3-server[1127]: 2026/09/21 09:15:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 111.756435] nix-grpc-daemon[1283]: time=2026-09-21T09:15:01.351Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 111.757978] nix-grpc-daemon[1283]: time=2026-09-21T09:15:01.351Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 111.816173] niks3-server[1127]: 2026/09/21 09:15:01 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 111.825227] niks3-server[1127]: 2026/09/21 09:15:01 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 111.809175] nix-grpc-daemon[1283]: time=2026-09-21T09:15:01.404Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.837829] niks3-server[1127]: 2026/09/21 09:15:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 111.846058] niks3-server[1127]: 2026/09/21 09:15:01 INFO Signed narinfos id=32 count=1 lb # [ 111.847966] niks3-server[1127]: 2026/09/21 09:15:01 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls worker1 # [ 111.829947] nix-grpc-daemon[1283]: time=2026-09-21T09:15:01.425Z level=INFO msg="Upload complete. (300ms)" lb # [ 111.855949] niks3-server[1127]: 2026/09/21 09:15:01 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 111.860161] niks3-server[1127]: 2026/09/21 09:15:01 INFO Completed upload id=32 lb # [ 111.862254] niks3-server[1127]: 2026/09/21 09:15:01 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker1 # [ 111.841206] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 111.854618] nix-daemon[843]: reaped child process 1378, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.35 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds) worker2 # [ 112.220931] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 112.226929] systemd[1]: Starting scheduler-token.service... worker2 # [ 112.318113] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 112.324112] systemd[1]: Finished scheduler-token.service. worker2 # [ 112.327137] systemd[1]: scheduler-token.service: Consumed 37ms CPU time over 94ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 112.330888] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 112.505898] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:02Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 112.508490] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:02Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 112.512591] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:02Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 112.520065] nix-grpc-daemon[1197]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 112.521535] nix-grpc-daemon[1197]: E0000 00:00:1789982102.101626 1197 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 112.537056] nix-grpc-daemon[1197]: E0000 00:00:1789982102.108048 1197 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 112.542675] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:02Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 112.568282] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 112.569117] nix-grpc-daemon[1197]: E0000 00:00:1789982102.129173 1239 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 112.571407] nix-grpc-daemon[1197]: E0000 00:00:1789982102.145808 1239 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 112.584267] nix-grpc-daemon[1197]: E0000 00:00:1789982102.145953 1239 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 112.587051] nix-grpc-daemon[1197]: E0000 00:00:1789982102.166258 1239 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 112.600183] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.603807] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:02Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 112.608402] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:02Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:60388 worker1 # [ 112.613727] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:02Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.04 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 112.983487] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.10 seconds) client # Running as unit: rs.service; invocation ID: d11348792e2342d0a3821875fa9107e4 client # [ 113.252456] nix[1166]: don't know how to build these paths: client # [ 113.254331] nix[1166]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 113.254051] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 113.267187] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:02Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 113.274534] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:02Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 113.314700] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 113.330569] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60396 client # [ 113.340949] nix[1166]: copying 1 paths to 'lb:50051'... client # [ 113.345080] nix[1166]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 113.348114] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 113.363140] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker1 # [ 113.574614] nix-daemon[843]: accepted connection from pid 1411, user nix-grpc-daemon (trusted) worker1 # [ 113.594094] nix-daemon[843]: reaped child process 1414, status = succeeded worker1 # [ 113.769388] nix-daemon[843]: accepted connection from pid 1416, user nix-grpc-daemon (trusted) worker1 # [ 113.786552] nix-daemon[843]: reaped child process 1419, status = succeeded lb # [ 113.827145] niks3-server[1127]: 2026/09/21 09:15:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 113.811689] nix-grpc-daemon[1283]: time=2026-09-21T09:15:03.406Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 113.813424] nix-grpc-daemon[1283]: time=2026-09-21T09:15:03.406Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 113.853129] niks3-server[1127]: 2026/09/21 09:15:03 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 113.868764] niks3-server[1127]: 2026/09/21 09:15:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker1 # [ 113.848886] nix-grpc-daemon[1283]: time=2026-09-21T09:15:03.444Z level=INFO msg="Uploading 1 narinfos" lb # [ 113.880851] niks3-server[1127]: 2026/09/21 09:15:03 INFO Signed narinfos id=33 count=1 lb # [ 113.888163] niks3-server[1127]: 2026/09/21 09:15:03 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 113.898059] niks3-server[1127]: 2026/09/21 09:15:03 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 113.904341] niks3-server[1127]: 2026/09/21 09:15:03 INFO Completed upload id=33 worker1 # [ 113.877815] nix-grpc-daemon[1283]: time=2026-09-21T09:15:03.473Z level=INFO msg="Upload complete. (497ms)" lb # [ 113.908517] niks3-server[1127]: 2026/09/21 09:15:03 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker1 # [ 113.888510] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60396 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 113.902291] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 worker1 # [ 113.908932] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) worker1 # [ 113.914145] nix-daemon[843]: reaped child process 1409, status = succeeded client # [ 113.922306] nix[1166]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker1 # [ 113.928205] nix-daemon[843]: accepted connection from pid 1207, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 115.934239] systemd-journald[269]: Received client request to rotate journal, rotating. worker2 # [ 115.958218] systemd-journald[269]: Vacuuming done, freed 0B of archived journals from /var/log/journal/ad6ef90e50024f498dcd3264791bf1a9. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 116.002703] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds) client: must succeed: sleep 5.0 worker1 # [ 116.685219] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:06Z level=info event=draining lb # [ 120.970791] envoy[913]: conn peer=[2001:db8:1::1]:48698 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9623 tx=3861 ms=8044 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1 # [ 121.355999] nix-daemon[843]: reaped child process 1423, status = succeeded worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 121.515158] nix-daemon[843]: accepted connection from pid 1463, user nix-grpc-daemon (trusted) worker1 # [ 121.533593] nix-daemon[843]: reaped child process 1466, status = succeeded lb # [ 121.572812] niks3-server[1127]: 2026/09/21 09:15:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 121.559229] nix-grpc-daemon[1283]: time=2026-09-21T09:15:11.152Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 121.560841] nix-grpc-daemon[1283]: time=2026-09-21T09:15:11.152Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 121.617383] niks3-server[1127]: 2026/09/21 09:15:11 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 121.601218] nix-grpc-daemon[1283]: time=2026-09-21T09:15:11.196Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.625752] niks3-server[1127]: 2026/09/21 09:15:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 121.638648] niks3-server[1127]: 2026/09/21 09:15:11 INFO Signed narinfos id=34 count=1 lb # [ 121.645062] niks3-server[1127]: 2026/09/21 09:15:11 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 121.654682] niks3-server[1127]: 2026/09/21 09:15:11 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls worker1 # [ 121.633787] nix-grpc-daemon[1283]: time=2026-09-21T09:15:11.229Z level=INFO msg="Upload complete. (291ms)" lb # [ 121.659971] niks3-server[1127]: 2026/09/21 09:15:11 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 121.666515] niks3-server[1127]: 2026/09/21 09:15:11 INFO Completed upload id=34 lb # [ 121.669428] niks3-server[1127]: 2026/09/21 09:15:11 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 121.645266] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60396 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 121.658817] nix-daemon[843]: reaped child process 1421, status = succeeded worker1 # [ 121.685375] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=signal_exit client # [ 121.687219] systemd[1]: rs.service: Deactivated successfully. client # [ 121.691577] systemd[1]: rs.service: Consumed 178ms CPU time over 8.707s wall clock time, 41.2M memory peak, 6.8K incoming IP traffic, 8.1K outgoing IP traffic. worker1 # [ 121.896362] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=scheduler_yield worker1 # [ 121.902122] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 121.921605] niks3-server[1127]: 2026/09/21 09:15:11 INFO lead: released remote=192.168.1.3:59142 worker2 # [ 121.910764] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:11Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 121.908566] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60388 worker1 # [ 121.913092] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 121.917125] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60388 worker1 # [ 121.921535] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 122.103135] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 122.110745] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 122.108593] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 122.116222] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 122.309393] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 122.317209] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 122.314627] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 122.322438] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.12 seconds) client: waiting for success: ! systemctl is-active rs worker1 # [ 122.515475] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 122.523493] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 122.520964] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 122.528552] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 122.557176] niks3-server[1127]: 2026/09/21 09:15:12 INFO lead: acquired remote=192.168.1.4:42508 worker2 # [ 122.539774] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:12Z level=info event=scheduler_take_over client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 122.723512] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 122.730542] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 122.727790] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 122.734796] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker1 # [ 122.902084] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:12Z level=info event=scheduler_restarting worker2 # [ 122.933901] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 122.938129] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 122.946012] nix-grpc-daemon[1207]: ts=2026-09-21T09:15:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 122.962458] nix-daemon[843]: reaped child process 1274, status = succeeded worker2 # [ 123.135152] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.140438] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.341671] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.346713] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.547904] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.553015] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 123.753977] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 123.769997] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:13Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 123.774404] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:13Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:57158 worker2 # [ 123.779604] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 123.894452] nix-grpc-daemon[1207]: E0000 00:00:1789982113.488746 1252 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 123.900960] nix-grpc-daemon[1207]: E0000 00:00:1789982113.488977 1252 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker1 # [ 124.762402] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 124.765617] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 124.771670] systemd[1]: nix-grpc-daemon.service: Consumed 1.827s CPU time over 27.318s wall clock time, 36.8M memory peak, 48.4K incoming IP traffic, 89.8K outgoing IP traffic. worker1 # [ 124.789484] systemd[1]: Starting Nix worker-protocol over gRPC... lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 124.984544] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:14Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 124.987358] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 124.991561] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:14Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 125.000087] nix-grpc-daemon[1473]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 125.001571] nix-grpc-daemon[1473]: E0000 00:00:1789982114.593754 1473 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 125.007819] nix-grpc-daemon[1473]: E0000 00:00:1789982114.595811 1473 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 125.012286] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 125.014384] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 125.019368] nix-grpc-daemon[1473]: E0000 00:00:1789982114.613697 1512 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker1 # [ 125.048164] nix-grpc-daemon[1473]: E0000 00:00:1789982114.631174 1512 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 125.050431] nix-grpc-daemon[1473]: E0000 00:00:1789982114.631351 1512 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 125.056999] nix-grpc-daemon[1473]: E0000 00:00:1789982114.651089 1512 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 125.064891] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 125.075471] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:14Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57158 worker2 # [ 125.075753] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:14Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.22 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 125.207759] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 5a854f21515d4d17bfe706eb67e333a1 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds) worker2 # [ 125.479995] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:57166 worker2 # [ 125.494776] nix-daemon[870]: accepted connection from pid 1197, user nix-grpc-daemon (trusted) client # [ 125.503303] nix[1202]: don't know how to build these paths: client # [ 125.504611] nix[1202]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 125.524368] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:15Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 125.531068] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:15Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 125.578288] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57166 worker2 # [ 125.599088] nix-grpc-daemon[1197]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 82 ms (attempt 1/5) worker2 # [ 125.688767] nix-grpc-daemon[1197]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 151 ms (attempt 2/5) worker2 # [ 125.847479] nix-grpc-daemon[1197]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 188 ms (attempt 3/5) worker2 # [ 126.043175] nix-grpc-daemon[1197]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 329 ms (attempt 4/5) worker2 # [ 126.374192] nix-grpc-daemon[1197]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 126.395260] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57166 client # [ 126.400235] nix[1202]: copying 1 paths to 'lb:50051'... worker2 # [ 126.410753] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57166 client # [ 126.404158] nix[1202]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 126.427627] nix-daemon[870]: accepted connection from pid 1197, user nix-grpc-daemon (trusted) worker2 # [ 126.456970] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:16Z level=info event=niks3_push_started pid=1315 worker2 # [ 126.691404] nix-grpc-daemon[1315]: time=2026-09-21T09:15:16.273Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 126.866012] nix-daemon[870]: accepted connection from pid 1332, user nix-grpc-daemon (trusted) worker2 # [ 126.883136] nix-daemon[870]: reaped child process 1335, status = succeeded worker2 # [ 127.058853] nix-daemon[870]: accepted connection from pid 1337, user nix-grpc-daemon (trusted) worker2 # [ 127.074841] nix-daemon[870]: reaped child process 1340, status = succeeded lb # [ 127.105981] niks3-server[1127]: 2026/09/21 09:15:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 127.097607] nix-grpc-daemon[1315]: time=2026-09-21T09:15:16.679Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 127.099053] nix-grpc-daemon[1315]: time=2026-09-21T09:15:16.679Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 127.140311] niks3-server[1127]: 2026/09/21 09:15:16 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst lb # [ 127.156957] niks3-server[1127]: 2026/09/21 09:15:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign worker2 # [ 127.145992] nix-grpc-daemon[1315]: time=2026-09-21T09:15:16.728Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.172340] niks3-server[1127]: 2026/09/21 09:15:16 INFO Signed narinfos id=35 count=1 lb # [ 127.175592] niks3-server[1127]: 2026/09/21 09:15:16 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 127.187331] niks3-server[1127]: 2026/09/21 09:15:16 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 127.199696] niks3-server[1127]: 2026/09/21 09:15:16 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo lb # [ 127.223584] niks3-server[1127]: 2026/09/21 09:15:16 INFO Completed upload id=35 worker2 # [ 127.205462] nix-grpc-daemon[1315]: time=2026-09-21T09:15:16.788Z level=INFO msg="Upload complete. (510ms)" worker2 # [ 127.220294] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57166 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 127.232580] nix-grpc-daemon[1197]: ts=2026-09-21T09:15:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57166 worker2 # [ 127.243309] nix-daemon[870]: accepted connection from pid 1197, user nix-grpc-daemon (trusted) worker2 # [ 127.251037] nix-daemon[870]: reaped child process 1313, status = succeeded client # [ 127.254152] nix[1202]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 127.264411] nix-daemon[870]: accepted connection from pid 1197, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 129.244453] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1197 (nix-grpc-daemon) on client request. worker2 # [ 129.246023] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 129.281898] niks3-server[1127]: 2026/09/21 09:15:18 INFO lead: released remote=192.168.1.4:42508 worker2 # [ 129.274098] systemd[1]: Starting scheduler-token.service... client # [ 129.262946] nix[1202]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 129.265264] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:18Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 129.269330] nix[1202]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 129.287494] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 129.294046] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 129.295357] systemd[1]: nix-grpc-daemon.service: Consumed 580ms CPU time over 16.960s wall clock time, 34.5M memory peak, 17.2K incoming IP traffic, 33.6K outgoing IP traffic. worker2 # [ 129.313880] nix-daemon[870]: reaped child process 1306, status = succeeded worker2 # [ 129.315527] nix-daemon[870]: reaped child process 1342, status = succeeded worker2 # [ 129.324397] nix-daemon[1344]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 129.332764] nix-daemon[870]: reaped child process 1344, status = failed with exit code 1 worker2 # [ 129.376391] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 129.377339] systemd[1]: Finished scheduler-token.service. worker2 # [ 129.378067] systemd[1]: scheduler-token.service: Consumed 23ms CPU time over 99ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 129.379918] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 129.385360] systemd[1]: Starting scheduler-token.service... worker2 # [ 129.456001] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 129.459819] systemd[1]: Finished scheduler-token.service. worker2 # [ 129.461013] systemd[1]: scheduler-token.service: Consumed 22ms CPU time over 70ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 129.464311] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 129.465342] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.631114] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 129.633628] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 129.637649] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 129.644067] nix-grpc-daemon[1386]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 129.645505] nix-grpc-daemon[1386]: E0000 00:00:1789982119.226606 1386 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 129.662303] nix-grpc-daemon[1386]: E0000 00:00:1789982119.232804 1386 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 129.665696] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 129.684732] niks3-server[1127]: 2026/09/21 09:15:19 INFO lead: acquired remote=192.168.1.4:44764 worker2 # [ 129.668915] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 129.670055] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=info event=scheduler_take_over worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.49 seconds) client: must succeed: sleep 5.0 worker2 # [ 129.700179] nix-grpc-daemon[1386]: E0000 00:00:1789982119.254338 1428 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 129.702520] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57170 worker2 # [ 129.709945] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 129.712236] nix-grpc-daemon[1386]: E0000 00:00:1789982119.273143 1428 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 129.714623] nix-grpc-daemon[1386]: E0000 00:00:1789982119.273280 1428 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 129.719767] nix-grpc-daemon[1386]: E0000 00:00:1789982119.292067 1428 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 129.725113] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 129.730053] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 129.731367] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:57170 worker2 # [ 129.733312] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 129.786047] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 129.789495] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:19Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 129.842565] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45222 worker1 # [ 129.858378] nix-daemon[843]: accepted connection from pid 1473, user nix-grpc-daemon (trusted) worker1 # [ 129.884494] nix-grpc-daemon[1473]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5) worker1 # [ 129.967129] nix-grpc-daemon[1473]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 2/5) worker1 # [ 130.011191] nix-grpc-daemon[1473]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 257 ms (attempt 3/5) worker1 # [ 130.277715] nix-grpc-daemon[1473]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 367 ms (attempt 4/5) worker1 # [ 130.645708] nix-grpc-daemon[1473]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 130.670383] nix-grpc-daemon[1473]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'... worker1 # [ 130.699366] nix-daemon[843]: accepted connection from pid 1473, user nix-grpc-daemon (trusted) client # [ 130.715631] nix[1202]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker1 # [ 130.722315] nix-daemon[843]: accepted connection from pid 1473, user nix-grpc-daemon (trusted) lb # [ 130.975135] envoy[913]: conn peer=[2001:db8:1::1]:35730 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2936 tx=1332 ms=8409 lb # [ 130.980143] envoy[913]: conn peer=[2001:db8:1::3]:53266 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4160 tx=1315 ms=25205 lb # [ 130.985258] envoy[913]: conn peer=[2001:db8:1::4]:58204 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=8006 tx=595 ms=16682 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 135.149111] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:24Z level=info event=niks3_push_started pid=1577 worker1 # [ 135.193460] nix-daemon[843]: reaped child process 1553, status = succeeded worker1 # [ 135.385466] nix-grpc-daemon[1577]: time=2026-09-21T09:15:24.980Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 135.560198] nix-daemon[843]: accepted connection from pid 1590, user nix-grpc-daemon (trusted) worker1 # [ 135.578313] nix-daemon[843]: reaped child process 1593, status = succeeded lb # [ 135.617224] niks3-server[1127]: 2026/09/21 09:15:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 135.602911] nix-grpc-daemon[1577]: time=2026-09-21T09:15:25.196Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 135.605730] nix-grpc-daemon[1577]: time=2026-09-21T09:15:25.196Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 135.665437] niks3-server[1127]: 2026/09/21 09:15:25 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 135.678256] niks3-server[1127]: 2026/09/21 09:15:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign worker1 # [ 135.654456] nix-grpc-daemon[1577]: time=2026-09-21T09:15:25.248Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.688225] niks3-server[1127]: 2026/09/21 09:15:25 INFO Signed narinfos id=36 count=1 lb # [ 135.690791] niks3-server[1127]: 2026/09/21 09:15:25 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 135.680246] nix-grpc-daemon[1577]: time=2026-09-21T09:15:25.275Z level=INFO msg="Upload complete. (291ms)" lb # [ 135.706527] niks3-server[1127]: 2026/09/21 09:15:25 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 135.720361] niks3-server[1127]: 2026/09/21 09:15:25 INFO Completed upload id=36 worker1 # [ 135.688145] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45222 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 135.703547] nix-daemon[843]: reaped child process 1551, status = succeeded worker1 # [ 135.712100] nix-grpc-daemon[1577]: time=2026-09-21T09:15:25.307Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n" lb # [ 135.744438] niks3-server[1127]: 2026/09/21 09:15:25 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls client # [ 135.736740] systemd[1]: mid.service: Deactivated successfully. client # [ 135.740876] systemd[1]: mid.service: Consumed 184ms CPU time over 10.532s wall clock time, 39.2M memory peak, 8.1K incoming IP traffic, 9.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.11 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 136.283172] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: d64b9d980a774276a4efc99b9d9f7110 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.05 seconds) worker2 # [ 136.542702] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 136.557213] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) client # [ 136.565954] nix[1238]: don't know how to build these paths: client # [ 136.568413] nix[1238]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 136.588831] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:26Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker2 # [ 136.595487] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:26Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 136.642015] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 136.659871] nix-grpc-daemon[1386]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 1/5) worker2 # [ 136.747605] nix-grpc-daemon[1386]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 2/5) worker2 # [ 136.850315] nix-grpc-daemon[1386]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 188 ms (attempt 3/5) worker2 # [ 137.046053] nix-grpc-daemon[1386]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 119 ms (attempt 4/5) worker2 # [ 137.173537] nix-grpc-daemon[1386]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 137.194566] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 client # [ 137.200139] nix[1238]: copying 1 paths to 'lb:50051'... client # [ 137.204057] nix[1238]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker2 # [ 137.214205] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 137.229221] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 137.258099] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:26Z level=info event=niks3_push_started pid=1461 worker2 # [ 137.469485] nix-grpc-daemon[1461]: time=2026-09-21T09:15:27.051Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 137.654272] nix-daemon[870]: accepted connection from pid 1474, user nix-grpc-daemon (trusted) worker2 # [ 137.671782] nix-daemon[870]: reaped child process 1481, status = succeeded worker2 # [ 137.846776] nix-daemon[870]: accepted connection from pid 1483, user nix-grpc-daemon (trusted) worker2 # [ 137.865381] nix-daemon[870]: reaped child process 1486, status = succeeded lb # [ 137.898077] niks3-server[1127]: 2026/09/21 09:15:27 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 137.894592] nix-grpc-daemon[1461]: time=2026-09-21T09:15:27.476Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 137.896346] nix-grpc-daemon[1461]: time=2026-09-21T09:15:27.476Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 137.937883] niks3-server[1127]: 2026/09/21 09:15:27 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 137.949309] niks3-server[1127]: 2026/09/21 09:15:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign worker2 # [ 137.938771] nix-grpc-daemon[1461]: time=2026-09-21T09:15:27.521Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.962886] niks3-server[1127]: 2026/09/21 09:15:27 INFO Signed narinfos id=37 count=1 lb # [ 137.984084] niks3-server[1127]: 2026/09/21 09:15:27 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete worker2 # [ 137.977380] nix-grpc-daemon[1461]: time=2026-09-21T09:15:27.560Z level=INFO msg="Upload complete. (504ms)" lb # [ 137.995083] niks3-server[1127]: 2026/09/21 09:15:27 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 138.001793] niks3-server[1127]: 2026/09/21 09:15:27 INFO Completed upload id=37 lb # [ 138.005146] niks3-server[1127]: 2026/09/21 09:15:27 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker2 # [ 137.988614] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 138.000711] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 138.012174] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 138.016914] nix-daemon[870]: reaped child process 1459, status = succeeded client # [ 138.019385] nix[1238]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker2 # [ 138.031531] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr worker2 # [ 139.989596] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:29Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 139.977227] systemd[1]: intr.service: Sent signal SIGINT to main process 1238 (nix) on client request. client # [ 139.986476] nix[1238]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds) client # [ 139.996530] nix[1238]: error: interrupted by the user client # [ 140.037273] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 140.042092] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 140.044684] systemd[1]: intr.service: Consumed 158ms CPU time over 3.757s wall clock time, 41.2M memory peak, 6.1K incoming IP traffic, 8K outgoing IP traffic. worker2 # [ 140.057045] nix-daemon[870]: reaped child process 1488, status = succeeded worker2 # [ 140.059348] nix-daemon[1490]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 140.067813] nix-daemon[870]: reaped child process 1490, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.88 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 140.191554] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 7f9064b5e9924b88b5ac6865a541a247 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.08 seconds) worker1 # [ 140.440630] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:45222 client # [ 140.447515] nix[1258]: don't know how to build these paths: client # [ 140.448669] nix[1258]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 140.467361] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:30Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 140.473512] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:30Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 140.507004] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45222 worker1 # [ 140.523549] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:45222 client # [ 140.536264] nix[1258]: copying 1 paths to 'lb:50051'... worker1 # [ 140.538964] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45222 client # [ 140.538571] nix[1258]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 140.555695] nix-daemon[843]: accepted connection from pid 1473, user nix-grpc-daemon (trusted) worker1 # [ 140.768337] nix-daemon[843]: accepted connection from pid 1621, user nix-grpc-daemon (trusted) worker1 # [ 140.789236] nix-daemon[843]: reaped child process 1624, status = succeeded lb # [ 140.972003] envoy[913]: conn peer=[2001:db8:1::1]:38380 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3828 tx=1685 ms=10241 lb # [ 140.972448] envoy[913]: conn peer=[2001:db8:1::1]:49892 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=757 ms=3493 worker1 # [ 140.972672] nix-daemon[843]: accepted connection from pid 1626, user nix-grpc-daemon (trusted) worker1 # [ 140.989854] nix-daemon[843]: reaped child process 1629, status = succeeded lb # [ 141.028905] niks3-server[1127]: 2026/09/21 09:15:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 141.017122] nix-grpc-daemon[1577]: time=2026-09-21T09:15:30.612Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 141.018646] nix-grpc-daemon[1577]: time=2026-09-21T09:15:30.612Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 141.062319] niks3-server[1127]: 2026/09/21 09:15:30 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker1 # [ 141.051765] nix-grpc-daemon[1577]: time=2026-09-21T09:15:30.647Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.078795] niks3-server[1127]: 2026/09/21 09:15:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 141.090073] niks3-server[1127]: 2026/09/21 09:15:30 INFO Signed narinfos id=38 count=1 lb # [ 141.102998] niks3-server[1127]: 2026/09/21 09:15:30 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 141.106924] niks3-server[1127]: 2026/09/21 09:15:30 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 141.111773] niks3-server[1127]: 2026/09/21 09:15:30 INFO Completed upload id=38 worker1 # [ 141.085758] nix-grpc-daemon[1577]: time=2026-09-21T09:15:30.681Z level=INFO msg="Upload complete. (512ms)" lb # [ 141.114784] niks3-server[1127]: 2026/09/21 09:15:30 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker1 # [ 141.096366] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:45222 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 141.112349] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45222 worker1 # [ 141.118599] nix-daemon[843]: accepted connection from pid 1473, user nix-grpc-daemon (trusted) worker1 # [ 141.124507] nix-daemon[843]: reaped child process 1619, status = succeeded client # [ 141.133203] nix[1258]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker1 # [ 141.139610] nix-daemon[843]: accepted connection from pid 1473, user nix-grpc-daemon (trusted) worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 142.889362] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 142.935092] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.10 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 worker1 # [ 143.015016] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:32Z level=info event=draining client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 143.278076] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 143.285736] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 143.310760] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:32Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 143.318047] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:32Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 143.361833] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 143.377198] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 client # copying 1 paths to 'lb:50051'... worker2 # [ 143.393443] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker2 # [ 143.417150] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 143.628821] nix-daemon[870]: accepted connection from pid 1540, user nix-grpc-daemon (trusted) worker2 # [ 143.648555] nix-daemon[870]: reaped child process 1543, status = succeeded worker2 # [ 143.822523] nix-daemon[870]: accepted connection from pid 1545, user nix-grpc-daemon (trusted) worker2 # [ 143.839226] nix-daemon[870]: reaped child process 1548, status = succeeded lb # [ 143.870305] niks3-server[1127]: 2026/09/21 09:15:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 143.864336] nix-grpc-daemon[1461]: time=2026-09-21T09:15:33.446Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 143.865794] nix-grpc-daemon[1461]: time=2026-09-21T09:15:33.446Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 143.907835] niks3-server[1127]: 2026/09/21 09:15:33 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst lb # [ 143.925621] niks3-server[1127]: 2026/09/21 09:15:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign worker2 # [ 143.913105] nix-grpc-daemon[1461]: time=2026-09-21T09:15:33.495Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.936518] niks3-server[1127]: 2026/09/21 09:15:33 INFO Signed narinfos id=39 count=1 lb # [ 143.938732] niks3-server[1127]: 2026/09/21 09:15:33 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 143.948796] niks3-server[1127]: 2026/09/21 09:15:33 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 143.955755] niks3-server[1127]: 2026/09/21 09:15:33 INFO Completed upload id=39 worker2 # [ 143.937422] nix-grpc-daemon[1461]: time=2026-09-21T09:15:33.520Z level=INFO msg="Upload complete. (503ms)" lb # [ 143.958446] niks3-server[1127]: 2026/09/21 09:15:33 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker2 # [ 143.947540] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 143.960252] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 143.967278] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 143.972623] nix-daemon[870]: reaped child process 1538, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker2 # [ 143.986137] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-during-drain worker2 # [ 145.228801] nix-daemon[870]: reaped child process 1552, status = succeeded worker2 # [ 145.406221] nix-daemon[870]: accepted connection from pid 1567, user nix-grpc-daemon (trusted) worker2 # [ 145.423249] nix-daemon[870]: reaped child process 1570, status = succeeded lb # [ 145.454152] niks3-server[1127]: 2026/09/21 09:15:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 145.448496] nix-grpc-daemon[1461]: time=2026-09-21T09:15:35.030Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 145.450456] nix-grpc-daemon[1461]: time=2026-09-21T09:15:35.030Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 145.501196] niks3-server[1127]: 2026/09/21 09:15:35 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 145.514681] niks3-server[1127]: 2026/09/21 09:15:35 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 145.522825] niks3-server[1127]: 2026/09/21 09:15:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 145.528821] niks3-server[1127]: 2026/09/21 09:15:35 INFO Signed narinfos id=40 count=1 worker2 # [ 145.510665] nix-grpc-daemon[1461]: time=2026-09-21T09:15:35.092Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.534240] niks3-server[1127]: 2026/09/21 09:15:35 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 145.543560] niks3-server[1127]: 2026/09/21 09:15:35 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete worker2 # [ 145.530540] nix-grpc-daemon[1461]: time=2026-09-21T09:15:35.113Z level=INFO msg="Upload complete. (333ms)" lb # [ 145.550745] niks3-server[1127]: 2026/09/21 09:15:35 INFO Completed upload id=40 lb # [ 145.553590] niks3-server[1127]: 2026/09/21 09:15:35 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker2 # [ 145.545595] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker2 # [ 145.566060] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:35Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker2 # [ 145.570551] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:35Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 145.575166] nix-daemon[870]: reaped child process 1550, status = succeeded worker2 # [ 145.602155] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 145.617636] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 145.632744] nix-grpc-daemon[1461]: time=2026-09-21T09:15:35.215Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 145.642534] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker2 # [ 145.667063] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 145.876901] nix-daemon[870]: accepted connection from pid 1576, user nix-grpc-daemon (trusted) worker2 # [ 145.896535] nix-daemon[870]: reaped child process 1579, status = succeeded worker2 # [ 146.067940] nix-daemon[870]: accepted connection from pid 1581, user nix-grpc-daemon (trusted) worker2 # [ 146.086181] nix-daemon[870]: reaped child process 1584, status = succeeded lb # [ 146.115445] niks3-server[1127]: 2026/09/21 09:15:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 146.107009] nix-grpc-daemon[1461]: time=2026-09-21T09:15:35.689Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 146.108572] nix-grpc-daemon[1461]: time=2026-09-21T09:15:35.689Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 146.144632] niks3-server[1127]: 2026/09/21 09:15:35 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst worker2 # [ 146.139573] nix-grpc-daemon[1461]: time=2026-09-21T09:15:35.722Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.160253] niks3-server[1127]: 2026/09/21 09:15:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 146.171329] niks3-server[1127]: 2026/09/21 09:15:35 INFO Signed narinfos id=41 count=1 lb # [ 146.177337] niks3-server[1127]: 2026/09/21 09:15:35 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls worker2 # [ 146.167589] nix-grpc-daemon[1461]: time=2026-09-21T09:15:35.750Z level=INFO msg="Upload complete. (483ms)" lb # [ 146.186559] niks3-server[1127]: 2026/09/21 09:15:35 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 146.191450] niks3-server[1127]: 2026/09/21 09:15:35 INFO Completed upload id=41 worker2 # [ 146.176209] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 146.195467] niks3-server[1127]: 2026/09/21 09:15:35 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker2 # [ 146.185623] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 146.192443] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 146.196938] nix-daemon[870]: reaped child process 1574, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker2 # [ 146.209727] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-during-drain worker2 # [ 147.431838] nix-daemon[870]: reaped child process 1588, status = succeeded worker2 # [ 147.595870] nix-daemon[870]: accepted connection from pid 1603, user nix-grpc-daemon (trusted) worker2 # [ 147.615461] nix-daemon[870]: reaped child process 1606, status = succeeded lb # [ 147.646457] niks3-server[1127]: 2026/09/21 09:15:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 147.638838] nix-grpc-daemon[1461]: time=2026-09-21T09:15:37.220Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 147.640467] nix-grpc-daemon[1461]: time=2026-09-21T09:15:37.220Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 147.679983] niks3-server[1127]: 2026/09/21 09:15:37 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 147.695856] niks3-server[1127]: 2026/09/21 09:15:37 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 147.712616] niks3-server[1127]: 2026/09/21 09:15:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker2 # [ 147.701492] nix-grpc-daemon[1461]: time=2026-09-21T09:15:37.283Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.725901] niks3-server[1127]: 2026/09/21 09:15:37 INFO Signed narinfos id=42 count=1 lb # [ 147.731821] niks3-server[1127]: 2026/09/21 09:15:37 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 147.739572] niks3-server[1127]: 2026/09/21 09:15:37 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete worker2 # [ 147.727381] nix-grpc-daemon[1461]: time=2026-09-21T09:15:37.310Z level=INFO msg="Upload complete. (308ms)" lb # [ 147.747312] niks3-server[1127]: 2026/09/21 09:15:37 INFO Completed upload id=42 lb # [ 147.750249] niks3-server[1127]: 2026/09/21 09:15:37 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 147.745669] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker2 # [ 147.762857] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:37Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker2 # [ 147.767411] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:37Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 147.772276] nix-daemon[870]: reaped child process 1586, status = succeeded worker2 # [ 147.789805] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 147.804541] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 147.820572] nix-grpc-daemon[1461]: time=2026-09-21T09:15:37.403Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker2 # [ 147.830978] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 147.849094] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 148.053373] nix-daemon[870]: accepted connection from pid 1612, user nix-grpc-daemon (trusted) worker2 # [ 148.071438] nix-daemon[870]: reaped child process 1615, status = succeeded worker2 # [ 148.248675] nix-daemon[870]: accepted connection from pid 1617, user nix-grpc-daemon (trusted) worker2 # [ 148.264913] nix-daemon[870]: reaped child process 1620, status = succeeded lb # [ 148.296796] niks3-server[1127]: 2026/09/21 09:15:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 148.288094] nix-grpc-daemon[1461]: time=2026-09-21T09:15:37.870Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 148.289978] nix-grpc-daemon[1461]: time=2026-09-21T09:15:37.870Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 148.326310] niks3-server[1127]: 2026/09/21 09:15:37 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst worker2 # [ 148.320968] nix-grpc-daemon[1461]: time=2026-09-21T09:15:37.903Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.343434] niks3-server[1127]: 2026/09/21 09:15:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 148.354221] niks3-server[1127]: 2026/09/21 09:15:37 INFO Signed narinfos id=43 count=1 worker2 # [ 148.345917] nix-grpc-daemon[1461]: time=2026-09-21T09:15:37.928Z level=INFO msg="Upload complete. (480ms)" lb # [ 148.364623] niks3-server[1127]: 2026/09/21 09:15:37 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 148.369715] niks3-server[1127]: 2026/09/21 09:15:37 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete worker2 # [ 148.352240] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 148.374317] niks3-server[1127]: 2026/09/21 09:15:37 INFO Completed upload id=43 lb # [ 148.376491] niks3-server[1127]: 2026/09/21 09:15:37 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker2 # [ 148.364752] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 148.373552] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 148.376857] nix-daemon[870]: reaped child process 1610, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker2 # [ 148.388805] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> LOG-farm-top-during-drain worker2 # [ 150.228622] nix-daemon[870]: reaped child process 1624, status = succeeded worker2 # [ 150.412746] nix-daemon[870]: accepted connection from pid 1639, user nix-grpc-daemon (trusted) worker2 # [ 150.431448] nix-daemon[870]: reaped child process 1642, status = succeeded lb # [ 150.462507] niks3-server[1127]: 2026/09/21 09:15:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 150.455427] nix-grpc-daemon[1461]: time=2026-09-21T09:15:40.036Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 150.457065] nix-grpc-daemon[1461]: time=2026-09-21T09:15:40.036Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 150.499466] niks3-server[1127]: 2026/09/21 09:15:40 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 150.498180] nix-grpc-daemon[1461]: time=2026-09-21T09:15:40.080Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.516411] niks3-server[1127]: 2026/09/21 09:15:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 150.523969] niks3-server[1127]: 2026/09/21 09:15:40 INFO Signed narinfos id=44 count=1 lb # [ 150.530554] niks3-server[1127]: 2026/09/21 09:15:40 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 150.539528] niks3-server[1127]: 2026/09/21 09:15:40 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls lb # [ 150.548254] niks3-server[1127]: 2026/09/21 09:15:40 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 150.554257] niks3-server[1127]: 2026/09/21 09:15:40 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker2 # [ 150.535839] nix-grpc-daemon[1461]: time=2026-09-21T09:15:40.118Z level=INFO msg="Upload complete. (336ms)" lb # [ 150.558447] niks3-server[1127]: 2026/09/21 09:15:40 INFO Completed upload id=44 worker2 # [ 150.549129] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=2 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker2 # [ 150.566001] nix-daemon[870]: reaped child process 1622, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 7.59 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw lb # [ 150.973741] envoy[913]: conn peer=[2001:db8:1::1]:43120 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9668 tx=3887 ms=7287 worker1 # [ 150.980909] nix-daemon[843]: reaped child process 1633, status = succeeded worker1 # [ 151.142974] nix-daemon[843]: accepted connection from pid 1673, user nix-grpc-daemon (trusted) worker1 # [ 151.160332] nix-daemon[843]: reaped child process 1676, status = succeeded lb # [ 151.197293] niks3-server[1127]: 2026/09/21 09:15:40 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.182285] nix-grpc-daemon[1577]: time=2026-09-21T09:15:40.777Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.183818] nix-grpc-daemon[1577]: time=2026-09-21T09:15:40.777Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 151.228396] niks3-server[1127]: 2026/09/21 09:15:40 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 151.242578] niks3-server[1127]: 2026/09/21 09:15:40 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 151.253496] niks3-server[1127]: 2026/09/21 09:15:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign worker1 # [ 151.232819] nix-grpc-daemon[1577]: time=2026-09-21T09:15:40.827Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.262546] niks3-server[1127]: 2026/09/21 09:15:40 INFO Signed narinfos id=45 count=1 lb # [ 151.267760] niks3-server[1127]: 2026/09/21 09:15:40 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 151.274921] niks3-server[1127]: 2026/09/21 09:15:40 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 151.281668] niks3-server[1127]: 2026/09/21 09:15:40 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo lb # [ 151.286824] niks3-server[1127]: 2026/09/21 09:15:40 INFO Completed upload id=45 worker1 # [ 151.261479] nix-grpc-daemon[1577]: time=2026-09-21T09:15:40.857Z level=INFO msg="Upload complete. (303ms)" worker1 # [ 151.272986] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:45222 duration_s=10 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 151.285200] nix-daemon[843]: reaped child process 1631, status = succeeded client # [ 151.312255] systemd[1]: sw.service: Deactivated successfully. client # [ 151.317387] systemd[1]: sw.service: Consumed 170ms CPU time over 11.124s wall clock time, 41.2M memory peak, 6.7K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.11 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } worker1 # [ 152.017388] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:41Z level=info event=signal_exit client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 153.253052] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57170 worker2 # [ 153.257966] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:42Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 153.252816] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:42Z level=info event=scheduler_restarting worker1 # [ 153.271241] nix-grpc-daemon[1473]: ts=2026-09-21T09:15:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 153.296180] nix-daemon[843]: reaped child process 1545, status = succeeded worker1 # [ 153.828279] nix-grpc-daemon[1473]: E0000 00:00:1789982143.423609 1518 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 153.834764] nix-grpc-daemon[1473]: E0000 00:00:1789982143.423893 1518 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 155.065311] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 155.071296] systemd[1]: nix-grpc-daemon.service: Consumed 892ms CPU time over 30.274s wall clock time, 33.5M memory peak, 21K incoming IP traffic, 27.1K outgoing IP traffic. worker1 # [ 155.092493] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 155.286711] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:44Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 155.289367] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 155.293688] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 155.301492] nix-grpc-daemon[1690]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 155.303002] nix-grpc-daemon[1690]: E0000 00:00:1789982144.896437 1690 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 155.314120] nix-grpc-daemon[1690]: E0000 00:00:1789982144.902598 1690 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 155.318616] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:44Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.29 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 155.352038] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 155.353007] nix-grpc-daemon[1690]: E0000 00:00:1789982144.918896 1730 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 155.358703] nix-grpc-daemon[1690]: E0000 00:00:1789982144.934202 1730 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 155.361703] nix-grpc-daemon[1690]: E0000 00:00:1789982144.934377 1730 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 155.364203] nix-grpc-daemon[1690]: E0000 00:00:1789982144.953567 1730 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 155.376866] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.386732] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:44Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57170 worker2 # [ 155.392516] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:44Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.53 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 156.929354] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 worker1 # [ 156.933019] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 156.949076] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 156.974617] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 14 ms (attempt 1/5) worker1 # [ 156.996820] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 167 ms (attempt 2/5) worker1 # [ 157.171488] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 3/5) worker1 # [ 157.363417] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 233 ms (attempt 4/5) worker1 # [ 157.604832] nix-grpc-daemon[1690]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 157.663281] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:47Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker2 # [ 157.663630] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:47Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 157.663810] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:47Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker2 # [ 157.663942] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:47Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 157.702815] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 157.720437] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 157.735171] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 157.750980] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 157.779050] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:47Z level=info event=niks3_push_started pid=1749 worker1 # [ 158.004307] nix-grpc-daemon[1749]: time=2026-09-21T09:15:47.599Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 158.183372] nix-daemon[843]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 158.200697] nix-daemon[843]: reaped child process 1765, status = succeeded worker1 # [ 158.381284] nix-daemon[843]: accepted connection from pid 1767, user nix-grpc-daemon (trusted) worker1 # [ 158.398699] nix-daemon[843]: reaped child process 1770, status = succeeded lb # [ 158.437723] niks3-server[1127]: 2026/09/21 09:15:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.424987] nix-grpc-daemon[1749]: time=2026-09-21T09:15:48.019Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 158.426501] nix-grpc-daemon[1749]: time=2026-09-21T09:15:48.019Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 158.479015] niks3-server[1127]: 2026/09/21 09:15:48 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 158.473839] nix-grpc-daemon[1749]: time=2026-09-21T09:15:48.069Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.492307] niks3-server[1127]: 2026/09/21 09:15:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 158.505501] niks3-server[1127]: 2026/09/21 09:15:48 INFO Signed narinfos id=46 count=1 lb # [ 158.512226] niks3-server[1127]: 2026/09/21 09:15:48 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 158.524138] niks3-server[1127]: 2026/09/21 09:15:48 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete worker1 # [ 158.505746] nix-grpc-daemon[1749]: time=2026-09-21T09:15:48.101Z level=INFO msg="Upload complete. (497ms)" lb # [ 158.531792] niks3-server[1127]: 2026/09/21 09:15:48 INFO Completed upload id=46 lb # [ 158.534406] niks3-server[1127]: 2026/09/21 09:15:48 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 158.515067] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 158.529968] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 158.539730] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 158.542466] nix-daemon[843]: reaped child process 1747, status = succeeded worker1 # [ 158.556190] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 159.595745] nix-daemon[843]: reaped child process 1774, status = succeeded worker1 # [ 159.771721] nix-daemon[843]: accepted connection from pid 1789, user nix-grpc-daemon (trusted) worker1 # [ 159.791351] nix-daemon[843]: reaped child process 1792, status = succeeded lb # [ 159.829728] niks3-server[1127]: 2026/09/21 09:15:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.816418] nix-grpc-daemon[1749]: time=2026-09-21T09:15:49.409Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 159.817942] nix-grpc-daemon[1749]: time=2026-09-21T09:15:49.409Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 159.859724] niks3-server[1127]: 2026/09/21 09:15:49 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 159.878591] niks3-server[1127]: 2026/09/21 09:15:49 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst worker1 # [ 159.867495] nix-grpc-daemon[1749]: time=2026-09-21T09:15:49.462Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.895915] niks3-server[1127]: 2026/09/21 09:15:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 159.905410] niks3-server[1127]: 2026/09/21 09:15:49 INFO Signed narinfos id=47 count=1 lb # [ 159.909186] niks3-server[1127]: 2026/09/21 09:15:49 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls worker1 # [ 159.892182] nix-grpc-daemon[1749]: time=2026-09-21T09:15:49.487Z level=INFO msg="Upload complete. (325ms)" lb # [ 159.917845] niks3-server[1127]: 2026/09/21 09:15:49 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 159.921562] niks3-server[1127]: 2026/09/21 09:15:49 INFO Completed upload id=47 lb # [ 159.924802] niks3-server[1127]: 2026/09/21 09:15:49 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker2 # [ 159.908580] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:49Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.902807] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=1 worker2 # [ 159.921327] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:49Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 159.920337] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 159.928171] nix-daemon[843]: reaped child process 1772, status = succeeded worker1 # [ 159.931184] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 159.942933] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 159.953372] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 160.144440] nix-daemon[843]: accepted connection from pid 1796, user nix-grpc-daemon (trusted) worker1 # [ 160.164671] nix-daemon[843]: reaped child process 1799, status = succeeded worker1 # [ 160.340246] nix-daemon[843]: accepted connection from pid 1801, user nix-grpc-daemon (trusted) worker1 # [ 160.359411] nix-daemon[843]: reaped child process 1804, status = succeeded lb # [ 160.398582] niks3-server[1127]: 2026/09/21 09:15:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.381260] nix-grpc-daemon[1749]: time=2026-09-21T09:15:49.977Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 160.383482] nix-grpc-daemon[1749]: time=2026-09-21T09:15:49.978Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 160.426417] niks3-server[1127]: 2026/09/21 09:15:50 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 160.413456] nix-grpc-daemon[1749]: time=2026-09-21T09:15:50.008Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.442931] niks3-server[1127]: 2026/09/21 09:15:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 160.453675] niks3-server[1127]: 2026/09/21 09:15:50 INFO Signed narinfos id=48 count=1 lb # [ 160.463111] niks3-server[1127]: 2026/09/21 09:15:50 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 160.467072] niks3-server[1127]: 2026/09/21 09:15:50 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 160.473000] niks3-server[1127]: 2026/09/21 09:15:50 INFO Completed upload id=48 worker1 # [ 160.445625] nix-grpc-daemon[1749]: time=2026-09-21T09:15:50.041Z level=INFO msg="Upload complete. (480ms)" lb # [ 160.476449] niks3-server[1127]: 2026/09/21 09:15:50 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 160.452400] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 160.466500] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 160.472834] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 160.477761] nix-daemon[843]: reaped child process 1794, status = succeeded worker1 # [ 160.490612] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) lb # [ 160.973645] envoy[913]: conn peer=[2001:db8:1::1]:49908 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2935 tx=1333 ms=10843 lb # [ 160.978727] envoy[913]: conn peer=[2001:db8:1::3]:43914 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=448 ms=28194 worker1 # [ 162.122407] nix-daemon[843]: reaped child process 1808, status = succeeded worker1 # [ 162.288900] nix-daemon[843]: accepted connection from pid 1823, user nix-grpc-daemon (trusted) worker1 # [ 162.306994] nix-daemon[843]: reaped child process 1826, status = succeeded lb # [ 162.344939] niks3-server[1127]: 2026/09/21 09:15:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.332077] nix-grpc-daemon[1749]: time=2026-09-21T09:15:51.926Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 162.333638] nix-grpc-daemon[1749]: time=2026-09-21T09:15:51.926Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 162.377992] niks3-server[1127]: 2026/09/21 09:15:51 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 162.391111] niks3-server[1127]: 2026/09/21 09:15:51 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 162.407933] niks3-server[1127]: 2026/09/21 09:15:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 162.389215] nix-grpc-daemon[1749]: time=2026-09-21T09:15:51.984Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.419749] niks3-server[1127]: 2026/09/21 09:15:52 INFO Signed narinfos id=49 count=1 lb # [ 162.425996] niks3-server[1127]: 2026/09/21 09:15:52 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 162.432153] niks3-server[1127]: 2026/09/21 09:15:52 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 162.441422] niks3-server[1127]: 2026/09/21 09:15:52 INFO Completed upload id=49 worker1 # [ 162.415797] nix-grpc-daemon[1749]: time=2026-09-21T09:15:52.011Z level=INFO msg="Upload complete. (314ms)" lb # [ 162.444139] niks3-server[1127]: 2026/09/21 09:15:52 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker2 # [ 162.433055] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:52Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 162.428467] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=1 worker2 # [ 162.445777] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:52Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 162.447667] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 162.454110] nix-daemon[843]: reaped child process 1806, status = succeeded worker1 # [ 162.462484] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 162.476134] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 162.488708] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 162.686871] nix-daemon[843]: accepted connection from pid 1830, user nix-grpc-daemon (trusted) worker1 # [ 162.705906] nix-daemon[843]: reaped child process 1833, status = succeeded worker1 # [ 162.881837] nix-daemon[843]: accepted connection from pid 1835, user nix-grpc-daemon (trusted) worker1 # [ 162.899672] nix-daemon[843]: reaped child process 1838, status = succeeded lb # [ 162.940908] niks3-server[1127]: 2026/09/21 09:15:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.924141] nix-grpc-daemon[1749]: time=2026-09-21T09:15:52.519Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 162.925717] nix-grpc-daemon[1749]: time=2026-09-21T09:15:52.519Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 162.973012] niks3-server[1127]: 2026/09/21 09:15:52 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 162.984107] niks3-server[1127]: 2026/09/21 09:15:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker1 # [ 162.964792] nix-grpc-daemon[1749]: time=2026-09-21T09:15:52.560Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.994168] niks3-server[1127]: 2026/09/21 09:15:52 INFO Signed narinfos id=50 count=1 lb # [ 163.000915] niks3-server[1127]: 2026/09/21 09:15:52 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 163.009302] niks3-server[1127]: 2026/09/21 09:15:52 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 163.014292] niks3-server[1127]: 2026/09/21 09:15:52 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo lb # [ 163.018371] niks3-server[1127]: 2026/09/21 09:15:52 INFO Completed upload id=50 worker1 # [ 162.993056] nix-grpc-daemon[1749]: time=2026-09-21T09:15:52.588Z level=INFO msg="Upload complete. (490ms)" worker1 # [ 163.000916] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 163.014324] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 163.020731] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 163.025561] nix-daemon[843]: reaped child process 1828, status = succeeded worker1 # [ 163.038692] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 164.087854] nix-daemon[843]: reaped child process 1842, status = succeeded worker1 # [ 164.278377] nix-daemon[843]: accepted connection from pid 1857, user nix-grpc-daemon (trusted) worker1 # [ 164.296662] nix-daemon[843]: reaped child process 1860, status = succeeded lb # [ 164.334173] niks3-server[1127]: 2026/09/21 09:15:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.320390] nix-grpc-daemon[1749]: time=2026-09-21T09:15:53.915Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 164.321903] nix-grpc-daemon[1749]: time=2026-09-21T09:15:53.915Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 164.373292] niks3-server[1127]: 2026/09/21 09:15:53 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 164.384315] niks3-server[1127]: 2026/09/21 09:15:53 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst worker1 # [ 164.372428] nix-grpc-daemon[1749]: time=2026-09-21T09:15:53.967Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.393549] niks3-server[1127]: 2026/09/21 09:15:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 164.401996] niks3-server[1127]: 2026/09/21 09:15:54 INFO Signed narinfos id=51 count=1 lb # [ 164.406386] niks3-server[1127]: 2026/09/21 09:15:54 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 164.412249] niks3-server[1127]: 2026/09/21 09:15:54 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 164.418607] niks3-server[1127]: 2026/09/21 09:15:54 INFO Completed upload id=51 worker1 # [ 164.393142] nix-grpc-daemon[1749]: time=2026-09-21T09:15:53.988Z level=INFO msg="Upload complete. (344ms)" lb # [ 164.420475] niks3-server[1127]: 2026/09/21 09:15:54 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker2 # [ 164.412177] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:53Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 164.405178] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=1 worker2 # [ 164.419988] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:54Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 164.423399] nix-daemon[843]: reaped child process 1840, status = succeeded worker1 # [ 164.451906] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 164.467255] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 164.482746] nix-grpc-daemon[1749]: time=2026-09-21T09:15:54.077Z level=INFO msg="All 1 paths already cached" worker1 # [ 164.488274] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 164.501944] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 164.708971] nix-daemon[843]: accepted connection from pid 1864, user nix-grpc-daemon (trusted) worker1 # [ 164.728666] nix-daemon[843]: reaped child process 1867, status = succeeded worker1 # [ 164.907011] nix-daemon[843]: accepted connection from pid 1869, user nix-grpc-daemon (trusted) worker1 # [ 164.925651] nix-daemon[843]: reaped child process 1872, status = succeeded lb # [ 164.964736] niks3-server[1127]: 2026/09/21 09:15:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.949347] nix-grpc-daemon[1749]: time=2026-09-21T09:15:54.544Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 164.950894] nix-grpc-daemon[1749]: time=2026-09-21T09:15:54.544Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 164.996893] niks3-server[1127]: 2026/09/21 09:15:54 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 164.986176] nix-grpc-daemon[1749]: time=2026-09-21T09:15:54.581Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.012542] niks3-server[1127]: 2026/09/21 09:15:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 165.022781] niks3-server[1127]: 2026/09/21 09:15:54 INFO Signed narinfos id=52 count=1 lb # [ 165.028442] niks3-server[1127]: 2026/09/21 09:15:54 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 165.036631] niks3-server[1127]: 2026/09/21 09:15:54 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 165.043034] niks3-server[1127]: 2026/09/21 09:15:54 INFO Completed upload id=52 worker1 # [ 165.017740] nix-grpc-daemon[1749]: time=2026-09-21T09:15:54.613Z level=INFO msg="Upload complete. (498ms)" lb # [ 165.045829] niks3-server[1127]: 2026/09/21 09:15:54 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 165.028385] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 165.039259] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 165.046255] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 165.051155] nix-daemon[843]: reaped child process 1862, status = succeeded worker1 # [ 165.063071] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 166.713687] nix-daemon[843]: reaped child process 1876, status = succeeded worker1 # [ 166.891892] nix-daemon[843]: accepted connection from pid 1891, user nix-grpc-daemon (trusted) worker1 # [ 166.909461] nix-daemon[843]: reaped child process 1894, status = succeeded lb # [ 166.949199] niks3-server[1127]: 2026/09/21 09:15:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 166.936225] nix-grpc-daemon[1749]: time=2026-09-21T09:15:56.529Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 166.937784] nix-grpc-daemon[1749]: time=2026-09-21T09:15:56.529Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 166.984340] niks3-server[1127]: 2026/09/21 09:15:56 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst worker1 # [ 166.975622] nix-grpc-daemon[1749]: time=2026-09-21T09:15:56.570Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.000472] niks3-server[1127]: 2026/09/21 09:15:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 167.013592] niks3-server[1127]: 2026/09/21 09:15:56 INFO Signed narinfos id=53 count=1 lb # [ 167.022051] niks3-server[1127]: 2026/09/21 09:15:56 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 167.028808] niks3-server[1127]: 2026/09/21 09:15:56 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 167.037476] niks3-server[1127]: 2026/09/21 09:15:56 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 167.042658] niks3-server[1127]: 2026/09/21 09:15:56 INFO Completed upload id=53 worker1 # [ 167.017182] nix-grpc-daemon[1749]: time=2026-09-21T09:15:56.612Z level=INFO msg="Upload complete. (340ms)" lb # [ 167.045509] niks3-server[1127]: 2026/09/21 09:15:56 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker2 # [ 167.033866] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:56Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 167.029112] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=1 worker2 # [ 167.046987] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:56Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 167.046801] nix-daemon[843]: reaped child process 1874, status = succeeded worker1 # [ 167.086062] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 167.107196] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 167.122608] nix-grpc-daemon[1749]: time=2026-09-21T09:15:56.718Z level=INFO msg="All 1 paths already cached" worker1 # [ 167.131460] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 167.148121] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 167.355423] nix-daemon[843]: accepted connection from pid 1898, user nix-grpc-daemon (trusted) worker1 # [ 167.373896] nix-daemon[843]: reaped child process 1901, status = succeeded worker1 # [ 167.551516] nix-daemon[843]: accepted connection from pid 1903, user nix-grpc-daemon (trusted) worker1 # [ 167.567737] nix-daemon[843]: reaped child process 1906, status = succeeded lb # [ 167.607646] niks3-server[1127]: 2026/09/21 09:15:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.592172] nix-grpc-daemon[1749]: time=2026-09-21T09:15:57.187Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 167.595026] nix-grpc-daemon[1749]: time=2026-09-21T09:15:57.187Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 167.639032] niks3-server[1127]: 2026/09/21 09:15:57 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 167.652426] niks3-server[1127]: 2026/09/21 09:15:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker1 # [ 167.633384] nix-grpc-daemon[1749]: time=2026-09-21T09:15:57.228Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.663034] niks3-server[1127]: 2026/09/21 09:15:57 INFO Signed narinfos id=54 count=1 lb # [ 167.669307] niks3-server[1127]: 2026/09/21 09:15:57 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 167.675958] niks3-server[1127]: 2026/09/21 09:15:57 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete worker1 # [ 167.656868] nix-grpc-daemon[1749]: time=2026-09-21T09:15:57.252Z level=INFO msg="Upload complete. (492ms)" lb # [ 167.682942] niks3-server[1127]: 2026/09/21 09:15:57 INFO Completed upload id=54 lb # [ 167.685569] niks3-server[1127]: 2026/09/21 09:15:57 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 167.664136] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 167.677063] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 167.684641] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 167.689150] nix-daemon[843]: reaped child process 1896, status = succeeded worker1 # [ 167.702109] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 168.326263] nix-daemon[843]: reaped child process 1910, status = succeeded worker1 # [ 168.484059] nix-daemon[843]: accepted connection from pid 1925, user nix-grpc-daemon (trusted) worker1 # [ 168.499782] nix-daemon[843]: reaped child process 1928, status = succeeded lb # [ 168.540879] niks3-server[1127]: 2026/09/21 09:15:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 168.527839] nix-grpc-daemon[1749]: time=2026-09-21T09:15:58.120Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 168.529540] nix-grpc-daemon[1749]: time=2026-09-21T09:15:58.120Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 168.576945] niks3-server[1127]: 2026/09/21 09:15:58 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst worker1 # [ 168.565137] nix-grpc-daemon[1749]: time=2026-09-21T09:15:58.160Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.590372] niks3-server[1127]: 2026/09/21 09:15:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign lb # [ 168.599145] niks3-server[1127]: 2026/09/21 09:15:58 INFO Signed narinfos id=55 count=1 lb # [ 168.606535] niks3-server[1127]: 2026/09/21 09:15:58 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 168.616205] niks3-server[1127]: 2026/09/21 09:15:58 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls worker1 # [ 168.598294] nix-grpc-daemon[1749]: time=2026-09-21T09:15:58.193Z level=INFO msg="Upload complete. (287ms)" lb # [ 168.625212] niks3-server[1127]: 2026/09/21 09:15:58 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 168.631371] niks3-server[1127]: 2026/09/21 09:15:58 INFO Completed upload id=55 worker2 # [ 168.614327] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:58Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 168.634882] niks3-server[1127]: 2026/09/21 09:15:58 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 168.608974] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=0 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=1 worker2 # [ 168.627038] nix-grpc-daemon[1386]: ts=2026-09-21T09:15:58Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 168.623652] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 168.629332] nix-daemon[843]: reaped child process 1908, status = succeeded worker1 # [ 168.636232] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 168.648972] nix-grpc-daemon[1749]: time=2026-09-21T09:15:58.244Z level=INFO msg="All 1 paths already cached" worker1 # [ 168.656399] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 168.666274] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 168.850225] nix-daemon[843]: accepted connection from pid 1932, user nix-grpc-daemon (trusted) worker1 # [ 168.869570] nix-daemon[843]: reaped child process 1935, status = succeeded worker1 # [ 169.043188] nix-daemon[843]: accepted connection from pid 1937, user nix-grpc-daemon (trusted) worker1 # [ 169.059861] nix-daemon[843]: reaped child process 1940, status = succeeded lb # [ 169.096484] niks3-server[1127]: 2026/09/21 09:15:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 169.081933] nix-grpc-daemon[1749]: time=2026-09-21T09:15:58.677Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 169.083401] nix-grpc-daemon[1749]: time=2026-09-21T09:15:58.677Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 169.130071] niks3-server[1127]: 2026/09/21 09:15:58 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 169.139852] niks3-server[1127]: 2026/09/21 09:15:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker1 # [ 169.120925] nix-grpc-daemon[1749]: time=2026-09-21T09:15:58.716Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.151765] niks3-server[1127]: 2026/09/21 09:15:58 INFO Signed narinfos id=56 count=1 lb # [ 169.157600] niks3-server[1127]: 2026/09/21 09:15:58 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls worker1 # [ 169.140951] nix-grpc-daemon[1749]: time=2026-09-21T09:15:58.736Z level=INFO msg="Upload complete. (462ms)" lb # [ 169.166716] niks3-server[1127]: 2026/09/21 09:15:58 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 169.171740] niks3-server[1127]: 2026/09/21 09:15:58 INFO Completed upload id=56 worker1 # [ 169.148252] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 169.174669] niks3-server[1127]: 2026/09/21 09:15:58 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 169.159616] nix-grpc-daemon[1690]: ts=2026-09-21T09:15:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 169.168296] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 169.171125] nix-daemon[843]: reaped child process 1930, status = succeeded worker1 # [ 169.181221] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 170.202465] nix-daemon[843]: reaped child process 1944, status = succeeded worker1 # [ 170.359092] nix-daemon[843]: accepted connection from pid 1959, user nix-grpc-daemon (trusted) worker1 # [ 170.377232] nix-daemon[843]: reaped child process 1962, status = succeeded lb # [ 170.417876] niks3-server[1127]: 2026/09/21 09:16:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 170.401488] nix-grpc-daemon[1749]: time=2026-09-21T09:15:59.996Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 170.402989] nix-grpc-daemon[1749]: time=2026-09-21T09:15:59.996Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 170.450724] niks3-server[1127]: 2026/09/21 09:16:00 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 170.461961] niks3-server[1127]: 2026/09/21 09:16:00 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 170.477238] niks3-server[1127]: 2026/09/21 09:16:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 170.482951] niks3-server[1127]: 2026/09/21 09:16:00 INFO Signed narinfos id=57 count=1 worker1 # [ 170.457806] nix-grpc-daemon[1749]: time=2026-09-21T09:16:00.053Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.487869] niks3-server[1127]: 2026/09/21 09:16:00 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 170.499449] niks3-server[1127]: 2026/09/21 09:16:00 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 170.508115] niks3-server[1127]: 2026/09/21 09:16:00 INFO Completed upload id=57 worker1 # [ 170.482750] nix-grpc-daemon[1749]: time=2026-09-21T09:16:00.078Z level=INFO msg="Upload complete. (290ms)" lb # [ 170.511141] niks3-server[1127]: 2026/09/21 09:16:00 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker2 # [ 170.499691] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:00Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 170.493075] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=1 worker2 # [ 170.512334] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:00Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 170.510748] nix-daemon[843]: reaped child process 1942, status = succeeded worker1 # [ 170.546980] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 170.559195] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 170.573407] nix-grpc-daemon[1749]: time=2026-09-21T09:16:00.169Z level=INFO msg="All 2 paths already cached" worker1 # [ 170.582922] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 170.597472] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 170.801016] nix-daemon[843]: accepted connection from pid 1966, user nix-grpc-daemon (trusted) worker1 # [ 170.818377] nix-daemon[843]: reaped child process 1969, status = succeeded worker1 # [ 170.996845] nix-daemon[843]: accepted connection from pid 1971, user nix-grpc-daemon (trusted) worker1 # [ 171.014385] nix-daemon[843]: reaped child process 1974, status = succeeded lb # [ 171.051080] niks3-server[1127]: 2026/09/21 09:16:00 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 171.034602] nix-grpc-daemon[1749]: time=2026-09-21T09:16:00.630Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 171.036254] nix-grpc-daemon[1749]: time=2026-09-21T09:16:00.630Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 171.076610] niks3-server[1127]: 2026/09/21 09:16:00 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 171.091160] niks3-server[1127]: 2026/09/21 09:16:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign worker1 # [ 171.072399] nix-grpc-daemon[1749]: time=2026-09-21T09:16:00.667Z level=INFO msg="Uploading 1 narinfos" lb # [ 171.103770] niks3-server[1127]: 2026/09/21 09:16:00 INFO Signed narinfos id=58 count=1 lb # [ 171.109254] niks3-server[1127]: 2026/09/21 09:16:00 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 171.117056] niks3-server[1127]: 2026/09/21 09:16:00 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete worker1 # [ 171.097092] nix-grpc-daemon[1749]: time=2026-09-21T09:16:00.692Z level=INFO msg="Upload complete. (483ms)" lb # [ 171.122738] niks3-server[1127]: 2026/09/21 09:16:00 INFO Completed upload id=58 lb # [ 171.126776] niks3-server[1127]: 2026/09/21 09:16:00 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 171.104107] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 171.115438] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 171.122217] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 171.126984] nix-daemon[843]: reaped child process 1964, status = succeeded worker1 # [ 171.140156] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 172.186255] nix-daemon[843]: reaped child process 1978, status = succeeded worker1 # [ 172.368785] nix-daemon[843]: accepted connection from pid 1993, user nix-grpc-daemon (trusted) worker1 # [ 172.387817] nix-daemon[843]: reaped child process 1996, status = succeeded lb # [ 172.426030] niks3-server[1127]: 2026/09/21 09:16:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 172.412398] nix-grpc-daemon[1749]: time=2026-09-21T09:16:02.005Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 172.415258] nix-grpc-daemon[1749]: time=2026-09-21T09:16:02.005Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 172.466810] niks3-server[1127]: 2026/09/21 09:16:02 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 172.479372] niks3-server[1127]: 2026/09/21 09:16:02 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 172.487424] niks3-server[1127]: 2026/09/21 09:16:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker1 # [ 172.468229] nix-grpc-daemon[1749]: time=2026-09-21T09:16:02.063Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.496251] niks3-server[1127]: 2026/09/21 09:16:02 INFO Signed narinfos id=59 count=1 lb # [ 172.498997] niks3-server[1127]: 2026/09/21 09:16:02 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 172.510172] niks3-server[1127]: 2026/09/21 09:16:02 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 172.517615] niks3-server[1127]: 2026/09/21 09:16:02 INFO Completed upload id=59 worker1 # [ 172.492399] nix-grpc-daemon[1749]: time=2026-09-21T09:16:02.088Z level=INFO msg="Upload complete. (340ms)" lb # [ 172.520409] niks3-server[1127]: 2026/09/21 09:16:02 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker2 # [ 172.508711] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:02Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 172.505088] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=1 worker1 # [ 172.520653] nix-daemon[843]: reaped child process 1976, status = succeeded worker1 # [ 172.546998] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 172.561690] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 172.575288] nix-grpc-daemon[1749]: time=2026-09-21T09:16:02.170Z level=INFO msg="All 2 paths already cached" worker1 # [ 172.584301] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 172.598044] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 172.796533] nix-daemon[843]: accepted connection from pid 2000, user nix-grpc-daemon (trusted) worker1 # [ 172.816884] nix-daemon[843]: reaped child process 2003, status = succeeded worker1 # [ 172.996458] nix-daemon[843]: accepted connection from pid 2005, user nix-grpc-daemon (trusted) worker1 # [ 173.013035] nix-daemon[843]: reaped child process 2008, status = succeeded lb # [ 173.052153] niks3-server[1127]: 2026/09/21 09:16:02 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 173.035465] nix-grpc-daemon[1749]: time=2026-09-21T09:16:02.630Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 173.037303] nix-grpc-daemon[1749]: time=2026-09-21T09:16:02.630Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 173.080748] niks3-server[1127]: 2026/09/21 09:16:02 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst lb # [ 173.092255] niks3-server[1127]: 2026/09/21 09:16:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign worker1 # [ 173.072947] nix-grpc-daemon[1749]: time=2026-09-21T09:16:02.668Z level=INFO msg="Uploading 1 narinfos" lb # [ 173.102078] niks3-server[1127]: 2026/09/21 09:16:02 INFO Signed narinfos id=60 count=1 lb # [ 173.108736] niks3-server[1127]: 2026/09/21 09:16:02 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 173.116633] niks3-server[1127]: 2026/09/21 09:16:02 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 173.122958] niks3-server[1127]: 2026/09/21 09:16:02 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo lb # [ 173.128287] niks3-server[1127]: 2026/09/21 09:16:02 INFO Completed upload id=60 worker1 # [ 173.102583] nix-grpc-daemon[1749]: time=2026-09-21T09:16:02.698Z level=INFO msg="Upload complete. (489ms)" worker1 # [ 173.111319] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 173.120945] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 173.131340] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 173.138120] nix-daemon[843]: reaped child process 1998, status = succeeded worker1 # [ 173.148186] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 173.977235] nix-daemon[843]: reaped child process 2012, status = succeeded worker1 # [ 174.144147] nix-daemon[843]: accepted connection from pid 2027, user nix-grpc-daemon (trusted) worker1 # [ 174.163877] nix-daemon[843]: reaped child process 2030, status = succeeded lb # [ 174.202422] niks3-server[1127]: 2026/09/21 09:16:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.187607] nix-grpc-daemon[1749]: time=2026-09-21T09:16:03.782Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 174.189245] nix-grpc-daemon[1749]: time=2026-09-21T09:16:03.782Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 174.240691] niks3-server[1127]: 2026/09/21 09:16:03 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 174.251826] niks3-server[1127]: 2026/09/21 09:16:03 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst worker1 # [ 174.237220] nix-grpc-daemon[1749]: time=2026-09-21T09:16:03.832Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.264171] niks3-server[1127]: 2026/09/21 09:16:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 174.267474] niks3-server[1127]: 2026/09/21 09:16:03 INFO Signed narinfos id=61 count=1 lb # [ 174.274212] niks3-server[1127]: 2026/09/21 09:16:03 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 174.280393] niks3-server[1127]: 2026/09/21 09:16:03 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 174.284337] niks3-server[1127]: 2026/09/21 09:16:03 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo lb # [ 174.288061] niks3-server[1127]: 2026/09/21 09:16:03 INFO Completed upload id=61 worker1 # [ 174.262780] nix-grpc-daemon[1749]: time=2026-09-21T09:16:03.858Z level=INFO msg="Upload complete. (305ms)" worker2 # [ 174.277104] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:03Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 174.273098] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=1 worker1 # [ 174.287832] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 174.292519] nix-daemon[843]: reaped child process 2010, status = succeeded worker1 # [ 174.302253] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 174.313884] nix-grpc-daemon[1749]: time=2026-09-21T09:16:03.909Z level=INFO msg="All 2 paths already cached" worker1 # [ 174.321806] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 174.333862] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 174.524103] nix-daemon[843]: accepted connection from pid 2034, user nix-grpc-daemon (trusted) worker1 # [ 174.542304] nix-daemon[843]: reaped child process 2037, status = succeeded worker1 # [ 174.718868] nix-daemon[843]: accepted connection from pid 2039, user nix-grpc-daemon (trusted) worker1 # [ 174.735050] nix-daemon[843]: reaped child process 2042, status = succeeded lb # [ 174.772899] niks3-server[1127]: 2026/09/21 09:16:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 174.759074] nix-grpc-daemon[1749]: time=2026-09-21T09:16:04.354Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 174.760643] nix-grpc-daemon[1749]: time=2026-09-21T09:16:04.354Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 174.804445] niks3-server[1127]: 2026/09/21 09:16:04 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 174.789510] nix-grpc-daemon[1749]: time=2026-09-21T09:16:04.385Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.820418] niks3-server[1127]: 2026/09/21 09:16:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 174.830881] niks3-server[1127]: 2026/09/21 09:16:04 INFO Signed narinfos id=62 count=1 lb # [ 174.834887] niks3-server[1127]: 2026/09/21 09:16:04 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 174.843295] niks3-server[1127]: 2026/09/21 09:16:04 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 174.848257] niks3-server[1127]: 2026/09/21 09:16:04 INFO Completed upload id=62 worker1 # [ 174.822694] nix-grpc-daemon[1749]: time=2026-09-21T09:16:04.418Z level=INFO msg="Upload complete. (476ms)" lb # [ 174.851027] niks3-server[1127]: 2026/09/21 09:16:04 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 174.832240] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 174.843590] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 worker1 # [ 174.854047] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 174.857152] nix-daemon[843]: reaped child process 2032, status = succeeded worker1 # [ 174.871289] nix-daemon[843]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 175.491632] nix-daemon[843]: reaped child process 2046, status = succeeded worker1 # [ 175.649668] nix-daemon[843]: accepted connection from pid 2061, user nix-grpc-daemon (trusted) worker1 # [ 175.667792] nix-daemon[843]: reaped child process 2064, status = succeeded lb # [ 175.702371] niks3-server[1127]: 2026/09/21 09:16:05 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 175.684443] nix-grpc-daemon[1749]: time=2026-09-21T09:16:05.278Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 175.685922] nix-grpc-daemon[1749]: time=2026-09-21T09:16:05.278Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 175.739154] niks3-server[1127]: 2026/09/21 09:16:05 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst worker1 # [ 175.728819] nix-grpc-daemon[1749]: time=2026-09-21T09:16:05.324Z level=INFO msg="Uploading 1 narinfos" lb # [ 175.754525] niks3-server[1127]: 2026/09/21 09:16:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 175.762512] niks3-server[1127]: 2026/09/21 09:16:05 INFO Signed narinfos id=63 count=1 lb # [ 175.767900] niks3-server[1127]: 2026/09/21 09:16:05 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 175.773898] niks3-server[1127]: 2026/09/21 09:16:05 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls worker1 # [ 175.756298] nix-grpc-daemon[1749]: time=2026-09-21T09:16:05.351Z level=INFO msg="Upload complete. (276ms)" lb # [ 175.782562] niks3-server[1127]: 2026/09/21 09:16:05 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 175.785288] niks3-server[1127]: 2026/09/21 09:16:05 INFO Completed upload id=63 lb # [ 175.788045] niks3-server[1127]: 2026/09/21 09:16:05 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 175.764871] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36620 duration_s=0 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=1 worker1 # [ 175.779167] nix-daemon[843]: reaped child process 2044, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 19.19 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 175.984635] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 6b56d758890d468884c8d1908abfc599 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client # [ 176.243583] nix[1338]: don't know how to build these paths: client # [ 176.245127] nix[1338]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker1 # [ 176.244070] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36620 worker2 # [ 176.257757] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 client # [ 176.275655] nix[1338]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker worker2 # [ 176.283808] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:05Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 180.978789] envoy[913]: conn peer=[2001:db8:1::1]:35510 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27161 tx=10757 ms=18864 client # [ 206.277255] nix[1338]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu} client # [ 206.287100] nix[1338]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 206.326931] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 206.337312] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 206.340763] systemd[1]: gpu.service: Consumed 175ms CPU time over 30.351s wall clock time, 35.4M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.27 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 50.32 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.09 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 208.334665] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:37Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 209.473141] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 209.480794] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 209.504148] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:39Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 209.511056] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:39Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 209.549543] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 209.565644] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 209.581522] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 209.599413] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 209.808155] nix-daemon[870]: accepted connection from pid 1676, user nix-grpc-daemon (trusted) worker2 # [ 209.825732] nix-daemon[870]: reaped child process 1679, status = succeeded worker2 # [ 210.002328] nix-daemon[870]: accepted connection from pid 1681, user nix-grpc-daemon (trusted) worker2 # [ 210.018470] nix-daemon[870]: reaped child process 1684, status = succeeded lb # [ 210.050129] niks3-server[1127]: 2026/09/21 09:16:39 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 210.044182] nix-grpc-daemon[1461]: time=2026-09-21T09:16:39.626Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 210.045652] nix-grpc-daemon[1461]: time=2026-09-21T09:16:39.626Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 210.082427] niks3-server[1127]: 2026/09/21 09:16:39 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst worker2 # [ 210.078511] nix-grpc-daemon[1461]: time=2026-09-21T09:16:39.661Z level=INFO msg="Uploading 1 narinfos" lb # [ 210.097062] niks3-server[1127]: 2026/09/21 09:16:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 210.106764] niks3-server[1127]: 2026/09/21 09:16:39 INFO Signed narinfos id=64 count=1 lb # [ 210.114675] niks3-server[1127]: 2026/09/21 09:16:39 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 210.124104] niks3-server[1127]: 2026/09/21 09:16:39 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 210.130742] niks3-server[1127]: 2026/09/21 09:16:39 INFO Completed upload id=64 worker2 # [ 210.112323] nix-grpc-daemon[1461]: time=2026-09-21T09:16:39.695Z level=INFO msg="Upload complete. (495ms)" lb # [ 210.133792] niks3-server[1127]: 2026/09/21 09:16:39 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 210.120137] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 210.134426] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 210.141105] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 210.146055] nix-daemon[870]: reaped child process 1674, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 210.159444] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) lb # [ 210.977837] envoy[913]: conn peer=[2001:db8:1::1]:52566 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=30061 client # farm-a> LOG-farm-a-drain worker2 # [ 211.403152] nix-daemon[870]: reaped child process 1688, status = succeeded worker2 # [ 211.587084] nix-daemon[870]: accepted connection from pid 1703, user nix-grpc-daemon (trusted) worker2 # [ 211.604104] nix-daemon[870]: reaped child process 1706, status = succeeded lb # [ 211.637496] niks3-server[1127]: 2026/09/21 09:16:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 211.628390] nix-grpc-daemon[1461]: time=2026-09-21T09:16:41.209Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 211.629845] nix-grpc-daemon[1461]: time=2026-09-21T09:16:41.209Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 211.671590] niks3-server[1127]: 2026/09/21 09:16:41 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 211.689469] niks3-server[1127]: 2026/09/21 09:16:41 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 211.695108] niks3-server[1127]: 2026/09/21 09:16:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 211.681526] nix-grpc-daemon[1461]: time=2026-09-21T09:16:41.263Z level=INFO msg="Uploading 1 narinfos" lb # [ 211.705465] niks3-server[1127]: 2026/09/21 09:16:41 INFO Signed narinfos id=65 count=1 lb # [ 211.707932] niks3-server[1127]: 2026/09/21 09:16:41 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 211.716838] niks3-server[1127]: 2026/09/21 09:16:41 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 211.722382] niks3-server[1127]: 2026/09/21 09:16:41 INFO Completed upload id=65 worker2 # [ 211.703532] nix-grpc-daemon[1461]: time=2026-09-21T09:16:41.286Z level=INFO msg="Upload complete. (333ms)" worker2 # [ 211.719103] nix-grpc-daemon[1461]: time=2026-09-21T09:16:41.286Z level=WARN msg="Failed to register uploaded object" key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 211.741110] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=1 worker2 # [ 211.748563] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:41Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker2 # [ 211.752540] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:41Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 211.757141] nix-daemon[870]: reaped child process 1686, status = succeeded worker2 # [ 211.778015] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 211.792887] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 211.806978] nix-grpc-daemon[1461]: time=2026-09-21T09:16:41.389Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 211.816987] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 211.830237] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 212.037210] nix-daemon[870]: accepted connection from pid 1712, user nix-grpc-daemon (trusted) worker2 # [ 212.054974] nix-daemon[870]: reaped child process 1715, status = succeeded worker2 # [ 212.226495] nix-daemon[870]: accepted connection from pid 1717, user nix-grpc-daemon (trusted) worker2 # [ 212.242811] nix-daemon[870]: reaped child process 1720, status = succeeded lb # [ 212.272683] niks3-server[1127]: 2026/09/21 09:16:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 212.262760] nix-grpc-daemon[1461]: time=2026-09-21T09:16:41.845Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 212.264386] nix-grpc-daemon[1461]: time=2026-09-21T09:16:41.845Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 212.299317] niks3-server[1127]: 2026/09/21 09:16:41 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst lb # [ 212.313897] niks3-server[1127]: 2026/09/21 09:16:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker2 # [ 212.300982] nix-grpc-daemon[1461]: time=2026-09-21T09:16:41.883Z level=INFO msg="Uploading 1 narinfos" lb # [ 212.324658] niks3-server[1127]: 2026/09/21 09:16:41 INFO Signed narinfos id=66 count=1 lb # [ 212.327622] niks3-server[1127]: 2026/09/21 09:16:41 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 212.337897] niks3-server[1127]: 2026/09/21 09:16:41 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 212.344147] niks3-server[1127]: 2026/09/21 09:16:41 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo lb # [ 212.348218] niks3-server[1127]: 2026/09/21 09:16:41 INFO Completed upload id=66 worker2 # [ 212.329693] nix-grpc-daemon[1461]: time=2026-09-21T09:16:41.912Z level=INFO msg="Upload complete. (480ms)" worker2 # [ 212.340431] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 212.351077] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 212.356960] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 212.361693] nix-daemon[870]: reaped child process 1710, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 212.374012] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) client # farm-b> LOG-farm-b-drain worker2 # [ 213.617733] nix-daemon[870]: reaped child process 1724, status = succeeded worker2 # [ 213.801236] nix-daemon[870]: accepted connection from pid 1739, user nix-grpc-daemon (trusted) worker2 # [ 213.819620] nix-daemon[870]: reaped child process 1742, status = succeeded lb # [ 213.851711] niks3-server[1127]: 2026/09/21 09:16:43 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 213.848457] nix-grpc-daemon[1461]: time=2026-09-21T09:16:43.427Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 213.850169] nix-grpc-daemon[1461]: time=2026-09-21T09:16:43.427Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" worker2 # [ 213.890803] nix-grpc-daemon[1461]: time=2026-09-21T09:16:43.473Z level=INFO msg="Uploading 1 narinfos" lb # [ 213.900747] niks3-server[1127]: 2026/09/21 09:16:43 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 213.912777] niks3-server[1127]: 2026/09/21 09:16:43 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 213.920495] niks3-server[1127]: 2026/09/21 09:16:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 213.923462] niks3-server[1127]: 2026/09/21 09:16:43 INFO Signed narinfos id=67 count=1 lb # [ 213.926994] niks3-server[1127]: 2026/09/21 09:16:43 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls worker2 # [ 213.915771] nix-grpc-daemon[1461]: time=2026-09-21T09:16:43.498Z level=INFO msg="Upload complete. (331ms)" lb # [ 213.934709] niks3-server[1127]: 2026/09/21 09:16:43 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 213.938925] niks3-server[1127]: 2026/09/21 09:16:43 INFO Completed upload id=67 lb # [ 213.942861] niks3-server[1127]: 2026/09/21 09:16:43 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 213.931025] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=1 worker2 # [ 213.948126] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:43Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 213.951994] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:43Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 213.956721] nix-daemon[870]: reaped child process 1722, status = succeeded worker2 # [ 213.989881] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 214.004757] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 214.018806] nix-grpc-daemon[1461]: time=2026-09-21T09:16:43.601Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 214.028948] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 214.044457] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 214.244803] nix-daemon[870]: accepted connection from pid 1748, user nix-grpc-daemon (trusted) worker2 # [ 214.265223] nix-daemon[870]: reaped child process 1751, status = succeeded worker2 # [ 214.436379] nix-daemon[870]: accepted connection from pid 1753, user nix-grpc-daemon (trusted) worker2 # [ 214.454712] nix-daemon[870]: reaped child process 1756, status = succeeded lb # [ 214.484815] niks3-server[1127]: 2026/09/21 09:16:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 214.475827] nix-grpc-daemon[1461]: time=2026-09-21T09:16:44.058Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 214.477485] nix-grpc-daemon[1461]: time=2026-09-21T09:16:44.058Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 214.515224] niks3-server[1127]: 2026/09/21 09:16:44 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 214.507997] nix-grpc-daemon[1461]: time=2026-09-21T09:16:44.090Z level=INFO msg="Uploading 1 narinfos" lb # [ 214.531459] niks3-server[1127]: 2026/09/21 09:16:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 214.541759] niks3-server[1127]: 2026/09/21 09:16:44 INFO Signed narinfos id=68 count=1 lb # [ 214.546255] niks3-server[1127]: 2026/09/21 09:16:44 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls worker2 # [ 214.536329] nix-grpc-daemon[1461]: time=2026-09-21T09:16:44.119Z level=INFO msg="Upload complete. (473ms)" lb # [ 214.554977] niks3-server[1127]: 2026/09/21 09:16:44 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 214.560324] niks3-server[1127]: 2026/09/21 09:16:44 INFO Completed upload id=68 worker2 # [ 214.544130] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=0 paths=1 nar_bytes_in=760 lb # [ 214.563570] niks3-server[1127]: 2026/09/21 09:16:44 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 214.554302] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 worker2 # [ 214.560886] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) worker2 # [ 214.565620] nix-daemon[870]: reaped child process 1746, status = succeeded worker2 # [ 214.576452] nix-daemon[870]: accepted connection from pid 1386, user nix-grpc-daemon (trusted) client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv client # farm-top> LOG-farm-top-drain worker2 # [ 216.212570] nix-daemon[870]: reaped child process 1760, status = succeeded worker2 # [ 216.381754] nix-daemon[870]: accepted connection from pid 1775, user nix-grpc-daemon (trusted) worker2 # [ 216.399981] nix-daemon[870]: reaped child process 1778, status = succeeded lb # [ 216.436573] niks3-server[1127]: 2026/09/21 09:16:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 216.427612] nix-grpc-daemon[1461]: time=2026-09-21T09:16:46.009Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 216.429232] nix-grpc-daemon[1461]: time=2026-09-21T09:16:46.009Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 216.472237] niks3-server[1127]: 2026/09/21 09:16:46 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 216.484413] niks3-server[1127]: 2026/09/21 09:16:46 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst worker2 # [ 216.474630] nix-grpc-daemon[1461]: time=2026-09-21T09:16:46.057Z level=INFO msg="Uploading 1 narinfos" lb # [ 216.497108] niks3-server[1127]: 2026/09/21 09:16:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 216.504836] niks3-server[1127]: 2026/09/21 09:16:46 INFO Signed narinfos id=69 count=1 lb # [ 216.507316] niks3-server[1127]: 2026/09/21 09:16:46 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls lb # [ 216.515136] niks3-server[1127]: 2026/09/21 09:16:46 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 216.521332] niks3-server[1127]: 2026/09/21 09:16:46 INFO Completed upload id=69 worker2 # [ 216.502411] nix-grpc-daemon[1461]: time=2026-09-21T09:16:46.085Z level=INFO msg="Upload complete. (313ms)" lb # [ 216.524458] niks3-server[1127]: 2026/09/21 09:16:46 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 216.517111] nix-grpc-daemon[1386]: ts=2026-09-21T09:16:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46616 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=1 worker2 # [ 216.529899] nix-daemon[870]: reaped child process 1758, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.37 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 217.343205] nix-grpc-daemon[1690]: ts=2026-09-21T09:16:46Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 11.20 seconds) (finished: run the VM test script, in 219.13 seconds) test script finished in 219.41s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.03 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh