tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker1 # Disk image does not exist, creating the virtualisation disk image... worker1 # Formatting '/build/vm-state-worker1/tmp.FNy7z8jvAS', fmt=raw size=1073741824 worker2 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 51) worker2: QEMU running (pid 52) client: QEMU running (pid 49) lb # Disk image does not exist, creating the virtualisation disk image... lb: QEMU running (pid 50) worker2 # Formatting '/build/vm-state-worker2/tmp.V8lnM0Ixs9', fmt=raw size=1073741824 lb # Formatting '/build/vm-state-lb/tmp.Ec0R3f5YD0', fmt=raw size=1073741824 client # Disk image does not exist, creating the virtualisation disk image... worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # mke2fs 1.47.4 (6-Mar-2025) client # Formatting '/build/vm-state-client/tmp.4jN9OSFsna', fmt=raw size=1073741824 worker1 # Discarding device blocks: 0/262144 done worker2 # Discarding device blocks: 0/262144 done client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Discarding device blocks: 0/262144 done worker1 # Filesystem UUID: d8132a6a-ae54-4b63-b1bd-4145e3baa661 worker2 # Filesystem UUID: 5eaeb1a5-07ac-4e59-a660-4d29c727ebf8 client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Superblock backups stored on blocks: worker2 # Superblock backups stored on blocks: client # Filesystem UUID: 9ef88811-bc5e-4f00-b803-60ab8875d700 worker1 # 32768, 98304, 163840, 229376 worker2 # 32768, 98304, 163840, 229376 client # Superblock backups stored on blocks: worker1 # worker2 # client # 32768, 98304, 163840, 229376 worker1 # Allocating group tables: 0/8 done worker2 # Allocating group tables: 0/8 done client # worker1 # Writing inode tables: 0/8 done worker2 # Writing inode tables: 0/8 done client # Allocating group tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker2 # Creating journal (8192 blocks): done client # Writing inode tables: 0/8 done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # Creating journal (8192 blocks): done worker1 # worker2 # client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Virtualisation disk image created. worker2 # Virtualisation disk image created. (finished: start all VMs, in 0.47 seconds) lb # mke2fs 1.47.4 (6-Mar-2025) client # lb # Discarding device blocks: 0/262144 done client # Virtualisation disk image created. lb # Creating filesystem with 262144 4k blocks and 65536 inodes client: waiting for unit network-addresses-eth1.service lb # Filesystem UUID: 52ff3af8-ca46-4cf7-9f9b-4fa114b7037a client: waiting for the VM to finish booting lb # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 lb # lb # Allocating group tables: 0/8 done lb # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done lb # lb # Virtualisation disk image created. worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] random: crng init done worker1 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] DMA32 empty worker1 # [ 0.000000] Normal empty worker1 # [ 0.000000] Device empty worker1 # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/85sl11dh0zky10jc8x3p4y9xadvl89kj-nixos-system-worker1-test/init regInfo=/nix/store/sf77vbcbghgk9hk2xbbk4q5n9r9ql4qy-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/sf77vbcbghgk9hk2xbbk4q5n9r9ql4qy-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000034] arm-pv: using stolen time PV worker1 # [ 0.000641] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.000794] Console: colour dummy device 80x25 worker1 # [ 0.000802] printk: legacy console [tty0] enabled worker1 # [ 0.001018] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.001025] pid_max: default: 32768 minimum: 301 worker1 # [ 0.001124] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.001298] landlock: Up and running. worker1 # [ 0.001301] Yama: becoming mindful. client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.001940] LSM support for eBPF active worker1 # [ 0.002112] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] KASLR enabled worker1 # [ 0.002145] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000000] random: crng init done client # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.003250] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.000000] efi: UEFI not found. worker1 # [ 0.004031] rcu: Hierarchical SRCU implementation. client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.004035] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.005233] fsl-mc MSI: its@8080000 domain created client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.005323] EFI services will not be available. client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.005438] smp: Bringing up secondary CPUs ... client # [ 0.000000] Zone ranges: worker1 # [ 0.005446] smp: Brought up 1 node, 1 CPU client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.005449] SMP: Total of 1 processors activated. client # [ 0.000000] DMA32 empty client # [ 0.000000] Normal empty worker1 # [ 0.005455] CPU: All CPU(s) started at EL1 client # [ 0.000000] Device empty lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.005467] CPU features: detected: Branch Target Identification client # [ 0.000000] Movable zone start for each node client # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.005472] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 lb # [ 0.000000] KASLR enabled worker1 # [ 0.005475] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] random: crng init done worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled lb # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.005479] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.000000] random: crng init done lb # [ 0.000000] efi: UEFI not found. client # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.005482] CPU features: detected: Common not Private translations client # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.005486] CPU features: detected: CRC32 instructions client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.005488] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Zone ranges: client # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.005492] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Zone ranges: client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] DMA32 empty worker1 # [ 0.005495] CPU features: detected: Data independent timing control (DIT) lb # [ 0.000000] Normal empty worker1 # [ 0.005498] CPU features: detected: E0PD worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] Device empty worker2 # [ 0.000000] DMA32 empty worker1 # [ 0.005501] CPU features: detected: Enhanced Counter Virtualization client # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] Normal empty lb # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] Device empty lb # [ 0.000000] Early memory node ranges worker1 # [ 0.005504] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.000000] Movable zone start for each node client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Early memory node ranges client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.005507] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.005510] CPU features: detected: Fine Grained Traps worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.005515] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.005519] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.005522] CPU features: detected: LSE atomic instructions worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.005525] CPU features: detected: Privileged Access Never worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.005528] CPU features: detected: PMUv3 worker2 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.005531] CPU features: detected: RAS Extension Support worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) lb # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.005534] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test/init regInfo=/nix/store/qv89ps7hlc2xvxz8pzqw4jziggm25i3g-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.005536] CPU features: detected: Random Number Generator worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.005539] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.005542] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/qv89ps7hlc2xvxz8pzqw4jziggm25i3g-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.005545] CPU features: detected: TLB range maintenance instructions lb # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.005550] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.005591] alternatives: applying system-wide alternatives worker2 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.008565] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.008744] Memory: 1406556K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.009135] devtmpfs: initialized client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.010934] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.010956] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/f4b0lk4znyrmdfpm6f1kvcry9mqdiq05-nixos-system-lb-test/init regInfo=/nix/store/lvhvpzdlnfy9xyrdr3lx689a20qywaqb-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.011143] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/wykyb0qy7gxax0kbx52lhrandvn5hhwl-nixos-system-worker2-test/init regInfo=/nix/store/vijscrzsxl5jgm579rc9xqvnsymkza5v-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] Policy zone: DMA worker1 # [ 0.011148] 0 pages in range for non-PLT usage lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/lvhvpzdlnfy9xyrdr3lx689a20qywaqb-closure-info/registration", will be passed to user space. worker1 # [ 0.011149] 508288 pages in range for PLT usage client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.011260] pinctrl core: initialized pinctrl subsystem lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.012093] DMI not present or invalid. worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/vijscrzsxl5jgm579rc9xqvnsymkza5v-closure-info/registration", will be passed to user space. client # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.015900] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.018160] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.018341] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.018542] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.018564] audit: initializing netlink subsys (disabled) worker2 # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.019113] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.019115] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.019119] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.000000] Policy zone: DMA client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.019124] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Policy zone: DMA worker1 # [ 0.019127] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.019151] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.019160] cpuidle: using governor ladder lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.019165] cpuidle: using governor menu lb # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.019355] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.019370] ASID allocator initialised with 65536 entries worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.020605] Serial: AMBA PL011 UART driver lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] rcu: RCU event tracing is enabled. lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.025882] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.026005] printk: console [ttyAMA0] enabled lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.148149] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.148167] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000027] arm-pv: using stolen time PV worker1 # [ 0.148172] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.148176] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000404] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.148181] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.000535] Console: colour dummy device 80x25 worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000543] printk: legacy console [tty0] enabled worker1 # [ 0.148185] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.148189] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.000747] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 worker1 # [ 0.148194] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.000753] pid_max: default: 32768 minimum: 301 lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000821] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.000953] landlock: Up and running. client # [ 0.000956] Yama: becoming mindful. worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.001410] LSM support for eBPF active worker1 # [ 0.155309] fbcon: Taking over console lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.155323] ACPI: Interpreter disabled. client # [ 0.001565] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.157146] iommu: Default domain type: Translated lb # [ 0.000027] arm-pv: using stolen time PV worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.001597] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.157155] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.002613] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000368] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.158784] SCSI subsystem initialized worker2 # [ 0.000027] arm-pv: using stolen time PV client # [ 0.003341] rcu: Hierarchical SRCU implementation. lb # [ 0.000545] Console: colour dummy device 80x25 client # [ 0.003345] rcu: Max phase no-delay instances is 1000. lb # [ 0.000553] printk: legacy console [tty0] enabled worker2 # [ 0.000418] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.004525] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.000592] Console: colour dummy device 80x25 client # [ 0.004615] EFI services will not be available. lb # [ 0.000751] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.004694] smp: Bringing up secondary CPUs ... worker2 # [ 0.000600] printk: legacy console [tty0] enabled lb # [ 0.000758] pid_max: default: 32768 minimum: 301 client # [ 0.004702] smp: Brought up 1 node, 1 CPU lb # [ 0.000853] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.004705] SMP: Total of 1 processors activated. worker2 # [ 0.000786] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000978] landlock: Up and running. client # [ 0.004710] CPU: All CPU(s) started at EL1 lb # [ 0.000980] Yama: becoming mindful. worker2 # [ 0.000792] pid_max: default: 32768 minimum: 301 lb # [ 0.001410] LSM support for eBPF active client # [ 0.004720] CPU features: detected: Branch Target Identification worker2 # [ 0.000858] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.004725] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.001007] landlock: Up and running. lb # [ 0.001559] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.001010] Yama: becoming mindful. worker1 # [ 0.164367] usbcore: registered new interface driver usbfs worker2 # [ 0.001474] LSM support for eBPF active lb # [ 0.001597] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.004728] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.164399] usbcore: registered new interface driver hub lb # [ 0.002668] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.001619] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.164416] usbcore: registered new device driver usb client # [ 0.004732] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.003362] rcu: Hierarchical SRCU implementation. worker1 # [ 0.164679] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.001652] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.004736] CPU features: detected: Common not Private translations lb # [ 0.003366] rcu: Max phase no-delay instances is 1000. client # [ 0.004739] CPU features: detected: CRC32 instructions worker2 # [ 0.002707] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.004546] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.164684] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.003401] rcu: Hierarchical SRCU implementation. lb # [ 0.004644] EFI services will not be available. worker1 # [ 0.164695] PTP clock support registered client # [ 0.004742] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.004725] smp: Bringing up secondary CPUs ... worker1 # [ 0.164742] EDAC MC: Ver: 3.0.0 worker2 # [ 0.003405] rcu: Max phase no-delay instances is 1000. lb # [ 0.004733] smp: Brought up 1 node, 1 CPU worker2 # [ 0.004633] fsl-mc MSI: its@8080000 domain created client # [ 0.004745] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.169183] scmi_core: SCMI protocol bus registered lb # [ 0.004737] SMP: Total of 1 processors activated. worker2 # [ 0.004724] EFI services will not be available. client # [ 0.004749] CPU features: detected: Data independent timing control (DIT) lb # [ 0.004745] CPU: All CPU(s) started at EL1 worker2 # [ 0.004834] smp: Bringing up secondary CPUs ... client # [ 0.004752] CPU features: detected: E0PD worker1 # [ 0.170118] FPGA manager framework worker2 # [ 0.004842] smp: Brought up 1 node, 1 CPU worker1 # [ 0.170988] vgaarb: loaded lb # [ 0.004756] CPU features: detected: Branch Target Identification client # [ 0.004754] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.004845] SMP: Total of 1 processors activated. lb # [ 0.004761] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.004850] CPU: All CPU(s) started at EL1 worker1 # [ 0.171594] clocksource: Switched to clocksource arch_sys_counter client # [ 0.004757] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.004862] CPU features: detected: Branch Target Identification lb # [ 0.004764] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.004760] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.004867] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.004763] CPU features: detected: Fine Grained Traps lb # [ 0.004768] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.004766] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.004870] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.004799] CPU features: detected: Common not Private translations client # [ 0.004771] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.004802] CPU features: detected: CRC32 instructions worker2 # [ 0.004873] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.175149] VFS: Disk quotas dquot_6.6.0 client # [ 0.004773] CPU features: detected: LSE atomic instructions lb # [ 0.004805] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.004877] CPU features: detected: Common not Private translations worker1 # [ 0.175189] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.004777] CPU features: detected: Privileged Access Never lb # [ 0.004809] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.004880] CPU features: detected: CRC32 instructions client # [ 0.004779] CPU features: detected: PMUv3 client # [ 0.004782] CPU features: detected: RAS Extension Support lb # [ 0.004812] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.004883] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.004815] CPU features: detected: E0PD client # [ 0.004785] CPU features: detected: RASv1p1 Extension Support lb # [ 0.004817] CPU features: detected: Enhanced Counter Virtualization client # [ 0.004787] CPU features: detected: Random Number Generator worker1 # [ 0.178698] netfs: FS-Cache loaded worker1 # [ 0.178815] pnp: PnP ACPI: disabled lb # [ 0.004820] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.004823] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.004826] CPU features: detected: Fine Grained Traps lb # [ 0.004830] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.004835] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.004838] CPU features: detected: LSE atomic instructions worker1 # [ 0.182613] NET: Registered PF_INET protocol family lb # [ 0.004841] CPU features: detected: Privileged Access Never lb # [ 0.004844] CPU features: detected: PMUv3 worker1 # [ 0.182880] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.004846] CPU features: detected: RAS Extension Support lb # [ 0.004849] CPU features: detected: RASv1p1 Extension Support lb # [ 0.004852] CPU features: detected: Random Number Generator worker2 # [ 0.004887] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.004854] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.004890] CPU features: detected: Data independent timing control (DIT) client # [ 0.004790] CPU features: detected: Speculation barrier (SB) lb # [ 0.004857] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.004893] CPU features: detected: E0PD client # [ 0.004792] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.004895] CPU features: detected: Enhanced Counter Virtualization client # [ 0.004795] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.004898] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.004799] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.004901] CPU features: detected: Enhanced Virtualization Traps client # [ 0.004835] alternatives: applying system-wide alternatives worker2 # [ 0.004904] CPU features: detected: Fine Grained Traps client # [ 0.007693] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.004907] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.004913] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.007882] Memory: 1406508K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker2 # [ 0.004915] CPU features: detected: LSE atomic instructions client # [ 0.008268] devtmpfs: initialized worker2 # [ 0.004918] CPU features: detected: Privileged Access Never client # [ 0.010099] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.004921] CPU features: detected: PMUv3 worker2 # [ 0.004923] CPU features: detected: RAS Extension Support client # [ 0.010126] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.004926] CPU features: detected: RASv1p1 Extension Support client # [ 0.010302] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.004929] CPU features: detected: Random Number Generator client # [ 0.010306] 0 pages in range for non-PLT usage lb # [ 0.004860] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.004931] CPU features: detected: Speculation barrier (SB) client # [ 0.010307] 508288 pages in range for PLT usage lb # [ 0.004864] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.004934] CPU features: detected: Stage-2 Force Write-Back client # [ 0.010420] pinctrl core: initialized pinctrl subsystem lb # [ 0.004901] alternatives: applying system-wide alternatives client # [ 0.011167] DMI not present or invalid. worker2 # [ 0.004937] CPU features: detected: TLB range maintenance instructions lb # [ 0.007776] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.014316] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.004942] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.016801] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.004977] alternatives: applying system-wide alternatives lb # [ 0.008005] Memory: 1406536K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) client # [ 0.016985] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.007916] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.008402] devtmpfs: initialized client # [ 0.017180] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.010218] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.017203] audit: initializing netlink subsys (disabled) worker2 # [ 0.008164] Memory: 1406544K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) lb # [ 0.010239] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.008559] devtmpfs: initialized client # [ 0.017771] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.010422] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.010311] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.017773] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.010426] 0 pages in range for non-PLT usage client # [ 0.017776] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.010427] 508288 pages in range for PLT usage worker2 # [ 0.010332] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.017781] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.010516] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.010519] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.011240] DMI not present or invalid. client # [ 0.017784] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.010524] 0 pages in range for non-PLT usage lb # [ 0.014555] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.010524] 508288 pages in range for PLT usage client # [ 0.017806] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.016788] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.010637] pinctrl core: initialized pinctrl subsystem client # [ 0.017817] cpuidle: using governor ladder worker2 # [ 0.011387] DMI not present or invalid. client # [ 0.017822] cpuidle: using governor menu lb # [ 0.016968] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.014714] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.018001] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.017163] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.017306] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.018016] ASID allocator initialised with 65536 entries lb # [ 0.017184] audit: initializing netlink subsys (disabled) client # [ 0.019185] Serial: AMBA PL011 UART driver worker2 # [ 0.017480] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.017772] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.024379] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.017678] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.017773] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.024528] printk: console [ttyAMA0] enabled worker2 # [ 0.017701] audit: initializing netlink subsys (disabled) lb # [ 0.017777] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.018251] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.017782] thermal_sys: Registered thermal governor 'user_space' client # [ 0.144367] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.018253] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.017785] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.144388] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.018257] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.017815] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.144393] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.018262] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.017825] cpuidle: using governor ladder client # [ 0.144398] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.017830] cpuidle: using governor menu worker2 # [ 0.018264] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.144402] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.018011] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.018286] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.018026] ASID allocator initialised with 65536 entries client # [ 0.144406] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.018296] cpuidle: using governor ladder lb # [ 0.019220] Serial: AMBA PL011 UART driver worker2 # [ 0.018301] cpuidle: using governor menu client # [ 0.144411] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.024404] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.018489] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.144415] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.024561] printk: console [ttyAMA0] enabled worker2 # [ 0.018503] ASID allocator initialised with 65536 entries worker2 # [ 0.019656] Serial: AMBA PL011 UART driver lb # [ 0.143696] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.024789] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.151750] fbcon: Taking over console lb # [ 0.143712] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.024938] printk: console [ttyAMA0] enabled worker1 # [ 0.210869] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.151764] ACPI: Interpreter disabled. lb # [ 0.143718] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.210910] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.143722] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.145549] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.210936] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.145565] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.143726] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.211010] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.143731] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.145570] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.211155] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.145574] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.143735] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.211232] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.143739] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.145578] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.211267] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.145582] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.211303] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.145587] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.159006] iommu: Default domain type: Translated worker1 # [ 0.211389] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.150942] fbcon: Taking over console worker2 # [ 0.145591] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.159015] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.150955] ACPI: Interpreter disabled. worker1 # [ 0.211417] NET: Registered PF_XDP protocol family worker1 # [ 0.211434] PCI: CLS 0 bytes, default 64 client # [ 0.160621] SCSI subsystem initialized worker1 # [ 0.211654] Trying to unpack rootfs image as initramfs... worker2 # [ 0.152933] fbcon: Taking over console client # [ 0.161307] usbcore: registered new interface driver usbfs worker2 # [ 0.152947] ACPI: Interpreter disabled. client # [ 0.161338] usbcore: registered new interface driver hub client # [ 0.161354] usbcore: registered new device driver usb client # [ 0.161619] pps_core: LinuxPPS API ver. 1 registered client # [ 0.161625] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.161635] PTP clock support registered client # [ 0.161685] EDAC MC: Ver: 3.0.0 client # [ 0.166267] scmi_core: SCMI protocol bus registered lb # [ 0.159415] iommu: Default domain type: Translated client # [ 0.167209] FPGA manager framework client # [ 0.168154] vgaarb: loaded lb # [ 0.159425] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.229025] kvm [1]: HYP mode not available lb # [ 0.161103] SCSI subsystem initialized client # [ 0.168795] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.161690] iommu: Default domain type: Translated lb # [ 0.161792] usbcore: registered new interface driver usbfs worker2 # [ 0.161699] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.161815] usbcore: registered new interface driver hub lb # [ 0.161846] usbcore: registered new device driver usb worker2 # [ 0.163434] SCSI subsystem initialized client # [ 0.171727] VFS: Disk quotas dquot_6.6.0 lb # [ 0.162100] pps_core: LinuxPPS API ver. 1 registered client # [ 0.171756] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.164121] usbcore: registered new interface driver usbfs lb # [ 0.162106] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.162115] PTP clock support registered worker2 # [ 0.164145] usbcore: registered new interface driver hub lb # [ 0.162158] EDAC MC: Ver: 3.0.0 worker2 # [ 0.164182] usbcore: registered new device driver usb worker2 # [ 0.164436] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.166732] scmi_core: SCMI protocol bus registered client # [ 0.175372] netfs: FS-Cache loaded client # [ 0.175487] pnp: PnP ACPI: disabled lb # [ 0.167681] FPGA manager framework worker2 # [ 0.164442] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.168637] vgaarb: loaded worker2 # [ 0.164452] PTP clock support registered worker2 # [ 0.164500] EDAC MC: Ver: 3.0.0 worker2 # [ 0.169120] scmi_core: SCMI protocol bus registered lb # [ 0.169253] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.169831] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.170079] FPGA manager framework worker2 # [ 0.171013] vgaarb: loaded lb # [ 0.169863] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.172196] netfs: FS-Cache loaded lb # [ 0.172306] pnp: PnP ACPI: disabled worker2 # [ 0.171646] clocksource: Switched to clocksource arch_sys_counter client # [ 0.179351] NET: Registered PF_INET protocol family worker2 # [ 0.172239] VFS: Disk quotas dquot_6.6.0 client # [ 0.179606] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.172270] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.174695] netfs: FS-Cache loaded worker2 # [ 0.174808] pnp: PnP ACPI: disabled lb # [ 0.178084] NET: Registered PF_INET protocol family lb # [ 0.178342] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.180562] NET: Registered PF_INET protocol family worker2 # [ 0.180839] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.208592] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.208632] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.208667] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.208740] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.212724] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.213592] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.207048] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.213633] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.207092] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.213671] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.213773] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.207121] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.213845] NET: Registered PF_XDP protocol family lb # [ 0.207192] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.213863] PCI: CLS 0 bytes, default 64 lb # [ 0.207336] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.214084] Trying to unpack rootfs image as initramfs... lb # [ 0.207413] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.207447] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.207483] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.207582] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.210602] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.207614] NET: Registered PF_XDP protocol family worker2 # [ 0.210647] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.207631] PCI: CLS 0 bytes, default 64 lb # [ 0.207848] Trying to unpack rootfs image as initramfs... worker2 # [ 0.210675] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.210751] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.210893] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.225798] kvm [1]: HYP mode not available worker2 # [ 0.210975] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.222883] kvm [1]: HYP mode not available worker2 # [ 0.211012] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.211050] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.211181] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.211243] NET: Registered PF_XDP protocol family worker2 # [ 0.211260] PCI: CLS 0 bytes, default 64 worker2 # [ 0.211486] Trying to unpack rootfs image as initramfs... worker2 # [ 0.229471] kvm [1]: HYP mode not available worker1 # [ 0.313954] Initialise system trusted keyrings worker1 # [ 0.319645] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.321075] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.321837] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.342404] Key type asymmetric registered worker1 # [ 0.342424] Asymmetric key parser 'x509' registered worker1 # [ 0.342484] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.347640] io scheduler mq-deadline registered worker1 # [ 0.347655] io scheduler kyber registered worker1 # [ 0.359736] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.360340] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.360693] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.360709] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.360720] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.360728] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.360749] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.360770] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.360844] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.360854] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.360859] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.360865] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.360870] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.360941] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.361369] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.361550] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.361566] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.361595] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.361610] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.317336] Initialise system trusted keyrings worker1 # [ 0.362052] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.362230] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.318074] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.362246] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.319374] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.362274] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.362710] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.320137] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.362888] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.362903] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.314433] Initialise system trusted keyrings worker1 # [ 0.362932] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.314964] Initialise system trusted keyrings worker2 # [ 0.315165] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.363371] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.315665] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.363548] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.316511] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.316879] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.363563] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.363615] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.364074] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.364250] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.364266] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.364295] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.364746] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.364923] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.364939] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.364967] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.365440] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.317677] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.365617] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.365632] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.365661] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.365676] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.366115] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.366297] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.366326] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.366763] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.323700] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.366944] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.340670] Key type asymmetric registered worker1 # [ 0.366973] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.340688] Asymmetric key parser 'x509' registered worker1 # [ 0.367355] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.340757] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.367531] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.337646] Key type asymmetric registered lb # [ 0.337663] Asymmetric key parser 'x509' registered lb # [ 0.337721] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.348849] io scheduler mq-deadline registered client # [ 0.348864] io scheduler kyber registered worker2 # [ 0.343592] Key type asymmetric registered worker2 # [ 0.343609] Asymmetric key parser 'x509' registered worker1 # [ 0.415811] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.345307] io scheduler mq-deadline registered worker2 # [ 0.344850] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.416102] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.345323] io scheduler kyber registered worker2 # [ 0.345853] io scheduler mq-deadline registered worker1 # [ 0.416120] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.345864] io scheduler kyber registered worker1 # [ 0.416149] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.416614] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.416794] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.416810] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.357030] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.416839] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.417397] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.417408] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.358321] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.417414] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.358670] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.353402] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.417457] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.358686] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.417502] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.358711] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.417547] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.355791] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.417592] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.358719] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.354698] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.417636] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.358738] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.355070] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.417681] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.358762] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.355086] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.417727] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.358834] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.355098] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.358843] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.417773] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.355107] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.358849] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.417818] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.358854] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.355127] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.417877] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.358859] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.355155] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.417922] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.358914] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.357110] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.355237] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.417942] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.355246] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.357470] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.359349] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.417963] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.355252] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.359533] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.357488] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.417984] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.355257] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.359549] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.418007] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.357501] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.359578] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.355262] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.418028] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.359594] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.357510] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.355316] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.418049] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.360041] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.355744] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.357530] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.418070] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.360222] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.355930] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.418092] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.357552] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.360238] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.355946] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.418113] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.360267] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.357624] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.355976] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.418134] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.357633] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.355992] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.357639] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.418156] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.356444] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.418177] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.357644] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.379471] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.356629] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.418197] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.379656] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.357649] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.356644] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.418218] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.379672] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.356673] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.357707] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.418238] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.379702] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.357143] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.418259] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.358152] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.380159] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.358339] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.418279] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.380341] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.358355] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.418300] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.380356] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.358385] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.418321] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.380388] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.358401] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.418342] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker1 # [ 0.418368] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.358855] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.418377] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.359039] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.418382] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.359054] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.419510] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.359084] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.359532] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.359732] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.359748] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.359777] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.381363] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.381385] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.360228] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.360418] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.381415] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.360433] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.381886] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.360465] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.382069] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.382084] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.360932] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.361115] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.463739] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 43197 usecs lb # [ 0.382116] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.361131] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.382570] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.361160] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.382751] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.382766] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.361609] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.361793] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.382796] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.392898] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.361808] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.393095] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.383240] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.361838] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.393111] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.383422] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.383437] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.393140] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.362294] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.383467] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.362477] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.393609] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.362492] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.393792] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.383915] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.362522] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.393807] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.384097] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.362538] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.384113] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.393836] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.384142] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.363022] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.394326] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.384157] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.363211] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.394509] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.394525] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.384644] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.363240] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.384925] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.394554] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.394570] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.384959] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.395021] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.395207] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.395236] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.395686] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.395871] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.395900] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.396293] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.396474] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.396728] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.397028] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.397045] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.397074] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.407727] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.483772] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.407925] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.397530] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.485921] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.407956] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.397712] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.397727] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.408364] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.397757] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.408552] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.409473] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.398335] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.408814] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.409674] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.398346] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.409062] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.409704] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.409078] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.398352] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.410096] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.409108] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.398396] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.410277] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.409575] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.398442] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.410528] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.409756] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.410786] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.398488] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.409772] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.410803] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.398534] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.409801] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.410833] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.410362] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.398579] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.411288] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.410373] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.398624] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.411469] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.410379] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.411484] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.496182] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.398669] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.498460] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.411513] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.410423] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.398714] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.412103] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.410469] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.398760] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.412114] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.410515] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.398819] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.412119] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.398864] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.410561] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.412164] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.398886] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.410607] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.412211] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.398907] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.410655] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.398928] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.412258] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.410703] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.398952] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.412305] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.398974] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.410749] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.412352] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.398995] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.410795] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.412400] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.399017] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.410866] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.412447] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.399038] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.410912] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.399060] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.412493] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.410933] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.399082] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.412540] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.410954] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.508615] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.399104] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.410976] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.412609] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.510973] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) client # [ 0.399125] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.410999] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.412655] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.399146] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.412676] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.411021] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.399167] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.412697] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.411042] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.399188] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.412719] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.411064] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.399210] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.514586] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.412743] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.399231] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.411086] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.399252] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.412764] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.411107] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.399274] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.412800] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.411130] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.399295] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.412822] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.411152] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.399322] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.411173] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.412844] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.399331] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.411194] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.412866] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.399336] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.411215] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.412888] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.400485] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.411236] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.412910] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.411257] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.412931] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.411279] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.412952] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.523047] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.411301] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.412974] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.411322] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.412995] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.411344] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.413016] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.411370] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.413038] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.411379] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.413059] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.411384] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.413081] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.413102] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.413129] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.460909] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 59013 usecs lb # [ 0.413138] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.413143] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.414330] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.529176] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.456568] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.530893] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.541008] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.480921] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.482967] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.553914] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.479392] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.481648] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.556389] msm_serial: driver initialized worker1 # [ 0.556566] SuperH (H)SCI(F) driver initialized worker1 # [ 0.556619] STM32 USART driver initialized client # [ 0.492973] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.495354] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.487813] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.490046] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.489459] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.492992] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.494974] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.496966] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.504984] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.507958] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.499922] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.501915] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.506637] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.508711] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.519434] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.588360] loop: module loaded worker1 # [ 0.588532] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.589259] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.522437] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.524399] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.511800] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.514752] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.520287] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.516831] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.518862] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.526936] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.534184] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.536769] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) lb # [ 0.528726] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.600199] megasas: 07.734.00.00-rc1 worker2 # [ 0.528926] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.600903] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.531462] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.603190] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.603214] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.604789] Using buffer write method worker1 # [ 0.604850] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.606484] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.606507] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.538763] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.624231] Using buffer write method worker2 # [ 0.548937] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.557279] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.624265] Concatenating MTD devices: worker1 # [ 0.624270] (0): "0.flash" worker1 # [ 0.624274] (1): "0.flash" worker1 # [ 0.624277] into device "0.flash" worker2 # [ 0.551490] msm_serial: driver initialized worker2 # [ 0.551628] SuperH (H)SCI(F) driver initialized client # [ 0.559809] msm_serial: driver initialized client # [ 0.559958] SuperH (H)SCI(F) driver initialized client # [ 0.560010] STM32 USART driver initialized lb # [ 0.553443] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.556010] msm_serial: driver initialized lb # [ 0.556167] SuperH (H)SCI(F) driver initialized lb # [ 0.556221] STM32 USART driver initialized worker2 # [ 0.559740] STM32 USART driver initialized client # [ 0.586627] loop: module loaded client # [ 0.586801] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.587505] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.584015] loop: module loaded lb # [ 0.584182] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.584932] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.587895] loop: module loaded worker2 # [ 0.588065] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.588797] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.601353] megasas: 07.734.00.00-rc1 client # [ 0.602037] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.604251] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.604275] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.596262] megasas: 07.734.00.00-rc1 client # [ 0.605819] Using buffer write method worker2 # [ 0.597083] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.597844] megasas: 07.734.00.00-rc1 client # [ 0.605880] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.598551] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.599211] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.599236] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.600844] Using buffer write method lb # [ 0.600697] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.607611] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.600721] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.607632] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.600912] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.602281] Using buffer write method client # [ 0.616780] Using buffer write method client # [ 0.617261] Concatenating MTD devices: lb # [ 0.602339] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.617266] (0): "0.flash" client # [ 0.617270] (1): "0.flash" worker2 # [ 0.602580] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.617274] into device "0.flash" worker2 # [ 0.602610] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.603978] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.604005] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.616150] Using buffer write method worker2 # [ 0.616174] Concatenating MTD devices: worker2 # [ 0.616178] (0): "0.flash" worker2 # [ 0.616182] (1): "0.flash" worker2 # [ 0.616186] into device "0.flash" lb # [ 0.622892] Using buffer write method lb # [ 0.622933] Concatenating MTD devices: lb # [ 0.622937] (0): "0.flash" lb # [ 0.622942] (1): "0.flash" lb # [ 0.622945] into device "0.flash" worker1 # [ 0.847955] Freeing initrd memory: 26148K worker1 # [ 0.853961] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.857626] thunder_xcv, ver 1.0 worker1 # [ 0.857669] thunder_bgx, ver 1.0 worker1 # [ 0.857691] nicpf, ver 1.0 worker1 # [ 0.858254] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.858261] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.858286] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.858294] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.858323] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.858328] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 0.858353] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.858358] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.858500] sky2: driver version 1.30 worker1 # [ 0.867096] usbcore: registered new interface driver usb-storage worker1 # [ 0.867147] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.867162] usbserial: USB Serial support registered for generic worker1 # [ 0.868324] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 0.868349] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.868623] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.873416] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.874923] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.874948] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T12:32:53 UTC (1789993973) worker1 # [ 0.875253] i2c_dev: i2c /dev entries driver worker1 # [ 0.880302] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.880312] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.880589] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.880972] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.882687] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.882942] usbcore: registered new interface driver usbhid worker1 # [ 0.882948] usbhid: USB HID core driver worker1 # [ 0.888133] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.889161] hub 1-0:1.0: USB hub found worker1 # [ 0.889649] hub 1-0:1.0: 6 ports detected worker1 # [ 0.891045] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.893762] drop_monitor: Initializing network drop monitor service worker1 # [ 0.893906] NET: Registered PF_INET6 protocol family worker1 # [ 0.895803] Segment Routing with IPv6 worker1 # [ 0.895822] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.895847] NET: Registered PF_PACKET protocol family worker1 # [ 0.897477] 9pnet: Installing 9P2000 support worker1 # [ 0.899511] Key type dns_resolver registered client # [ 0.836504] Freeing initrd memory: 26160K worker1 # [ 0.906384] registered taskstats version 1 worker1 # [ 0.906537] Loading compiled-in X.509 certificates client # [ 0.842736] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.837699] Freeing initrd memory: 26140K worker1 # [ 0.915848] Demotion targets for Node 0: null worker1 # [ 0.915980] Key type .fscrypt registered client # [ 0.846356] thunder_xcv, ver 1.0 worker1 # [ 0.915985] Key type fscrypt-provisioning registered client # [ 0.846395] thunder_bgx, ver 1.0 client # [ 0.846416] nicpf, ver 1.0 worker1 # [ 0.916080] ima: No TPM chip found, activating TPM-bypass! client # [ 0.846949] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.916099] ima: Allocated hash algorithm: sha1 lb # [ 0.843619] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.916119] ima: No architecture policies found client # [ 0.846956] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.846980] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.920112] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.846988] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.847017] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.847022] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.847045] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.847697] Freeing initrd memory: 26148K client # [ 0.847050] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.847179] sky2: driver version 1.30 lb # [ 0.847369] thunder_xcv, ver 1.0 lb # [ 0.847412] thunder_bgx, ver 1.0 client # [ 0.848728] usbcore: registered new interface driver usb-storage lb # [ 0.847433] nicpf, ver 1.0 client # [ 0.849685] ehci-pci 0000:00:0a.0: EHCI Host Controller lb # [ 0.847974] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.849709] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 0.847981] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.848003] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.850041] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.848011] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.848043] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.860282] usbcore: registered new interface driver usbserial_generic lb # [ 0.848048] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.860301] usbserial: USB Serial support registered for generic worker2 # [ 0.853561] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.848071] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.862329] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.848077] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.863335] hub 1-0:1.0: USB hub found lb # [ 0.848208] sky2: driver version 1.30 client # [ 0.863827] hub 1-0:1.0: 6 ports detected lb # [ 0.856935] usbcore: registered new interface driver usb-storage client # [ 0.864857] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.857032] usbcore: registered new interface driver usbserial_generic lb # [ 0.857047] usbserial: USB Serial support registered for generic client # [ 0.866347] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.860108] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.866373] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T12:32:53 UTC (1789993973) worker2 # [ 0.857193] thunder_xcv, ver 1.0 client # [ 0.866667] i2c_dev: i2c /dev entries driver worker2 # [ 0.857235] thunder_bgx, ver 1.0 lb # [ 0.860135] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.857257] nicpf, ver 1.0 lb # [ 0.860397] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.857782] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.857789] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.857813] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.863288] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.857821] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.938042] clk: Disabling unused clocks worker1 # [ 0.938067] PM: genpd: Disabling unused power domains worker2 # [ 0.857850] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.871631] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.864834] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.871642] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.857856] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.871901] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.857878] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.864861] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T12:32:53 UTC (1789993973) lb # [ 0.865168] i2c_dev: i2c /dev entries driver client # [ 0.872260] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.857884] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.858012] sky2: driver version 1.30 worker1 # [ 0.942251] Freeing unused kernel memory: 4736K worker1 # [ 0.942444] Run /init as init process worker2 # [ 0.859516] usbcore: registered new interface driver usb-storage client # [ 0.876516] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.859611] usbcore: registered new interface driver usbserial_generic client # [ 0.876761] usbcore: registered new interface driver usbhid worker2 # [ 0.859625] usbserial: USB Serial support registered for generic client # [ 0.876768] usbhid: USB HID core driver worker2 # [ 0.860313] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.860339] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.860641] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.872139] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.870057] sdhci: Secure Digital Host Controller Interface driver client # [ 0.879673] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.872527] hub 1-0:1.0: USB hub found lb # [ 0.870067] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.872548] hub 1-0:1.0: 6 ports detected lb # [ 0.870328] Synopsys Designware Multimedia Card Interface Driver client # [ 0.882229] drop_monitor: Initializing network drop monitor service lb # [ 0.870693] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 0.882406] NET: Registered PF_INET6 protocol family lb # [ 0.872318] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.875155] hv_vmbus: registering driver hyperv_keyboard client # [ 0.884313] Segment Routing with IPv6 lb # [ 0.872554] usbcore: registered new interface driver usbhid client # [ 0.884335] In-situ OAM (IOAM) with IPv6 lb # [ 0.872561] usbhid: USB HID core driver client # [ 0.884362] NET: Registered PF_PACKET protocol family worker2 # [ 0.876641] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.877703] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.878032] hub 1-0:1.0: USB hub found worker2 # [ 0.876667] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T12:32:53 UTC (1789993973) lb # [ 0.878063] hub 1-0:1.0: 6 ports detected worker2 # [ 0.876956] i2c_dev: i2c /dev entries driver client # [ 0.886189] 9pnet: Installing 9P2000 support client # [ 0.888303] Key type dns_resolver registered lb # [ 0.880508] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.957772] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.883127] drop_monitor: Initializing network drop monitor service worker2 # [ 0.881896] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.883264] NET: Registered PF_INET6 protocol family worker2 # [ 0.881906] sdhci: Copyright(c) Pierre Ossman lb # [ 0.885177] Segment Routing with IPv6 worker2 # [ 0.882166] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.885196] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.882519] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.885229] NET: Registered PF_PACKET protocol family worker2 # [ 0.886914] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.887159] usbcore: registered new interface driver usbhid client # [ 0.894987] registered taskstats version 1 lb # [ 0.886863] 9pnet: Installing 9P2000 support worker2 # [ 0.887166] usbhid: USB HID core driver client # [ 0.895144] Loading compiled-in X.509 certificates lb # [ 0.888992] Key type dns_resolver registered worker2 # [ 0.889998] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.891444] drop_monitor: Initializing network drop monitor service worker2 # [ 0.891565] NET: Registered PF_INET6 protocol family worker2 # [ 0.894575] Segment Routing with IPv6 worker2 # [ 0.894605] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.894635] NET: Registered PF_PACKET protocol family client # [ 0.903559] Demotion targets for Node 0: null client # [ 0.903660] Key type .fscrypt registered lb # [ 0.895874] registered taskstats version 1 client # [ 0.903667] Key type fscrypt-provisioning registered lb # [ 0.896015] Loading compiled-in X.509 certificates client # [ 0.903754] ima: No TPM chip found, activating TPM-bypass! client # [ 0.903774] ima: Allocated hash algorithm: sha1 client # [ 0.903795] ima: No architecture policies found worker2 # [ 0.896505] 9pnet: Installing 9P2000 support client # [ 0.907895] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.898546] Key type dns_resolver registered lb # [ 0.904510] Demotion targets for Node 0: null lb # [ 0.904615] Key type .fscrypt registered lb # [ 0.904622] Key type fscrypt-provisioning registered lb # [ 0.904710] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.904729] ima: Allocated hash algorithm: sha1 lb # [ 0.904748] ima: No architecture policies found worker2 # [ 0.905168] registered taskstats version 1 worker2 # [ 0.905319] Loading compiled-in X.509 certificates lb # [ 0.908949] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.913735] Demotion targets for Node 0: null worker2 # [ 0.913839] Key type .fscrypt registered worker2 # [ 0.913846] Key type fscrypt-provisioning registered worker2 # [ 0.913939] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.913958] ima: Allocated hash algorithm: sha1 worker2 # [ 0.913978] ima: No architecture policies found worker2 # [ 0.918034] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.925139] clk: Disabling unused clocks client # [ 0.925162] PM: genpd: Disabling unused power domains client # [ 0.929360] Freeing unused kernel memory: 4736K client # [ 0.929557] Run /init as init process lb # [ 0.926232] clk: Disabling unused clocks lb # [ 0.926260] PM: genpd: Disabling unused power domains lb # [ 0.930446] Freeing unused kernel memory: 4736K lb # [ 0.930652] Run /init as init process worker2 # [ 0.935889] clk: Disabling unused clocks worker2 # [ 0.935912] PM: genpd: Disabling unused power domains client # [ 0.946931] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 0.940150] Freeing unused kernel memory: 4736K worker2 # [ 0.940343] Run /init as init process lb # [ 0.947448] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 0.957817] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.139663] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.108865] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.119710] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.125333] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.292168] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.298003] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.310270] systemd[1]: Detected virtualization qemu. worker1 # [ 1.312403] systemd[1]: Detected architecture arm64. worker1 # [ 1.314294] systemd[1]: Running in initrd. worker1 # [ 1.316865] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.319709] systemd[1]: Hostname set to . client # [ 1.263041] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.271962] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.277535] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.281688] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.293611] systemd[1]: Detected virtualization qemu. client # [ 1.295572] systemd[1]: Detected architecture arm64. client # [ 1.297515] systemd[1]: Running in initrd. client # [ 1.300020] systemd[1]: Initializing machine ID from random generator. lb # [ 1.283445] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.302926] systemd[1]: Hostname set to . lb # [ 1.295594] systemd[1]: Detected virtualization qemu. lb # [ 1.297650] systemd[1]: Detected architecture arm64. lb # [ 1.299566] systemd[1]: Running in initrd. worker2 # [ 1.292612] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.300514] systemd[1]: Initializing machine ID from random generator. lb # [ 1.300816] systemd[1]: Hostname set to . worker2 # [ 1.304794] systemd[1]: Detected virtualization qemu. worker2 # [ 1.306819] systemd[1]: Detected architecture arm64. worker2 # [ 1.308786] systemd[1]: Running in initrd. worker1 # [ 1.383838] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.311283] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.314229] systemd[1]: Hostname set to . client # [ 1.353065] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.359909] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.361547] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.503642] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.476836] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.481332] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.483724] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.615319] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.662740] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.667805] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.606478] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.610437] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.612653] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.641391] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.645974] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.641713] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.644206] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.726460] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.649543] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.649198] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker1 # [ 1.738292] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.739666] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.739712] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.739742] systemd[1]: Reached target Path Units. worker1 # [ 1.739762] systemd[1]: Reached target Slice Units. worker1 # [ 1.739783] systemd[1]: Reached target Swaps. worker1 # [ 1.739806] systemd[1]: Reached target Timer Units. worker1 # [ 1.740024] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.740195] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.740365] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.740512] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.740653] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.740678] systemd[1]: Reached target Socket Units. worker1 # [ 1.754537] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.763803] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.765123] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.771786] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.782124] systemd[1]: Starting Journal Service... client # [ 1.723437] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.735241] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.727303] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.802321] systemd[1]: Starting Load Kernel Modules... client # [ 1.736466] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.802420] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.737945] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.739105] systemd[1]: Reached target Path Units. worker2 # [ 1.731162] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.739956] systemd[1]: Reached target Slice Units. client # [ 1.740883] systemd[1]: Reached target Swaps. client # [ 1.741654] systemd[1]: Reached target Timer Units. client # [ 1.742688] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.735430] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.743954] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.736521] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.745185] systemd[1]: Listening on Journal Sockets. lb # [ 1.737867] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.746219] systemd[1]: Listening on udev Control Socket. lb # [ 1.738930] systemd[1]: Reached target Path Units. client # [ 1.747289] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.739746] systemd[1]: Reached target Slice Units. client # [ 1.748240] systemd[1]: Reached target Socket Units. lb # [ 1.740585] systemd[1]: Reached target Swaps. lb # [ 1.741377] systemd[1]: Reached target Timer Units. lb # [ 1.742384] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.742134] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.743617] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.743386] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.750773] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.744750] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.744878] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.745986] systemd[1]: Reached target Path Units. lb # [ 1.745816] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.746834] systemd[1]: Reached target Slice Units. lb # [ 1.745937] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.747765] systemd[1]: Reached target Swaps. lb # [ 1.745960] systemd[1]: Reached target Socket Units. worker2 # [ 1.748575] systemd[1]: Reached target Timer Units. lb # [ 1.750059] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.749714] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.750995] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.752205] systemd[1]: Listening on Journal Sockets. client # [ 1.760974] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.752360] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.752495] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.831242] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.761062] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.752522] systemd[1]: Reached target Socket Units. worker2 # [ 1.757687] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.765684] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.760301] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.761598] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.764740] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.839773] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.765916] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.777448] systemd[1]: Starting Journal Service... worker1 # [ 1.843712] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.844531] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.844839] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.775824] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.774740] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.785271] systemd[1]: Starting Journal Service... worker1 # [ 1.860407] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.862183] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.797492] systemd[1]: Starting Journal Service... client # [ 1.808565] systemd[1]: Starting Load Kernel Modules... lb # [ 1.801468] systemd[1]: Starting Load Kernel Modules... client # [ 1.808697] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.802375] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.871151] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.871390] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.871400] [drm] features: -context_init lb # [ 1.806449] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.882347] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.882897] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.817587] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.819291] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.894713] [drm] number of scanouts: 1 worker1 # [ 1.894741] [drm] number of cap sets: 0 client # [ 1.828681] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.819816] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.819921] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.836988] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.896284] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.896298] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.833505] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.833558] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.835445] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.909905] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.836562] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.915961] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.849020] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.849915] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.850200] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.845305] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.846119] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.846397] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.846614] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.851641] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.857443] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.857975] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.928456] Console: switching to colour frame buffer device 160x50 worker1 # [ 1.935023] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 1.872994] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.874413] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.866320] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker2 # [ 1.866555] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.866563] [drm] features: -context_init worker2 # [ 1.867248] [drm] number of scanouts: 1 worker2 # [ 1.867264] [drm] number of cap sets: 0 lb # [ 1.870530] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.880137] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.874784] systemd-journald[73]: Collecting audit messages is disabled. lb # [ 1.885847] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.879956] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 1.879974] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 client # [ 1.895957] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.889357] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.963760] systemd[1]: Finished Load Kernel Modules. lb # [ 1.891522] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.966738] systemd[1]: Starting Apply Kernel Variables... client # [ 1.901489] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.896988] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 1.897222] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 1.897232] [drm] features: -context_init client # [ 1.908558] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.909891] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.910575] [drm] number of scanouts: 1 worker1 # [ 1.983731] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.910605] [drm] number of cap sets: 0 worker2 # [ 1.904003] Console: switching to colour frame buffer device 160x50 worker1 # [ 1.984117] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.984151] systemd[1]: Reached target Local File Systems. client # [ 1.921198] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.988805] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.921214] [drm] features: -context_init client # [ 1.921947] [drm] number of scanouts: 1 client # [ 1.921966] [drm] number of cap sets: 0 lb # [ 1.913410] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 1.913427] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.911498] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.929185] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.929202] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.928295] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.930768] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.935685] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 2.015105] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.948526] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.024850] systemd[1]: Started Journal Service. lb # [ 1.945715] Console: switching to colour frame buffer device 160x50 worker2 # [ 1.953131] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.953989] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 2.015210] systemd-modules-load[75]: Inserted module 'dm_mod' client # [ 1.957147] Console: switching to colour frame buffer device 160x50 lb # [ 1.954159] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.954183] systemd[1]: Reached target Local File Systems. worker1 # [ 2.016567] systemd-modules-load[75]: Module 'virtio_balloon' is built in worker1 # [ 2.017633] systemd-modules-load[75]: Module 'virtio_console' is built in worker1 # [ 2.018664] systemd-modules-load[75]: Inserted module 'virtio_gpu' worker1 # [ 2.019636] systemd-modules-load[75]: Module 'virtio_rng' is built in client # [ 1.973474] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.973646] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.973670] systemd[1]: Reached target Local File Systems. lb # [ 1.965711] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.977545] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 2.032378] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.972237] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.972462] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.972498] systemd[1]: Reached target Local File Systems. lb # [ 1.977879] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.980015] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.989427] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 1.994656] systemd[1]: Finished Load Kernel Modules. client # [ 2.009099] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.064602] systemd[1]: Finished Create System Files and Directories. client # [ 2.012097] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.068700] systemd-udevd[81]: Using default interface naming scheme 'v261'. lb # [ 2.006525] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.015959] systemd[1]: Finished Apply Kernel Variables. client # [ 2.031022] systemd-modules-load[75]: Inserted module 'dm_mod' worker1 # [ 2.095941] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.032160] systemd-modules-load[75]: Module 'virtio_balloon' is built in client # [ 2.033238] systemd-modules-load[75]: Module 'virtio_console' is built in client # [ 2.034293] systemd-modules-load[75]: Inserted module 'virtio_gpu' client # [ 2.035254] systemd-modules-load[75]: Module 'virtio_rng' is built in client # [ 2.052989] systemd[1]: Started Journal Service. client # [ 2.053249] systemd[1]: Starting Create System Files and Directories... lb # [ 2.062039] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.061152] systemd[1]: Started Journal Service. lb # [ 2.051080] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.065460] systemd[1]: Started Journal Service. lb # [ 2.055249] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker2 # [ 2.060247] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.068102] systemd[1]: Finished Apply Kernel Variables. lb # [ 2.061177] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.062223] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker2 # [ 2.064203] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.063310] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.065330] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.072409] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker2 # [ 2.066392] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker2 # [ 2.067536] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.072627] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 2.073721] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.152795] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.085422] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.087999] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker2 # [ 2.098652] systemd[1]: Finished Create System Files and Directories. client # [ 2.108700] systemd[1]: Finished Create System Files and Directories. client # [ 2.109688] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.110828] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.113412] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.116750] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.200443] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.203774] systemd[1]: Finished Virtual Console Setup. client # [ 2.160920] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.172131] systemd[1]: Starting Virtual Console Setup... lb # [ 2.172175] systemd[1]: Starting Virtual Console Setup... client # [ 2.220462] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.223658] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.220419] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.220531] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.223866] systemd[1]: Finished Virtual Console Setup. lb # [ 2.223823] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.814616] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.820734] systemd[1]: Reached target System Initialization. worker1 # [ 2.822116] systemd[1]: Reached target Basic System. worker2 # [ 2.808783] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.810587] systemd[1]: Reached target System Initialization. worker2 # [ 2.816988] systemd[1]: Reached target Basic System. client # [ 2.830379] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.831300] systemd[1]: Reached target System Initialization. client # [ 2.832161] systemd[1]: Reached target Basic System. lb # [ 2.831927] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.836073] systemd[1]: Reached target System Initialization. lb # [ 2.837262] systemd[1]: Reached target Basic System. worker1 # [ 2.960445] (udev-worker)[107]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.972566] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.993481] (udev-worker)[107]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.956385] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.963194] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.974182] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.979822] (udev-worker)[105]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 2.990193] (udev-worker)[99]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.056627] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.994507] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.060511] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.063343] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.007876] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.016877] (udev-worker)[105]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.019848] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.110451] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.118523] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.124304] systemd[1]: Mounting /sysroot... worker2 # [ 3.059977] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.072573] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.066853] systemd[1]: Reached target Initrd Root Device. client # [ 3.074543] systemd[1]: Reached target Initrd Root Device. client # [ 3.077598] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.073106] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.081841] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.172080] EXT4-fs (vda): mounted filesystem d8132a6a-ae54-4b63-b1bd-4145e3baa661 r/w with ordered data mode. Quota mode: none. lb # [ 3.087660] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.161850] systemd[1]: Mounted /sysroot. worker1 # [ 3.164892] systemd[1]: Reached target Initrd Root File System. lb # [ 3.092528] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.168307] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.119664] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.195098] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.131122] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.128146] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.136283] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.202766] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 3.132439] systemd[1]: Mounting /sysroot... worker1 # [ 3.204465] systemd[1]: Reloading... client # [ 3.149735] systemd[1]: Mounting /sysroot... lb # [ 3.143382] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.151001] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.152775] systemd[1]: Mounting /sysroot... worker2 # [ 3.178527] EXT4-fs (vda): mounted filesystem 5eaeb1a5-07ac-4e59-a660-4d29c727ebf8 r/w with ordered data mode. Quota mode: none. client # [ 3.189428] EXT4-fs (vda): mounted filesystem 9ef88811-bc5e-4f00-b803-60ab8875d700 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.173598] systemd[1]: Mounted /sysroot. client # [ 3.183401] systemd[1]: Mounted /sysroot. worker2 # [ 3.176674] systemd[1]: Reached target Initrd Root File System. client # [ 3.186431] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.181150] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.188825] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.200070] EXT4-fs (vda): mounted filesystem 52ff3af8-ca46-4cf7-9f9b-4fa114b7037a r/w with ordered data mode. Quota mode: none. lb # [ 3.195014] systemd[1]: Mounted /sysroot. lb # [ 3.196093] systemd[1]: Reached target Initrd Root File System. lb # [ 3.199410] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.207392] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.217462] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.215377] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.223681] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.226610] systemd[1]: Reloading... worker2 # [ 3.220084] systemd[1]: Reloading... lb # [ 3.223404] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.228712] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.232755] systemd[1]: Reloading... worker1 # [ 3.411280] systemd[1]: Reloading finished in 209 ms. worker1 # [ 3.441802] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.447739] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.451844] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.459894] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.462037] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.464304] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.484848] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.486288] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.431873] systemd[1]: Reloading finished in 205 ms. worker2 # [ 3.425849] systemd[1]: Reloading finished in 211 ms. lb # [ 3.440132] systemd[1]: Reloading finished in 205 ms. client # [ 3.465761] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.460671] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.465266] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... client # [ 3.472850] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.475627] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.469729] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.472105] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.473516] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.484373] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.476740] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.479485] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.487709] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.482526] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.483530] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.492270] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.484614] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.486767] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.487904] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.510111] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.511717] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.506570] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 3.508158] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.508739] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.510130] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.828435] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.839320] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.852697] systemd[1]: Mounting /sysroot/run... lb # [ 3.798817] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.874809] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.810064] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.818007] systemd[1]: Mounting /sysroot/run... client # [ 3.836257] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.903333] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.841161] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.834766] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.836384] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.850405] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.920762] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.849756] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.862168] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.854727] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.930306] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.867688] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.863345] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.949013] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.956645] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.890693] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.963195] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.970295] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.903864] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.911675] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.912640] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.913989] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.991351] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.993000] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.927434] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.931252] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.942711] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.936923] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.944841] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.947350] systemd[1]: Mounted /sysroot/run. lb # [ 3.939511] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.943843] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.948165] systemd[1]: Mounted /sysroot/run. client # [ 3.955632] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.958214] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.966909] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.958904] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.959993] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.966958] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.975996] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.991140] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.992331] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.985793] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.999338] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.002023] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.007692] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.041675] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.043642] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.048264] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.055510] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.089254] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.106845] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.110844] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.113289] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.143155] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.146282] systemd[1]: Stopped target Basic System. worker2 # [ 4.148766] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.150599] systemd[1]: Stopped target Path Units. worker2 # [ 4.154626] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.156578] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 4.160127] systemd[1]: Stopped target Slice Units. worker2 # [ 4.164511] systemd[1]: Stopped target Socket Units. worker2 # [ 4.166336] systemd[1]: Stopped target System Initialization. worker2 # [ 4.168123] systemd[1]: Stopped target Swaps. worker2 # [ 4.172708] systemd[1]: Stopped target Timer Units. worker2 # [ 4.173493] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.175300] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.176891] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 4.181484] systemd[1]: Stopped Find NixOS closure. worker2 # [ 4.183461] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 4.185979] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.190084] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.201038] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 4.204167] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.209285] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 4.211274] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.217497] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.218643] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 4.219645] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.228782] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.229599] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.230539] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 4.232387] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.234588] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 4.235666] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.236878] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.237617] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.238537] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.239441] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 4.244625] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 4.246326] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.250710] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.251595] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.253053] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.254061] systemd[1]: systemd-udevd.service: Consumed 1.129s CPU time over 2.274s wall clock time, 18.5M memory peak. worker2 # [ 4.255463] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.256629] systemd[1]: Closed udev Control Socket. worker2 # [ 4.257346] systemd[1]: Starting Cleanup udev Database... worker2 # [ 4.258106] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.259155] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 4.263531] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.268221] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.269481] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 4.270465] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.354586] (udev-worker)[94]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker2 # [ 4.297312] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 4.360229] (udev-worker)[94]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.300523] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.301350] systemd[1]: Reached target Switch Root. worker2 # [ 4.304483] systemd[1]: Starting NixOS Activation... worker1 # [ 4.379845] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.381128] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.384163] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.385595] systemd[1]: Starting Virtual Console Setup... client # [ 4.325796] (udev-worker)[95]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.394306] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.395750] systemd[1]: Stopped Virtual Console Setup. client # [ 4.331694] (udev-worker)[95]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.401069] systemd[1]: Starting Virtual Console Setup... lb # [ 4.332643] (udev-worker)[93]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.340982] (udev-worker)[93]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.358632] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.363764] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.428824] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.366115] systemd[1]: Stopping Virtual Console Setup... client # [ 4.366888] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.432164] systemd[1]: Finished Virtual Console Setup. lb # [ 4.364390] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.365477] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.368116] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.369814] systemd[1]: Starting Virtual Console Setup... client # [ 4.380383] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.382186] systemd[1]: Stopped Virtual Console Setup. client # [ 4.386174] systemd[1]: Starting Virtual Console Setup... lb # [ 4.382506] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.385770] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.386874] systemd[1]: Starting Virtual Console Setup... client # [ 4.412397] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.415621] systemd[1]: Finished Virtual Console Setup. lb # [ 4.407715] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.411270] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.463217] initrd-nixos-activation-start[173]: booting system configuration /nix/store/wykyb0qy7gxax0kbx52lhrandvn5hhwl-nixos-system-worker2-test worker2 # [ 4.526432] initrd-nixos-activation-start[173]: running activation script... worker1 # [ 4.831986] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.801320] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.893591] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.831958] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.899335] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.902466] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.916416] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.865553] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.868882] systemd[1]: Reached target Initrd File Systems. lb # [ 4.873300] systemd[1]: Starting Find NixOS closure... lb # [ 4.881272] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.895797] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.960257] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.900388] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.967590] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.906560] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.980227] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.982413] systemd[1]: Reached target Initrd Default Target. client # [ 4.916888] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.988430] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.928168] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.930633] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.941373] initrd-nixos-activation-start[196]: setting up /etc... worker1 # [ 5.014240] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.016205] systemd[1]: Stopped target Basic System. worker1 # [ 5.020559] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.947934] systemd[1]: Finished Find NixOS closure. worker1 # [ 5.021754] systemd[1]: Stopped target Path Units. client # [ 4.958734] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.024126] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.951339] systemd[1]: Reached target Initrd Default Target. worker1 # [ 5.026156] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.962243] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 4.956428] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 5.032161] systemd[1]: Stopped target Slice Units. worker1 # [ 5.033206] systemd[1]: Stopped target Socket Units. worker1 # [ 5.034115] systemd[1]: Stopped target System Initialization. worker1 # [ 5.036165] systemd[1]: Stopped target Swaps. worker1 # [ 5.037404] systemd[1]: Stopped target Timer Units. worker1 # [ 5.039303] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.042058] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 4.978113] systemd[1]: Finished Find NixOS closure. worker1 # [ 5.044127] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.980269] systemd[1]: Reached target Initrd Default Target. worker1 # [ 5.048213] systemd[1]: Stopped Find NixOS closure. client # [ 4.983246] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 5.052538] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 5.056248] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.064778] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.066790] systemd[1]: Stopped Apply Kernel Variables. lb # [ 4.994426] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.000651] systemd[1]: Stopped target Basic System. lb # [ 5.001874] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.003086] systemd[1]: Stopped target Path Units. worker1 # [ 5.075881] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 5.006192] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 5.008158] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.018479] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.084478] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.011610] systemd[1]: Stopped target Slice Units. client # [ 5.020526] systemd[1]: Stopped target Basic System. worker1 # [ 5.085331] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.086526] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.087709] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.024444] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.016254] systemd[1]: Stopped target Socket Units. client # [ 5.025583] systemd[1]: Stopped target Path Units. lb # [ 5.017247] systemd[1]: Stopped target System Initialization. lb # [ 5.018346] systemd[1]: Stopped target Swaps. lb # [ 5.019170] systemd[1]: Stopped target Timer Units. client # [ 5.028127] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.030796] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 5.024167] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 5.025238] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.034399] systemd[1]: Stopped target Slice Units. lb # [ 5.026276] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.035341] systemd[1]: Stopped target Socket Units. worker1 # [ 5.100355] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.028725] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.102346] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.104540] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.040252] systemd[1]: Stopped target System Initialization. lb # [ 5.032168] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.041206] systemd[1]: Stopped target Swaps. lb # [ 5.033231] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.041992] systemd[1]: Stopped target Timer Units. client # [ 5.042806] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.107634] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.035189] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.043719] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.110297] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.037799] systemd[1]: Stopped Apply Kernel Variables. lb # [ 5.039912] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.048291] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.049527] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.111450] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.050750] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.043604] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.116493] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.117569] systemd[1]: Stopped Virtual Console Setup. client # [ 5.053215] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.118316] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.119247] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.057080] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.059468] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.124331] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 5.125399] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.126450] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.127403] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.063183] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 5.057313] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 5.058471] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.130963] systemd[1]: systemd-udevd.service: Consumed 1.415s CPU time over 3.132s wall clock time, 25.4M memory peak. worker1 # [ 5.132662] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.059784] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.133729] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.134582] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.135617] systemd[1]: Closed udev Control Socket. worker1 # [ 5.140374] systemd[1]: Starting Cleanup udev Database... client # [ 5.076360] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.141249] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.077154] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.078422] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.143317] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.079620] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.148427] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.076167] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.149586] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 5.077190] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.150594] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 5.077965] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.151558] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.078903] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.079912] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.088230] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.097161] systemd[1]: Stopped Create System Files and Directories. client # [ 5.098095] systemd[1]: Stopped target Local File Systems. client # [ 5.098887] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 5.090668] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.099841] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.095261] systemd[1]: Stopped Virtual Console Setup. client # [ 5.104830] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.096683] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.097662] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 5.098568] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.106909] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.111018] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 5.104195] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 5.105123] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.106122] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.106929] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.116402] systemd[1]: Stopped Virtual Console Setup. client # [ 5.117195] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.109068] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.118136] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.119056] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.110682] systemd[1]: systemd-udevd.service: Consumed 1.388s CPU time over 3.135s wall clock time, 22.5M memory peak. lb # [ 5.112415] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.121433] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 5.113409] systemd[1]: Closed udev Control Socket. lb # [ 5.114121] systemd[1]: Starting Cleanup udev Database... lb # [ 5.114881] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.187679] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.123642] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.115946] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.116956] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.118076] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.191533] systemd[1]: Finished Cleanup udev Database. lb # [ 5.119049] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.192714] systemd[1]: Reached target Switch Root. client # [ 5.128286] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.129156] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 5.130072] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.131063] systemd[1]: systemd-udevd.service: Consumed 1.384s CPU time over 3.148s wall clock time, 22.3M memory peak. worker1 # [ 5.196347] systemd[1]: Starting NixOS Activation... lb # [ 5.124160] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 5.133840] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.134878] systemd[1]: Closed udev Control Socket. client # [ 5.135596] systemd[1]: Starting Cleanup udev Database... client # [ 5.136600] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.137657] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.138543] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.139683] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.144208] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.145260] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.165447] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.168198] systemd[1]: Finished Cleanup udev Database. lb # [ 5.169966] systemd[1]: Reached target Switch Root. lb # [ 5.172176] systemd[1]: Starting NixOS Activation... client # [ 5.187849] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.192417] systemd[1]: Finished Cleanup udev Database. client # [ 5.193200] systemd[1]: Reached target Switch Root. client # [ 5.193909] systemd[1]: Starting NixOS Activation... worker2 # [ 5.241259] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.244211] systemd[1]: Finished NixOS Activation. worker2 # [ 5.245986] systemd[1]: Starting Switch Root... worker2 # [ 5.273781] systemd[1]: Switching root. worker1 # [ 5.377973] initrd-nixos-activation-start[180]: booting system configuration /nix/store/85sl11dh0zky10jc8x3p4y9xadvl89kj-nixos-system-worker1-test lb # [ 5.362094] initrd-nixos-activation-start[180]: booting system configuration /nix/store/f4b0lk4znyrmdfpm6f1kvcry9mqdiq05-nixos-system-lb-test client # [ 5.373085] initrd-nixos-activation-start[181]: booting system configuration /nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test worker1 # [ 5.450470] initrd-nixos-activation-start[180]: running activation script... lb # [ 5.436237] initrd-nixos-activation-start[180]: running activation script... client # [ 5.446485] initrd-nixos-activation-start[181]: running activation script... worker2 # [ 5.462874] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 5.949854] initrd-nixos-activation-start[203]: setting up /etc... client # [ 5.932748] initrd-nixos-activation-start[204]: setting up /etc... lb # [ 5.943551] initrd-nixos-activation-start[203]: setting up /etc... worker2 # [ 6.115311] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.129047] systemd[1]: Detected virtualization qemu. worker2 # [ 6.132429] systemd[1]: Detected architecture arm64. worker2 # [ 6.135924] systemd[1]: Detected first boot. worker2 # [ 6.146264] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.260898] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.264302] systemd[1]: Finished NixOS Activation. worker1 # [ 6.265845] systemd[1]: Starting Switch Root... worker1 # [ 6.295841] systemd[1]: Switching root. client # [ 6.236806] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.240114] systemd[1]: Finished NixOS Activation. client # [ 6.241371] systemd[1]: Starting Switch Root... lb # [ 6.257613] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.267199] systemd[1]: Switching root. lb # [ 6.261262] systemd[1]: Finished NixOS Activation. lb # [ 6.262482] systemd[1]: Starting Switch Root... lb # [ 6.290337] systemd[1]: Switching root. worker1 # [ 6.493743] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 6.461700] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.488882] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 6.512394] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.739716] systemd[1]: Applying preset policy. worker1 # [ 7.153707] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 7.166199] systemd[1]: Detected virtualization qemu. worker1 # [ 7.170080] systemd[1]: Detected architecture arm64. worker1 # [ 7.172510] systemd[1]: Detected first boot. worker1 # [ 7.181139] systemd[1]: Initializing machine ID from random generator. client # [ 7.105778] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 7.119355] systemd[1]: Detected virtualization qemu. client # [ 7.122666] systemd[1]: Detected architecture arm64. client # [ 7.126114] systemd[1]: Detected first boot. client # [ 7.135136] systemd[1]: Initializing machine ID from random generator. lb # [ 7.125202] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 7.139116] systemd[1]: Detected virtualization qemu. lb # [ 7.141465] systemd[1]: Detected architecture arm64. lb # [ 7.145189] systemd[1]: Detected first boot. lb # [ 7.153880] systemd[1]: Initializing machine ID from random generator. worker2 # [ 7.312403] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.560740] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.515770] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 7.530973] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 7.784037] systemd[1]: Applying preset policy. client # [ 7.732185] systemd[1]: Applying preset policy. lb # [ 7.742878] systemd[1]: Applying preset policy. worker2 # [ 7.917298] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.920803] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 7.924399] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 7.928805] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.931063] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.932834] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.933347] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.933718] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 7.934067] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.934429] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.934778] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.935086] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.935385] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.942161] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.944418] systemd[1]: Reached target Path Units. worker2 # [ 7.946229] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.948177] systemd[1]: Reached target Slice Units. worker2 # [ 7.949922] systemd[1]: Reached target Swaps. worker2 # [ 7.954377] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.960029] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.964684] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.969089] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.971192] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.977634] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 7.980854] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.985520] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.988017] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.990572] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.993219] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.005739] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 8.008099] systemd[1]: Listening on udev Control Socket. worker2 # [ 8.009305] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 8.014004] systemd[1]: Mounting Huge Pages File System... worker2 # [ 8.019344] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 8.026709] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 8.039879] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 8.053693] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 8.070668] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 8.071107] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.089528] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 8.092406] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 8.096981] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.109772] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 8.113849] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.181451] systemd[1]: Starting Journal Service... worker2 # [ 8.194815] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.223515] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.238432] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.316717] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 8.241325] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.259443] systemd[1]: Starting Coldplug All udev Devices... client # [ 8.274071] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 8.265846] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 8.266320] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.266740] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 8.267131] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.267510] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 8.276213] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.297663] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 8.304474] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 8.311531] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 8.371897] EXT4-fs (vda): re-mounted 5eaeb1a5-07ac-4e59-a660-4d29c727ebf8. worker2 # [ 8.377750] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 8.381721] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 8.386862] systemd[1]: Finished Load Kernel Modules. worker2 # [ 8.397094] systemd[1]: Starting Firewall... worker2 # [ 8.404517] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.408296] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.408884] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.409192] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.417333] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 8.419887] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.447315] fuse: init (API version 7.45) worker2 # [ 8.457207] systemd-journald[268]: Collecting audit messages is enabled. worker2 # [ 8.482736] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.495491] systemd[1]: Started Journal Service. worker2 # [ 8.495128] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.510074] systemd-modules-load[269]: Module 'atkbd' is built in worker2 # [ 8.515398] systemd-modules-load[269]: Module 'loop' is built in worker2 # [ 8.527514] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 8.537502] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 8.548105] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 8.553019] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 8.563272] systemd[1]: Reached target First Boot Complete. worker2 # [ 8.588233] systemd-oomd[270]: No swap; memory pressure usage will be degraded worker2 # [ 8.593458] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 8.599854] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.609554] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 8.613636] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 8.629576] systemd-journald[268]: Received client request to flush runtime journal. worker2 # [ 8.691836] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.816890] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 8.818282] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.821719] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.738815] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 8.739845] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 8.825968] systemd[1]: Created slice Slice /system/getty. worker1 # [ 8.829565] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.831663] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 8.833900] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 8.742964] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.836153] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 8.837892] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.839704] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 8.841563] systemd[1]: Stopped target initrd-fs.target. client # [ 8.775506] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 8.843330] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.777028] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.845204] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 8.847072] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.779886] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 8.849170] systemd[1]: Reached target Path Units. client # [ 8.783850] systemd[1]: Created slice Slice /system/getty. worker1 # [ 8.851031] systemd[1]: Reached target Remote File Systems. worker1 # [ 8.852931] systemd[1]: Reached target Slice Units. client # [ 8.786468] systemd[1]: Created slice User and Session Slice. worker1 # [ 8.854639] systemd[1]: Reached target Swaps. client # [ 8.788928] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.791346] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.858795] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.793581] systemd[1]: Expecting device /dev/hvc0... client # [ 8.795339] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.864778] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.797204] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.799069] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 8.868707] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.800980] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.802855] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 8.872576] systemd[1]: Listening on Factory Reset Management. client # [ 8.804716] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.873872] systemd[1]: Listening on Hostname Service Socket. client # [ 8.806652] systemd[1]: Reached target Path Units. client # [ 8.808323] systemd[1]: Reached target Remote File Systems. client # [ 8.810203] systemd[1]: Reached target Slice Units. worker1 # [ 8.879485] systemd[1]: Starting Journal Log Access Socket... client # [ 8.811846] systemd[1]: Reached target Swaps. worker1 # [ 8.881897] systemd[1]: Listening on Journal Audit Socket. client # [ 8.815917] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 8.885896] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 8.887528] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.820768] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 8.889705] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.824574] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 8.892334] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.821205] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.828404] systemd[1]: Listening on Factory Reset Management. client # [ 8.830395] systemd[1]: Listening on Hostname Service Socket. lb # [ 8.822853] systemd[1]: Stopped initrd-switch-root.service. lb # [ 8.824660] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.835692] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 8.903701] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.829190] systemd[1]: Created slice Slice /system/getty. client # [ 8.838503] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.905824] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.907820] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.832516] systemd[1]: Created slice User and Session Slice. client # [ 8.842668] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.834712] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 8.836918] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.845073] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 8.912761] systemd[1]: Mounting Huge Pages File System... lb # [ 8.838968] systemd[1]: Expecting device /dev/hvc0... client # [ 8.847433] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.840680] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.849836] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.842530] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 8.844340] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 8.920282] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 8.846162] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.847926] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 8.849837] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 8.851711] systemd[1]: Reached target Path Units. client # [ 8.860607] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.853439] systemd[1]: Reached target Remote File Systems. client # [ 8.861980] systemd[1]: Listening on udev Control Socket. client # [ 8.863419] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.855193] systemd[1]: Reached target Slice Units. worker1 # [ 8.928788] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.856867] systemd[1]: Reached target Swaps. client # [ 8.867571] systemd[1]: Mounting Huge Pages File System... lb # [ 8.860932] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.872629] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 8.865739] systemd[1]: Listening on Process Core Dump Socket. lb # [ 8.869589] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.879696] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 8.942546] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.873490] systemd[1]: Listening on Factory Reset Management. lb # [ 8.875411] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.954986] systemd[1]: Starting Create List of Static Device Nodes... client # [ 8.888672] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.880661] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.883484] systemd[1]: Listening on Journal Audit Socket. lb # [ 8.888366] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.888967] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 8.891095] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.967506] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.893334] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.903013] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 8.972962] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.904862] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 8.913196] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.906326] systemd[1]: Listening on udev Control Socket. client # [ 8.915101] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.983051] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.908529] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 8.986180] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 8.913242] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.990532] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 8.918327] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.927406] systemd[1]: Mounting Kernel Configuration File System... client # [ 8.929440] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 8.910445] systemd[1]: Mounting /run/wrappers... lb # [ 8.923843] systemd[1]: Mounting Kernel Debug File System... client # [ 8.931369] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.916198] systemd[1]: Mounting FUSE Control File System... lb # [ 8.933365] systemd[1]: Mounting Kernel Trace File System... client # [ 8.946012] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.949295] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 8.945742] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 9.020429] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 9.020867] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 8.958750] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 9.034892] systemd[1]: Starting Journal Service... lb # [ 8.960332] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.964105] systemd[1]: Mounted FUSE Control File System. lb # [ 8.976809] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.979682] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 8.983780] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 8.981764] systemd-udevd[304]: Using default interface naming scheme 'v261'. client # [ 9.002132] systemd[1]: Starting Journal Service... lb # [ 9.000860] systemd[1]: Starting Load Kernel Module fuse... lb # [ 9.003021] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 8.993655] systemd[1]: Mounted /run/wrappers. worker2 # [ 8.995394] systemd[1]: Reached target Local File Systems. worker1 # [ 9.085566] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.999412] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 9.006622] systemd[1]: Starting register-nix-paths.service... worker2 # [ 9.009410] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 9.104965] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 9.043955] systemd[1]: Starting Load Kernel Modules... worker2 # [ 9.024666] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 9.048993] systemd[1]: Starting Journal Service... worker1 # [ 9.128219] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 9.039429] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.130533] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 9.064222] fuse: init (API version 7.45) worker2 # [ 9.047626] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.141135] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 9.146154] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 9.150568] systemd[1]: Mounted Huge Pages File System. lb # [ 9.081520] systemd[1]: Starting Load Kernel Modules... worker1 # [ 9.155792] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 9.156316] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 9.156732] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 9.157123] systemd[1]: Mounted Kernel Configuration File System. client # [ 9.100674] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 9.116680] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 9.119349] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 9.114321] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 9.199734] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 9.209178] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 9.133445] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 9.133812] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 9.146898] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 9.129387] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.153557] systemd-journald[275]: Collecting audit messages is enabled. worker2 # [ 9.137906] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 9.152063] systemd[1]: Starting Coldplug All udev Devices... client # [ 9.153696] systemd[1]: Queued start job for default target Multi-User System. client # [ 9.170594] systemd[1]: Started Journal Service. client # [ 9.160357] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 9.167636] systemd-journald[274]: Collecting audit messages is enabled. client # [ 9.165350] systemd-modules-load[276]: Module 'atkbd' is built in client # [ 9.170259] systemd-modules-load[276]: Module 'loop' is built in client # [ 9.176520] systemd[1]: Listening on Journal Log Access Socket. client # [ 9.177491] systemd[1]: Mounted Huge Pages File System. client # [ 9.178345] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 9.170387] systemd[1]: Queued start job for default target Multi-User System. client # [ 9.179304] systemd[1]: Mounted Kernel Debug File System. lb # [ 9.187480] systemd[1]: Started Journal Service. lb # [ 9.175292] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 9.185858] systemd[1]: Mounted Kernel Trace File System. lb # [ 9.180734] systemd-modules-load[275]: Module 'atkbd' is built in lb # [ 9.181722] systemd-modules-load[275]: Module 'loop' is built in client # [ 9.191607] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 9.200661] fuse: init (API version 7.45) worker1 # [ 9.279737] EXT4-fs (vda): re-mounted d8132a6a-ae54-4b63-b1bd-4145e3baa661. client # [ 9.201332] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 9.193156] systemd[1]: Listening on Journal Log Access Socket. client # [ 9.202447] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 9.203366] systemd[1]: Mounted Kernel Configuration File System. lb # [ 9.196121] systemd[1]: Mounted Huge Pages File System. worker1 # [ 9.286707] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 9.289238] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 9.212305] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 9.291327] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 9.203280] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 9.207952] systemd[1]: Mounted Kernel Debug File System. client # [ 9.218636] systemd[1]: Finished Load Kernel Module fuse. client # [ 9.222408] systemd[1]: Finished Load Kernel Modules. lb # [ 9.211645] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 9.304044] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 9.216868] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 9.304381] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 9.221973] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 9.309768] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 9.243792] EXT4-fs (vda): re-mounted 9ef88811-bc5e-4f00-b803-60ab8875d700. worker1 # [ 9.312287] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 9.227632] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 9.233777] systemd[1]: Mounted Kernel Configuration File System. client # [ 9.243305] systemd[1]: Mounting FUSE Control File System... lb # [ 9.237673] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 9.326281] systemd[1]: Finished Load Kernel Modules. client # [ 9.248335] systemd[1]: Starting Apply Kernel Variables... lb # [ 9.241621] systemd[1]: Finished Load Kernel Module fuse. worker1 # [ 9.332902] systemd[1]: Starting Firewall... worker2 # [ 9.246466] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.336525] systemd-journald[274]: Collecting audit messages is enabled. lb # [ 9.249404] systemd[1]: Finished Load Kernel Modules. client # [ 9.263235] systemd-oomd[278]: No swap; memory pressure usage will be degraded worker2 # [ 9.258295] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.269176] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 9.273385] EXT4-fs (vda): re-mounted 52ff3af8-ca46-4cf7-9f9b-4fa114b7037a. lb # [ 9.264285] systemd[1]: Mounting FUSE Control File System... worker2 # [ 9.266756] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.354180] systemd[1]: Starting Apply Kernel Variables... client # [ 9.288220] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 9.293708] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 9.288100] systemd[1]: Starting Firewall... worker1 # [ 9.360662] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 9.377378] systemd[1]: Started Journal Service. lb # [ 9.296856] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 9.370724] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 9.306563] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 9.314149] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 9.315971] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 9.321934] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 9.316693] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 9.394134] systemd-modules-load[275]: Module 'atkbd' is built in lb # [ 9.322884] systemd-oomd[277]: No swap; memory pressure usage will be degraded client # [ 9.331244] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.400494] systemd-modules-load[275]: Module 'loop' is built in worker1 # [ 9.406814] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 9.336743] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 9.344405] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 9.445667] fuse: init (API version 7.45) worker2 # [ 9.360575] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.372669] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 9.447148] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 9.454124] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 9.384161] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.393394] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.460582] systemd-oomd[276]: No swap; memory pressure usage will be degraded lb # [ 9.390389] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 9.392340] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 9.401475] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 9.402690] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.479390] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.427288] systemd-journald[275]: Received client request to flush runtime journal. worker1 # [ 9.481334] systemd[1]: Reached target First Boot Complete. worker1 # [ 9.484344] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 9.511034] systemd-journald[274]: Received client request to flush runtime journal. lb # [ 9.457279] systemd[1]: Mounted FUSE Control File System. client # [ 9.467895] systemd[1]: Mounted FUSE Control File System. client # [ 9.473113] systemd[1]: Finished Load/Save OS Random Seed. client # [ 9.475944] systemd[1]: Reached target First Boot Complete. client # [ 9.480235] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 9.475225] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 9.475572] systemd[1]: Finished Apply Kernel Variables. client # [ 9.483482] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 9.477918] systemd[1]: Starting Update is Completed... client # [ 9.488210] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 9.496641] systemd-journald[274]: Received client request to flush runtime journal. worker1 # [ 9.558617] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 9.564923] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.567997] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.571612] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 9.544770] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 9.548903] systemd[1]: Reached target First Boot Complete. lb # [ 9.556393] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.557397] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.564832] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 9.582372] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.583410] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.585923] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 9.656455] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.657521] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 9.660781] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 9.592078] systemd[1]: Finished Update is Completed. lb # [ 9.650391] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 9.657757] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 9.660758] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.695570] systemd-udevd[307]: Using default interface naming scheme 'v261'. worker1 # [ 9.789866] systemd-udevd[311]: Using default interface naming scheme 'v261'. worker1 # [ 9.809644] systemd[1]: Mounting /run/wrappers... worker1 # [ 9.812213] systemd[1]: Mounting FUSE Control File System... client # [ 9.769664] systemd[1]: Mounting /run/wrappers... lb # [ 9.772854] systemd-udevd[315]: Using default interface naming scheme 'v261'. worker1 # [ 9.850894] systemd[1]: Mounted FUSE Control File System. worker1 # [ 9.882237] systemd[1]: Mounted /run/wrappers. lb # [ 9.812736] systemd[1]: Mounting /run/wrappers... client # [ 9.821490] systemd[1]: Mounted /run/wrappers. client # [ 9.822434] systemd[1]: Reached target Local File Systems. worker1 # [ 9.883840] systemd[1]: Reached target Local File Systems. client # [ 9.826282] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 9.889030] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.835348] systemd[1]: Starting register-nix-paths.service... worker1 # [ 9.899924] systemd[1]: Starting register-nix-paths.service... worker1 # [ 9.904399] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.839681] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.844545] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.916614] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.850898] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.926391] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.930687] systemd[1]: Starting Create System Files and Directories... lb # [ 9.873046] systemd[1]: Mounted /run/wrappers. lb # [ 9.874066] systemd[1]: Reached target Local File Systems. lb # [ 9.879071] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.888349] systemd[1]: Starting register-nix-paths.service... client # [ 9.897736] systemd[1]: Starting Create System Files and Directories... client # [ 9.900476] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.892256] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.896730] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 9.909243] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 9.938813] systemd[1]: Starting Create System Files and Directories... worker1 # [ 10.018596] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 10.023333] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.981992] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.990274] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 10.006860] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 10.021644] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 10.124572] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 10.061762] systemd[1]: Finished Create System Files and Directories. worker2 # [ 10.066344] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 10.078963] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 10.146218] systemd[1]: Finished Create System Files and Directories. client # [ 10.085308] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 10.155955] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 10.090732] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 10.168722] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 10.133084] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 10.136976] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 10.166626] systemd[1]: Finished Create System Files and Directories. client # [ 10.176613] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 10.181635] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 10.209857] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 10.225555] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 10.291261] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 10.233049] systemd[1]: Starting Update is Completed... client # [ 10.300219] systemd[1]: Finished Update is Completed. worker1 # [ 10.372933] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 10.376250] systemd[1]: Starting Update is Completed... lb # [ 10.309389] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 10.381114] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 10.462164] systemd[1]: Finished Update is Completed. lb # [ 10.395179] systemd[1]: Starting Update is Completed... lb # [ 10.483106] systemd[1]: Finished Update is Completed. worker2 # [ 10.566081] systemd[1]: Finished Firewall. client # [ 10.800302] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.802958] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 10.877305] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 10.880405] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.840947] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.892193] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 10.897029] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.911613] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.969756] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 11.140633] systemd[1]: Finished register-nix-paths.service. worker2 # [ 11.142996] systemd[1]: Reached target System Initialization. worker2 # [ 11.144934] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 11.147101] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 11.152177] systemd[1]: Reached target Timer Units. worker2 # [ 11.153708] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.162769] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 11.155719] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.162943] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 11.171072] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 11.180411] systemd[1]: Reached target Socket Units. worker2 # [ 11.188213] systemd[1]: Reached target Basic System. worker2 # [ 11.193339] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 11.198742] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.210051] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 11.207880] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.216940] systemd[1]: Started Reset console on configuration changes. worker2 # [ 11.221415] systemd[1]: Starting resolvconf update... worker2 # [ 11.229629] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.231166] systemd[1]: Finished register-nix-paths.service. worker1 # [ 11.316966] systemd[1]: Finished Firewall. worker2 # [ 11.296849] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.339428] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.344227] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.353898] nsncd[491]: Sep 21 12:33:03.975 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.365428] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.370533] systemd[1]: Starting User Login Management... worker2 # [ 11.384173] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 11.479889] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.408110] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.410450] systemd[1]: Reached target System Initialization. lb # [ 11.414246] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 11.419040] systemd[1]: Started niks3 garbage collection timer. lb # [ 11.422017] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 11.424541] systemd[1]: Reached target Timer Units. lb # [ 11.430759] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 11.431683] systemd[1]: Listening on niks3 server socket. lb # [ 11.434872] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.438406] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 11.443149] systemd[1]: Reached target Socket Units. worker2 # [ 11.445278] dbus-broker-launch[495]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.446549] systemd[1]: Reached target Basic System. lb # [ 11.452687] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.454568] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.461886] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.465517] dbus-broker-launch[495]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.552567] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 11.490895] systemd[1]: Finished register-nix-paths.service. worker2 # [ 11.471174] dbus-broker-launch[495]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 11.494935] systemd[1]: Reached target System Initialization. client # [ 11.496857] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.499085] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 11.490938] systemd[1]: Started Reset console on configuration changes. client # [ 11.503215] systemd[1]: Reached target Timer Units. client # [ 11.505713] (udev-worker)[318]: Network interface NamePolicy= disabled on kernel command line. client # [ 11.508633] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.512671] systemd[1]: Listening on Nix Daemon Socket. client # [ 11.517373] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.520205] systemd[1]: Reached target Socket Units. client # [ 11.520963] systemd[1]: Reached target Basic System. lb # [ 11.507905] systemd[1]: Starting resolvconf update... worker2 # [ 11.516107] systemd[1]: Started D-Bus System Message Bus. client # [ 11.524142] (udev-worker)[390]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 11.532536] (udev-worker)[390]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.527709] systemd-logind[506]: New seat seat0. client # [ 11.535431] systemd[1]: Started backdoor.service. client # [ 11.538236] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.541819] systemd[1]: Starting nftables firewall... worker2 # [ 11.536392] systemd[1]: Started User Login Management. worker2 # [ 11.539559] systemd[1]: Starting linger-users.service... client # [ 11.562261] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 11.554325] systemd[1]: Started rustfs.service. client # [ 11.567435] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.582814] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.588361] systemd[1]: Starting rustfs-bucket.service... worker2 # [ 11.588491] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.604905] systemd[1]: Started Reset console on configuration changes. worker2 # [ 11.604944] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 11.614861] systemd[1]: Stopping User and Group Name Lookups... lb # [ 11.616819] systemd[1]: Finished Firewall. worker2 # [ 11.624353] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.634111] systemd[1]: Starting resolvconf update... worker2 # [ 11.632733] systemd[1]: Starting Virtual Console Setup... lb # [ 11.633460] systemd[1]: Finished Post-Boot Actions. lb # [ 11.638562] nsncd[495]: Sep 21 12:33:04.285 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.642838] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.646725] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.650163] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.655864] dbus-broker-launch[495]: Ready worker2 # [ 11.662734] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.748422] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 11.682207] systemd[1]: Reached target Host and Network Name Lookups. client # connecting to host... lb # [ 11.691364] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.697712] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.700618] systemd[1]: Finished linger-users.service. client # [ 11.712091] systemd[1]: Finished Post-Boot Actions. worker1 # [ 11.778773] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 11.703270] systemd[1]: Starting D-Bus System Message Bus... lb # [ 11.709387] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 11.738630] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.744278] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.812213] systemd[1]: Finished register-nix-paths.service. worker2 # [ 11.748289] nsncd[563]: Sep 21 12:33:04.377 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.815724] systemd[1]: Reached target System Initialization. lb # [ 11.754088] systemd[1]: Starting User Login Management... client # [ 11.768622] nsncd[400]: Sep 21 12:33:04.413 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.753861] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.818616] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 11.761474] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.770543] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.761988] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 11.820409] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.784412] systemd[1]: Reached target Host and Network Name Lookups. client: connected to guest root shell worker2 # [ 11.796460] systemd[1]: Finished resolvconf update. worker1 # [ 11.824912] systemd[1]: Reached target Timer Units. client # [ 11.787917] systemd[1]: Reached target User and Group Name Lookups. client: (connecting took 12.26 seconds) worker2 # [ 11.798598] systemd[1]: Reached target Preparation for Network. worker1 # [ 11.826807] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.797400] systemd[1]: Starting D-Bus System Message Bus... client: (finished: waiting for the VM to finish booting, in 12.26 seconds) worker2 # [ 11.806058] systemd[1]: Starting DHCP Client... worker1 # [ 11.833792] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.809173] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.840657] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 11.854274] systemd-logind[506]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 11.849292] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.810803] systemd[1]: Starting User Login Management... worker1 # [ 11.858993] systemd[1]: Reached target Socket Units. client # [ 11.835846] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 11.863768] systemd[1]: Reached target Basic System. worker1 # [ 11.869294] systemd[1]: Started backdoor.service. worker1 # [ 11.881587] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 11.888894] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.897384] systemd[1]: Starting Post-Boot Actions... worker1 # [ 11.904591] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.909356] systemd[1]: Starting resolvconf update... worker1 # [ 11.921625] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 11.986441] systemd[1]: Finished Post-Boot Actions. worker1 # [ 12.038876] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # connecting to host... worker1 # [ 12.048203] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.980061] dbus-broker-launch[528]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 12.056874] nsncd[496]: Sep 21 12:33:04.680 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 12.058897] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 12.059752] systemd[1]: Starting User Login Management... lb # [ 12.004696] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 12.008598] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 12.088308] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 12.018932] dbus-broker-launch[528]: NSS returned no entry for 'systemd-timesync' lb # [ 12.028181] dbus-broker-launch[528]: Invalid user-name in /nix/store/kxmx3smba321l9v2dpmh9zahhsbc77yh-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 12.041297] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 12.048471] systemd[1]: Stopping User and Group Name Lookups... lb # [ 12.057976] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 12.073320] systemd-logind[432]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 12.074868] dhcpcd[597]: dhcpcd-10.3.2 starting lb # [ 12.068798] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 12.149797] dbus-broker-launch[500]: Looking up NSS user entry for 'systemd-timesync'... client # [ 12.083446] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 12.078479] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 12.085401] systemd-logind[540]: New seat seat0. client # [ 12.093862] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 12.090940] dhcpcd[637]: dev: loaded udev lb # [ 12.093301] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 12.103004] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 12.168485] dbus-broker-launch[500]: NSS returned no entry for 'systemd-timesync' worker2 # [ 12.098060] dhcpcd[637]: no valid interfaces found worker1 # [ 12.169565] dbus-broker-launch[500]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 12.099490] dhcpcd[637]: no valid interfaces found lb # [ 12.100260] systemd[1]: Started D-Bus System Message Bus. client # [ 12.112175] dbus-broker-launch[431]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 12.105884] systemd[1]: Started User Login Management. client # [ 12.120881] systemd[1]: Stopping User and Group Name Lookups... client # [ 12.125893] dbus-broker-launch[431]: NSS returned no entry for 'systemd-timesync' lb # [ 12.120466] systemd[1]: Starting linger-users.service... client # [ 12.133225] dbus-broker-launch[431]: Invalid user-name in /nix/store/ydh4ywywm30g15n5m6x5vfz42682s2cc-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 12.127968] systemd[1]: Finished Extra networking commands.. worker2 # [ 12.132615] systemd[1]: Reached target Network. worker2 # [ 12.136767] systemd[1]: Starting Permit User Sessions... client # [ 12.147182] systemd-logind[432]: New seat seat0. worker1 # [ 12.214256] systemd[1]: Started D-Bus System Message Bus. client # [ 12.154021] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 12.161355] systemd[1]: Started User Login Management. client # [ 12.162123] systemd[1]: nscd.service: Deactivated successfully. client # [ 12.162913] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 12.163766] systemd[1]: Starting linger-users.service... lb # [ 12.156120] dbus-broker-launch[528]: Ready client # [ 12.191818] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 12.195651] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 12.263452] systemd-logind[510]: New seat seat0. worker1 # [ 12.264578] systemd[1]: Started User Login Management. worker2 # [ 12.193165] systemd[1]: Finished Permit User Sessions. worker2 # [ 12.196243] systemd[1]: Started Getty on tty1. worker1 # [ 12.269504] systemd[1]: Starting linger-users.service... worker2 # [ 12.197996] systemd[1]: Reached target Login Prompts. client # [ 12.205521] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 12.195274] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 12.277644] dbus-broker-launch[500]: Ready worker1 # [ 12.291060] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 12.295873] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 12.302993] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 12.303935] systemd[1]: Stopping User and Group Name Lookups... lb # [ 12.236300] systemd[1]: Finished resolvconf update. worker1 # [ 12.313872] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 12.242917] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.320984] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 12.321880] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 12.322732] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 12.253893] nsncd[584]: Sep 21 12:33:04.899 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 12.259721] dbus-broker-launch[431]: Ready lb # [ 12.261921] systemd[1]: Starting DHCP Client... client # [ 12.272781] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 12.265965] systemd[1]: Starting Extra networking commands.... lb # [ 12.269909] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 12.273922] systemd[1]: linger-users.service: Deactivated successfully. client # [ 12.293829] mousedev: PS/2 mouse device common for all mice client # [ 12.283401] systemd[1]: Finished linger-users.service. lb # [ 12.281763] systemd[1]: Finished linger-users.service. client # [ 12.290938] systemd[1]: Finished resolvconf update. client # [ 12.303845] systemd[1]: Starting DHCP Client... worker2 # [ 12.296340] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 12.381153] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 12.384280] systemd[1]: Finished linger-users.service. lb # [ 12.320322] systemd[1]: Reached target Host and Network Name Lookups. client # [ 12.330036] nsncd[501]: Sep 21 12:33:04.974 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 12.324602] systemd[1]: Reached target User and Group Name Lookups. client # [ 12.338549] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 12.339485] systemd[1]: Reached target Host and Network Name Lookups. client # [ 12.344745] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 12.410546] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 12.413849] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 12.415072] nsncd[568]: Sep 21 12:33:05.052 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 12.421251] systemd[1]: Reached target User and Group Name Lookups. lb # [ 12.352339] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 12.354008] systemd-vconsole-setup[559]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 12.430173] (udev-worker)[355]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 12.360943] systemd[1]: Finished Virtual Console Setup. client # [ 12.370731] systemd-logind[432]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 12.435618] (udev-worker)[355]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.367097] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 12.366867] systemd[1]: Started backdoor.service. worker1 # [ 12.440605] (udev-worker)[374]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.370675] systemd[1]: Started backdoor.service. worker1 # [ 12.460735] systemd[1]: Finished resolvconf update. worker1 # [ 12.464985] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.469117] systemd[1]: Starting DHCP Client... worker1 # [ 12.478391] systemd[1]: Starting Extra networking commands.... worker2 # [ 12.423592] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.474789] (udev-worker)[652]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 12.494070] (udev-worker)[652]: Network interface NamePolicy= disabled on kernel command line. lb # connecting to host... worker2 # [ 12.520723] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 12.512191] (udev-worker)[658]: Network interface NamePolicy= disabled on kernel command line. worker2 # connecting to host... client # [ 12.539664] dhcpcd[530]: dhcpcd-10.3.2 starting client # [ 12.551314] dhcpcd[540]: dev: loaded udev worker2 # [ 12.555315] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.555868] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.560755] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.561094] cfg80211: failed to load regulatory.db client # [ 12.605298] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 12.683565] systemd-logind[510]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 12.702206] dhcpcd[603]: dhcpcd-10.3.2 starting lb # [ 12.639665] dhcpcd[621]: dhcpcd-10.3.2 starting worker1 # [ 12.718698] dhcpcd[642]: dev: loaded udev lb # [ 12.653662] dhcpcd[668]: dev: loaded udev worker2 # [ 12.669007] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 12.682327] systemd[1]: Finished nftables firewall. worker1 # [ 12.748428] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.675519] systemd[1]: Starting Address configuration of eth1... client # [ 12.686719] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.754840] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.777966] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.703796] systemd[1]: Starting Address configuration of eth1... client # [ 12.722217] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 12.715253] 8021q: 802.1Q VLAN Support v1.8 client # [ 12.714006] systemd[1]: Starting Extra networking commands.... lb # [ 12.706113] systemd[1]: Finished Extra networking commands.. lb # [ 12.715172] systemd[1]: Reached target Network. lb # [ 12.720182] systemd[1]: Starting PostgreSQL Server... worker1 # [ 12.796473] systemd[1]: Finished Extra networking commands.. lb # [ 12.725575] systemd[1]: Starting Permit User Sessions... worker1 # [ 12.801154] systemd[1]: Reached target Network. worker1 # [ 12.808183] systemd[1]: Starting Permit User Sessions... client # [ 12.767587] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.768078] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 12.773945] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.774278] cfg80211: failed to load regulatory.db worker2 # [ 12.784543] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 12.777083] dhcpcd[637]: eth0: waiting for carrier worker2 # [ 12.779151] dhcpcd[637]: eth0: carrier acquired worker1 # [ 12.879182] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 12.804982] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 12.798895] dhcpcd[637]: DUID 00:01:00:01:32:43:e0:81:52:54:00:12:34:56 worker2 # [ 12.802509] dhcpcd[637]: eth0: IAID 00:12:34:56 worker2 # [ 12.803226] dhcpcd[637]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 12.806976] systemd-logind[506]: Watching system buttons on /dev/input/event0 (gpio-keys) worker2 # [ 12.819822] network-addresses-eth1-start[678]: adding address 192.168.1.4/24... done worker1 # [ 12.918428] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.918915] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 12.831884] (udev-worker)[371]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 12.834392] network-addresses-eth1-start[678]: adding address 2001:db8:1::4/64... done worker1 # [ 12.924069] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 12.924400] cfg80211: failed to load regulatory.db lb # [ 12.843985] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.919633] systemd[1]: Finished Permit User Sessions. client # [ 12.871946] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 12.923484] systemd[1]: Started Getty on tty1. worker1 # [ 12.926033] systemd[1]: Reached target Login Prompts. worker2 # [ 12.855293] systemd[1]: Finished Address configuration of eth1. lb # [ 12.855572] (udev-worker)[367]: Network interface NamePolicy= disabled on kernel command line. lb # [ 12.867174] systemd[1]: Finished Permit User Sessions. client # [ 12.893606] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.883961] dhcpcd[540]: eth0: waiting for carrier client # [ 12.887094] dhcpcd[540]: libudev: received NULL device client # [ 12.887878] dhcpcd[540]: libudev: received NULL device worker1 # [ 12.969112] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 12.892256] dhcpcd[540]: eth0: carrier acquired lb # [ 12.887779] systemd[1]: Started Getty on tty1. client # [ 12.897865] network-addresses-eth1-start[549]: adding address 192.168.1.1/24... done lb # [ 12.893046] systemd[1]: Reached target Login Prompts. client # [ 12.909057] dhcpcd[540]: DUID 00:01:00:01:32:43:e0:81:52:54:00:12:34:56 client # [ 12.910997] dhcpcd[540]: eth0: IAID 00:12:34:56 worker1 # [ 12.977772] network-addresses-eth1-start[653]: adding address 192.168.1.3/24... done client # [ 12.913576] dhcpcd[540]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 12.916218] network-addresses-eth1-start[549]: adding address 2001:db8:1::1/64... done lb # [ 12.927677] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.997103] network-addresses-eth1-start[653]: adding address 2001:db8:1::3/64... done client # [ 12.934770] systemd[1]: Finished Address configuration of eth1. worker2 # [ 12.942680] mousedev: PS/2 mouse device common for all mice worker1 # [ 13.034299] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 13.021383] dhcpcd[642]: eth0: waiting for carrier worker1 # [ 13.027758] dhcpcd[642]: eth0: waiting for carrier worker1 # [ 13.029414] systemd[1]: Finished Address configuration of eth1. worker1 # [ 13.032376] dhcpcd[642]: eth0: carrier acquired lb # [ 12.975419] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 12.975878] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 12.981190] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 12.982608] cfg80211: failed to load regulatory.db worker1 # [ 13.047961] dhcpcd[642]: DUID 00:01:00:01:32:43:e0:81:52:54:00:12:34:56 worker1 # [ 13.050287] dhcpcd[642]: eth0: IAID 00:12:34:56 worker1 # [ 13.050954] dhcpcd[642]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 13.006739] systemd-logind[506]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 13.101144] mousedev: PS/2 mouse device common for all mice lb # [ 13.020704] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 13.037027] systemd[1]: Starting Address configuration of eth1... worker1 # [ 13.118688] systemd-logind[510]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 13.123507] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 13.114408] dhcpcd[668]: eth0: waiting for carrier lb # [ 13.130911] dhcpcd[668]: eth0: waiting for carrier lb # [ 13.131712] dhcpcd[668]: eth0: carrier acquired lb # [ 13.162039] dhcpcd[668]: DUID 00:01:00:01:32:43:e0:81:52:54:00:12:34:56 lb # [ 13.165217] dhcpcd[668]: eth0: IAID 00:12:34:56 lb # [ 13.168899] dhcpcd[668]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 13.196341] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 13.212959] network-addresses-eth1-start[705]: adding address 192.168.1.2/24... done lb # [ 13.235845] network-addresses-eth1-start[705]: adding address 2001:db8:1::2/64... done lb # [ 13.250088] postgresql-pre-start[702]: The files belonging to this database system will be owned by user "postgres". lb # [ 13.251472] postgresql-pre-start[702]: This user must also own the server process. lb # [ 13.266816] postgresql-pre-start[702]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 13.270613] postgresql-pre-start[702]: The default database encoding has accordingly been set to "UTF8". lb # [ 13.276935] postgresql-pre-start[702]: The default text search configuration will be set to "english". lb # [ 13.278157] postgresql-pre-start[702]: Data page checksums are enabled. lb # [ 13.279001] postgresql-pre-start[702]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 13.288454] postgresql-pre-start[702]: creating subdirectories ... ok client: (finished: waiting for unit network-addresses-eth1.service, in 13.70 seconds) lb # [ 13.292854] postgresql-pre-start[702]: selecting dynamic shared memory implementation ... posix client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 13.298733] systemd[1]: Finished Address configuration of eth1. client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 13.467269] dhcpcd[642]: eth0: soliciting a DHCP lease worker1 # [ 13.472561] dhcpcd[642]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 13.480424] dhcpcd[642]: eth0: probing address 10.0.2.15/24 lb # [ 13.495140] postgresql-pre-start[702]: selecting default "max_connections" ... 100 lb: (finished: waiting for unit network-addresses-eth1.service, in 0.16 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb # [ 13.520960] systemd-logind[540]: Watching system buttons on /dev/input/event0 (gpio-keys) lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.09 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) client # [ 13.626755] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.687336] postgresql-pre-start[702]: selecting default "shared_buffers" ... 128MB worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 13.764180] mousedev: PS/2 mouse device common for all mice worker1 # [ 13.886075] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit niks3.service client # [ 13.909733] systemd[1]: Starting Virtual Console Setup... client # [ 13.973755] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 13.966430] systemd-logind[540]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 13.974740] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 13.975910] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.977317] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.978139] systemd[1]: Stopping Virtual Console Setup... client # [ 13.984788] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.982068] systemd[1]: Starting Virtual Console Setup... client # [ 13.990933] systemd[1]: Stopped Virtual Console Setup. client # [ 13.996523] systemd[1]: Starting Virtual Console Setup... lb # [ 13.995716] dhcpcd[668]: eth0: soliciting a DHCP lease lb # [ 14.000475] dhcpcd[668]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 14.001953] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 14.003045] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 14.005791] systemd[1]: Starting Virtual Console Setup... lb # [ 14.008308] dhcpcd[668]: eth0: probing address 10.0.2.15/24 client # [ 14.059085] systemd-logind[432]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 14.080699] systemd[1]: Finished Extra networking commands.. client # [ 14.082789] systemd[1]: Reached target Network. client # [ 14.087266] systemd[1]: Starting Permit User Sessions... worker1 # [ 14.167882] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 14.123715] systemd[1]: Finished Permit User Sessions. worker1 # [ 14.189951] systemd[1]: Starting Virtual Console Setup... client # [ 14.129088] systemd[1]: Started Getty on tty1. client # [ 14.131458] systemd[1]: Reached target Login Prompts. worker1 # [ 14.211588] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 14.215318] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 14.217361] systemd[1]: Starting Virtual Console Setup... worker1 # [ 14.263762] systemd-logind[510]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 14.241041] dhcpcd[637]: eth0: soliciting a DHCP lease worker2 # [ 14.248514] dhcpcd[637]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 14.256178] dhcpcd[637]: eth0: probing address 10.0.2.15/24 worker2 # [ 14.326114] systemd-vconsole-setup[711]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.330082] systemd[1]: Finished Virtual Console Setup. client # [ 14.451785] systemd-vconsole-setup[627]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 14.455885] systemd[1]: Finished Virtual Console Setup. worker2 # [ 14.544588] dhcpcd[637]: eth0: soliciting an IPv6 router worker2 # [ 14.548978] dhcpcd[637]: eth0: Router Advertisement from fe80::2 worker2 # [ 14.551456] dhcpcd[637]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 14.554320] dhcpcd[637]: eth0: adding route to fec0::/64 worker2 # [ 14.556584] dhcpcd[637]: eth0: adding default route via fe80::2 worker1 # [ 14.638120] systemd-vconsole-setup[708]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.643003] systemd[1]: Finished Virtual Console Setup. client # [ 14.713956] dhcpcd[540]: eth0: soliciting a DHCP lease client # [ 14.721150] dhcpcd[540]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 14.724495] dhcpcd[540]: eth0: probing address 10.0.2.15/24 lb # [ 14.847993] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 15.117426] dhcpcd[540]: eth0: soliciting an IPv6 router client # [ 15.121272] dhcpcd[540]: eth0: Router Advertisement from fe80::2 client # [ 15.123817] dhcpcd[540]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 15.126682] dhcpcd[540]: eth0: adding route to fec0::/64 client # [ 15.128981] dhcpcd[540]: eth0: adding default route via fe80::2 lb # [ 15.313845] systemd[1]: Starting Virtual Console Setup... lb # [ 15.343097] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.346937] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.365993] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 15.369319] systemd[1]: Starting Virtual Console Setup... lb # [ 15.438283] systemd-logind[540]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 15.711911] dhcpcd[642]: eth0: soliciting an IPv6 router worker1 # [ 15.715359] dhcpcd[642]: eth0: Router Advertisement from fe80::2 worker1 # [ 15.718168] dhcpcd[642]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 15.720961] dhcpcd[642]: eth0: adding route to fec0::/64 worker1 # [ 15.723111] dhcpcd[642]: eth0: adding default route via fe80::2 lb # [ 15.831099] systemd-vconsole-setup[774]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 15.834416] systemd[1]: Finished Virtual Console Setup. lb # [ 16.028461] dhcpcd[668]: eth0: soliciting an IPv6 router lb # [ 16.029332] dhcpcd[668]: eth0: Router Advertisement from fe80::2 lb # [ 16.030126] dhcpcd[668]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 16.030991] dhcpcd[668]: eth0: adding route to fec0::/64 lb # [ 16.031711] dhcpcd[668]: eth0: adding default route via fe80::2 lb # [ 16.179948] postgresql-pre-start[702]: selecting default time zone ... UTC lb # [ 16.187649] postgresql-pre-start[702]: creating configuration files ... ok lb # [ 16.512729] postgresql-pre-start[702]: running bootstrap script ... ok lb # [ 17.093901] postgresql-pre-start[702]: performing post-bootstrap initialization ... ok lb # [ 17.239079] postgresql-pre-start[702]: syncing data to disk ... ok lb # [ 17.242086] postgresql-pre-start[702]: initdb: warning: enabling "trust" authentication for local connections lb # [ 17.243404] postgresql-pre-start[702]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 17.246003] postgresql-pre-start[702]: Success. You can now start the database server using: lb # [ 17.247251] postgresql-pre-start[702]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 17.400418] postgres[798]: [798] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.404400] postgres[798]: [798] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.405549] postgres[798]: [798] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.408335] postgres[798]: [798] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.419632] postgres[812]: [812] LOG: database system was shut down at 2026-09-21 12:33:09 GMT lb # [ 17.426205] postgres[798]: [798] LOG: database system is ready to accept connections lb # [ 17.431086] systemd[1]: Started PostgreSQL Server. lb # [ 17.436642] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 17.668701] postgresql-setup-start[823]: CREATE DATABASE lb # [ 17.721249] postgresql-setup-start[833]: CREATE ROLE lb # [ 17.744543] postgresql-setup-start[835]: ALTER DATABASE lb # [ 17.751354] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 17.753189] systemd[1]: Reached target PostgreSQL. worker1 # [ 17.917840] dhcpcd[642]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 17.920516] dhcpcd[642]: eth0: adding route to 10.0.2.0/24 worker1 # [ 17.922771] dhcpcd[642]: eth0: adding default route via 10.0.2.2 worker1 # [ 18.121177] systemd[1]: Started DHCP Client. worker1 # [ 18.123067] systemd[1]: Reached target Multi-User System. worker1 # [ 18.123872] systemd[1]: Startup finished in 931ms (kernel) + 5.718s (initrd) + 11.473s (userspace) = 18.122s. lb # [ 18.675038] dhcpcd[668]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 18.678305] dhcpcd[668]: eth0: adding route to 10.0.2.0/24 lb # [ 18.678471] dhcpcd[668]: eth0: adding default route via 10.0.2.2 lb # [ 18.837208] systemd[1]: Started DHCP Client. lb # [ 18.843137] systemd[1]: Reached target Network is Online. lb # [ 18.845984] systemd[1]: Started Envoy reverse proxy. lb # [ 18.852438] systemd[1]: Started mock-oidc.service. lb # [ 18.949119] mock-oidc-server[903]: Mock OIDC Server running lb # [ 18.950194] mock-oidc-server[903]: OIDC Address: 192.168.1.2:8080 lb # [ 18.951510] mock-oidc-server[903]: Issue Address: 0.0.0.0:8081 lb # [ 18.953288] mock-oidc-server[903]: Issuer: http://192.168.1.2:8080/oidc lb # [ 18.954384] mock-oidc-server[903]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 18.956229] mock-oidc-server[903]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 18.957709] mock-oidc-server[903]: Issue tokens: http://0.0.0.0:8081/issue?sub=... client # [ 19.167611] dhcpcd[540]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 19.171051] dhcpcd[540]: eth0: adding route to 10.0.2.0/24 client # [ 19.174121] dhcpcd[540]: eth0: adding default route via 10.0.2.2 worker2 # [ 19.230607] dhcpcd[637]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 19.236476] dhcpcd[637]: eth0: adding route to 10.0.2.0/24 worker2 # [ 19.245787] dhcpcd[637]: eth0: adding default route via 10.0.2.2 client # [ 19.357568] systemd[1]: Started DHCP Client. client # [ 19.359112] systemd[1]: Reached target Multi-User System. client # [ 19.360473] systemd[1]: Startup finished in 921ms (kernel) + 5.682s (initrd) + 12.756s (userspace) = 19.360s. worker2 # [ 19.386388] systemd[1]: Started DHCP Client. worker2 # [ 19.388080] systemd[1]: Reached target Multi-User System. worker2 # [ 19.389407] systemd[1]: Startup finished in 933ms (kernel) + 4.680s (initrd) + 13.775s (userspace) = 19.388s. lb # [ 19.499071] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 19.501271] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 19.504191] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 19.509705] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 19.512298] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 19.514885] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 19.517747] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 19.519695] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 19.522094] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 19.525284] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 19.531769] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 19.534597] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 19.557460] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 19.564318] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 19.567500] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 19.571827] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 19.583868] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 19.587083] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 19.589128] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 19.594070] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 19.602329] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 19.605285] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 19.609325] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 19.611855] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 19.618560] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 19.620884] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 19.623980] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 19.627046] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 19.629947] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 19.632848] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 19.634681] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 19.638574] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 19.641970] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 19.644196] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 19.646900] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 19.654199] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 19.657024] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 19.659613] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 19.663330] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 19.667577] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 19.671222] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 19.674432] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 19.677305] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 19.682741] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 19.687259] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 19.690135] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 19.703652] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 19.736245] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 19.744346] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 19.751912] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 19.763444] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 19.765758] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 19.768970] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 19.771002] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 19.776132] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 19.777839] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 19.779645] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 19.783041] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 19.790725] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 19.795280] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 19.802415] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 19.805165] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 19.808127] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 19.812314] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 19.815673] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 19.821136] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 19.825512] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 19.830556] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 19.834234] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 19.838451] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 19.840692] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 19.843055] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 19.847932] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 19.850581] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 19.852925] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 19.859718] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 19.862712] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 19.864773] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 19.866719] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 19.870415] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 19.873677] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap worker1 # [ 19.949346] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 19.878822] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 19.883071] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 19.885591] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default worker2 # [ 19.891883] systemd[1]: Reached target Network is Online. lb # [ 19.887540] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 19.896202] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override worker2 # [ 19.898464] systemd[1]: Starting scheduler-token.service... lb # [ 19.899324] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 19.902536] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 19.907694] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 19.921405] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 19.925063] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 19.927000] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 19.932513] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 19.934460] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 19.937136] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 19.943008] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 19.946305] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 19.949311] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 19.957639] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 19.961450] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 19.963090] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 19.965838] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 19.967631] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 19.970353] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 19.975546] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 19.978693] envoy[902]: [2026-09-21 12:33:12.146][902][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 19.981994] envoy[902]: [2026-09-21 12:33:12.179][902][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 19.983617] envoy[902]: [2026-09-21 12:33:12.192][902][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 19.999394] envoy[902]: [2026-09-21 12:33:12.192][902][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 20.001561] envoy[902]: [2026-09-21 12:33:12.192][902][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 20.011786] envoy[902]: [2026-09-21 12:33:12.192][902][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 20.014335] envoy[902]: [2026-09-21 12:33:12.305][902][info][main] [source/server/server.cc:968] runtime: {} lb # [ 20.015826] envoy[902]: [2026-09-21 12:33:12.322][902][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 20.018339] envoy[902]: [2026-09-21 12:33:12.322][902][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 20.020739] envoy[902]: [2026-09-21 12:33:12.322][902][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 20.023106] envoy[902]: [2026-09-21 12:33:12.328][902][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 20.025517] envoy[902]: [2026-09-21 12:33:12.328][902][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 20.027397] envoy[902]: [2026-09-21 12:33:12.328][902][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 20.029753] envoy[902]: [2026-09-21 12:33:12.530][902][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 20.032060] envoy[902]: [2026-09-21 12:33:12.585][902][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 20.034197] envoy[902]: [2026-09-21 12:33:12.591][902][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 20.040607] envoy[902]: [2026-09-21 12:33:12.591][902][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 20.054135] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 20.064479] systemd[1]: Finished scheduler-token.service. worker2 # [ 20.067031] systemd[1]: scheduler-token.service: Consumed 54ms CPU time over 159ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 20.077533] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 20.215470] nix-grpc-daemon[773]: ts=2026-09-21T12:33:12Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 20.227838] nix-grpc-daemon[773]: ts=2026-09-21T12:33:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 20.230532] nix-grpc-daemon[773]: ts=2026-09-21T12:33:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 20.269397] nix-grpc-daemon[773]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 20.271004] nix-grpc-daemon[773]: E0000 00:00:1789993992.909790 773 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 20.285943] nix-grpc-daemon[773]: E0000 00:00:1789993992.926403 773 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 20.289597] nix-grpc-daemon[773]: ts=2026-09-21T12:33:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 20.291317] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 20.328098] nix-grpc-daemon[773]: E0000 00:00:1789993992.967424 812 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 20.253122] envoy[902]: [2026-09-21 12:33:12.901][902][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 20.258851] envoy[902]: [2026-09-21 12:33:12.906][902][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 20.265647] envoy[902]: [2026-09-21 12:33:12.906][902][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker1 # [ 20.346932] nix-grpc-daemon[773]: E0000 00:00:1789993992.987327 812 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 20.275330] envoy[902]: [2026-09-21 12:33:12.923][902][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 20.352055] nix-grpc-daemon[773]: E0000 00:00:1789993992.990637 812 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 20.369195] nix-grpc-daemon[773]: E0000 00:00:1789993993.008946 812 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 20.384221] nix-grpc-daemon[773]: ts=2026-09-21T12:33:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.314261] nix-grpc-daemon[779]: ts=2026-09-21T12:33:12Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 20.387811] nix-grpc-daemon[773]: ts=2026-09-21T12:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.325885] nix-grpc-daemon[779]: ts=2026-09-21T12:33:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 20.328341] nix-grpc-daemon[779]: ts=2026-09-21T12:33:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 20.362934] nix-grpc-daemon[779]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 20.364816] nix-grpc-daemon[779]: E0000 00:00:1789993992.997746 779 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 20.377462] nix-grpc-daemon[779]: E0000 00:00:1789993993.012173 779 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 20.381979] nix-grpc-daemon[779]: ts=2026-09-21T12:33:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 20.383727] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 20.417659] nix-grpc-daemon[779]: E0000 00:00:1789993993.051458 820 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 20.436086] nix-grpc-daemon[779]: E0000 00:00:1789993993.070814 820 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 20.440069] nix-grpc-daemon[779]: E0000 00:00:1789993993.073954 820 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 20.457915] nix-grpc-daemon[779]: E0000 00:00:1789993993.091935 820 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 20.472734] nix-grpc-daemon[779]: ts=2026-09-21T12:33:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.474513] nix-grpc-daemon[779]: ts=2026-09-21T12:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.589142] nix-grpc-daemon[773]: ts=2026-09-21T12:33:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.594317] nix-grpc-daemon[773]: ts=2026-09-21T12:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.676089] nix-grpc-daemon[779]: ts=2026-09-21T12:33:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.681131] nix-grpc-daemon[779]: ts=2026-09-21T12:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.795107] nix-grpc-daemon[773]: ts=2026-09-21T12:33:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.800324] nix-grpc-daemon[773]: ts=2026-09-21T12:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.882183] nix-grpc-daemon[779]: ts=2026-09-21T12:33:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.887079] nix-grpc-daemon[779]: ts=2026-09-21T12:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.001161] nix-grpc-daemon[773]: ts=2026-09-21T12:33:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.006147] nix-grpc-daemon[773]: ts=2026-09-21T12:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.088150] nix-grpc-daemon[779]: ts=2026-09-21T12:33:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.093198] nix-grpc-daemon[779]: ts=2026-09-21T12:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.206967] nix-grpc-daemon[773]: ts=2026-09-21T12:33:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.212193] nix-grpc-daemon[773]: ts=2026-09-21T12:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.294288] nix-grpc-daemon[779]: ts=2026-09-21T12:33:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.299458] nix-grpc-daemon[779]: ts=2026-09-21T12:33:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.414779] nix-grpc-daemon[773]: ts=2026-09-21T12:33:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.418963] nix-grpc-daemon[773]: ts=2026-09-21T12:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.502421] nix-grpc-daemon[779]: ts=2026-09-21T12:33:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.506520] nix-grpc-daemon[779]: ts=2026-09-21T12:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.615162] nix-grpc-daemon[773]: ts=2026-09-21T12:33:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.620584] nix-grpc-daemon[773]: ts=2026-09-21T12:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.702953] nix-grpc-daemon[779]: ts=2026-09-21T12:33:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.707841] nix-grpc-daemon[779]: ts=2026-09-21T12:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.821326] nix-grpc-daemon[773]: ts=2026-09-21T12:33:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.826218] nix-grpc-daemon[773]: ts=2026-09-21T12:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.909067] nix-grpc-daemon[779]: ts=2026-09-21T12:33:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.914089] nix-grpc-daemon[779]: ts=2026-09-21T12:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.027051] nix-grpc-daemon[773]: ts=2026-09-21T12:33:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.032266] nix-grpc-daemon[773]: ts=2026-09-21T12:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.115273] nix-grpc-daemon[779]: ts=2026-09-21T12:33:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.120415] nix-grpc-daemon[779]: ts=2026-09-21T12:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.233212] nix-grpc-daemon[773]: ts=2026-09-21T12:33:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.238242] nix-grpc-daemon[773]: ts=2026-09-21T12:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.321703] nix-grpc-daemon[779]: ts=2026-09-21T12:33:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.327143] nix-grpc-daemon[779]: ts=2026-09-21T12:33:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.440685] nix-grpc-daemon[773]: ts=2026-09-21T12:33:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.444507] nix-grpc-daemon[773]: ts=2026-09-21T12:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.529819] nix-grpc-daemon[779]: ts=2026-09-21T12:33:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.537932] nix-grpc-daemon[779]: ts=2026-09-21T12:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.641202] nix-grpc-daemon[773]: ts=2026-09-21T12:33:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.646223] nix-grpc-daemon[773]: ts=2026-09-21T12:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.730618] nix-grpc-daemon[779]: ts=2026-09-21T12:33:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.735796] nix-grpc-daemon[779]: ts=2026-09-21T12:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.846901] nix-grpc-daemon[773]: ts=2026-09-21T12:33:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.850405] nix-grpc-daemon[773]: ts=2026-09-21T12:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.936984] nix-grpc-daemon[779]: ts=2026-09-21T12:33:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.941937] nix-grpc-daemon[779]: ts=2026-09-21T12:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.051317] nix-grpc-daemon[773]: ts=2026-09-21T12:33:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.056356] nix-grpc-daemon[773]: ts=2026-09-21T12:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.143093] nix-grpc-daemon[779]: ts=2026-09-21T12:33:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.148266] nix-grpc-daemon[779]: ts=2026-09-21T12:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.257083] nix-grpc-daemon[773]: ts=2026-09-21T12:33:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.262369] nix-grpc-daemon[773]: ts=2026-09-21T12:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.349300] nix-grpc-daemon[779]: ts=2026-09-21T12:33:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.354450] nix-grpc-daemon[779]: ts=2026-09-21T12:33:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.464976] nix-grpc-daemon[773]: ts=2026-09-21T12:33:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.469127] nix-grpc-daemon[773]: ts=2026-09-21T12:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.557178] nix-grpc-daemon[779]: ts=2026-09-21T12:33:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.561388] nix-grpc-daemon[779]: ts=2026-09-21T12:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.665345] nix-grpc-daemon[773]: ts=2026-09-21T12:33:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.670518] nix-grpc-daemon[773]: ts=2026-09-21T12:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.757829] nix-grpc-daemon[779]: ts=2026-09-21T12:33:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.762835] nix-grpc-daemon[779]: ts=2026-09-21T12:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.871289] nix-grpc-daemon[773]: ts=2026-09-21T12:33:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.876390] nix-grpc-daemon[773]: ts=2026-09-21T12:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.964003] nix-grpc-daemon[779]: ts=2026-09-21T12:33:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.968970] nix-grpc-daemon[779]: ts=2026-09-21T12:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.077236] nix-grpc-daemon[773]: ts=2026-09-21T12:33:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.082291] nix-grpc-daemon[773]: ts=2026-09-21T12:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.169834] nix-grpc-daemon[779]: ts=2026-09-21T12:33:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.174846] nix-grpc-daemon[779]: ts=2026-09-21T12:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.283088] nix-grpc-daemon[773]: ts=2026-09-21T12:33:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.288457] nix-grpc-daemon[773]: ts=2026-09-21T12:33:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.376228] nix-grpc-daemon[779]: ts=2026-09-21T12:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.381485] nix-grpc-daemon[779]: ts=2026-09-21T12:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.491443] nix-grpc-daemon[773]: ts=2026-09-21T12:33:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.495733] nix-grpc-daemon[773]: ts=2026-09-21T12:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.584465] nix-grpc-daemon[779]: ts=2026-09-21T12:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.588650] nix-grpc-daemon[779]: ts=2026-09-21T12:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.691885] nix-grpc-daemon[773]: ts=2026-09-21T12:33:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.697180] nix-grpc-daemon[773]: ts=2026-09-21T12:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.785692] nix-grpc-daemon[779]: ts=2026-09-21T12:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.791159] nix-grpc-daemon[779]: ts=2026-09-21T12:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.897990] nix-grpc-daemon[773]: ts=2026-09-21T12:33:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.903162] nix-grpc-daemon[773]: ts=2026-09-21T12:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.992334] nix-grpc-daemon[779]: ts=2026-09-21T12:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.997583] nix-grpc-daemon[779]: ts=2026-09-21T12:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.103990] nix-grpc-daemon[773]: ts=2026-09-21T12:33:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.109071] nix-grpc-daemon[773]: ts=2026-09-21T12:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.198869] nix-grpc-daemon[779]: ts=2026-09-21T12:33:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.204344] nix-grpc-daemon[779]: ts=2026-09-21T12:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.309926] nix-grpc-daemon[773]: ts=2026-09-21T12:33:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.315090] nix-grpc-daemon[773]: ts=2026-09-21T12:33:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.405349] nix-grpc-daemon[779]: ts=2026-09-21T12:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.410339] nix-grpc-daemon[779]: ts=2026-09-21T12:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.517234] nix-grpc-daemon[773]: ts=2026-09-21T12:33:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.521858] nix-grpc-daemon[773]: ts=2026-09-21T12:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.613013] nix-grpc-daemon[779]: ts=2026-09-21T12:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.617662] nix-grpc-daemon[779]: ts=2026-09-21T12:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.722720] nix-grpc-daemon[773]: ts=2026-09-21T12:33:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.728149] nix-grpc-daemon[773]: ts=2026-09-21T12:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.818618] nix-grpc-daemon[779]: ts=2026-09-21T12:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.823499] nix-grpc-daemon[779]: ts=2026-09-21T12:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.928999] nix-grpc-daemon[773]: ts=2026-09-21T12:33:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.934112] nix-grpc-daemon[773]: ts=2026-09-21T12:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.024851] nix-grpc-daemon[779]: ts=2026-09-21T12:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.030058] nix-grpc-daemon[779]: ts=2026-09-21T12:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.136457] nix-grpc-daemon[773]: ts=2026-09-21T12:33:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.144623] nix-grpc-daemon[773]: ts=2026-09-21T12:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.231168] nix-grpc-daemon[779]: ts=2026-09-21T12:33:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.236285] nix-grpc-daemon[779]: ts=2026-09-21T12:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.337433] nix-grpc-daemon[773]: ts=2026-09-21T12:33:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.343748] nix-grpc-daemon[773]: ts=2026-09-21T12:33:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.437441] nix-grpc-daemon[779]: ts=2026-09-21T12:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.442601] nix-grpc-daemon[779]: ts=2026-09-21T12:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.542664] nix-grpc-daemon[773]: ts=2026-09-21T12:33:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.546800] nix-grpc-daemon[773]: ts=2026-09-21T12:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.645806] nix-grpc-daemon[779]: ts=2026-09-21T12:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.650032] nix-grpc-daemon[779]: ts=2026-09-21T12:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.743258] nix-grpc-daemon[773]: ts=2026-09-21T12:33:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.748864] nix-grpc-daemon[773]: ts=2026-09-21T12:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.847089] nix-grpc-daemon[779]: ts=2026-09-21T12:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.852614] nix-grpc-daemon[779]: ts=2026-09-21T12:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.949766] nix-grpc-daemon[773]: ts=2026-09-21T12:33:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.955163] nix-grpc-daemon[773]: ts=2026-09-21T12:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.053725] nix-grpc-daemon[779]: ts=2026-09-21T12:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.058698] nix-grpc-daemon[779]: ts=2026-09-21T12:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.156539] nix-grpc-daemon[773]: ts=2026-09-21T12:33:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.161839] nix-grpc-daemon[773]: ts=2026-09-21T12:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.259980] nix-grpc-daemon[779]: ts=2026-09-21T12:33:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.265478] nix-grpc-daemon[779]: ts=2026-09-21T12:33:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.362526] nix-grpc-daemon[773]: ts=2026-09-21T12:33:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.368000] nix-grpc-daemon[773]: ts=2026-09-21T12:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.466230] nix-grpc-daemon[779]: ts=2026-09-21T12:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.471676] nix-grpc-daemon[779]: ts=2026-09-21T12:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.570787] nix-grpc-daemon[773]: ts=2026-09-21T12:33:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.574891] nix-grpc-daemon[773]: ts=2026-09-21T12:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.675215] nix-grpc-daemon[779]: ts=2026-09-21T12:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.679618] nix-grpc-daemon[779]: ts=2026-09-21T12:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.771092] nix-grpc-daemon[773]: ts=2026-09-21T12:33:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.776308] nix-grpc-daemon[773]: ts=2026-09-21T12:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.876185] nix-grpc-daemon[779]: ts=2026-09-21T12:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.881274] nix-grpc-daemon[779]: ts=2026-09-21T12:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.977061] nix-grpc-daemon[773]: ts=2026-09-21T12:33:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.981902] nix-grpc-daemon[773]: ts=2026-09-21T12:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.082630] nix-grpc-daemon[779]: ts=2026-09-21T12:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.087940] nix-grpc-daemon[779]: ts=2026-09-21T12:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.182758] nix-grpc-daemon[773]: ts=2026-09-21T12:33:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.187961] nix-grpc-daemon[773]: ts=2026-09-21T12:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.289420] nix-grpc-daemon[779]: ts=2026-09-21T12:33:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.294912] nix-grpc-daemon[779]: ts=2026-09-21T12:33:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.388927] nix-grpc-daemon[773]: ts=2026-09-21T12:33:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.394255] nix-grpc-daemon[773]: ts=2026-09-21T12:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.496187] nix-grpc-daemon[779]: ts=2026-09-21T12:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.501496] nix-grpc-daemon[779]: ts=2026-09-21T12:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.597204] nix-grpc-daemon[773]: ts=2026-09-21T12:33:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.601328] nix-grpc-daemon[773]: ts=2026-09-21T12:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.704388] nix-grpc-daemon[779]: ts=2026-09-21T12:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.709563] nix-grpc-daemon[779]: ts=2026-09-21T12:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.797839] nix-grpc-daemon[773]: ts=2026-09-21T12:33:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.803217] nix-grpc-daemon[773]: ts=2026-09-21T12:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.910841] nix-grpc-daemon[779]: ts=2026-09-21T12:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.916244] nix-grpc-daemon[779]: ts=2026-09-21T12:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.004389] nix-grpc-daemon[773]: ts=2026-09-21T12:33:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.009484] nix-grpc-daemon[773]: ts=2026-09-21T12:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.117369] nix-grpc-daemon[779]: ts=2026-09-21T12:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.122352] nix-grpc-daemon[779]: ts=2026-09-21T12:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.210556] nix-grpc-daemon[773]: ts=2026-09-21T12:33:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.219229] nix-grpc-daemon[773]: ts=2026-09-21T12:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.324845] nix-grpc-daemon[779]: ts=2026-09-21T12:33:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.330052] nix-grpc-daemon[779]: ts=2026-09-21T12:33:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.418503] nix-grpc-daemon[773]: ts=2026-09-21T12:33:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.427602] nix-grpc-daemon[773]: ts=2026-09-21T12:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.531164] nix-grpc-daemon[779]: ts=2026-09-21T12:33:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.536604] nix-grpc-daemon[779]: ts=2026-09-21T12:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.627418] nix-grpc-daemon[773]: ts=2026-09-21T12:33:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.631456] nix-grpc-daemon[773]: ts=2026-09-21T12:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.739726] nix-grpc-daemon[779]: ts=2026-09-21T12:33:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.744192] nix-grpc-daemon[779]: ts=2026-09-21T12:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.827941] nix-grpc-daemon[773]: ts=2026-09-21T12:33:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.833043] nix-grpc-daemon[773]: ts=2026-09-21T12:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.940784] nix-grpc-daemon[779]: ts=2026-09-21T12:33:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.946173] nix-grpc-daemon[779]: ts=2026-09-21T12:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.033733] nix-grpc-daemon[773]: ts=2026-09-21T12:33:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.038827] nix-grpc-daemon[773]: ts=2026-09-21T12:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.147616] nix-grpc-daemon[779]: ts=2026-09-21T12:33:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.153237] nix-grpc-daemon[779]: ts=2026-09-21T12:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.239972] nix-grpc-daemon[773]: ts=2026-09-21T12:33:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.246250] nix-grpc-daemon[773]: ts=2026-09-21T12:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.354212] nix-grpc-daemon[779]: ts=2026-09-21T12:33:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.359445] nix-grpc-daemon[779]: ts=2026-09-21T12:33:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.446291] nix-grpc-daemon[773]: ts=2026-09-21T12:33:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.451396] nix-grpc-daemon[773]: ts=2026-09-21T12:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.560701] nix-grpc-daemon[779]: ts=2026-09-21T12:33:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.565855] nix-grpc-daemon[779]: ts=2026-09-21T12:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.653989] nix-grpc-daemon[773]: ts=2026-09-21T12:33:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.658123] nix-grpc-daemon[773]: ts=2026-09-21T12:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.768938] nix-grpc-daemon[779]: ts=2026-09-21T12:33:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.773023] nix-grpc-daemon[779]: ts=2026-09-21T12:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.854373] nix-grpc-daemon[773]: ts=2026-09-21T12:33:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.859520] nix-grpc-daemon[773]: ts=2026-09-21T12:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.969953] nix-grpc-daemon[779]: ts=2026-09-21T12:33:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.974846] nix-grpc-daemon[779]: ts=2026-09-21T12:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.060324] nix-grpc-daemon[773]: ts=2026-09-21T12:33:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.065304] nix-grpc-daemon[773]: ts=2026-09-21T12:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.175988] nix-grpc-daemon[779]: ts=2026-09-21T12:33:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.181100] nix-grpc-daemon[779]: ts=2026-09-21T12:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.266126] nix-grpc-daemon[773]: ts=2026-09-21T12:33:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.271113] nix-grpc-daemon[773]: ts=2026-09-21T12:33:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.382329] nix-grpc-daemon[779]: ts=2026-09-21T12:33:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.387544] nix-grpc-daemon[779]: ts=2026-09-21T12:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.471720] nix-grpc-daemon[773]: ts=2026-09-21T12:33:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.477235] nix-grpc-daemon[773]: ts=2026-09-21T12:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.588604] nix-grpc-daemon[779]: ts=2026-09-21T12:33:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.593531] nix-grpc-daemon[779]: ts=2026-09-21T12:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.680289] nix-grpc-daemon[773]: ts=2026-09-21T12:33:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.684160] nix-grpc-daemon[773]: ts=2026-09-21T12:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.796568] nix-grpc-daemon[779]: ts=2026-09-21T12:33:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.800651] nix-grpc-daemon[779]: ts=2026-09-21T12:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.880557] nix-grpc-daemon[773]: ts=2026-09-21T12:33:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.885598] nix-grpc-daemon[773]: ts=2026-09-21T12:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.997398] nix-grpc-daemon[779]: ts=2026-09-21T12:33:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.002444] nix-grpc-daemon[779]: ts=2026-09-21T12:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.086437] nix-grpc-daemon[773]: ts=2026-09-21T12:33:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.091514] nix-grpc-daemon[773]: ts=2026-09-21T12:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.203692] nix-grpc-daemon[779]: ts=2026-09-21T12:33:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.208845] nix-grpc-daemon[779]: ts=2026-09-21T12:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.292322] nix-grpc-daemon[773]: ts=2026-09-21T12:33:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.297353] nix-grpc-daemon[773]: ts=2026-09-21T12:33:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.409906] nix-grpc-daemon[779]: ts=2026-09-21T12:33:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.415040] nix-grpc-daemon[779]: ts=2026-09-21T12:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.498063] nix-grpc-daemon[773]: ts=2026-09-21T12:33:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.503155] nix-grpc-daemon[773]: ts=2026-09-21T12:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.615685] nix-grpc-daemon[779]: ts=2026-09-21T12:33:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.618692] nix-grpc-daemon[779]: ts=2026-09-21T12:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.705713] nix-grpc-daemon[773]: ts=2026-09-21T12:33:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.709789] nix-grpc-daemon[773]: ts=2026-09-21T12:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.821945] nix-grpc-daemon[779]: ts=2026-09-21T12:33:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.826182] nix-grpc-daemon[779]: ts=2026-09-21T12:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.906207] nix-grpc-daemon[773]: ts=2026-09-21T12:33:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.910885] nix-grpc-daemon[773]: ts=2026-09-21T12:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 32.940753] rustfs-bucket-start[1030]: mb s3://farm lb # [ 32.949712] systemd[1]: Finished rustfs-bucket.service. lb # [ 32.962136] systemd[1]: Starting niks3 server... worker2 # [ 33.023071] nix-grpc-daemon[779]: ts=2026-09-21T12:33:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.028449] nix-grpc-daemon[779]: ts=2026-09-21T12:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.111744] nix-grpc-daemon[773]: ts=2026-09-21T12:33:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.117021] nix-grpc-daemon[773]: ts=2026-09-21T12:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 33.226688] postgres[1050]: [1050] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 33.227969] postgres[1050]: [1050] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC worker2 # [ 33.229542] nix-grpc-daemon[779]: ts=2026-09-21T12:33:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.234740] nix-grpc-daemon[779]: ts=2026-09-21T12:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.317706] nix-grpc-daemon[773]: ts=2026-09-21T12:33:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.322660] nix-grpc-daemon[773]: ts=2026-09-21T12:33:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 33.259558] niks3-server[1040]: 2026/09/21 12:33:25 OK 20241026095416_initial_model.sql (19ms) lb # [ 33.262807] niks3-server[1040]: 2026/09/21 12:33:25 OK 20251210153512_drop_unused_gin_index.sql (1.81ms) lb # [ 33.268617] niks3-server[1040]: 2026/09/21 12:33:25 OK 20251218171726_add_pins.sql (5.76ms) lb # [ 33.273009] niks3-server[1040]: 2026/09/21 12:33:25 OK 20260628120000_add_object_size_and_stats.sql (4.36ms) lb # [ 33.278777] niks3-server[1040]: 2026/09/21 12:33:25 OK 20260905000000_add_claims.sql (5.73ms) lb # [ 33.283130] niks3-server[1040]: 2026/09/21 12:33:25 OK 20260920000000_drop_claims.sql (4.24ms) lb # [ 33.285092] niks3-server[1040]: 2026/09/21 12:33:25 goose: successfully migrated database to version: 20260920000000 lb # [ 33.289226] niks3-server[1040]: 2026/09/21 12:33:25 OK 1_commit_pending_closure.sql (6.07ms) lb # [ 33.291718] niks3-server[1040]: 2026/09/21 12:33:25 OK 2_object_stats_trigger.sql (2.37ms) lb # [ 33.293203] niks3-server[1040]: 2026/09/21 12:33:25 goose: up to current file version: 2 lb # [ 33.296939] niks3-server[1040]: 2026/09/21 12:33:25 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 33.340417] niks3-server[1040]: 2026/09/21 12:33:25 INFO Read proxy enabled — serving cache objects from S3 lb # [ 33.341748] niks3-server[1040]: 2026/09/21 12:33:25 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 33.345998] niks3-server[1040]: 2026/09/21 12:33:25 INFO systemd watchdog enabled interval=15s lb # [ 33.349811] systemd[1]: Started niks3 server. lb # [ 33.350494] niks3-server[1040]: 2026/09/21 12:33:25 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 33.352523] systemd[1]: Reached target Multi-User System. lb # [ 33.354920] systemd[1]: Startup finished in 921ms (kernel) + 5.697s (initrd) + 26.729s (userspace) = 33.349s. lb # [ 33.358676] niks3-server[1040]: 2026/09/21 12:33:26 INFO lead: acquired remote=192.168.1.3:50560 worker1 # [ 33.438030] nix-grpc-daemon[773]: ts=2026-09-21T12:33:26Z level=info event=scheduler_take_over worker2 # [ 33.435921] nix-grpc-daemon[779]: ts=2026-09-21T12:33:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.443406] nix-grpc-daemon[779]: ts=2026-09-21T12:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.523432] nix-grpc-daemon[773]: ts=2026-09-21T12:33:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.528559] nix-grpc-daemon[773]: ts=2026-09-21T12:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.638680] nix-grpc-daemon[779]: ts=2026-09-21T12:33:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.643935] nix-grpc-daemon[779]: ts=2026-09-21T12:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.731186] nix-grpc-daemon[773]: ts=2026-09-21T12:33:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.735359] nix-grpc-daemon[773]: ts=2026-09-21T12:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.847276] nix-grpc-daemon[779]: ts=2026-09-21T12:33:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.851599] nix-grpc-daemon[779]: ts=2026-09-21T12:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.931622] nix-grpc-daemon[773]: ts=2026-09-21T12:33:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.936843] nix-grpc-daemon[773]: ts=2026-09-21T12:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.048204] nix-grpc-daemon[779]: ts=2026-09-21T12:33:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.053393] nix-grpc-daemon[779]: ts=2026-09-21T12:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.138067] nix-grpc-daemon[773]: ts=2026-09-21T12:33:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.143305] nix-grpc-daemon[773]: ts=2026-09-21T12:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.254640] nix-grpc-daemon[779]: ts=2026-09-21T12:33:26Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.259703] nix-grpc-daemon[779]: ts=2026-09-21T12:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting for unit niks3.service, in 20.39 seconds) lb: waiting for TCP port 5751 on localhost worker1 # [ 34.344207] nix-grpc-daemon[773]: ts=2026-09-21T12:33:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.350071] nix-grpc-daemon[773]: ts=2026-09-21T12:33:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.06 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 34.456789] envoy[902]: conn peer=[::1]:57924 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) worker2 # [ 34.460600] nix-grpc-daemon[779]: ts=2026-09-21T12:33:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.552289] nix-grpc-daemon[773]: ts=2026-09-21T12:33:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.565728] nix-grpc-daemon[773]: ts=2026-09-21T12:33:27Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:42116 worker1 # [ 34.571835] nix-grpc-daemon[773]: ts=2026-09-21T12:33:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 34.577459] nix-grpc-daemon[773]: ts=2026-09-21T12:33:27Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 34.584279] nix-grpc-daemon[773]: ts=2026-09-21T12:33:27Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:42116 worker1 # [ 34.590960] nix-grpc-daemon[773]: ts=2026-09-21T12:33:27Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 34.670876] systemd[1]: Starting scheduler-token.service... worker2 # [ 34.761291] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 34.764560] systemd[1]: Finished scheduler-token.service. worker2 # [ 34.765674] systemd[1]: scheduler-token.service: Consumed 34ms CPU time over 93ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.86 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 36.069047] nix-grpc-daemon[779]: ts=2026-09-21T12:33:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 36.086888] systemd[1]: Started Nix Daemon. worker2 # [ 36.382936] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 36.407665] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5) worker2 # [ 36.433384] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 2/5) worker2 # [ 36.474332] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 80 ms (attempt 3/5) worker2 # [ 36.561194] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 413 ms (attempt 4/5) worker2 # [ 36.976514] nix-grpc-daemon[779]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 36.982209] nix-grpc-daemon[779]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 37.000981] nix-grpc-daemon[779]: ts=2026-09-21T12:33:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 37.015553] nix-grpc-daemon[779]: ts=2026-09-21T12:33:29Z level=debug event=path_info_miss path=llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test error="error: path '/nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 37.028384] nix-grpc-daemon[779]: ts=2026-09-21T12:33:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 37.038678] nix-grpc-daemon[779]: ts=2026-09-21T12:33:29Z level=debug event=path_info_miss path=llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test error="error: path '/nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds) client: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds) worker1 # [ 37.569782] nix-grpc-daemon[773]: ts=2026-09-21T12:33:30Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:42124 worker1 # [ 37.588838] systemd[1]: Started Nix Daemon. worker1 # [ 37.846249] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 37.868937] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 1/5) worker1 # [ 37.917540] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 2/5) worker1 # [ 37.964507] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 3/5) worker1 # [ 38.037836] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 310 ms (attempt 4/5) worker1 # [ 38.358466] nix-grpc-daemon[773]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 38.364855] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 38.383779] nix-grpc-daemon[773]: ts=2026-09-21T12:33:31Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:42124 worker1 # [ 38.399505] nix-grpc-daemon[773]: ts=2026-09-21T12:33:31Z level=debug event=path_info_miss path=llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test error="error: path '/nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 38.345469] nix-grpc-daemon[779]: ts=2026-09-21T12:33:30Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 38.352739] nix-grpc-daemon[779]: ts=2026-09-21T12:33:30Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:36638 worker2 # [ 38.361175] nix-grpc-daemon[779]: ts=2026-09-21T12:33:30Z level=debug event=path_info_miss path=llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test error="error: path '/nix/store/llyf0bg5i97i0wydcrmwr522c4lqspsl-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds) worker2 # [ 38.698322] nix-grpc-daemon[779]: ts=2026-09-21T12:33:31Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 38.961282] nix-grpc-daemon[779]: ts=2026-09-21T12:33:31Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.25 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker2 # [ 39.214345] nix-grpc-daemon[779]: ts=2026-09-21T12:33:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36638 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 39.301332] nix-grpc-daemon[773]: ts=2026-09-21T12:33:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 39.334641] nix-grpc-daemon[773]: ts=2026-09-21T12:33:31Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker1 # [ 39.341863] nix-grpc-daemon[773]: ts=2026-09-21T12:33:31Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 39.380849] nix-grpc-daemon[773]: ts=2026-09-21T12:33:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 39.402965] nix-grpc-daemon[773]: ts=2026-09-21T12:33:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 client # copying 1 paths to 'lb:50051'... worker1 # [ 39.420826] nix-grpc-daemon[773]: ts=2026-09-21T12:33:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 39.449726] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 39.478999] nix-grpc-daemon[773]: ts=2026-09-21T12:33:32Z level=info event=niks3_push_started pid=869 worker1 # [ 39.764811] nix-grpc-daemon[869]: time=2026-09-21T12:33:32.403Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 39.956581] nix-daemon[855]: accepted connection from pid 883, user nix-grpc-daemon (trusted) lb # [ 39.887488] envoy[902]: conn peer=[2001:db8:1::1]:41220 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=365 ms=1015 worker1 # [ 39.975843] nix-daemon[855]: reaped child process 886, status = succeeded worker1 # [ 40.147458] nix-daemon[855]: accepted connection from pid 888, user nix-grpc-daemon (trusted) worker1 # [ 40.165242] nix-daemon[855]: reaped child process 891, status = succeeded lb # [ 39.892584] envoy[902]: conn peer=[2001:db8:1::1]:41226 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=365 ms=892 lb # [ 39.892710] envoy[902]: conn peer=[2001:db8:1::1]:41236 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=12 lb # [ 39.892810] envoy[902]: conn peer=[2001:db8:1::1]:41244 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=12 lb # [ 40.104655] niks3-server[1040]: 2026/09/21 12:33:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.213926] nix-grpc-daemon[869]: time=2026-09-21T12:33:32.854Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 40.217560] nix-grpc-daemon[869]: time=2026-09-21T12:33:32.856Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 40.187851] niks3-server[1040]: 2026/09/21 12:33:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 40.200007] niks3-server[1040]: 2026/09/21 12:33:32 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 40.227800] niks3-server[1040]: 2026/09/21 12:33:32 INFO Signed narinfos id=1 count=1 worker1 # [ 40.304127] nix-grpc-daemon[869]: time=2026-09-21T12:33:32.944Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.236579] niks3-server[1040]: 2026/09/21 12:33:32 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 40.251649] niks3-server[1040]: 2026/09/21 12:33:32 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 40.259727] niks3-server[1040]: 2026/09/21 12:33:32 INFO Completed upload id=1 worker1 # [ 40.333046] nix-grpc-daemon[869]: time=2026-09-21T12:33:32.973Z level=INFO msg="Upload complete. (560ms)" lb # [ 40.271064] niks3-server[1040]: 2026/09/21 12:33:32 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo worker1 # [ 40.348594] nix-grpc-daemon[773]: ts=2026-09-21T12:33:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 40.364456] nix-grpc-daemon[773]: ts=2026-09-21T12:33:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 40.371231] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 40.383171] nix-daemon[855]: reaped child process 867, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker1 # [ 40.391657] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 42.085827] nix-daemon[855]: reaped child process 895, status = succeeded worker1 # [ 42.278257] nix-daemon[855]: accepted connection from pid 911, user nix-grpc-daemon (trusted) worker1 # [ 42.298219] nix-daemon[855]: reaped child process 914, status = succeeded lb # [ 42.241976] niks3-server[1040]: 2026/09/21 12:33:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.348589] nix-grpc-daemon[869]: time=2026-09-21T12:33:34.987Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 42.350583] nix-grpc-daemon[869]: time=2026-09-21T12:33:34.988Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 42.353353] niks3-server[1040]: 2026/09/21 12:33:35 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 42.360348] niks3-server[1040]: 2026/09/21 12:33:35 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 42.366720] niks3-server[1040]: 2026/09/21 12:33:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 42.373238] niks3-server[1040]: 2026/09/21 12:33:35 INFO Signed narinfos id=2 count=1 worker1 # [ 42.445650] nix-grpc-daemon[869]: time=2026-09-21T12:33:35.084Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.375264] niks3-server[1040]: 2026/09/21 12:33:35 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 42.387560] niks3-server[1040]: 2026/09/21 12:33:35 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 42.392372] niks3-server[1040]: 2026/09/21 12:33:35 INFO Completed upload id=2 worker1 # [ 42.465131] nix-grpc-daemon[869]: time=2026-09-21T12:33:35.105Z level=INFO msg="Upload complete. (452ms)" lb # [ 42.395472] niks3-server[1040]: 2026/09/21 12:33:35 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 42.493070] nix-grpc-daemon[773]: ts=2026-09-21T12:33:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=2 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker1 # [ 42.512591] nix-grpc-daemon[773]: ts=2026-09-21T12:33:35Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker1 # [ 42.517504] nix-grpc-daemon[773]: ts=2026-09-21T12:33:35Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 42.521702] nix-daemon[855]: reaped child process 893, status = succeeded worker1 # [ 42.549200] nix-grpc-daemon[773]: ts=2026-09-21T12:33:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 42.574795] nix-grpc-daemon[773]: ts=2026-09-21T12:33:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 42.599018] nix-grpc-daemon[869]: time=2026-09-21T12:33:35.239Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 42.613285] nix-grpc-daemon[773]: ts=2026-09-21T12:33:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 42.637499] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 42.927644] nix-daemon[855]: accepted connection from pid 920, user nix-grpc-daemon (trusted) worker1 # [ 42.952465] nix-daemon[855]: reaped child process 924, status = succeeded worker1 # [ 43.150534] nix-daemon[855]: accepted connection from pid 926, user nix-grpc-daemon (trusted) worker1 # [ 43.169820] nix-daemon[855]: reaped child process 929, status = succeeded lb # [ 43.109544] niks3-server[1040]: 2026/09/21 12:33:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.207350] nix-grpc-daemon[869]: time=2026-09-21T12:33:35.847Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 43.209021] nix-grpc-daemon[869]: time=2026-09-21T12:33:35.847Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 43.170773] niks3-server[1040]: 2026/09/21 12:33:35 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst lb # [ 43.174319] niks3-server[1040]: 2026/09/21 12:33:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign worker1 # [ 43.250513] nix-grpc-daemon[869]: time=2026-09-21T12:33:35.890Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.180345] niks3-server[1040]: 2026/09/21 12:33:35 INFO Signed narinfos id=3 count=1 lb # [ 43.183949] niks3-server[1040]: 2026/09/21 12:33:35 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 43.188645] niks3-server[1040]: 2026/09/21 12:33:35 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 43.195133] niks3-server[1040]: 2026/09/21 12:33:35 INFO Completed upload id=3 worker1 # [ 43.268586] nix-grpc-daemon[869]: time=2026-09-21T12:33:35.909Z level=INFO msg="Upload complete. (609ms)" lb # [ 43.197506] niks3-server[1040]: 2026/09/21 12:33:35 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker1 # [ 43.280698] nix-grpc-daemon[773]: ts=2026-09-21T12:33:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 43.292080] nix-grpc-daemon[773]: ts=2026-09-21T12:33:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 43.304503] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 43.309384] nix-daemon[855]: reaped child process 918, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... worker1 # [ 43.321364] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 44.147166] nix-daemon[855]: reaped child process 933, status = succeeded worker1 # [ 44.307668] nix-daemon[855]: accepted connection from pid 949, user nix-grpc-daemon (trusted) worker1 # [ 44.327404] nix-daemon[855]: reaped child process 952, status = succeeded lb # [ 44.266751] niks3-server[1040]: 2026/09/21 12:33:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 44.351033] nix-grpc-daemon[869]: time=2026-09-21T12:33:36.990Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 44.352656] nix-grpc-daemon[869]: time=2026-09-21T12:33:36.990Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 44.311405] niks3-server[1040]: 2026/09/21 12:33:36 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 44.323016] niks3-server[1040]: 2026/09/21 12:33:36 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 44.332921] niks3-server[1040]: 2026/09/21 12:33:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign worker1 # [ 44.411531] nix-grpc-daemon[869]: time=2026-09-21T12:33:37.051Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.340246] niks3-server[1040]: 2026/09/21 12:33:36 INFO Signed narinfos id=4 count=1 lb # [ 44.345918] niks3-server[1040]: 2026/09/21 12:33:36 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 44.354572] niks3-server[1040]: 2026/09/21 12:33:37 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 44.361658] niks3-server[1040]: 2026/09/21 12:33:37 INFO Completed upload id=4 worker1 # [ 44.434137] nix-grpc-daemon[869]: time=2026-09-21T12:33:37.074Z level=INFO msg="Upload complete. (297ms)" lb # [ 44.364677] niks3-server[1040]: 2026/09/21 12:33:37 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker1 # [ 44.448445] nix-grpc-daemon[773]: ts=2026-09-21T12:33:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker1 # [ 44.466457] nix-grpc-daemon[773]: ts=2026-09-21T12:33:37Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker1 # [ 44.470798] nix-grpc-daemon[773]: ts=2026-09-21T12:33:37Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 44.475044] nix-daemon[855]: reaped child process 931, status = succeeded worker1 # [ 44.505773] nix-grpc-daemon[773]: ts=2026-09-21T12:33:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 44.521430] nix-grpc-daemon[773]: ts=2026-09-21T12:33:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 44.537456] nix-grpc-daemon[869]: time=2026-09-21T12:33:37.177Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 44.547790] nix-grpc-daemon[773]: ts=2026-09-21T12:33:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 44.568334] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 44.778763] nix-daemon[855]: accepted connection from pid 958, user nix-grpc-daemon (trusted) worker1 # [ 44.796760] nix-daemon[855]: reaped child process 961, status = succeeded worker1 # [ 44.972427] nix-daemon[855]: accepted connection from pid 963, user nix-grpc-daemon (trusted) worker1 # [ 44.989345] nix-daemon[855]: reaped child process 966, status = succeeded lb # [ 44.927927] niks3-server[1040]: 2026/09/21 12:33:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.011832] nix-grpc-daemon[869]: time=2026-09-21T12:33:37.652Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 45.013504] nix-grpc-daemon[869]: time=2026-09-21T12:33:37.652Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 44.959621] niks3-server[1040]: 2026/09/21 12:33:37 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 44.973387] niks3-server[1040]: 2026/09/21 12:33:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 45.053054] nix-grpc-daemon[869]: time=2026-09-21T12:33:37.693Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.984058] niks3-server[1040]: 2026/09/21 12:33:37 INFO Signed narinfos id=5 count=1 lb # [ 44.986715] niks3-server[1040]: 2026/09/21 12:33:37 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 44.996201] niks3-server[1040]: 2026/09/21 12:33:37 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 45.003931] niks3-server[1040]: 2026/09/21 12:33:37 INFO Completed upload id=5 worker1 # [ 45.076742] nix-grpc-daemon[869]: time=2026-09-21T12:33:37.717Z level=INFO msg="Upload complete. (487ms)" lb # [ 45.006456] niks3-server[1040]: 2026/09/21 12:33:37 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 45.086063] nix-grpc-daemon[773]: ts=2026-09-21T12:33:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 45.098798] nix-grpc-daemon[773]: ts=2026-09-21T12:33:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 45.105303] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 45.110060] nix-daemon[855]: reaped child process 956, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... worker1 # [ 45.122664] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 46.364534] nix-daemon[855]: reaped child process 970, status = succeeded worker1 # [ 46.552192] nix-daemon[855]: accepted connection from pid 987, user nix-grpc-daemon (trusted) worker1 # [ 46.571241] nix-daemon[855]: reaped child process 990, status = succeeded lb # [ 46.510812] niks3-server[1040]: 2026/09/21 12:33:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 46.594700] nix-grpc-daemon[869]: time=2026-09-21T12:33:39.234Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 46.598072] nix-grpc-daemon[869]: time=2026-09-21T12:33:39.237Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 46.551665] niks3-server[1040]: 2026/09/21 12:33:39 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 46.561228] niks3-server[1040]: 2026/09/21 12:33:39 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst worker1 # [ 46.644867] nix-grpc-daemon[869]: time=2026-09-21T12:33:39.285Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.572240] niks3-server[1040]: 2026/09/21 12:33:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 46.579311] niks3-server[1040]: 2026/09/21 12:33:39 INFO Signed narinfos id=6 count=1 lb # [ 46.583600] niks3-server[1040]: 2026/09/21 12:33:39 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 46.588176] niks3-server[1040]: 2026/09/21 12:33:39 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 46.596291] niks3-server[1040]: 2026/09/21 12:33:39 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 46.600771] niks3-server[1040]: 2026/09/21 12:33:39 INFO Completed upload id=6 worker1 # [ 46.673951] nix-grpc-daemon[869]: time=2026-09-21T12:33:39.314Z level=INFO msg="Upload complete. (341ms)" worker1 # [ 46.685185] nix-grpc-daemon[773]: ts=2026-09-21T12:33:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker1 # [ 46.701370] nix-daemon[855]: reaped child process 968, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.69 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.38 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.27 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.30 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 48.263185] nix-grpc-daemon[773]: ts=2026-09-21T12:33:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42124 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # [ 48.282675] nix-grpc-daemon[773]: ts=2026-09-21T12:33:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 48.293780] nix-grpc-daemon[869]: time=2026-09-21T12:33:40.933Z level=INFO msg="All 2 paths already cached" worker1 # [ 48.312788] nix-grpc-daemon[773]: ts=2026-09-21T12:33:40Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.36 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.46 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 49.290045] nix-grpc-daemon[779]: ts=2026-09-21T12:33:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36638 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 49.374847] nix-grpc-daemon[773]: ts=2026-09-21T12:33:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 49.387652] nix-grpc-daemon[869]: time=2026-09-21T12:33:42.027Z level=INFO msg="All 2 paths already cached" worker1 # [ 49.403784] nix-grpc-daemon[773]: ts=2026-09-21T12:33:42Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker1 # [ 49.410717] nix-grpc-daemon[773]: ts=2026-09-21T12:33:42Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 49.453186] nix-grpc-daemon[773]: ts=2026-09-21T12:33:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 49.468943] nix-grpc-daemon[773]: ts=2026-09-21T12:33:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 49.483542] nix-grpc-daemon[869]: time=2026-09-21T12:33:42.124Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 49.493686] nix-grpc-daemon[773]: ts=2026-09-21T12:33:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker1 # [ 49.512122] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 49.718882] nix-daemon[855]: accepted connection from pid 1019, user nix-grpc-daemon (trusted) worker1 # [ 49.737618] nix-daemon[855]: reaped child process 1022, status = succeeded worker1 # [ 49.911006] nix-daemon[855]: accepted connection from pid 1024, user nix-grpc-daemon (trusted) worker1 # [ 49.926957] nix-daemon[855]: reaped child process 1027, status = succeeded lb # [ 49.867017] niks3-server[1040]: 2026/09/21 12:33:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 49.949508] nix-grpc-daemon[869]: time=2026-09-21T12:33:42.589Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 49.950991] nix-grpc-daemon[869]: time=2026-09-21T12:33:42.589Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 49.890695] envoy[902]: conn peer=[2001:db8:1::1]:41246 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9549 tx=4050 ms=7422 lb # [ 49.901425] envoy[902]: conn peer=[2001:db8:1::1]:48096 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=71 worker1 # [ 49.987548] nix-grpc-daemon[869]: time=2026-09-21T12:33:42.627Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.915143] niks3-server[1040]: 2026/09/21 12:33:42 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 49.927049] niks3-server[1040]: 2026/09/21 12:33:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 49.933390] niks3-server[1040]: 2026/09/21 12:33:42 INFO Signed narinfos id=7 count=1 worker1 # [ 50.013636] nix-grpc-daemon[869]: time=2026-09-21T12:33:42.654Z level=INFO msg="Upload complete. (483ms)" lb # [ 49.941259] niks3-server[1040]: 2026/09/21 12:33:42 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 49.947121] niks3-server[1040]: 2026/09/21 12:33:42 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 49.951849] niks3-server[1040]: 2026/09/21 12:33:42 INFO Completed upload id=7 worker1 # [ 50.024272] nix-grpc-daemon[773]: ts=2026-09-21T12:33:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 49.954208] niks3-server[1040]: 2026/09/21 12:33:42 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker1 # [ 50.034657] nix-grpc-daemon[773]: ts=2026-09-21T12:33:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 50.044512] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 50.047364] nix-daemon[855]: reaped child process 1017, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... worker1 # [ 50.058872] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 51.103677] nix-daemon[855]: reaped child process 1031, status = succeeded worker1 # [ 51.285036] nix-daemon[855]: accepted connection from pid 1047, user nix-grpc-daemon (trusted) worker1 # [ 51.302086] nix-daemon[855]: reaped child process 1050, status = succeeded lb # [ 51.242727] niks3-server[1040]: 2026/09/21 12:33:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 51.328504] nix-grpc-daemon[869]: time=2026-09-21T12:33:43.965Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 51.330654] nix-grpc-daemon[869]: time=2026-09-21T12:33:43.966Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 51.284785] niks3-server[1040]: 2026/09/21 12:33:43 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 51.295349] niks3-server[1040]: 2026/09/21 12:33:43 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 51.307375] niks3-server[1040]: 2026/09/21 12:33:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker1 # [ 51.386600] nix-grpc-daemon[869]: time=2026-09-21T12:33:44.026Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.313394] niks3-server[1040]: 2026/09/21 12:33:43 INFO Signed narinfos id=8 count=1 lb # [ 51.318553] niks3-server[1040]: 2026/09/21 12:33:43 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 51.331662] niks3-server[1040]: 2026/09/21 12:33:43 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 51.339016] niks3-server[1040]: 2026/09/21 12:33:43 INFO Completed upload id=8 worker1 # [ 51.411581] nix-grpc-daemon[869]: time=2026-09-21T12:33:44.052Z level=INFO msg="Upload complete. (339ms)" lb # [ 51.342115] niks3-server[1040]: 2026/09/21 12:33:43 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker1 # [ 51.425176] nix-grpc-daemon[773]: ts=2026-09-21T12:33:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker1 # [ 51.442739] nix-daemon[855]: reaped child process 1029, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.37 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.02 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 51.925272] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: c621bc2bcb2b490997ffeeea48bcce97 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.09 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup worker2 # [ 52.182280] nix-grpc-daemon[779]: ts=2026-09-21T12:33:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36638 client # [ 52.196883] nix[880]: don't know how to build these paths: client # [ 52.198693] nix[880]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 52.272173] nix-grpc-daemon[773]: ts=2026-09-21T12:33:44Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker1 # [ 52.272628] nix-grpc-daemon[773]: ts=2026-09-21T12:33:44Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 52.257753] nix-grpc-daemon[779]: ts=2026-09-21T12:33:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 52.278544] nix-grpc-daemon[779]: ts=2026-09-21T12:33:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36638 client # [ 52.300177] nix[880]: copying 1 paths to 'lb:50051'... worker2 # [ 52.298417] nix-grpc-daemon[779]: ts=2026-09-21T12:33:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36638 client # [ 52.307875] nix[880]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 52.314519] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 52.345696] nix-grpc-daemon[779]: ts=2026-09-21T12:33:44Z level=info event=niks3_push_started pid=875 worker2 # [ 52.608755] nix-grpc-daemon[875]: time=2026-09-21T12:33:45.241Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 52.797286] nix-daemon[847]: accepted connection from pid 888, user nix-grpc-daemon (trusted) worker2 # [ 52.815833] nix-daemon[847]: reaped child process 891, status = succeeded worker2 # [ 52.988585] nix-daemon[847]: accepted connection from pid 893, user nix-grpc-daemon (trusted) worker2 # [ 53.004329] nix-daemon[847]: reaped child process 896, status = succeeded lb # [ 53.018050] niks3-server[1040]: 2026/09/21 12:33:45 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 53.025553] nix-grpc-daemon[875]: time=2026-09-21T12:33:45.660Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 53.028886] nix-grpc-daemon[875]: time=2026-09-21T12:33:45.662Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" client # [ 53.039739] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. lb # [ 53.051534] niks3-server[1040]: 2026/09/21 12:33:45 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.13 seconds) worker2 # [ 53.072222] nix-grpc-daemon[875]: time=2026-09-21T12:33:45.706Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.064808] niks3-server[1040]: 2026/09/21 12:33:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 53.076931] niks3-server[1040]: 2026/09/21 12:33:45 INFO Signed narinfos id=9 count=1 lb # [ 53.083266] niks3-server[1040]: 2026/09/21 12:33:45 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 53.094310] niks3-server[1040]: 2026/09/21 12:33:45 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 53.103873] niks3-server[1040]: 2026/09/21 12:33:45 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo lb # [ 53.109019] niks3-server[1040]: 2026/09/21 12:33:45 INFO Completed upload id=9 worker2 # [ 53.110250] nix-grpc-daemon[875]: time=2026-09-21T12:33:45.745Z level=INFO msg="Upload complete. (493ms)" worker2 # [ 53.118880] nix-grpc-daemon[779]: ts=2026-09-21T12:33:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36638 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 53.131527] nix-grpc-daemon[779]: ts=2026-09-21T12:33:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 53.137898] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 53.142804] nix-daemon[847]: reaped child process 873, status = succeeded client # Running as unit: dedup2.service; invocation ID: 18878402dd2f4d5da4424fbcf149accf client # [ 53.159237] nix[880]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 53.153638] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # [ 53.373933] nix[896]: don't know how to build these paths: client # [ 53.375608] nix[896]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 53.436979] nix-grpc-daemon[773]: ts=2026-09-21T12:33:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 53.451032] nix-grpc-daemon[773]: ts=2026-09-21T12:33:46Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 client # [ 53.393066] nix[896]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 53.385048] nix-grpc-daemon[779]: ts=2026-09-21T12:33:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36638 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.07 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 58.006800] nix-daemon[847]: reaped child process 902, status = succeeded worker2 # [ 58.196067] nix-daemon[847]: accepted connection from pid 934, user nix-grpc-daemon (trusted) worker2 # [ 58.212219] nix-daemon[847]: reaped child process 937, status = succeeded lb # [ 58.225623] niks3-server[1040]: 2026/09/21 12:33:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 58.238278] nix-grpc-daemon[875]: time=2026-09-21T12:33:50.871Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 58.241114] nix-grpc-daemon[875]: time=2026-09-21T12:33:50.871Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 58.269917] niks3-server[1040]: 2026/09/21 12:33:50 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 58.284523] niks3-server[1040]: 2026/09/21 12:33:50 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 58.296073] niks3-server[1040]: 2026/09/21 12:33:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 58.305036] niks3-server[1040]: 2026/09/21 12:33:50 INFO Signed narinfos id=10 count=1 worker2 # [ 58.305860] nix-grpc-daemon[875]: time=2026-09-21T12:33:50.939Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.308210] niks3-server[1040]: 2026/09/21 12:33:50 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 58.319501] niks3-server[1040]: 2026/09/21 12:33:50 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 58.329155] niks3-server[1040]: 2026/09/21 12:33:50 INFO Completed upload id=10 worker2 # [ 58.330711] nix-grpc-daemon[875]: time=2026-09-21T12:33:50.965Z level=INFO msg="Upload complete. (349ms)" lb # [ 58.333621] niks3-server[1040]: 2026/09/21 12:33:50 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 58.345163] nix-grpc-daemon[779]: ts=2026-09-21T12:33:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36638 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 58.360622] nix-grpc-daemon[779]: ts=2026-09-21T12:33:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36638 duration_s=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 58.369664] nix-daemon[847]: reaped child process 898, status = succeeded client # [ 58.417220] systemd[1]: dedup1.service: Deactivated successfully. client # [ 58.421076] systemd[1]: dedup1.service: Consumed 174ms CPU time over 6.495s wall clock time, 39.3M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. client # [ 58.430649] systemd[1]: dedup2.service: Deactivated successfully. client # [ 58.435049] systemd[1]: dedup2.service: Consumed 205ms CPU time over 5.391s wall clock time, 35.2M memory peak, 6K incoming IP traffic, 5.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: two clients wanting the same drv build it once, in 7.44 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 59.512764] systemd[1]: Started Nix Daemon. client # [ 59.696211] nix-daemon[938]: accepted connection from pid 935, user root (trusted) lb # [ 59.892312] envoy[902]: conn peer=[2001:db8:1::1]:48112 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4202 tx=1825 ms=2077 lb # [ 59.897736] envoy[902]: conn peer=[2001:db8:1::1]:54570 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3009 tx=1470 ms=6178 lb # [ 59.907199] envoy[902]: conn peer=[2001:db8:1::1]:54584 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1082 ms=5009 worker1 # [ 59.993874] nix-grpc-daemon[773]: ts=2026-09-21T12:33:52Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42124 worker2 # [ 59.926668] nix-grpc-daemon[779]: ts=2026-09-21T12:33:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36638 worker1 # [ 60.019074] nix-grpc-daemon[773]: ts=2026-09-21T12:33:52Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker1 # [ 60.026310] nix-grpc-daemon[773]: ts=2026-09-21T12:33:52Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 60.065925] nix-grpc-daemon[773]: ts=2026-09-21T12:33:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 60.082715] nix-grpc-daemon[773]: ts=2026-09-21T12:33:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 60.098486] nix-grpc-daemon[773]: ts=2026-09-21T12:33:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 60.114639] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 60.323701] nix-daemon[855]: accepted connection from pid 1090, user nix-grpc-daemon (trusted) worker1 # [ 60.344277] nix-daemon[855]: reaped child process 1093, status = succeeded worker1 # [ 60.520336] nix-daemon[855]: accepted connection from pid 1095, user nix-grpc-daemon (trusted) worker1 # [ 60.536862] nix-daemon[855]: reaped child process 1098, status = succeeded lb # [ 60.478817] niks3-server[1040]: 2026/09/21 12:33:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 60.561659] nix-grpc-daemon[869]: time=2026-09-21T12:33:53.201Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 60.563164] nix-grpc-daemon[869]: time=2026-09-21T12:33:53.201Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 60.509147] niks3-server[1040]: 2026/09/21 12:33:53 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 60.525229] niks3-server[1040]: 2026/09/21 12:33:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker1 # [ 60.604206] nix-grpc-daemon[869]: time=2026-09-21T12:33:53.244Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.538024] niks3-server[1040]: 2026/09/21 12:33:53 INFO Signed narinfos id=11 count=1 lb # [ 60.548220] niks3-server[1040]: 2026/09/21 12:33:53 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 60.551898] niks3-server[1040]: 2026/09/21 12:33:53 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 60.559014] niks3-server[1040]: 2026/09/21 12:33:53 INFO Completed upload id=11 worker1 # [ 60.631516] nix-grpc-daemon[869]: time=2026-09-21T12:33:53.272Z level=INFO msg="Upload complete. (499ms)" lb # [ 60.561763] niks3-server[1040]: 2026/09/21 12:33:53 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker1 # [ 60.640314] nix-grpc-daemon[773]: ts=2026-09-21T12:33:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 60.654193] nix-grpc-daemon[773]: ts=2026-09-21T12:33:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 60.661012] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 60.666368] nix-daemon[855]: reaped child process 1088, status = succeeded worker1 # [ 60.678049] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 61.528374] nix-daemon[855]: reaped child process 1102, status = succeeded worker1 # [ 61.701906] nix-daemon[855]: accepted connection from pid 1118, user nix-grpc-daemon (trusted) worker1 # [ 61.717605] nix-daemon[855]: reaped child process 1121, status = succeeded lb # [ 61.657205] niks3-server[1040]: 2026/09/21 12:33:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 61.744394] nix-grpc-daemon[869]: time=2026-09-21T12:33:54.380Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 61.745919] nix-grpc-daemon[869]: time=2026-09-21T12:33:54.380Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 61.705693] niks3-server[1040]: 2026/09/21 12:33:54 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst worker1 # [ 61.787155] nix-grpc-daemon[869]: time=2026-09-21T12:33:54.427Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.719022] niks3-server[1040]: 2026/09/21 12:33:54 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 61.727862] niks3-server[1040]: 2026/09/21 12:33:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 61.737408] niks3-server[1040]: 2026/09/21 12:33:54 INFO Signed narinfos id=12 count=1 lb # [ 61.740556] niks3-server[1040]: 2026/09/21 12:33:54 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls worker1 # [ 61.809754] nix-grpc-daemon[869]: time=2026-09-21T12:33:54.450Z level=INFO msg="Upload complete. (316ms)" lb # [ 61.745297] niks3-server[1040]: 2026/09/21 12:33:54 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 61.749858] niks3-server[1040]: 2026/09/21 12:33:54 INFO Completed upload id=12 worker1 # [ 61.821208] nix-grpc-daemon[773]: ts=2026-09-21T12:33:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 lb # [ 61.752430] niks3-server[1040]: 2026/09/21 12:33:54 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker1 # [ 61.838277] nix-grpc-daemon[773]: ts=2026-09-21T12:33:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 61.842311] nix-daemon[855]: reaped child process 1100, status = succeeded worker1 # [ 61.863558] nix-grpc-daemon[773]: ts=2026-09-21T12:33:54Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 61.869816] nix-grpc-daemon[773]: ts=2026-09-21T12:33:54Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 62.120464] nix-grpc-daemon[779]: ts=2026-09-21T12:33:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 62.126866] nix-grpc-daemon[779]: ts=2026-09-21T12:33:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36638 worker1 # [ 62.224129] nix-grpc-daemon[773]: ts=2026-09-21T12:33:54Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker1 # [ 62.230817] nix-grpc-daemon[773]: ts=2026-09-21T12:33:54Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 62.239074] nix-grpc-daemon[773]: ts=2026-09-21T12:33:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 62.249542] nix-grpc-daemon[773]: ts=2026-09-21T12:33:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 62.262882] nix-grpc-daemon[869]: time=2026-09-21T12:33:54.903Z level=INFO msg="All 1 paths already cached" worker1 # [ 62.271636] nix-grpc-daemon[773]: ts=2026-09-21T12:33:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 62.288570] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 62.491354] nix-daemon[855]: accepted connection from pid 1127, user nix-grpc-daemon (trusted) worker1 # [ 62.508923] nix-daemon[855]: reaped child process 1130, status = succeeded worker1 # [ 62.677131] nix-daemon[855]: accepted connection from pid 1132, user nix-grpc-daemon (trusted) worker1 # [ 62.692650] nix-daemon[855]: reaped child process 1135, status = succeeded lb # [ 62.631003] niks3-server[1040]: 2026/09/21 12:33:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 62.713865] nix-grpc-daemon[869]: time=2026-09-21T12:33:55.354Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 62.715281] nix-grpc-daemon[869]: time=2026-09-21T12:33:55.354Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 62.660682] niks3-server[1040]: 2026/09/21 12:33:55 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst lb # [ 62.672418] niks3-server[1040]: 2026/09/21 12:33:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign worker1 # [ 62.753148] nix-grpc-daemon[869]: time=2026-09-21T12:33:55.393Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.679852] niks3-server[1040]: 2026/09/21 12:33:55 INFO Signed narinfos id=13 count=1 lb # [ 62.690029] niks3-server[1040]: 2026/09/21 12:33:55 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 62.697896] niks3-server[1040]: 2026/09/21 12:33:55 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 62.704157] niks3-server[1040]: 2026/09/21 12:33:55 INFO Completed upload id=13 worker1 # [ 62.777230] nix-grpc-daemon[869]: time=2026-09-21T12:33:55.417Z level=INFO msg="Upload complete. (472ms)" lb # [ 62.707243] niks3-server[1040]: 2026/09/21 12:33:55 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker1 # [ 62.784270] nix-grpc-daemon[773]: ts=2026-09-21T12:33:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 62.797064] nix-grpc-daemon[773]: ts=2026-09-21T12:33:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 62.803131] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 62.807586] nix-daemon[855]: reaped child process 1125, status = succeeded worker1 # [ 62.820597] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 63.239761] nix-daemon[855]: reaped child process 1139, status = succeeded worker1 # [ 63.396644] nix-daemon[855]: accepted connection from pid 1155, user nix-grpc-daemon (trusted) worker1 # [ 63.411563] nix-daemon[855]: reaped child process 1158, status = succeeded lb # [ 63.352458] niks3-server[1040]: 2026/09/21 12:33:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 63.437453] nix-grpc-daemon[869]: time=2026-09-21T12:33:56.077Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 63.438895] nix-grpc-daemon[869]: time=2026-09-21T12:33:56.077Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 63.383572] niks3-server[1040]: 2026/09/21 12:33:56 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 63.397981] niks3-server[1040]: 2026/09/21 12:33:56 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 63.410159] niks3-server[1040]: 2026/09/21 12:33:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign worker1 # [ 63.487934] nix-grpc-daemon[869]: time=2026-09-21T12:33:56.128Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.419578] niks3-server[1040]: 2026/09/21 12:33:56 INFO Signed narinfos id=14 count=1 lb # [ 63.424119] niks3-server[1040]: 2026/09/21 12:33:56 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls worker1 # [ 63.503973] nix-grpc-daemon[869]: time=2026-09-21T12:33:56.144Z level=INFO msg="Upload complete. (275ms)" lb # [ 63.431345] niks3-server[1040]: 2026/09/21 12:33:56 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 63.435821] niks3-server[1040]: 2026/09/21 12:33:56 INFO Completed upload id=14 lb # [ 63.438376] niks3-server[1040]: 2026/09/21 12:33:56 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker1 # [ 63.512728] nix-grpc-daemon[773]: ts=2026-09-21T12:33:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=0 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker2 # [ 63.448666] nix-grpc-daemon[779]: ts=2026-09-21T12:33:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36638 worker1 # [ 63.525700] nix-daemon[855]: reaped child process 1137, status = succeeded worker2 # [ 63.464644] nix-grpc-daemon[779]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker2 # [ 63.482564] nix-grpc-daemon[779]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker2 # [ 63.523243] nix-grpc-daemon[779]: ts=2026-09-21T12:33:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 63.529982] nix-grpc-daemon[779]: ts=2026-09-21T12:33:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36638 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 63.921044] nix-grpc-daemon[773]: ts=2026-09-21T12:33:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42124 worker2 # [ 63.853245] nix-grpc-daemon[779]: ts=2026-09-21T12:33:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 63.864270] nix-grpc-daemon[875]: time=2026-09-21T12:33:56.498Z level=INFO msg="All 2 paths already cached" worker1 # [ 63.952848] nix-grpc-daemon[773]: ts=2026-09-21T12:33:56Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker1 # [ 63.960081] nix-grpc-daemon[773]: ts=2026-09-21T12:33:56Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 63.969878] nix-grpc-daemon[773]: ts=2026-09-21T12:33:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 63.980891] nix-grpc-daemon[773]: ts=2026-09-21T12:33:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 63.994956] nix-grpc-daemon[869]: time=2026-09-21T12:33:56.634Z level=INFO msg="All 2 paths already cached" worker1 # [ 64.003604] nix-grpc-daemon[773]: ts=2026-09-21T12:33:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 64.018410] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 64.219700] nix-daemon[855]: accepted connection from pid 1164, user nix-grpc-daemon (trusted) worker1 # [ 64.238073] nix-daemon[855]: reaped child process 1167, status = succeeded worker1 # [ 64.411431] nix-daemon[855]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker1 # [ 64.428606] nix-daemon[855]: reaped child process 1172, status = succeeded lb # [ 64.368679] niks3-server[1040]: 2026/09/21 12:33:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 64.452068] nix-grpc-daemon[869]: time=2026-09-21T12:33:57.092Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 64.453880] nix-grpc-daemon[869]: time=2026-09-21T12:33:57.092Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 64.397708] niks3-server[1040]: 2026/09/21 12:33:57 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst lb # [ 64.413981] niks3-server[1040]: 2026/09/21 12:33:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker1 # [ 64.492488] nix-grpc-daemon[869]: time=2026-09-21T12:33:57.132Z level=INFO msg="Uploading 1 narinfos" lb # [ 64.426014] niks3-server[1040]: 2026/09/21 12:33:57 INFO Signed narinfos id=15 count=1 lb # [ 64.433038] niks3-server[1040]: 2026/09/21 12:33:57 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 64.444316] niks3-server[1040]: 2026/09/21 12:33:57 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 64.449213] niks3-server[1040]: 2026/09/21 12:33:57 INFO Completed upload id=15 worker1 # [ 64.522039] nix-grpc-daemon[869]: time=2026-09-21T12:33:57.162Z level=INFO msg="Upload complete. (488ms)" lb # [ 64.451989] niks3-server[1040]: 2026/09/21 12:33:57 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker1 # [ 64.532975] nix-grpc-daemon[773]: ts=2026-09-21T12:33:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 64.544346] nix-grpc-daemon[773]: ts=2026-09-21T12:33:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 64.552162] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 64.555516] nix-daemon[855]: reaped child process 1162, status = succeeded worker1 # [ 64.570075] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 65.991900] nix-daemon[855]: reaped child process 1176, status = succeeded worker1 # [ 66.152591] nix-daemon[855]: accepted connection from pid 1192, user nix-grpc-daemon (trusted) worker1 # [ 66.168453] nix-daemon[855]: reaped child process 1195, status = succeeded lb # [ 66.111936] niks3-server[1040]: 2026/09/21 12:33:58 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 66.196390] nix-grpc-daemon[869]: time=2026-09-21T12:33:58.834Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 66.197847] nix-grpc-daemon[869]: time=2026-09-21T12:33:58.834Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 66.147661] niks3-server[1040]: 2026/09/21 12:33:58 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 66.163600] niks3-server[1040]: 2026/09/21 12:33:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker1 # [ 66.242873] nix-grpc-daemon[869]: time=2026-09-21T12:33:58.883Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.176102] niks3-server[1040]: 2026/09/21 12:33:58 INFO Signed narinfos id=16 count=1 lb # [ 66.178558] niks3-server[1040]: 2026/09/21 12:33:58 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 66.185899] niks3-server[1040]: 2026/09/21 12:33:58 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 66.193836] niks3-server[1040]: 2026/09/21 12:33:58 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 66.198236] niks3-server[1040]: 2026/09/21 12:33:58 INFO Completed upload id=16 worker1 # [ 66.271272] nix-grpc-daemon[869]: time=2026-09-21T12:33:58.911Z level=INFO msg="Upload complete. (291ms)" lb # [ 66.200688] niks3-server[1040]: 2026/09/21 12:33:58 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker1 # [ 66.281121] nix-grpc-daemon[773]: ts=2026-09-21T12:33:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker1 # [ 66.295917] nix-grpc-daemon[773]: ts=2026-09-21T12:33:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 66.300418] nix-daemon[855]: reaped child process 1174, status = succeeded worker1 # [ 66.314216] nix-grpc-daemon[773]: ts=2026-09-21T12:33:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 66.319110] nix-grpc-daemon[773]: ts=2026-09-21T12:33:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=0 paths=1 nar_bytes_out=232 client # [ 66.381382] nix-daemon[938]: reaped child process 940, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.11 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.24 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.44 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.24 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 67.668569] nix-daemon[938]: accepted connection from pid 1021, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 67.950189] nix-grpc-daemon[773]: ts=2026-09-21T12:34:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42124 worker2 # [ 67.883677] nix-grpc-daemon[779]: ts=2026-09-21T12:34:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36638 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker2 # [ 67.899988] nix-grpc-daemon[779]: ts=2026-09-21T12:34:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 67.915109] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 68.124415] nix-daemon[847]: accepted connection from pid 955, user nix-grpc-daemon (trusted) worker2 # [ 68.143504] nix-daemon[847]: reaped child process 958, status = succeeded lb # [ 68.155017] niks3-server[1040]: 2026/09/21 12:34:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 68.165892] nix-grpc-daemon[875]: time=2026-09-21T12:34:00.800Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 68.167328] nix-grpc-daemon[875]: time=2026-09-21T12:34:00.800Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 68.184705] niks3-server[1040]: 2026/09/21 12:34:00 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 68.195771] niks3-server[1040]: 2026/09/21 12:34:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker2 # [ 68.203781] nix-grpc-daemon[875]: time=2026-09-21T12:34:00.838Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.207179] niks3-server[1040]: 2026/09/21 12:34:00 INFO Signed narinfos id=17 count=1 lb # [ 68.213100] niks3-server[1040]: 2026/09/21 12:34:00 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 68.221906] niks3-server[1040]: 2026/09/21 12:34:00 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 68.226494] niks3-server[1040]: 2026/09/21 12:34:00 INFO Completed upload id=17 worker2 # [ 68.227919] nix-grpc-daemon[875]: time=2026-09-21T12:34:00.862Z level=INFO msg="Upload complete. (297ms)" lb # [ 68.229195] niks3-server[1040]: 2026/09/21 12:34:00 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker2 # [ 68.236278] nix-grpc-daemon[779]: ts=2026-09-21T12:34:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36638 duration_s=0 paths=1 nar_bytes_in=120 worker2 # [ 68.248417] nix-daemon[847]: reaped child process 953, status = succeeded worker1 # [ 68.324333] nix-grpc-daemon[773]: ts=2026-09-21T12:34:00Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker1 # [ 68.331106] nix-grpc-daemon[773]: ts=2026-09-21T12:34:00Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 68.297513] nix-grpc-daemon[779]: ts=2026-09-21T12:34:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 68.313820] nix-grpc-daemon[779]: ts=2026-09-21T12:34:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36638 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 68.333490] nix-grpc-daemon[779]: ts=2026-09-21T12:34:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36638 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 68.348437] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 68.557720] nix-daemon[847]: accepted connection from pid 962, user nix-grpc-daemon (trusted) worker2 # [ 68.574112] nix-daemon[847]: reaped child process 965, status = succeeded worker2 # [ 68.743357] nix-daemon[847]: accepted connection from pid 967, user nix-grpc-daemon (trusted) worker2 # [ 68.757989] nix-daemon[847]: reaped child process 970, status = succeeded lb # [ 68.772302] niks3-server[1040]: 2026/09/21 12:34:01 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 68.781093] niks3-server[1040]: 2026/09/21 12:34:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 68.790950] nix-grpc-daemon[875]: time=2026-09-21T12:34:01.425Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 68.792514] nix-grpc-daemon[875]: time=2026-09-21T12:34:01.425Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker2 # [ 68.794226] nix-grpc-daemon[875]: time=2026-09-21T12:34:01.425Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 68.818376] niks3-server[1040]: 2026/09/21 12:34:01 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 68.834667] niks3-server[1040]: 2026/09/21 12:34:01 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 68.844929] niks3-server[1040]: 2026/09/21 12:34:01 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls worker2 # [ 68.846841] nix-grpc-daemon[875]: time=2026-09-21T12:34:01.480Z level=INFO msg="Uploading 3 narinfos" lb # [ 68.850401] niks3-server[1040]: 2026/09/21 12:34:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 68.856325] niks3-server[1040]: 2026/09/21 12:34:01 INFO Signed narinfos id=18 count=1 lb # [ 68.861964] niks3-server[1040]: 2026/09/21 12:34:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 68.868797] niks3-server[1040]: 2026/09/21 12:34:01 INFO Signed narinfos id=19 count=2 lb # [ 68.870613] niks3-server[1040]: 2026/09/21 12:34:01 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 68.880115] niks3-server[1040]: 2026/09/21 12:34:01 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 68.882518] niks3-server[1040]: 2026/09/21 12:34:01 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 68.887780] niks3-server[1040]: 2026/09/21 12:34:01 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 68.893426] niks3-server[1040]: 2026/09/21 12:34:01 INFO Completed upload id=18 lb # [ 68.895630] niks3-server[1040]: 2026/09/21 12:34:01 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 68.898710] niks3-server[1040]: 2026/09/21 12:34:01 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 68.902001] niks3-server[1040]: 2026/09/21 12:34:01 INFO Completed upload id=19 worker2 # [ 68.903690] nix-grpc-daemon[875]: time=2026-09-21T12:34:01.538Z level=INFO msg="Upload complete. (535ms)" worker2 # [ 68.917217] nix-grpc-daemon[779]: ts=2026-09-21T12:34:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36638 duration_s=0 paths=2 nar_bytes_in=984 worker2 # [ 68.932543] nix-grpc-daemon[779]: ts=2026-09-21T12:34:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 68.943025] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 68.951722] nix-daemon[847]: reaped child process 960, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker2 # [ 68.958320] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 69.584494] nix-daemon[847]: reaped child process 974, status = succeeded worker2 # [ 69.744917] nix-daemon[847]: accepted connection from pid 990, user nix-grpc-daemon (trusted) worker2 # [ 69.762555] nix-daemon[847]: reaped child process 993, status = succeeded lb # [ 69.773896] niks3-server[1040]: 2026/09/21 12:34:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 69.784417] nix-grpc-daemon[875]: time=2026-09-21T12:34:02.418Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 69.803598] niks3-server[1040]: 2026/09/21 12:34:02 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 69.816953] nix-grpc-daemon[875]: time=2026-09-21T12:34:02.451Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.817374] niks3-server[1040]: 2026/09/21 12:34:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 69.828147] niks3-server[1040]: 2026/09/21 12:34:02 INFO Signed narinfos id=20 count=1 lb # [ 69.831190] niks3-server[1040]: 2026/09/21 12:34:02 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls worker2 # [ 69.845986] nix-grpc-daemon[875]: time=2026-09-21T12:34:02.480Z level=INFO msg="Upload complete. (275ms)" lb # [ 69.843710] niks3-server[1040]: 2026/09/21 12:34:02 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 69.852519] niks3-server[1040]: 2026/09/21 12:34:02 INFO Completed upload id=20 lb # [ 69.856189] niks3-server[1040]: 2026/09/21 12:34:02 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo client # copying 1 paths... worker2 # [ 69.854005] nix-grpc-daemon[779]: ts=2026-09-21T12:34:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36638 duration_s=0 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker2 # [ 69.869532] nix-grpc-daemon[779]: ts=2026-09-21T12:34:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:36638 client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 69.875227] nix-daemon[847]: reaped child process 972, status = succeeded lb # [ 69.892592] envoy[902]: conn peer=[2001:db8:1::1]:54598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3400 tx=1741 ms=1942 lb # [ 69.898335] envoy[902]: conn peer=[2001:db8:1::1]:45632 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=71 lb # [ 69.903981] envoy[902]: conn peer=[2001:db8:1::1]:45640 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3860 tx=2068 ms=1470 worker2 # [ 69.907318] nix-grpc-daemon[779]: ts=2026-09-21T12:34:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36638 lb # [ 69.909163] envoy[902]: conn peer=[2001:db8:1::1]:45644 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=375 ms=71 worker2 # [ 69.912243] nix-grpc-daemon[779]: ts=2026-09-21T12:34:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36638 duration_s=0 paths=1 nar_bytes_out=120 lb # [ 69.914060] envoy[902]: conn peer=[2001:db8:1::1]:45660 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=62 lb # [ 69.918405] envoy[902]: conn peer=[2001:db8:1::1]:45646 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4350 tx=2189 ms=2452 client # [ 70.047524] nix-daemon[938]: reaped child process 1024, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.61 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 70.268673] nix-daemon[938]: accepted connection from pid 1042, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 70.475439] nix-grpc-daemon[779]: ts=2026-09-21T12:34:03Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:36638 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 70.482920] nix-grpc-daemon[779]: ts=2026-09-21T12:34:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 70.489725] nix-grpc-daemon[875]: time=2026-09-21T12:34:03.123Z level=INFO msg="All 1 paths already cached" worker1 # [ 70.578791] nix-grpc-daemon[773]: ts=2026-09-21T12:34:03Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker1 # [ 70.579181] nix-grpc-daemon[773]: ts=2026-09-21T12:34:03Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 70.579354] nix-grpc-daemon[773]: ts=2026-09-21T12:34:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 70.605583] nix-grpc-daemon[773]: ts=2026-09-21T12:34:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 70.624892] nix-grpc-daemon[773]: ts=2026-09-21T12:34:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 70.639512] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 70.660750] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5) worker1 # [ 70.683626] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 103 ms (attempt 2/5) worker1 # [ 70.794186] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 106 ms (attempt 3/5) worker1 # [ 70.907246] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 399 ms (attempt 4/5) worker1 # [ 71.314143] nix-grpc-daemon[773]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 71.321656] nix-grpc-daemon[773]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 71.329019] nix-grpc-daemon[773]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 71.555501] nix-daemon[855]: accepted connection from pid 1213, user nix-grpc-daemon (trusted) worker1 # [ 71.572877] nix-daemon[855]: reaped child process 1216, status = succeeded worker1 # [ 71.748841] nix-daemon[855]: accepted connection from pid 1218, user nix-grpc-daemon (trusted) worker1 # [ 71.764895] nix-daemon[855]: reaped child process 1221, status = succeeded lb # [ 71.704724] niks3-server[1040]: 2026/09/21 12:34:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 71.788240] nix-grpc-daemon[869]: time=2026-09-21T12:34:04.428Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 71.789694] nix-grpc-daemon[869]: time=2026-09-21T12:34:04.428Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 71.733160] niks3-server[1040]: 2026/09/21 12:34:04 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst worker1 # [ 71.819870] nix-grpc-daemon[869]: time=2026-09-21T12:34:04.460Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.746849] niks3-server[1040]: 2026/09/21 12:34:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 71.759455] niks3-server[1040]: 2026/09/21 12:34:04 INFO Signed narinfos id=21 count=1 lb # [ 71.766280] niks3-server[1040]: 2026/09/21 12:34:04 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 71.772074] niks3-server[1040]: 2026/09/21 12:34:04 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 71.780390] niks3-server[1040]: 2026/09/21 12:34:04 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo lb # [ 71.785604] niks3-server[1040]: 2026/09/21 12:34:04 INFO Completed upload id=21 worker1 # [ 71.858797] nix-grpc-daemon[869]: time=2026-09-21T12:34:04.499Z level=INFO msg="Upload complete. (505ms)" worker1 # [ 71.868686] nix-grpc-daemon[773]: ts=2026-09-21T12:34:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=1 paths=1 nar_bytes_in=568 worker1 # [ 71.878939] nix-grpc-daemon[773]: ts=2026-09-21T12:34:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 71.889462] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) worker1 # [ 71.894511] nix-daemon[855]: reaped child process 1206, status = succeeded worker1 # [ 71.905312] nix-daemon[855]: accepted connection from pid 773, user nix-grpc-daemon (trusted) client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 73.550778] nix-daemon[855]: reaped child process 1225, status = succeeded worker1 # [ 73.730166] nix-daemon[855]: accepted connection from pid 1241, user nix-grpc-daemon (trusted) worker1 # [ 73.746538] nix-daemon[855]: reaped child process 1244, status = succeeded lb # [ 73.685921] niks3-server[1040]: 2026/09/21 12:34:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 73.771364] nix-grpc-daemon[869]: time=2026-09-21T12:34:06.410Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 73.724140] niks3-server[1040]: 2026/09/21 12:34:06 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 73.733847] niks3-server[1040]: 2026/09/21 12:34:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker1 # [ 73.814081] nix-grpc-daemon[869]: time=2026-09-21T12:34:06.454Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.743500] niks3-server[1040]: 2026/09/21 12:34:06 INFO Signed narinfos id=22 count=1 lb # [ 73.750177] niks3-server[1040]: 2026/09/21 12:34:06 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 73.761818] niks3-server[1040]: 2026/09/21 12:34:06 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete worker1 # [ 73.842348] nix-grpc-daemon[869]: time=2026-09-21T12:34:06.482Z level=INFO msg="Upload complete. (325ms)" lb # [ 73.771728] niks3-server[1040]: 2026/09/21 12:34:06 INFO Completed upload id=22 client # copying 1 paths... lb # [ 73.780300] niks3-server[1040]: 2026/09/21 12:34:06 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker1 # [ 73.857068] nix-grpc-daemon[773]: ts=2026-09-21T12:34:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker1 # [ 73.873034] nix-grpc-daemon[773]: ts=2026-09-21T12:34:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42124 client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 73.878277] nix-daemon[855]: reaped child process 1223, status = succeeded worker1 # [ 73.899758] nix-grpc-daemon[773]: ts=2026-09-21T12:34:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 73.905107] nix-grpc-daemon[773]: ts=2026-09-21T12:34:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:42124 duration_s=0 paths=1 nar_bytes_out=120 client # [ 73.969649] nix-daemon[938]: reaped child process 1045, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.92 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 74.189756] nix-daemon[938]: accepted connection from pid 1064, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 74.465672] nix-grpc-daemon[773]: ts=2026-09-21T12:34:07Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:42124 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 74.473117] nix-grpc-daemon[773]: ts=2026-09-21T12:34:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 74.479734] nix-grpc-daemon[869]: time=2026-09-21T12:34:07.119Z level=INFO msg="All 1 paths already cached" worker1 # [ 74.492154] nix-grpc-daemon[773]: ts=2026-09-21T12:34:07Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker1 # [ 74.498619] nix-grpc-daemon[773]: ts=2026-09-21T12:34:07Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 74.431279] nix-grpc-daemon[779]: ts=2026-09-21T12:34:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 74.446957] nix-grpc-daemon[779]: ts=2026-09-21T12:34:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36638 client # copying 1 paths to 'lb:50051'... worker2 # [ 74.462692] nix-grpc-daemon[875]: time=2026-09-21T12:34:07.095Z level=INFO msg="All 1 paths already cached" client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 74.468368] nix-grpc-daemon[779]: ts=2026-09-21T12:34:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 74.483402] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 74.693939] nix-daemon[847]: accepted connection from pid 997, user nix-grpc-daemon (trusted) worker2 # [ 74.710261] nix-daemon[847]: reaped child process 1000, status = succeeded worker2 # [ 74.879356] nix-daemon[847]: accepted connection from pid 1002, user nix-grpc-daemon (trusted) worker2 # [ 74.895141] nix-daemon[847]: reaped child process 1005, status = succeeded lb # [ 74.906250] niks3-server[1040]: 2026/09/21 12:34:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 74.916993] nix-grpc-daemon[875]: time=2026-09-21T12:34:07.551Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 74.918445] nix-grpc-daemon[875]: time=2026-09-21T12:34:07.551Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 74.932280] niks3-server[1040]: 2026/09/21 12:34:07 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst worker2 # [ 74.947556] nix-grpc-daemon[875]: time=2026-09-21T12:34:07.582Z level=INFO msg="Uploading 1 narinfos" lb # [ 74.945879] niks3-server[1040]: 2026/09/21 12:34:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 74.950714] niks3-server[1040]: 2026/09/21 12:34:07 INFO Signed narinfos id=23 count=1 lb # [ 74.956605] niks3-server[1040]: 2026/09/21 12:34:07 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 74.967450] niks3-server[1040]: 2026/09/21 12:34:07 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete worker2 # [ 74.972728] nix-grpc-daemon[875]: time=2026-09-21T12:34:07.607Z level=INFO msg="Upload complete. (471ms)" lb # [ 74.973471] niks3-server[1040]: 2026/09/21 12:34:07 INFO Completed upload id=23 lb # [ 74.977114] niks3-server[1040]: 2026/09/21 12:34:07 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker2 # [ 74.980121] nix-grpc-daemon[779]: ts=2026-09-21T12:34:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36638 duration_s=0 paths=1 nar_bytes_in=568 worker2 # [ 74.991891] nix-grpc-daemon[779]: ts=2026-09-21T12:34:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 74.998683] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) worker2 # [ 75.003324] nix-daemon[847]: reaped child process 995, status = succeeded worker2 # [ 75.013880] nix-daemon[847]: accepted connection from pid 779, user nix-grpc-daemon (trusted) client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 76.248002] nix-daemon[847]: reaped child process 1009, status = succeeded worker2 # [ 76.426249] nix-daemon[847]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker2 # [ 76.446983] nix-daemon[847]: reaped child process 1028, status = succeeded lb # [ 76.462567] niks3-server[1040]: 2026/09/21 12:34:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 76.473766] nix-grpc-daemon[875]: time=2026-09-21T12:34:09.108Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 76.505076] niks3-server[1040]: 2026/09/21 12:34:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker2 # [ 76.515588] nix-grpc-daemon[875]: time=2026-09-21T12:34:09.150Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.522659] niks3-server[1040]: 2026/09/21 12:34:09 INFO Signed narinfos id=24 count=1 lb # [ 76.531115] niks3-server[1040]: 2026/09/21 12:34:09 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 76.543383] niks3-server[1040]: 2026/09/21 12:34:09 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 76.549297] niks3-server[1040]: 2026/09/21 12:34:09 INFO Completed upload id=24 worker2 # [ 76.550101] nix-grpc-daemon[875]: time=2026-09-21T12:34:09.184Z level=INFO msg="Upload complete. (324ms)" lb # [ 76.552304] niks3-server[1040]: 2026/09/21 12:34:09 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 76.558289] niks3-server[1040]: 2026/09/21 12:34:09 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker2 # [ 76.560497] nix-grpc-daemon[779]: ts=2026-09-21T12:34:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36638 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker2 # [ 76.576708] nix-daemon[847]: reaped child process 1007, status = succeeded client # copying 1 paths... worker1 # [ 76.685447] nix-grpc-daemon[773]: ts=2026-09-21T12:34:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 76.703353] nix-grpc-daemon[773]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 76.685747] nix-grpc-daemon[779]: ts=2026-09-21T12:34:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36638 worker2 # [ 76.693642] nix-grpc-daemon[779]: ts=2026-09-21T12:34:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36638 duration_s=0 paths=1 nar_bytes_out=120 client # [ 76.795239] nix-daemon[938]: reaped child process 1067, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.82 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 10.27 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.46 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.42 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.26 seconds) worker2 # [ 78.209543] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 78.417148] nix-grpc-daemon[779]: ts=2026-09-21T12:34:11Z level=info event=signal_exit worker1 # [ 79.731782] nix-grpc-daemon[773]: ts=2026-09-21T12:34:12Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42116 worker2 # [ 79.661959] nix-grpc-daemon[779]: ts=2026-09-21T12:34:12Z level=info event=scheduler_restarting worker1 # [ 79.736588] nix-grpc-daemon[773]: ts=2026-09-21T12:34:12Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 79.689607] nix-grpc-daemon[779]: ts=2026-09-21T12:34:12Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 79.713700] nix-daemon[847]: reaped child process 849, status = succeeded lb # [ 79.891414] envoy[902]: conn peer=[2001:db8:1::1]:45686 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=75 lb # [ 79.896322] envoy[902]: conn peer=[2001:db8:1::1]:45674 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4244 tx=1830 ms=2093 lb # [ 79.900920] envoy[902]: conn peer=[2001:db8:1::1]:45702 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3753 tx=1901 ms=3410 lb # [ 79.905504] envoy[902]: conn peer=[2001:db8:1::1]:38762 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=61 lb # [ 79.909966] envoy[902]: conn peer=[2001:db8:1::1]:38774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3765 tx=2014 ms=2316 lb # [ 79.914617] envoy[902]: conn peer=[2001:db8:1::1]:38780 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=461 tx=328 ms=36 lb # [ 79.919449] envoy[902]: conn peer=[2001:db8:1::4]:60300 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=53447 tx=2679 ms=59198 worker2 # [ 80.537421] nix-grpc-daemon[779]: E0000 00:00:1789994053.172056 824 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker2 # [ 80.544978] nix-grpc-daemon[779]: E0000 00:00:1789994053.179740 824 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 81.349311] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 81.355635] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 81.363100] systemd[1]: nix-grpc-daemon.service: Consumed 1.857s CPU time over 1min 1.270s wall clock time, 51.3M memory peak, 54.7K incoming IP traffic, 140.5K outgoing IP traffic. worker2 # [ 81.376517] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 81.378617] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 81.382549] systemd[1]: nix-grpc-daemon.socket: Consumed 620us CPU time over 1min 10.233s wall clock time, 256K memory peak, 60.3K incoming IP traffic, 51.5K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 81.800313] nix-grpc-daemon[773]: ts=2026-09-21T12:34:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42124 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 81.861545] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 81.807888] nix-grpc-daemon[773]: ts=2026-09-21T12:34:14Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:42124 worker1 # [ 82.010777] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 82.340785] nix-grpc-daemon[773]: ts=2026-09-21T12:34:14Z level=info event=signal_exit worker2 # [ 82.338503] systemd[1]: Starting scheduler-token.service... worker2 # [ 82.445996] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 82.452456] systemd[1]: Finished scheduler-token.service. worker2 # [ 82.455238] systemd[1]: scheduler-token.service: Consumed 49ms CPU time over 110ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 82.459406] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 82.568427] nix-grpc-daemon[773]: ts=2026-09-21T12:34:15Z level=info event=scheduler_yield worker1 # [ 82.575035] nix-grpc-daemon[773]: ts=2026-09-21T12:34:15Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 82.503375] niks3-server[1040]: 2026/09/21 12:34:15 INFO lead: released remote=192.168.1.3:50560 worker1 # [ 82.579768] nix-grpc-daemon[773]: ts=2026-09-21T12:34:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:42116 worker1 # [ 82.584212] nix-grpc-daemon[773]: ts=2026-09-21T12:34:15Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 82.638321] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 82.640929] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 82.644983] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 82.652066] nix-grpc-daemon[1052]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 82.664642] nix-grpc-daemon[1052]: E0000 00:00:1789994055.286700 1052 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 82.669486] nix-grpc-daemon[1052]: E0000 00:00:1789994055.290449 1052 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 82.668589] niks3-server[1040]: 2026/09/21 12:34:15 INFO lead: acquired remote=192.168.1.4:58072 worker2 # [ 82.672372] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 82.674413] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 82.704144] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=scheduler_take_over worker1 # [ 82.774566] nix-grpc-daemon[773]: ts=2026-09-21T12:34:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.705334] nix-grpc-daemon[1052]: E0000 00:00:1789994055.312276 1093 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 82.707676] nix-grpc-daemon[1052]: E0000 00:00:1789994055.328588 1093 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 82.779910] nix-grpc-daemon[773]: ts=2026-09-21T12:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.715285] nix-grpc-daemon[1052]: E0000 00:00:1789994055.328742 1093 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 82.718347] nix-grpc-daemon[1052]: E0000 00:00:1789994055.349482 1093 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 82.727793] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.729604] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.982433] nix-grpc-daemon[773]: ts=2026-09-21T12:34:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.986469] nix-grpc-daemon[773]: ts=2026-09-21T12:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.931050] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.935864] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.183002] nix-grpc-daemon[773]: ts=2026-09-21T12:34:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.188345] nix-grpc-daemon[773]: ts=2026-09-21T12:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.136919] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.141824] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.388895] nix-grpc-daemon[773]: ts=2026-09-21T12:34:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.393908] nix-grpc-daemon[773]: ts=2026-09-21T12:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.342758] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.347842] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.573809] nix-grpc-daemon[773]: ts=2026-09-21T12:34:16Z level=info event=scheduler_restarting worker2 # [ 83.548833] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.621303] nix-grpc-daemon[773]: ts=2026-09-21T12:34:16Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 83.553585] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 83.640371] nix-daemon[855]: reaped child process 857, status = succeeded worker2 # [ 83.755956] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 83.771732] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:16Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 83.776221] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:16Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:60908 worker2 # [ 83.781295] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 84.448306] nix-grpc-daemon[773]: E0000 00:00:1789994057.087420 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 84.468112] nix-grpc-daemon[773]: E0000 00:00:1789994057.108437 818 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 85.337540] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 85.343906] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 85.348997] systemd[1]: nix-grpc-daemon.service: Consumed 3.666s CPU time over 1min 5.386s wall clock time, 66.2M memory peak, 96.7K incoming IP traffic, 202.5K outgoing IP traffic. worker1 # [ 85.361908] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 85.363948] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 85.366720] systemd[1]: nix-grpc-daemon.socket: Consumed 690us CPU time over 1min 13.544s wall clock time, 256K memory peak, 97.4K incoming IP traffic, 80.3K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 85.650691] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60914 worker2 # [ 85.666132] nix-daemon[847]: accepted connection from pid 1052, user nix-grpc-daemon (trusted) worker2 # [ 85.698692] nix-grpc-daemon[1052]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 1/5) worker2 # [ 85.751236] nix-grpc-daemon[1052]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 2/5) worker2 # [ 85.948855] nix-grpc-daemon[1052]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 3/5) worker2 # [ 85.993766] nix-grpc-daemon[1052]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 343 ms (attempt 4/5) worker2 # [ 86.344990] nix-grpc-daemon[1052]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 86.350641] nix-grpc-daemon[1052]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 86.375368] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60914 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 86.393459] nix-daemon[847]: accepted connection from pid 1052, user nix-grpc-daemon (trusted) worker2 # [ 86.424313] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:19Z level=info event=niks3_push_started pid=1112 worker2 # [ 86.651445] nix-grpc-daemon[1112]: time=2026-09-21T12:34:19.285Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 86.830683] nix-daemon[847]: accepted connection from pid 1125, user nix-grpc-daemon (trusted) worker2 # [ 86.847707] nix-daemon[847]: reaped child process 1128, status = succeeded lb # [ 86.861830] niks3-server[1040]: 2026/09/21 12:34:19 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 86.871897] niks3-server[1040]: 2026/09/21 12:34:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 86.883571] nix-grpc-daemon[1112]: time=2026-09-21T12:34:19.516Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 86.885973] nix-grpc-daemon[1112]: time=2026-09-21T12:34:19.516Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 86.887940] nix-grpc-daemon[1112]: time=2026-09-21T12:34:19.516Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 86.914550] niks3-server[1040]: 2026/09/21 12:34:19 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 86.934272] niks3-server[1040]: 2026/09/21 12:34:19 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 86.947151] niks3-server[1040]: 2026/09/21 12:34:19 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls worker2 # [ 86.956211] nix-grpc-daemon[1112]: time=2026-09-21T12:34:19.589Z level=INFO msg="Uploading 3 narinfos" lb # [ 86.956429] niks3-server[1040]: 2026/09/21 12:34:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 86.960534] niks3-server[1040]: 2026/09/21 12:34:19 INFO Signed narinfos id=25 count=1 lb # [ 86.962832] niks3-server[1040]: 2026/09/21 12:34:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 86.971143] niks3-server[1040]: 2026/09/21 12:34:19 INFO Signed narinfos id=26 count=2 lb # [ 86.976697] niks3-server[1040]: 2026/09/21 12:34:19 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 86.983391] niks3-server[1040]: 2026/09/21 12:34:19 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 86.993467] niks3-server[1040]: 2026/09/21 12:34:19 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 86.999333] niks3-server[1040]: 2026/09/21 12:34:19 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 87.006879] niks3-server[1040]: 2026/09/21 12:34:19 INFO Completed upload id=25 lb # [ 87.008565] niks3-server[1040]: 2026/09/21 12:34:19 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete lb # [ 87.012397] niks3-server[1040]: 2026/09/21 12:34:19 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 87.015362] niks3-server[1040]: 2026/09/21 12:34:19 INFO Completed upload id=26 worker2 # [ 87.017103] nix-grpc-daemon[1112]: time=2026-09-21T12:34:19.651Z level=INFO msg="Upload complete. (361ms)" worker2 # [ 87.029245] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60914 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 87.045562] nix-daemon[847]: reaped child process 1110, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.68 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds) worker1 # [ 87.258507] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 87.267349] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 87.462240] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:20Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 87.464903] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 87.469034] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 87.476056] nix-grpc-daemon[1270]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 87.477466] nix-grpc-daemon[1270]: E0000 00:00:1789994060.116029 1270 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 87.494429] nix-grpc-daemon[1270]: E0000 00:00:1789994060.122420 1270 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 87.499973] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 87.502654] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 87.528162] nix-grpc-daemon[1270]: E0000 00:00:1789994060.145303 1309 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 87.530521] nix-grpc-daemon[1270]: E0000 00:00:1789994060.161158 1309 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 87.540990] nix-grpc-daemon[1270]: E0000 00:00:1789994060.161313 1309 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 87.543805] nix-grpc-daemon[1270]: E0000 00:00:1789994060.180617 1309 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 87.559028] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.488876] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:20Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:60908 worker2 # [ 87.495839] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.75 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 87.800151] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 88.661958] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:21Z level=info event=signal_exit worker2 # [ 88.871960] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:21Z level=info event=scheduler_yield worker1 # [ 88.948235] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:21Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 88.874503] niks3-server[1040]: 2026/09/21 12:34:21 INFO lead: released remote=192.168.1.4:58072 worker2 # [ 88.878895] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60908 worker2 # [ 88.883723] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:21Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 88.891560] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:21Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 88.896135] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:21Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:60908 worker2 # [ 88.900984] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:21Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 89.148305] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.153474] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.091021] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.096239] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.354109] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.359156] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.297346] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.302424] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.559846] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.564944] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.503646] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.508861] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 89.765653] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 89.770634] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.711322] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.715592] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.877779] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:22Z level=info event=scheduler_restarting lb # [ 89.891070] envoy[902]: conn peer=[2001:db8:1::1]:52814 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=23 lb # [ 89.891378] envoy[902]: conn peer=[2001:db8:1::3]:57942 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=11907 tx=3300 ms=63223 worker1 # [ 89.972492] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:22Z level=info event=scheduler_connected addr=lb:50051 lb # [ 89.891557] envoy[902]: conn peer=[2001:db8:1::1]:52820 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=305 ms=1393 worker2 # [ 89.907923] nix-daemon[847]: reaped child process 1104, status = succeeded worker1 # [ 89.980225] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 89.930995] nix-grpc-daemon[1052]: ts=2026-09-21T12:34:22Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 90.181223] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.186220] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.386991] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.392156] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 90.592900] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 90.597887] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 90.700744] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 90.703661] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 90.707461] systemd[1]: nix-grpc-daemon.service: Consumed 494ms CPU time over 8.237s wall clock time, 33.6M memory peak, 20.1K incoming IP traffic, 30.4K outgoing IP traffic. worker2 # [ 90.719753] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 90.725832] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 90.798614] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 90.729002] systemd[1]: nix-grpc-daemon.socket: Consumed 695us CPU time over 8.865s wall clock time, 256K memory peak, 20.1K incoming IP traffic, 15K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 90.803744] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.09 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker1 # [ 91.006391] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.010599] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.206847] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.211799] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.412633] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.417631] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.618357] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.623477] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.824246] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.829218] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker1 # [ 92.030401] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.033475] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.234404] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.239593] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.440419] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.445230] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.500965] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:25Z level=info event=scheduler_take_over lb # [ 92.428760] niks3-server[1040]: 2026/09/21 12:34:25 INFO lead: acquired remote=192.168.1.3:49000 worker1 # [ 92.645844] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.655004] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:25Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:41972 worker1 # [ 92.660531] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker1 # [ 93.365258] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 93.380433] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 93.405304] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 93.426305] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 1/5) worker1 # [ 93.532836] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 111 ms (attempt 2/5) worker1 # [ 93.651490] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 202 ms (attempt 3/5) worker1 # [ 93.861156] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 619 ms (attempt 4/5) worker1 # [ 94.492857] nix-grpc-daemon[1270]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 94.497226] nix-grpc-daemon[1270]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 94.522856] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:27Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 94.530297] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:27Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 94.572185] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 94.588126] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41974 client # copying 1 paths to 'lb:50051'... worker1 # [ 94.602476] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41974 client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 94.621161] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 94.649309] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:27Z level=info event=niks3_push_started pid=1347 worker1 # [ 94.865236] nix-grpc-daemon[1347]: time=2026-09-21T12:34:27.504Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 95.040531] nix-daemon[855]: accepted connection from pid 1360, user nix-grpc-daemon (trusted) worker1 # [ 95.057832] nix-daemon[855]: reaped child process 1363, status = succeeded worker1 # [ 95.231734] nix-daemon[855]: accepted connection from pid 1365, user nix-grpc-daemon (trusted) worker1 # [ 95.250720] nix-daemon[855]: reaped child process 1368, status = succeeded lb # [ 95.190399] niks3-server[1040]: 2026/09/21 12:34:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 95.275821] nix-grpc-daemon[1347]: time=2026-09-21T12:34:27.915Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 95.277595] nix-grpc-daemon[1347]: time=2026-09-21T12:34:27.915Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 95.230953] niks3-server[1040]: 2026/09/21 12:34:27 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst worker1 # [ 95.316234] nix-grpc-daemon[1347]: time=2026-09-21T12:34:27.956Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.246828] niks3-server[1040]: 2026/09/21 12:34:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 95.256463] niks3-server[1040]: 2026/09/21 12:34:27 INFO Signed narinfos id=27 count=1 lb # [ 95.258817] niks3-server[1040]: 2026/09/21 12:34:27 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 95.268224] niks3-server[1040]: 2026/09/21 12:34:27 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 95.276880] niks3-server[1040]: 2026/09/21 12:34:27 INFO Completed upload id=27 worker1 # [ 95.350000] nix-grpc-daemon[1347]: time=2026-09-21T12:34:27.990Z level=INFO msg="Upload complete. (481ms)" worker1 # [ 95.356413] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41974 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 95.370136] nix-grpc-daemon[1347]: time=2026-09-21T12:34:28.004Z level=WARN msg="Failed to register uploaded object" key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 95.376491] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 95.384099] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 95.386902] nix-daemon[855]: reaped child process 1345, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker1 # [ 95.399224] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 96.844067] nix-daemon[855]: reaped child process 1372, status = succeeded worker1 # [ 97.030898] nix-daemon[855]: accepted connection from pid 1388, user nix-grpc-daemon (trusted) worker1 # [ 97.048218] nix-daemon[855]: reaped child process 1391, status = succeeded lb # [ 96.987405] niks3-server[1040]: 2026/09/21 12:34:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.076419] nix-grpc-daemon[1347]: time=2026-09-21T12:34:29.715Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 97.077960] nix-grpc-daemon[1347]: time=2026-09-21T12:34:29.715Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 97.046972] niks3-server[1040]: 2026/09/21 12:34:29 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 97.055141] niks3-server[1040]: 2026/09/21 12:34:29 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker1 # [ 97.135143] nix-grpc-daemon[1347]: time=2026-09-21T12:34:29.774Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.065347] niks3-server[1040]: 2026/09/21 12:34:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 97.072293] niks3-server[1040]: 2026/09/21 12:34:29 INFO Signed narinfos id=28 count=1 lb # [ 97.074595] niks3-server[1040]: 2026/09/21 12:34:29 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 97.081364] niks3-server[1040]: 2026/09/21 12:34:29 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 97.087721] niks3-server[1040]: 2026/09/21 12:34:29 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo lb # [ 97.092878] niks3-server[1040]: 2026/09/21 12:34:29 INFO Completed upload id=28 worker1 # [ 97.166060] nix-grpc-daemon[1347]: time=2026-09-21T12:34:29.806Z level=INFO msg="Upload complete. (355ms)" worker1 # [ 97.187279] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 97.202250] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:29Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 97.206631] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:29Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 97.211260] nix-daemon[855]: reaped child process 1370, status = succeeded worker1 # [ 97.233262] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 97.248668] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 97.263000] nix-grpc-daemon[1347]: time=2026-09-21T12:34:29.903Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 97.271786] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 97.290559] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 97.491816] nix-daemon[855]: accepted connection from pid 1397, user nix-grpc-daemon (trusted) worker1 # [ 97.509550] nix-daemon[855]: reaped child process 1400, status = succeeded worker1 # [ 97.684108] nix-daemon[855]: accepted connection from pid 1402, user nix-grpc-daemon (trusted) worker1 # [ 97.700714] nix-daemon[855]: reaped child process 1405, status = succeeded lb # [ 97.638824] niks3-server[1040]: 2026/09/21 12:34:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.723507] nix-grpc-daemon[1347]: time=2026-09-21T12:34:30.363Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 97.725109] nix-grpc-daemon[1347]: time=2026-09-21T12:34:30.363Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 97.669493] niks3-server[1040]: 2026/09/21 12:34:30 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 97.682607] niks3-server[1040]: 2026/09/21 12:34:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign worker1 # [ 97.762253] nix-grpc-daemon[1347]: time=2026-09-21T12:34:30.402Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.695704] niks3-server[1040]: 2026/09/21 12:34:30 INFO Signed narinfos id=29 count=1 lb # [ 97.700952] niks3-server[1040]: 2026/09/21 12:34:30 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls worker1 # [ 97.782307] nix-grpc-daemon[1347]: time=2026-09-21T12:34:30.422Z level=INFO msg="Upload complete. (475ms)" lb # [ 97.710346] niks3-server[1040]: 2026/09/21 12:34:30 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 97.716326] niks3-server[1040]: 2026/09/21 12:34:30 INFO Completed upload id=29 worker1 # [ 97.788242] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41974 duration_s=0 paths=1 nar_bytes_in=640 lb # [ 97.719364] niks3-server[1040]: 2026/09/21 12:34:30 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker1 # [ 97.800308] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 97.812190] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 97.814870] nix-daemon[855]: reaped child process 1395, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... worker1 # [ 97.825807] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 98.870701] nix-daemon[855]: reaped child process 1409, status = succeeded worker1 # [ 99.049437] nix-daemon[855]: accepted connection from pid 1425, user nix-grpc-daemon (trusted) worker1 # [ 99.068231] nix-daemon[855]: reaped child process 1428, status = succeeded lb # [ 99.007545] niks3-server[1040]: 2026/09/21 12:34:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 99.091697] nix-grpc-daemon[1347]: time=2026-09-21T12:34:31.731Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 99.094003] nix-grpc-daemon[1347]: time=2026-09-21T12:34:31.733Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 99.045371] niks3-server[1040]: 2026/09/21 12:34:31 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 99.058351] niks3-server[1040]: 2026/09/21 12:34:31 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 99.068290] niks3-server[1040]: 2026/09/21 12:34:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker1 # [ 99.146974] nix-grpc-daemon[1347]: time=2026-09-21T12:34:31.787Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.076811] niks3-server[1040]: 2026/09/21 12:34:31 INFO Signed narinfos id=30 count=1 lb # [ 99.079511] niks3-server[1040]: 2026/09/21 12:34:31 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 99.090965] niks3-server[1040]: 2026/09/21 12:34:31 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 99.098588] niks3-server[1040]: 2026/09/21 12:34:31 INFO Completed upload id=30 worker1 # [ 99.171665] nix-grpc-daemon[1347]: time=2026-09-21T12:34:31.812Z level=INFO msg="Upload complete. (333ms)" lb # [ 99.101913] niks3-server[1040]: 2026/09/21 12:34:31 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker1 # [ 99.185996] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 99.205798] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:31Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 99.210342] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:31Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 99.215079] nix-daemon[855]: reaped child process 1407, status = succeeded worker1 # [ 99.245449] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 99.261220] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 99.275848] nix-grpc-daemon[1347]: time=2026-09-21T12:34:31.916Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 99.284598] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 99.297935] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 99.494238] nix-daemon[855]: accepted connection from pid 1434, user nix-grpc-daemon (trusted) worker1 # [ 99.511133] nix-daemon[855]: reaped child process 1437, status = succeeded worker1 # [ 99.683873] nix-daemon[855]: accepted connection from pid 1439, user nix-grpc-daemon (trusted) worker1 # [ 99.700300] nix-daemon[855]: reaped child process 1442, status = succeeded lb # [ 99.638747] niks3-server[1040]: 2026/09/21 12:34:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 99.721380] nix-grpc-daemon[1347]: time=2026-09-21T12:34:32.361Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 99.722836] nix-grpc-daemon[1347]: time=2026-09-21T12:34:32.361Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 99.668147] niks3-server[1040]: 2026/09/21 12:34:32 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker1 # [ 99.751594] nix-grpc-daemon[1347]: time=2026-09-21T12:34:32.391Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.682768] niks3-server[1040]: 2026/09/21 12:34:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 99.693567] niks3-server[1040]: 2026/09/21 12:34:32 INFO Signed narinfos id=31 count=1 lb # [ 99.701752] niks3-server[1040]: 2026/09/21 12:34:32 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 99.705384] niks3-server[1040]: 2026/09/21 12:34:32 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete worker1 # [ 99.782409] nix-grpc-daemon[1347]: time=2026-09-21T12:34:32.422Z level=INFO msg="Upload complete. (468ms)" lb # [ 99.710078] niks3-server[1040]: 2026/09/21 12:34:32 INFO Completed upload id=31 lb # [ 99.713578] niks3-server[1040]: 2026/09/21 12:34:32 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker1 # [ 99.788209] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41974 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 99.801448] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 99.807155] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 99.811968] nix-daemon[855]: reaped child process 1432, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 99.824755] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) lb # [ 99.892605] envoy[902]: conn peer=[2001:db8:1::4]:42940 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7963 tx=535 ms=7194 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 101.071605] nix-daemon[855]: reaped child process 1446, status = succeeded worker1 # [ 101.250477] nix-daemon[855]: accepted connection from pid 1462, user nix-grpc-daemon (trusted) worker1 # [ 101.268270] nix-daemon[855]: reaped child process 1465, status = succeeded lb # [ 101.211570] niks3-server[1040]: 2026/09/21 12:34:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 101.296422] nix-grpc-daemon[1347]: time=2026-09-21T12:34:33.935Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 101.298004] nix-grpc-daemon[1347]: time=2026-09-21T12:34:33.935Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 101.247544] niks3-server[1040]: 2026/09/21 12:34:33 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 101.258935] niks3-server[1040]: 2026/09/21 12:34:33 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 101.270068] niks3-server[1040]: 2026/09/21 12:34:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker1 # [ 101.348114] nix-grpc-daemon[1347]: time=2026-09-21T12:34:33.988Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.277981] niks3-server[1040]: 2026/09/21 12:34:33 INFO Signed narinfos id=32 count=1 lb # [ 101.282894] niks3-server[1040]: 2026/09/21 12:34:33 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 101.290410] niks3-server[1040]: 2026/09/21 12:34:33 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 101.299271] niks3-server[1040]: 2026/09/21 12:34:33 INFO Completed upload id=32 worker1 # [ 101.372050] nix-grpc-daemon[1347]: time=2026-09-21T12:34:34.012Z level=INFO msg="Upload complete. (336ms)" lb # [ 101.302037] niks3-server[1040]: 2026/09/21 12:34:33 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker1 # [ 101.385060] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 101.400263] nix-daemon[855]: reaped child process 1444, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 8.33 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds) worker2 # [ 101.678473] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 101.687391] systemd[1]: Starting scheduler-token.service... worker2 # [ 101.777397] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 101.780611] systemd[1]: Finished scheduler-token.service. worker2 # [ 101.781803] systemd[1]: scheduler-token.service: Consumed 37ms CPU time over 93ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 101.790271] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 101.966613] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:34Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 101.969285] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:34Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 101.973337] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:34Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 101.980055] nix-grpc-daemon[1152]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 101.981520] nix-grpc-daemon[1152]: E0000 00:00:1789994074.614650 1152 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 101.994797] nix-grpc-daemon[1152]: E0000 00:00:1789994074.620981 1152 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 102.003740] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:34Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 102.007625] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 102.012107] nix-grpc-daemon[1152]: E0000 00:00:1789994074.645215 1194 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 102.040052] nix-grpc-daemon[1152]: E0000 00:00:1789994074.662745 1194 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 102.045702] nix-grpc-daemon[1152]: E0000 00:00:1789994074.662915 1194 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 102.048605] nix-grpc-daemon[1152]: E0000 00:00:1789994074.679809 1194 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 102.057824] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:34Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.140205] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:34Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 102.140611] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:34Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:41972 worker1 # [ 102.150182] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:34Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.83 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 102.452357] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 0be367d4dcd24a51bb5287cfee95147f client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds) worker2 # [ 102.715316] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55352 worker2 # [ 102.730538] nix-daemon[847]: accepted connection from pid 1152, user nix-grpc-daemon (trusted) client # [ 102.754993] nix[1168]: don't know how to build these paths: client # [ 102.758017] nix[1168]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 102.834231] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:35Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 102.834539] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:35Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 102.878120] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 102.893735] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41974 client # [ 102.843821] nix[1168]: copying 1 paths to 'lb:50051'... client # [ 102.846474] nix[1168]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 102.908384] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 102.925247] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 103.135902] nix-daemon[855]: accepted connection from pid 1478, user nix-grpc-daemon (trusted) worker1 # [ 103.156132] nix-daemon[855]: reaped child process 1481, status = succeeded worker1 # [ 103.329297] nix-daemon[855]: accepted connection from pid 1483, user nix-grpc-daemon (trusted) worker1 # [ 103.346357] nix-daemon[855]: reaped child process 1486, status = succeeded lb # [ 103.285710] niks3-server[1040]: 2026/09/21 12:34:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 103.368384] nix-grpc-daemon[1347]: time=2026-09-21T12:34:36.008Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 103.370245] nix-grpc-daemon[1347]: time=2026-09-21T12:34:36.008Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 103.314461] niks3-server[1040]: 2026/09/21 12:34:35 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst worker1 # [ 103.400924] nix-grpc-daemon[1347]: time=2026-09-21T12:34:36.041Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.331271] niks3-server[1040]: 2026/09/21 12:34:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign lb # [ 103.340938] niks3-server[1040]: 2026/09/21 12:34:35 INFO Signed narinfos id=33 count=1 lb # [ 103.345978] niks3-server[1040]: 2026/09/21 12:34:35 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 103.356491] niks3-server[1040]: 2026/09/21 12:34:35 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 103.361695] niks3-server[1040]: 2026/09/21 12:34:36 INFO Completed upload id=33 worker1 # [ 103.434773] nix-grpc-daemon[1347]: time=2026-09-21T12:34:36.075Z level=INFO msg="Upload complete. (492ms)" lb # [ 103.364705] niks3-server[1040]: 2026/09/21 12:34:36 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker1 # [ 103.444226] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41974 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 103.454166] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 worker1 # [ 103.461155] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) worker1 # [ 103.466091] nix-daemon[855]: reaped child process 1476, status = succeeded client # [ 103.411324] nix[1168]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker1 # [ 103.479791] nix-daemon[855]: accepted connection from pid 1270, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 105.394017] systemd-journald[268]: Received client request to rotate journal, rotating. worker2 # [ 105.415426] systemd-journald[268]: Vacuuming done, freed 0B of archived journals from /var/log/journal/a88252f7f1ab4e67aed68b68d54c340b. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 105.552889] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds) client: must succeed: sleep 5.0 worker1 # [ 106.495114] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:39Z level=info event=draining lb # [ 109.891637] envoy[902]: conn peer=[2001:db8:1::1]:44684 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9666 tx=4155 ms=8036 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1 # [ 110.909123] nix-daemon[855]: reaped child process 1490, status = succeeded worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 111.075109] nix-daemon[855]: accepted connection from pid 1531, user nix-grpc-daemon (trusted) worker1 # [ 111.096233] nix-daemon[855]: reaped child process 1534, status = succeeded lb # [ 111.035687] niks3-server[1040]: 2026/09/21 12:34:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 111.122488] nix-grpc-daemon[1347]: time=2026-09-21T12:34:43.760Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 111.124176] nix-grpc-daemon[1347]: time=2026-09-21T12:34:43.760Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 111.077408] niks3-server[1040]: 2026/09/21 12:34:43 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst worker1 # [ 111.166395] nix-grpc-daemon[1347]: time=2026-09-21T12:34:43.806Z level=INFO msg="Uploading 1 narinfos" lb # [ 111.094094] niks3-server[1040]: 2026/09/21 12:34:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 111.104882] niks3-server[1040]: 2026/09/21 12:34:43 INFO Signed narinfos id=34 count=1 lb # [ 111.107438] niks3-server[1040]: 2026/09/21 12:34:43 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 111.115970] niks3-server[1040]: 2026/09/21 12:34:43 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 111.123881] niks3-server[1040]: 2026/09/21 12:34:43 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 111.129571] niks3-server[1040]: 2026/09/21 12:34:43 INFO Completed upload id=34 worker1 # [ 111.202595] nix-grpc-daemon[1347]: time=2026-09-21T12:34:43.843Z level=INFO msg="Upload complete. (308ms)" lb # [ 111.132204] niks3-server[1040]: 2026/09/21 12:34:43 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 111.214426] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41974 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 111.230231] nix-daemon[855]: reaped child process 1488, status = succeeded client # [ 111.191010] systemd[1]: rs.service: Deactivated successfully. client # [ 111.195324] systemd[1]: rs.service: Consumed 187ms CPU time over 8.742s wall clock time, 41.2M memory peak, 7K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 111.495558] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=signal_exit worker1 # [ 111.523230] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=scheduler_yield lb # [ 111.452212] niks3-server[1040]: 2026/09/21 12:34:44 INFO lead: released remote=192.168.1.3:49000 worker1 # [ 111.530793] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 111.461166] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:44Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 111.536484] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:41972 worker1 # [ 111.542129] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 111.547590] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:41972 worker1 # [ 111.552326] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 111.731794] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.661129] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.737179] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.666442] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.937885] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 111.867400] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.943127] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.872664] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.13 seconds) client: waiting for success: ! systemctl is-active rs lb # [ 112.006114] niks3-server[1040]: 2026/09/21 12:34:44 INFO lead: acquired remote=192.168.1.4:44488 worker2 # [ 112.011731] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:44Z level=info event=scheduler_take_over client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } worker1 # [ 112.143928] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.073839] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.149285] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.079127] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 112.351901] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.281960] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:44Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.356317] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.287418] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:44Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds) worker1 # [ 112.529051] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:45Z level=info event=scheduler_restarting worker1 # [ 112.543474] nix-grpc-daemon[1270]: E0000 00:00:1789994085.183821 1315 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 112.484935] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.489972] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.576681] nix-grpc-daemon[1270]: E0000 00:00:1789994085.201342 1315 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 112.595955] nix-grpc-daemon[1270]: ts=2026-09-21T12:34:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 112.600557] nix-daemon[855]: reaped child process 1337, status = succeeded worker2 # [ 112.691095] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.696707] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.897824] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 112.903269] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:45Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.104182] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:45Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.120148] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:45Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 113.125252] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:45Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:54904 worker2 # [ 113.130605] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:45Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker1 # [ 114.288733] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 114.291758] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 114.298845] systemd[1]: nix-grpc-daemon.service: Consumed 1.813s CPU time over 27.019s wall clock time, 37.2M memory peak, 49.9K incoming IP traffic, 93.9K outgoing IP traffic. worker1 # [ 114.314984] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 114.509396] nix-grpc-daemon[1541]: ts=2026-09-21T12:34:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 114.513006] nix-grpc-daemon[1541]: ts=2026-09-21T12:34:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 114.515390] nix-grpc-daemon[1541]: ts=2026-09-21T12:34:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 114.523946] nix-grpc-daemon[1541]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 114.529307] nix-grpc-daemon[1541]: E0000 00:00:1789994087.162357 1541 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 114.532921] nix-grpc-daemon[1541]: E0000 00:00:1789994087.164371 1541 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 114.535892] nix-grpc-daemon[1541]: ts=2026-09-21T12:34:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 114.539121] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 114.544066] nix-grpc-daemon[1541]: E0000 00:00:1789994087.183635 1580 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 114.572048] nix-grpc-daemon[1541]: E0000 00:00:1789994087.201334 1580 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 114.574428] nix-grpc-daemon[1541]: E0000 00:00:1789994087.201510 1580 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 114.581283] nix-grpc-daemon[1541]: E0000 00:00:1789994087.220868 1580 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 114.593863] nix-grpc-daemon[1541]: ts=2026-09-21T12:34:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.525846] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:47Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:54904 worker2 # [ 114.526173] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.26 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 114.715760] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: b8096baa586b4e9db4172765c09430a5 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds) worker2 # [ 114.969809] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:55352 client # [ 114.985344] nix[1204]: don't know how to build these paths: client # [ 114.986361] nix[1204]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 114.989945] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:47Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 114.997692] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:47Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 115.037071] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55352 worker2 # [ 115.053900] nix-grpc-daemon[1152]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 1/5) worker2 # [ 115.071529] nix-grpc-daemon[1152]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 106 ms (attempt 2/5) worker2 # [ 115.185561] nix-grpc-daemon[1152]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 3/5) worker2 # [ 115.247169] nix-grpc-daemon[1152]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 150 ms (attempt 4/5) worker2 # [ 115.405095] nix-grpc-daemon[1152]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 115.410835] nix-grpc-daemon[1152]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 115.429176] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:55352 client # [ 115.451050] nix[1204]: copying 1 paths to 'lb:50051'... worker2 # [ 115.443698] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55352 client # [ 115.453599] nix[1204]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 115.459555] nix-daemon[847]: accepted connection from pid 1152, user nix-grpc-daemon (trusted) worker2 # [ 115.487186] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:48Z level=info event=niks3_push_started pid=1271 worker2 # [ 115.709874] nix-grpc-daemon[1271]: time=2026-09-21T12:34:48.344Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 115.880098] nix-daemon[847]: accepted connection from pid 1284, user nix-grpc-daemon (trusted) worker2 # [ 115.894706] nix-daemon[847]: reaped child process 1287, status = succeeded worker2 # [ 116.090926] nix-daemon[847]: accepted connection from pid 1289, user nix-grpc-daemon (trusted) worker2 # [ 116.107129] nix-daemon[847]: reaped child process 1296, status = succeeded lb # [ 116.118560] niks3-server[1040]: 2026/09/21 12:34:48 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 116.130583] nix-grpc-daemon[1271]: time=2026-09-21T12:34:48.764Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 116.132259] nix-grpc-daemon[1271]: time=2026-09-21T12:34:48.764Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 116.153604] niks3-server[1040]: 2026/09/21 12:34:48 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 116.169956] nix-grpc-daemon[1271]: time=2026-09-21T12:34:48.804Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.167994] niks3-server[1040]: 2026/09/21 12:34:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 116.178795] niks3-server[1040]: 2026/09/21 12:34:48 INFO Signed narinfos id=35 count=1 lb # [ 116.187468] niks3-server[1040]: 2026/09/21 12:34:48 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 116.197054] niks3-server[1040]: 2026/09/21 12:34:48 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 116.208940] niks3-server[1040]: 2026/09/21 12:34:48 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo lb # [ 116.235622] niks3-server[1040]: 2026/09/21 12:34:48 INFO Completed upload id=35 worker2 # [ 116.237315] nix-grpc-daemon[1271]: time=2026-09-21T12:34:48.872Z level=INFO msg="Upload complete. (523ms)" worker2 # [ 116.250102] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:55352 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 116.267003] nix-grpc-daemon[1152]: ts=2026-09-21T12:34:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:55352 worker2 # [ 116.277693] nix-daemon[847]: accepted connection from pid 1152, user nix-grpc-daemon (trusted) worker2 # [ 116.281807] nix-daemon[847]: reaped child process 1269, status = succeeded client # [ 116.301242] nix[1204]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 116.296188] nix-daemon[847]: accepted connection from pid 1152, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 117.532004] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1152 (nix-grpc-daemon) on client request. lb # [ 117.532967] niks3-server[1040]: 2026/09/21 12:34:50 INFO lead: released remote=192.168.1.4:44488 worker2 # [ 117.534778] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. client # [ 117.556742] nix[1204]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 117.620773] nix-grpc-daemon[1541]: ts=2026-09-21T12:34:50Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker2 # [ 117.558900] systemd[1]: Starting scheduler-token.service... client # [ 117.557161] nix[1204]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 117.569530] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 117.571014] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 117.577481] systemd[1]: nix-grpc-daemon.service: Consumed 578ms CPU time over 15.777s wall clock time, 34.6M memory peak, 16.8K incoming IP traffic, 33K outgoing IP traffic. worker2 # [ 117.603133] nix-daemon[847]: reaped child process 1211, status = succeeded worker2 # [ 117.605046] nix-daemon[847]: reaped child process 1298, status = succeeded worker2 # [ 117.612413] nix-daemon[1300]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 117.618751] nix-daemon[847]: reaped child process 1300, status = failed with exit code 1 worker2 # [ 117.660133] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 117.661286] systemd[1]: Finished scheduler-token.service. worker2 # [ 117.662259] systemd[1]: scheduler-token.service: Consumed 24ms CPU time over 98ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 117.664512] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 117.667221] systemd[1]: Starting scheduler-token.service... worker2 # [ 117.737606] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 117.740154] systemd[1]: Finished scheduler-token.service. worker2 # [ 117.740936] systemd[1]: scheduler-token.service: Consumed 22ms CPU time over 70ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 117.745691] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 117.821005] nix-grpc-daemon[1541]: ts=2026-09-21T12:34:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.909970] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 117.912539] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 117.916550] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 117.924077] nix-grpc-daemon[1340]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 117.925535] nix-grpc-daemon[1340]: E0000 00:00:1789994090.557726 1340 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 117.937273] nix-grpc-daemon[1340]: E0000 00:00:1789994090.563973 1340 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 117.942705] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 117.940189] niks3-server[1040]: 2026/09/21 12:34:50 INFO lead: acquired remote=192.168.1.4:41130 worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.47 seconds) worker2 # [ 117.947050] systemd[1]: Started Nix worker-protocol over gRPC. client: must succeed: sleep 5.0 worker2 # [ 117.948337] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=info event=scheduler_take_over worker2 # [ 117.949582] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:54914 worker2 # [ 117.951236] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 117.956127] nix-grpc-daemon[1340]: E0000 00:00:1789994090.588885 1379 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 117.984312] nix-grpc-daemon[1340]: E0000 00:00:1789994090.606351 1379 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 117.989792] nix-grpc-daemon[1340]: E0000 00:00:1789994090.606494 1379 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 117.992709] nix-grpc-daemon[1340]: E0000 00:00:1789994090.623983 1379 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 118.002055] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 118.007198] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 118.008722] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:54914 worker2 # [ 118.010426] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 118.055959] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 118.058344] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:50Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 118.187265] nix-grpc-daemon[1541]: ts=2026-09-21T12:34:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42758 worker1 # [ 118.201218] nix-daemon[855]: accepted connection from pid 1541, user nix-grpc-daemon (trusted) worker1 # [ 118.225356] nix-grpc-daemon[1541]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5) worker1 # [ 118.292452] nix-grpc-daemon[1541]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 195 ms (attempt 2/5) worker1 # [ 118.497134] nix-grpc-daemon[1541]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 3/5) worker1 # [ 118.529423] nix-grpc-daemon[1541]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 476 ms (attempt 4/5) worker1 # [ 119.014624] nix-grpc-daemon[1541]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 119.019981] nix-grpc-daemon[1541]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 119.034795] nix-grpc-daemon[1541]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'... worker1 # [ 119.056250] nix-daemon[855]: accepted connection from pid 1541, user nix-grpc-daemon (trusted) client # [ 119.012448] nix[1204]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker1 # [ 119.081011] nix-daemon[855]: accepted connection from pid 1541, user nix-grpc-daemon (trusted) lb # [ 119.889320] envoy[902]: conn peer=[2001:db8:1::1]:53570 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1405 ms=8442 lb # [ 119.894258] envoy[902]: conn peer=[2001:db8:1::3]:45906 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4282 tx=1297 ms=25020 lb # [ 119.899214] envoy[902]: conn peer=[2001:db8:1::4]:45912 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7245 tx=590 ms=15497 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 123.505277] nix-grpc-daemon[1541]: ts=2026-09-21T12:34:56Z level=info event=niks3_push_started pid=1643 worker1 # [ 123.551563] nix-daemon[855]: reaped child process 1618, status = succeeded worker1 # [ 123.751243] nix-grpc-daemon[1643]: time=2026-09-21T12:34:56.391Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 123.925164] nix-daemon[855]: accepted connection from pid 1656, user nix-grpc-daemon (trusted) worker1 # [ 123.945006] nix-daemon[855]: reaped child process 1659, status = succeeded lb # [ 123.887262] niks3-server[1040]: 2026/09/21 12:34:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 123.968069] nix-grpc-daemon[1643]: time=2026-09-21T12:34:56.606Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 123.969590] nix-grpc-daemon[1643]: time=2026-09-21T12:34:56.606Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 123.920511] niks3-server[1040]: 2026/09/21 12:34:56 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 123.927978] niks3-server[1040]: 2026/09/21 12:34:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign worker1 # [ 124.001931] nix-grpc-daemon[1643]: time=2026-09-21T12:34:56.641Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.930284] niks3-server[1040]: 2026/09/21 12:34:56 INFO Signed narinfos id=36 count=1 lb # [ 123.939704] niks3-server[1040]: 2026/09/21 12:34:56 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 123.949295] niks3-server[1040]: 2026/09/21 12:34:56 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete worker1 # [ 124.028727] nix-grpc-daemon[1643]: time=2026-09-21T12:34:56.669Z level=INFO msg="Upload complete. (273ms)" lb # [ 123.955966] niks3-server[1040]: 2026/09/21 12:34:56 INFO Completed upload id=36 worker1 # [ 124.036108] nix-grpc-daemon[1541]: ts=2026-09-21T12:34:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42758 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 124.044344] nix-grpc-daemon[1643]: time=2026-09-21T12:34:56.680Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 124.049424] nix-grpc-daemon[1643]: time=2026-09-21T12:34:56.680Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls error="server returned 404: object is not pending upload\n" worker1 # [ 124.053301] nix-daemon[855]: reaped child process 1616, status = succeeded client # [ 124.021497] systemd[1]: mid.service: Deactivated successfully. client # [ 124.026171] systemd[1]: mid.service: Consumed 191ms CPU time over 9.309s wall clock time, 39.2M memory peak, 8.7K incoming IP traffic, 10.3K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 9.87 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 124.557443] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: f0a578b7cbb848669411cfa6473c3746 client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) worker2 # [ 124.801239] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 124.816412] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) client # [ 124.841328] nix[1240]: don't know how to build these paths: client # [ 124.844276] nix[1240]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 124.848834] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:57Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker2 # [ 124.856647] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:57Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 124.894024] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 124.911548] nix-grpc-daemon[1340]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 1/5) worker2 # [ 124.991589] nix-grpc-daemon[1340]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 2/5) worker2 # [ 125.004256] nix-grpc-daemon[1340]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 3/5) worker2 # [ 125.112063] nix-grpc-daemon[1340]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 469 ms (attempt 4/5) worker2 # [ 125.581589] nix-grpc-daemon[1340]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 125.587420] nix-grpc-daemon[1340]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 125.605551] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37258 client # [ 125.627950] nix[1240]: copying 1 paths to 'lb:50051'... worker2 # [ 125.620814] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 client # [ 125.628449] nix[1240]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker2 # [ 125.635173] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 125.661841] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:58Z level=info event=niks3_push_started pid=1416 worker2 # [ 125.886492] nix-grpc-daemon[1416]: time=2026-09-21T12:34:58.520Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 126.072584] nix-daemon[847]: accepted connection from pid 1433, user nix-grpc-daemon (trusted) worker2 # [ 126.088855] nix-daemon[847]: reaped child process 1436, status = succeeded worker2 # [ 126.259611] nix-daemon[847]: accepted connection from pid 1438, user nix-grpc-daemon (trusted) worker2 # [ 126.274397] nix-daemon[847]: reaped child process 1441, status = succeeded lb # [ 126.289496] niks3-server[1040]: 2026/09/21 12:34:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 126.306784] nix-grpc-daemon[1416]: time=2026-09-21T12:34:58.940Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 126.308686] nix-grpc-daemon[1416]: time=2026-09-21T12:34:58.940Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" worker2 # [ 126.350094] nix-grpc-daemon[1416]: time=2026-09-21T12:34:58.984Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.341149] niks3-server[1040]: 2026/09/21 12:34:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 126.356322] niks3-server[1040]: 2026/09/21 12:34:58 INFO Signed narinfos id=37 count=1 lb # [ 126.358958] niks3-server[1040]: 2026/09/21 12:34:59 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 126.379036] niks3-server[1040]: 2026/09/21 12:34:59 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 126.383431] niks3-server[1040]: 2026/09/21 12:34:59 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 126.387560] niks3-server[1040]: 2026/09/21 12:34:59 INFO Completed upload id=37 worker2 # [ 126.389285] nix-grpc-daemon[1416]: time=2026-09-21T12:34:59.024Z level=INFO msg="Upload complete. (498ms)" lb # [ 126.389843] niks3-server[1040]: 2026/09/21 12:34:59 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker2 # [ 126.404595] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 126.416504] nix-grpc-daemon[1340]: ts=2026-09-21T12:34:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 126.422858] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 126.427788] nix-daemon[847]: reaped child process 1414, status = succeeded worker2 # [ 126.439197] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) client # [ 126.445490] nix[1240]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr worker2 # [ 128.291800] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:00Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 128.298265] systemd[1]: intr.service: Sent signal SIGINT to main process 1240 (nix) on client request. client # [ 128.306554] nix[1240]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 128.316185] nix[1240]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) client # [ 128.351046] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 128.355485] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 128.358363] systemd[1]: intr.service: Consumed 161ms CPU time over 3.796s wall clock time, 41.4M memory peak, 6.4K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 128.480404] nix-daemon[1445]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 128.485295] nix-daemon[847]: reaped child process 1443, status = succeeded worker2 # [ 128.490238] nix-daemon[847]: reaped child process 1445, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 5.13 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 129.711703] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: ac7195386d9245b3bb7a239d7b45dd86 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds) lb # [ 129.892530] envoy[902]: conn peer=[2001:db8:1::1]:38782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3940 tx=1851 ms=9016 client # [ 129.968787] nix[1260]: don't know how to build these paths: client # [ 129.969722] nix[1260]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 129.961079] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 129.975118] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:02Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 129.981587] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:02Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 130.094584] nix-grpc-daemon[1541]: ts=2026-09-21T12:35:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42758 worker1 # [ 130.111575] nix-grpc-daemon[1541]: ts=2026-09-21T12:35:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42758 client # [ 130.060249] nix[1260]: copying 1 paths to 'lb:50051'... worker1 # [ 130.126223] nix-grpc-daemon[1541]: ts=2026-09-21T12:35:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42758 client # [ 130.064145] nix[1260]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 130.143037] nix-daemon[855]: accepted connection from pid 1541, user nix-grpc-daemon (trusted) worker1 # [ 130.351452] nix-daemon[855]: accepted connection from pid 1691, user nix-grpc-daemon (trusted) worker1 # [ 130.371255] nix-daemon[855]: reaped child process 1694, status = succeeded worker1 # [ 130.544931] nix-daemon[855]: accepted connection from pid 1696, user nix-grpc-daemon (trusted) worker1 # [ 130.561283] nix-daemon[855]: reaped child process 1699, status = succeeded lb # [ 129.897591] envoy[902]: conn peer=[2001:db8:1::1]:50756 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3000 tx=829 ms=3532 lb # [ 130.502703] niks3-server[1040]: 2026/09/21 12:35:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 130.590487] nix-grpc-daemon[1643]: time=2026-09-21T12:35:03.230Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 130.591975] nix-grpc-daemon[1643]: time=2026-09-21T12:35:03.230Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 130.534819] niks3-server[1040]: 2026/09/21 12:35:03 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker1 # [ 130.620751] nix-grpc-daemon[1643]: time=2026-09-21T12:35:03.261Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.547712] niks3-server[1040]: 2026/09/21 12:35:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 130.560326] niks3-server[1040]: 2026/09/21 12:35:03 INFO Signed narinfos id=38 count=1 lb # [ 130.567211] niks3-server[1040]: 2026/09/21 12:35:03 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 130.580082] niks3-server[1040]: 2026/09/21 12:35:03 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete worker1 # [ 130.659514] nix-grpc-daemon[1643]: time=2026-09-21T12:35:03.300Z level=INFO msg="Upload complete. (499ms)" lb # [ 130.587251] niks3-server[1040]: 2026/09/21 12:35:03 INFO Completed upload id=38 lb # [ 130.590319] niks3-server[1040]: 2026/09/21 12:35:03 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker1 # [ 130.668246] nix-grpc-daemon[1541]: ts=2026-09-21T12:35:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42758 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 130.682269] nix-grpc-daemon[1541]: ts=2026-09-21T12:35:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42758 worker1 # [ 130.689336] nix-daemon[855]: accepted connection from pid 1541, user nix-grpc-daemon (trusted) worker1 # [ 130.694707] nix-daemon[855]: reaped child process 1689, status = succeeded client # [ 130.639879] nix[1260]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker1 # [ 130.708535] nix-daemon[855]: accepted connection from pid 1541, user nix-grpc-daemon (trusted) worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 132.478752] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 132.535225] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1 # [ 132.538958] nix-grpc-daemon[1541]: ts=2026-09-21T12:35:05Z level=info event=draining worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 132.793391] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 132.801218] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 132.822720] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:05Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 132.829664] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:05Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 132.869336] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 132.890790] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37258 client # copying 1 paths to 'lb:50051'... worker2 # [ 132.906669] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker2 # [ 132.932566] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 133.145425] nix-daemon[847]: accepted connection from pid 1500, user nix-grpc-daemon (trusted) worker2 # [ 133.163849] nix-daemon[847]: reaped child process 1503, status = succeeded worker2 # [ 133.335201] nix-daemon[847]: accepted connection from pid 1505, user nix-grpc-daemon (trusted) worker2 # [ 133.350990] nix-daemon[847]: reaped child process 1508, status = succeeded lb # [ 133.362311] niks3-server[1040]: 2026/09/21 12:35:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 133.374111] nix-grpc-daemon[1416]: time=2026-09-21T12:35:06.008Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 133.375558] nix-grpc-daemon[1416]: time=2026-09-21T12:35:06.008Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 133.394893] niks3-server[1040]: 2026/09/21 12:35:06 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker2 # [ 133.408713] nix-grpc-daemon[1416]: time=2026-09-21T12:35:06.043Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.409457] niks3-server[1040]: 2026/09/21 12:35:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 133.418297] niks3-server[1040]: 2026/09/21 12:35:06 INFO Signed narinfos id=39 count=1 lb # [ 133.428444] niks3-server[1040]: 2026/09/21 12:35:06 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 133.431652] niks3-server[1040]: 2026/09/21 12:35:06 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 133.438666] niks3-server[1040]: 2026/09/21 12:35:06 INFO Completed upload id=39 worker2 # [ 133.440115] nix-grpc-daemon[1416]: time=2026-09-21T12:35:06.074Z level=INFO msg="Upload complete. (489ms)" lb # [ 133.440948] niks3-server[1040]: 2026/09/21 12:35:06 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker2 # [ 133.448213] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 133.458244] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 133.467525] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 133.470272] nix-daemon[847]: reaped child process 1498, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker2 # [ 133.482900] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 134.928508] nix-daemon[847]: reaped child process 1512, status = succeeded worker2 # [ 135.102427] nix-daemon[847]: accepted connection from pid 1528, user nix-grpc-daemon (trusted) worker2 # [ 135.120293] nix-daemon[847]: reaped child process 1531, status = succeeded lb # [ 135.132613] niks3-server[1040]: 2026/09/21 12:35:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 135.147715] nix-grpc-daemon[1416]: time=2026-09-21T12:35:07.779Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 135.149901] nix-grpc-daemon[1416]: time=2026-09-21T12:35:07.779Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 135.174860] niks3-server[1040]: 2026/09/21 12:35:07 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 135.185193] niks3-server[1040]: 2026/09/21 12:35:07 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst worker2 # [ 135.198625] nix-grpc-daemon[1416]: time=2026-09-21T12:35:07.832Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.199602] niks3-server[1040]: 2026/09/21 12:35:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 135.208547] niks3-server[1040]: 2026/09/21 12:35:07 INFO Signed narinfos id=40 count=1 lb # [ 135.210975] niks3-server[1040]: 2026/09/21 12:35:07 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 135.219780] niks3-server[1040]: 2026/09/21 12:35:07 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 135.224575] niks3-server[1040]: 2026/09/21 12:35:07 INFO Completed upload id=40 worker2 # [ 135.226155] nix-grpc-daemon[1416]: time=2026-09-21T12:35:07.860Z level=INFO msg="Upload complete. (332ms)" lb # [ 135.227177] niks3-server[1040]: 2026/09/21 12:35:07 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker2 # [ 135.242522] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker2 # [ 135.257862] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:07Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker2 # [ 135.261607] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:07Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 135.265458] nix-daemon[847]: reaped child process 1510, status = succeeded worker2 # [ 135.285422] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 135.299336] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 135.313520] nix-grpc-daemon[1416]: time=2026-09-21T12:35:07.948Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 135.324340] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker2 # [ 135.347780] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 135.547309] nix-daemon[847]: accepted connection from pid 1537, user nix-grpc-daemon (trusted) worker2 # [ 135.563598] nix-daemon[847]: reaped child process 1540, status = succeeded worker2 # [ 135.737030] nix-daemon[847]: accepted connection from pid 1542, user nix-grpc-daemon (trusted) worker2 # [ 135.753605] nix-daemon[847]: reaped child process 1545, status = succeeded lb # [ 135.763110] niks3-server[1040]: 2026/09/21 12:35:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 135.774957] nix-grpc-daemon[1416]: time=2026-09-21T12:35:08.409Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 135.776522] nix-grpc-daemon[1416]: time=2026-09-21T12:35:08.409Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 135.792299] niks3-server[1040]: 2026/09/21 12:35:08 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst lb # [ 135.804849] niks3-server[1040]: 2026/09/21 12:35:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker2 # [ 135.813140] nix-grpc-daemon[1416]: time=2026-09-21T12:35:08.447Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.815856] niks3-server[1040]: 2026/09/21 12:35:08 INFO Signed narinfos id=41 count=1 lb # [ 135.822781] niks3-server[1040]: 2026/09/21 12:35:08 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 135.832357] niks3-server[1040]: 2026/09/21 12:35:08 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 135.838920] niks3-server[1040]: 2026/09/21 12:35:08 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo lb # [ 135.844490] niks3-server[1040]: 2026/09/21 12:35:08 INFO Completed upload id=41 worker2 # [ 135.846028] nix-grpc-daemon[1416]: time=2026-09-21T12:35:08.480Z level=INFO msg="Upload complete. (481ms)" worker2 # [ 135.854148] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 135.867844] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 135.877096] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 135.879919] nix-daemon[847]: reaped child process 1535, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker2 # [ 135.893281] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 137.528520] nix-daemon[847]: reaped child process 1549, status = succeeded worker2 # [ 137.702174] nix-daemon[847]: accepted connection from pid 1565, user nix-grpc-daemon (trusted) worker2 # [ 137.718084] nix-daemon[847]: reaped child process 1568, status = succeeded lb # [ 137.729077] niks3-server[1040]: 2026/09/21 12:35:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 137.740205] nix-grpc-daemon[1416]: time=2026-09-21T12:35:10.374Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 137.741675] nix-grpc-daemon[1416]: time=2026-09-21T12:35:10.374Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 137.766570] niks3-server[1040]: 2026/09/21 12:35:10 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 137.777945] niks3-server[1040]: 2026/09/21 12:35:10 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 137.785582] niks3-server[1040]: 2026/09/21 12:35:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 137.795661] niks3-server[1040]: 2026/09/21 12:35:10 INFO Signed narinfos id=42 count=1 worker2 # [ 137.800734] nix-grpc-daemon[1416]: time=2026-09-21T12:35:10.435Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.808088] niks3-server[1040]: 2026/09/21 12:35:10 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 137.816636] niks3-server[1040]: 2026/09/21 12:35:10 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 137.825481] niks3-server[1040]: 2026/09/21 12:35:10 INFO Completed upload id=42 worker2 # [ 137.827015] nix-grpc-daemon[1416]: time=2026-09-21T12:35:10.461Z level=INFO msg="Upload complete. (323ms)" lb # [ 137.828217] niks3-server[1040]: 2026/09/21 12:35:10 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 137.845058] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker2 # [ 137.860386] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:10Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker2 # [ 137.865395] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:10Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 137.869491] nix-daemon[847]: reaped child process 1547, status = succeeded worker2 # [ 137.889536] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 137.903965] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 137.917170] nix-grpc-daemon[1416]: time=2026-09-21T12:35:10.551Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker2 # [ 137.927004] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 137.943053] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 138.153373] nix-daemon[847]: accepted connection from pid 1574, user nix-grpc-daemon (trusted) worker2 # [ 138.170339] nix-daemon[847]: reaped child process 1577, status = succeeded worker2 # [ 138.343885] nix-daemon[847]: accepted connection from pid 1579, user nix-grpc-daemon (trusted) worker2 # [ 138.359105] nix-daemon[847]: reaped child process 1582, status = succeeded lb # [ 138.372217] niks3-server[1040]: 2026/09/21 12:35:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 138.382501] nix-grpc-daemon[1416]: time=2026-09-21T12:35:11.017Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 138.383979] nix-grpc-daemon[1416]: time=2026-09-21T12:35:11.017Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 138.399354] niks3-server[1040]: 2026/09/21 12:35:11 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst lb # [ 138.412619] niks3-server[1040]: 2026/09/21 12:35:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker2 # [ 138.419677] nix-grpc-daemon[1416]: time=2026-09-21T12:35:11.054Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.422856] niks3-server[1040]: 2026/09/21 12:35:11 INFO Signed narinfos id=43 count=1 lb # [ 138.429459] niks3-server[1040]: 2026/09/21 12:35:11 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 138.436713] niks3-server[1040]: 2026/09/21 12:35:11 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete worker2 # [ 138.444626] nix-grpc-daemon[1416]: time=2026-09-21T12:35:11.079Z level=INFO msg="Upload complete. (480ms)" lb # [ 138.444079] niks3-server[1040]: 2026/09/21 12:35:11 INFO Completed upload id=43 lb # [ 138.446807] niks3-server[1040]: 2026/09/21 12:35:11 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker2 # [ 138.452173] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 138.466975] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 138.470368] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 138.475717] nix-daemon[847]: reaped child process 1572, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker2 # [ 138.487140] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 139.917091] nix-daemon[847]: reaped child process 1586, status = succeeded worker2 # [ 140.082343] nix-daemon[847]: accepted connection from pid 1602, user nix-grpc-daemon (trusted) worker2 # [ 140.100040] nix-daemon[847]: reaped child process 1605, status = succeeded lb # [ 140.117711] niks3-server[1040]: 2026/09/21 12:35:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 140.128403] nix-grpc-daemon[1416]: time=2026-09-21T12:35:12.761Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 140.129890] nix-grpc-daemon[1416]: time=2026-09-21T12:35:12.761Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 140.155446] niks3-server[1040]: 2026/09/21 12:35:12 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 140.169209] nix-grpc-daemon[1416]: time=2026-09-21T12:35:12.803Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.164752] niks3-server[1040]: 2026/09/21 12:35:12 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 140.179734] niks3-server[1040]: 2026/09/21 12:35:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 140.189545] niks3-server[1040]: 2026/09/21 12:35:12 INFO Signed narinfos id=44 count=1 lb # [ 140.192661] niks3-server[1040]: 2026/09/21 12:35:12 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls worker2 # [ 140.198396] nix-grpc-daemon[1416]: time=2026-09-21T12:35:12.833Z level=INFO msg="Upload complete. (301ms)" lb # [ 140.197545] niks3-server[1040]: 2026/09/21 12:35:12 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 140.203594] niks3-server[1040]: 2026/09/21 12:35:12 INFO Completed upload id=44 lb # [ 140.208486] niks3-server[1040]: 2026/09/21 12:35:12 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker2 # [ 140.209477] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker2 # [ 140.225638] nix-daemon[847]: reaped child process 1584, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 7.73 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 140.753386] nix-daemon[855]: reaped child process 1703, status = succeeded worker1 # [ 140.929872] nix-daemon[855]: accepted connection from pid 1744, user nix-grpc-daemon (trusted) worker1 # [ 140.947923] nix-daemon[855]: reaped child process 1747, status = succeeded lb # [ 140.886300] niks3-server[1040]: 2026/09/21 12:35:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 140.969728] nix-grpc-daemon[1643]: time=2026-09-21T12:35:13.609Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 140.971349] nix-grpc-daemon[1643]: time=2026-09-21T12:35:13.609Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 140.917576] niks3-server[1040]: 2026/09/21 12:35:13 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 140.933906] niks3-server[1040]: 2026/09/21 12:35:13 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker1 # [ 141.016083] nix-grpc-daemon[1643]: time=2026-09-21T12:35:13.655Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.945908] niks3-server[1040]: 2026/09/21 12:35:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 140.952585] niks3-server[1040]: 2026/09/21 12:35:13 INFO Signed narinfos id=45 count=1 lb # [ 140.954632] niks3-server[1040]: 2026/09/21 12:35:13 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 140.960487] niks3-server[1040]: 2026/09/21 12:35:13 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 140.966823] niks3-server[1040]: 2026/09/21 12:35:13 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo lb # [ 140.970617] niks3-server[1040]: 2026/09/21 12:35:13 INFO Completed upload id=45 worker1 # [ 141.042970] nix-grpc-daemon[1643]: time=2026-09-21T12:35:13.683Z level=INFO msg="Upload complete. (316ms)" worker1 # [ 141.053064] nix-grpc-daemon[1541]: ts=2026-09-21T12:35:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42758 duration_s=10 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 141.070344] nix-daemon[855]: reaped child process 1701, status = succeeded client # [ 141.029826] systemd[1]: sw.service: Deactivated successfully. client # [ 141.034402] systemd[1]: sw.service: Consumed 177ms CPU time over 11.321s wall clock time, 41.2M memory peak, 7K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 141.539882] nix-grpc-daemon[1541]: ts=2026-09-21T12:35:14Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 142.697060] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:54914 worker2 # [ 142.701992] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:15Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 142.768002] nix-grpc-daemon[1541]: ts=2026-09-21T12:35:15Z level=info event=scheduler_restarting worker1 # [ 142.793633] nix-grpc-daemon[1541]: ts=2026-09-21T12:35:15Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 142.818517] nix-daemon[855]: reaped child process 1609, status = succeeded worker1 # [ 143.344715] nix-grpc-daemon[1541]: E0000 00:00:1789994115.985063 1586 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 143.353708] nix-grpc-daemon[1541]: E0000 00:00:1789994115.994098 1586 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 144.585249] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 144.591106] systemd[1]: nix-grpc-daemon.service: Consumed 890ms CPU time over 30.268s wall clock time, 33M memory peak, 21K incoming IP traffic, 27.2K outgoing IP traffic. worker1 # [ 144.609214] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 144.810373] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 144.813015] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 144.817044] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 144.824062] nix-grpc-daemon[1761]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 144.833699] nix-grpc-daemon[1761]: E0000 00:00:1789994117.464113 1761 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 144.837824] nix-grpc-daemon[1761]: E0000 00:00:1789994117.467720 1761 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 144.841423] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 144.843402] systemd[1]: Started Nix worker-protocol over gRPC. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.05 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 144.868135] nix-grpc-daemon[1761]: E0000 00:00:1789994117.485577 1803 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 144.870481] nix-grpc-daemon[1761]: E0000 00:00:1789994117.502602 1803 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 144.882407] nix-grpc-daemon[1761]: E0000 00:00:1789994117.502749 1803 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 144.885383] nix-grpc-daemon[1761]: E0000 00:00:1789994117.522071 1803 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 144.899448] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.831959] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:54914 worker2 # [ 144.832744] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 16.47 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 146.391393] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 146.397963] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 146.437392] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:19Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker2 # [ 146.448327] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:19Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 146.454175] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:19Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker2 # [ 146.459329] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:19Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 146.563137] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 146.578805] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 146.605303] nix-grpc-daemon[1761]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5) worker1 # [ 146.697587] nix-grpc-daemon[1761]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 2/5) worker1 # [ 146.871273] nix-grpc-daemon[1761]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 260 ms (attempt 3/5) worker1 # [ 147.131654] nix-grpc-daemon[1761]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 731 ms (attempt 4/5) worker1 # [ 147.871684] nix-grpc-daemon[1761]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 147.877221] nix-grpc-daemon[1761]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 147.898488] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 147.914278] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 147.929726] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 147.956862] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:20Z level=info event=niks3_push_started pid=1821 worker1 # [ 148.180180] nix-grpc-daemon[1821]: time=2026-09-21T12:35:20.820Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 148.359628] nix-daemon[855]: accepted connection from pid 1834, user nix-grpc-daemon (trusted) worker1 # [ 148.376311] nix-daemon[855]: reaped child process 1837, status = succeeded worker1 # [ 148.557505] nix-daemon[855]: accepted connection from pid 1839, user nix-grpc-daemon (trusted) worker1 # [ 148.574232] nix-daemon[855]: reaped child process 1842, status = succeeded lb # [ 148.513930] niks3-server[1040]: 2026/09/21 12:35:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.599491] nix-grpc-daemon[1821]: time=2026-09-21T12:35:21.238Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 148.601360] nix-grpc-daemon[1821]: time=2026-09-21T12:35:21.238Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 148.550977] niks3-server[1040]: 2026/09/21 12:35:21 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst lb # [ 148.564081] niks3-server[1040]: 2026/09/21 12:35:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign worker1 # [ 148.643065] nix-grpc-daemon[1821]: time=2026-09-21T12:35:21.283Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.575488] niks3-server[1040]: 2026/09/21 12:35:21 INFO Signed narinfos id=46 count=1 lb # [ 148.582548] niks3-server[1040]: 2026/09/21 12:35:21 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 148.595726] niks3-server[1040]: 2026/09/21 12:35:21 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete worker1 # [ 148.673984] nix-grpc-daemon[1821]: time=2026-09-21T12:35:21.314Z level=INFO msg="Upload complete. (489ms)" lb # [ 148.601790] niks3-server[1040]: 2026/09/21 12:35:21 INFO Completed upload id=46 lb # [ 148.605663] niks3-server[1040]: 2026/09/21 12:35:21 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 148.680210] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 148.688901] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 148.701086] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 148.703999] nix-daemon[855]: reaped child process 1819, status = succeeded worker1 # [ 148.713932] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) lb # [ 149.890458] envoy[902]: conn peer=[2001:db8:1::1]:33756 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9681 tx=4100 ms=7439 lb # [ 149.895532] envoy[902]: conn peer=[2001:db8:1::1]:50770 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=1429 ms=11035 lb # [ 149.900553] envoy[902]: conn peer=[2001:db8:1::3]:54344 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=425 ms=28187 worker1 # [ 150.360674] nix-daemon[855]: reaped child process 1846, status = succeeded worker1 # [ 150.541835] nix-daemon[855]: accepted connection from pid 1862, user nix-grpc-daemon (trusted) worker1 # [ 150.559798] nix-daemon[855]: reaped child process 1865, status = succeeded lb # [ 150.502748] niks3-server[1040]: 2026/09/21 12:35:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.588402] nix-grpc-daemon[1821]: time=2026-09-21T12:35:23.226Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.589930] nix-grpc-daemon[1821]: time=2026-09-21T12:35:23.226Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 150.534348] niks3-server[1040]: 2026/09/21 12:35:23 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 150.550293] niks3-server[1040]: 2026/09/21 12:35:23 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 150.564555] niks3-server[1040]: 2026/09/21 12:35:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 150.643031] nix-grpc-daemon[1821]: time=2026-09-21T12:35:23.282Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.574404] niks3-server[1040]: 2026/09/21 12:35:23 INFO Signed narinfos id=47 count=1 lb # [ 150.579885] niks3-server[1040]: 2026/09/21 12:35:23 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 150.587061] niks3-server[1040]: 2026/09/21 12:35:23 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 150.594977] niks3-server[1040]: 2026/09/21 12:35:23 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo lb # [ 150.599545] niks3-server[1040]: 2026/09/21 12:35:23 INFO Completed upload id=47 worker1 # [ 150.672371] nix-grpc-daemon[1821]: time=2026-09-21T12:35:23.312Z level=INFO msg="Upload complete. (345ms)" worker2 # [ 150.612393] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:23Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 150.683743] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=1 worker2 # [ 150.621427] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:23Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 150.701632] nix-daemon[855]: reaped child process 1844, status = succeeded worker1 # [ 150.729423] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 150.745147] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 150.759552] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 150.773263] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 150.972791] nix-daemon[855]: accepted connection from pid 1869, user nix-grpc-daemon (trusted) worker1 # [ 150.992135] nix-daemon[855]: reaped child process 1872, status = succeeded worker1 # [ 151.167207] nix-daemon[855]: accepted connection from pid 1874, user nix-grpc-daemon (trusted) worker1 # [ 151.183485] nix-daemon[855]: reaped child process 1877, status = succeeded lb # [ 151.122491] niks3-server[1040]: 2026/09/21 12:35:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.204139] nix-grpc-daemon[1821]: time=2026-09-21T12:35:23.844Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.206193] nix-grpc-daemon[1821]: time=2026-09-21T12:35:23.844Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 151.149086] niks3-server[1040]: 2026/09/21 12:35:23 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst lb # [ 151.164191] niks3-server[1040]: 2026/09/21 12:35:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker1 # [ 151.243399] nix-grpc-daemon[1821]: time=2026-09-21T12:35:23.883Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.174694] niks3-server[1040]: 2026/09/21 12:35:23 INFO Signed narinfos id=48 count=1 lb # [ 151.181999] niks3-server[1040]: 2026/09/21 12:35:23 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls worker1 # [ 151.264180] nix-grpc-daemon[1821]: time=2026-09-21T12:35:23.904Z level=INFO msg="Upload complete. (475ms)" lb # [ 151.192313] niks3-server[1040]: 2026/09/21 12:35:23 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 151.197800] niks3-server[1040]: 2026/09/21 12:35:23 INFO Completed upload id=48 worker1 # [ 151.272188] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 151.201040] niks3-server[1040]: 2026/09/21 12:35:23 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 151.281570] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 151.289264] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 151.291764] nix-daemon[855]: reaped child process 1867, status = succeeded worker1 # [ 151.303340] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 152.744804] nix-daemon[855]: reaped child process 1881, status = succeeded worker1 # [ 152.908369] nix-daemon[855]: accepted connection from pid 1897, user nix-grpc-daemon (trusted) worker1 # [ 152.923602] nix-daemon[855]: reaped child process 1900, status = succeeded lb # [ 152.866757] niks3-server[1040]: 2026/09/21 12:35:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.949732] nix-grpc-daemon[1821]: time=2026-09-21T12:35:25.589Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 152.951415] nix-grpc-daemon[1821]: time=2026-09-21T12:35:25.589Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 152.900524] niks3-server[1040]: 2026/09/21 12:35:25 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 152.914600] niks3-server[1040]: 2026/09/21 12:35:25 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 152.923489] niks3-server[1040]: 2026/09/21 12:35:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 153.002187] nix-grpc-daemon[1821]: time=2026-09-21T12:35:25.642Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.934461] niks3-server[1040]: 2026/09/21 12:35:25 INFO Signed narinfos id=49 count=1 lb # [ 152.941861] niks3-server[1040]: 2026/09/21 12:35:25 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 152.947884] niks3-server[1040]: 2026/09/21 12:35:25 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 152.955299] niks3-server[1040]: 2026/09/21 12:35:25 INFO Completed upload id=49 worker1 # [ 153.027963] nix-grpc-daemon[1821]: time=2026-09-21T12:35:25.668Z level=INFO msg="Upload complete. (314ms)" lb # [ 152.958207] niks3-server[1040]: 2026/09/21 12:35:25 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker2 # [ 152.966169] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:25Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 153.041006] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=1 worker2 # [ 152.979629] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:25Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 153.059212] nix-daemon[855]: reaped child process 1879, status = succeeded worker1 # [ 153.093626] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 153.108752] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 153.123183] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 153.137167] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 153.333795] nix-daemon[855]: accepted connection from pid 1904, user nix-grpc-daemon (trusted) worker1 # [ 153.351069] nix-daemon[855]: reaped child process 1907, status = succeeded worker1 # [ 153.526416] nix-daemon[855]: accepted connection from pid 1909, user nix-grpc-daemon (trusted) worker1 # [ 153.542141] nix-daemon[855]: reaped child process 1912, status = succeeded lb # [ 153.480830] niks3-server[1040]: 2026/09/21 12:35:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.567984] nix-grpc-daemon[1821]: time=2026-09-21T12:35:26.208Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 153.569559] nix-grpc-daemon[1821]: time=2026-09-21T12:35:26.208Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" worker1 # [ 153.598501] nix-grpc-daemon[1821]: time=2026-09-21T12:35:26.238Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.512677] niks3-server[1040]: 2026/09/21 12:35:26 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 153.528110] niks3-server[1040]: 2026/09/21 12:35:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 153.542909] niks3-server[1040]: 2026/09/21 12:35:26 INFO Signed narinfos id=50 count=1 lb # [ 153.549321] niks3-server[1040]: 2026/09/21 12:35:26 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 153.562420] niks3-server[1040]: 2026/09/21 12:35:26 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 153.568740] niks3-server[1040]: 2026/09/21 12:35:26 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo lb # [ 153.572796] niks3-server[1040]: 2026/09/21 12:35:26 INFO Completed upload id=50 worker1 # [ 153.645679] nix-grpc-daemon[1821]: time=2026-09-21T12:35:26.286Z level=INFO msg="Upload complete. (493ms)" worker1 # [ 153.656295] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 153.670681] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 153.677627] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 153.682911] nix-daemon[855]: reaped child process 1902, status = succeeded worker1 # [ 153.695476] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 154.749335] nix-daemon[855]: reaped child process 1916, status = succeeded worker1 # [ 154.935816] nix-daemon[855]: accepted connection from pid 1932, user nix-grpc-daemon (trusted) worker1 # [ 154.954162] nix-daemon[855]: reaped child process 1935, status = succeeded lb # [ 154.894779] niks3-server[1040]: 2026/09/21 12:35:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.978692] nix-grpc-daemon[1821]: time=2026-09-21T12:35:27.617Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 154.980264] nix-grpc-daemon[1821]: time=2026-09-21T12:35:27.617Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 154.929130] niks3-server[1040]: 2026/09/21 12:35:27 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 154.940390] niks3-server[1040]: 2026/09/21 12:35:27 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst worker1 # [ 155.026783] nix-grpc-daemon[1821]: time=2026-09-21T12:35:27.667Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.953715] niks3-server[1040]: 2026/09/21 12:35:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 154.960630] niks3-server[1040]: 2026/09/21 12:35:27 INFO Signed narinfos id=51 count=1 lb # [ 154.966457] niks3-server[1040]: 2026/09/21 12:35:27 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 154.977147] niks3-server[1040]: 2026/09/21 12:35:27 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 154.983723] niks3-server[1040]: 2026/09/21 12:35:27 INFO Completed upload id=51 worker1 # [ 155.056843] nix-grpc-daemon[1821]: time=2026-09-21T12:35:27.697Z level=INFO msg="Upload complete. (345ms)" lb # [ 154.986885] niks3-server[1040]: 2026/09/21 12:35:27 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker2 # [ 154.995071] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:27Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 155.069092] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=1 worker2 # [ 155.008141] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:27Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 155.087240] nix-daemon[855]: reaped child process 1914, status = succeeded worker1 # [ 155.121530] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 155.136637] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 155.150809] nix-grpc-daemon[1821]: time=2026-09-21T12:35:27.791Z level=INFO msg="All 1 paths already cached" worker1 # [ 155.160088] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 155.173532] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 155.370926] nix-daemon[855]: accepted connection from pid 1939, user nix-grpc-daemon (trusted) worker1 # [ 155.389207] nix-daemon[855]: reaped child process 1942, status = succeeded worker1 # [ 155.562944] nix-daemon[855]: accepted connection from pid 1944, user nix-grpc-daemon (trusted) worker1 # [ 155.580111] nix-daemon[855]: reaped child process 1947, status = succeeded lb # [ 155.521331] niks3-server[1040]: 2026/09/21 12:35:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.603576] nix-grpc-daemon[1821]: time=2026-09-21T12:35:28.243Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 155.605170] nix-grpc-daemon[1821]: time=2026-09-21T12:35:28.243Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 155.552695] niks3-server[1040]: 2026/09/21 12:35:28 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 155.634303] nix-grpc-daemon[1821]: time=2026-09-21T12:35:28.274Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.566362] niks3-server[1040]: 2026/09/21 12:35:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 155.577389] niks3-server[1040]: 2026/09/21 12:35:28 INFO Signed narinfos id=52 count=1 lb # [ 155.587329] niks3-server[1040]: 2026/09/21 12:35:28 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 155.592823] niks3-server[1040]: 2026/09/21 12:35:28 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete worker1 # [ 155.665347] nix-grpc-daemon[1821]: time=2026-09-21T12:35:28.305Z level=INFO msg="Upload complete. (475ms)" lb # [ 155.598047] niks3-server[1040]: 2026/09/21 12:35:28 INFO Completed upload id=52 worker1 # [ 155.672345] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 155.601468] niks3-server[1040]: 2026/09/21 12:35:28 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 155.680643] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 155.691586] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 155.693825] nix-daemon[855]: reaped child process 1937, status = succeeded worker1 # [ 155.704650] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 156.549146] nix-daemon[855]: reaped child process 1951, status = succeeded worker1 # [ 156.731122] nix-daemon[855]: accepted connection from pid 1967, user nix-grpc-daemon (trusted) worker1 # [ 156.747967] nix-daemon[855]: reaped child process 1970, status = succeeded lb # [ 156.690953] niks3-server[1040]: 2026/09/21 12:35:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.776397] nix-grpc-daemon[1821]: time=2026-09-21T12:35:29.414Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 156.777874] nix-grpc-daemon[1821]: time=2026-09-21T12:35:29.414Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 156.732794] niks3-server[1040]: 2026/09/21 12:35:29 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 156.744350] niks3-server[1040]: 2026/09/21 12:35:29 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst worker1 # [ 156.828201] nix-grpc-daemon[1821]: time=2026-09-21T12:35:29.468Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.756490] niks3-server[1040]: 2026/09/21 12:35:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign lb # [ 156.764213] niks3-server[1040]: 2026/09/21 12:35:29 INFO Signed narinfos id=53 count=1 lb # [ 156.766554] niks3-server[1040]: 2026/09/21 12:35:29 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 156.774050] niks3-server[1040]: 2026/09/21 12:35:29 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 156.780763] niks3-server[1040]: 2026/09/21 12:35:29 INFO Completed upload id=53 worker1 # [ 156.853876] nix-grpc-daemon[1821]: time=2026-09-21T12:35:29.494Z level=INFO msg="Upload complete. (338ms)" lb # [ 156.783543] niks3-server[1040]: 2026/09/21 12:35:29 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker2 # [ 156.795886] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:29Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 156.866709] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=1 worker2 # [ 156.803495] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:29Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 156.888630] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 156.892571] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 156.897609] nix-daemon[855]: reaped child process 1949, status = succeeded worker1 # [ 156.903913] nix-grpc-daemon[1821]: time=2026-09-21T12:35:29.544Z level=INFO msg="All 1 paths already cached" worker1 # [ 156.910939] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 156.921381] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 157.117362] nix-daemon[855]: accepted connection from pid 1974, user nix-grpc-daemon (trusted) worker1 # [ 157.135441] nix-daemon[855]: reaped child process 1977, status = succeeded worker1 # [ 157.314363] nix-daemon[855]: accepted connection from pid 1979, user nix-grpc-daemon (trusted) worker1 # [ 157.332597] nix-daemon[855]: reaped child process 1982, status = succeeded lb # [ 157.272103] niks3-server[1040]: 2026/09/21 12:35:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.353727] nix-grpc-daemon[1821]: time=2026-09-21T12:35:29.994Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 157.355879] nix-grpc-daemon[1821]: time=2026-09-21T12:35:29.996Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 157.302779] niks3-server[1040]: 2026/09/21 12:35:29 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst worker1 # [ 157.386717] nix-grpc-daemon[1821]: time=2026-09-21T12:35:30.026Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.319234] niks3-server[1040]: 2026/09/21 12:35:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 157.329429] niks3-server[1040]: 2026/09/21 12:35:29 INFO Signed narinfos id=54 count=1 lb # [ 157.333452] niks3-server[1040]: 2026/09/21 12:35:29 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 157.342231] niks3-server[1040]: 2026/09/21 12:35:29 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 157.347818] niks3-server[1040]: 2026/09/21 12:35:29 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo lb # [ 157.352669] niks3-server[1040]: 2026/09/21 12:35:30 INFO Completed upload id=54 worker1 # [ 157.425878] nix-grpc-daemon[1821]: time=2026-09-21T12:35:30.066Z level=INFO msg="Upload complete. (491ms)" worker1 # [ 157.434904] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 157.444998] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 157.458476] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 157.465089] nix-daemon[855]: reaped child process 1972, status = succeeded worker1 # [ 157.479081] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 158.724710] nix-daemon[855]: reaped child process 1986, status = succeeded worker1 # [ 158.913194] nix-daemon[855]: accepted connection from pid 2002, user nix-grpc-daemon (trusted) worker1 # [ 158.932377] nix-daemon[855]: reaped child process 2005, status = succeeded lb # [ 158.871488] niks3-server[1040]: 2026/09/21 12:35:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.956451] nix-grpc-daemon[1821]: time=2026-09-21T12:35:31.596Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 158.961390] nix-grpc-daemon[1821]: time=2026-09-21T12:35:31.598Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 158.915699] niks3-server[1040]: 2026/09/21 12:35:31 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 158.928239] niks3-server[1040]: 2026/09/21 12:35:31 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 158.935777] niks3-server[1040]: 2026/09/21 12:35:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 159.014196] nix-grpc-daemon[1821]: time=2026-09-21T12:35:31.654Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.945196] niks3-server[1040]: 2026/09/21 12:35:31 INFO Signed narinfos id=55 count=1 lb # [ 158.951222] niks3-server[1040]: 2026/09/21 12:35:31 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 158.959655] niks3-server[1040]: 2026/09/21 12:35:31 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 158.967815] niks3-server[1040]: 2026/09/21 12:35:31 INFO Completed upload id=55 worker1 # [ 159.040976] nix-grpc-daemon[1821]: time=2026-09-21T12:35:31.681Z level=INFO msg="Upload complete. (346ms)" lb # [ 158.970938] niks3-server[1040]: 2026/09/21 12:35:31 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker2 # [ 158.982454] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:31Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.052713] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=1 worker2 # [ 158.991972] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:31Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 159.075336] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 159.081195] nix-daemon[855]: reaped child process 1984, status = succeeded worker1 # [ 159.089129] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 159.101910] nix-grpc-daemon[1821]: time=2026-09-21T12:35:31.742Z level=INFO msg="All 1 paths already cached" worker1 # [ 159.110496] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 159.124522] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 159.313583] nix-daemon[855]: accepted connection from pid 2009, user nix-grpc-daemon (trusted) worker1 # [ 159.331922] nix-daemon[855]: reaped child process 2012, status = succeeded worker1 # [ 159.505120] nix-daemon[855]: accepted connection from pid 2014, user nix-grpc-daemon (trusted) worker1 # [ 159.522870] nix-daemon[855]: reaped child process 2017, status = succeeded lb # [ 159.461012] niks3-server[1040]: 2026/09/21 12:35:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.545164] nix-grpc-daemon[1821]: time=2026-09-21T12:35:32.185Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 159.546648] nix-grpc-daemon[1821]: time=2026-09-21T12:35:32.185Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 159.489359] niks3-server[1040]: 2026/09/21 12:35:32 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst worker1 # [ 159.576415] nix-grpc-daemon[1821]: time=2026-09-21T12:35:32.216Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.507002] niks3-server[1040]: 2026/09/21 12:35:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 159.515598] niks3-server[1040]: 2026/09/21 12:35:32 INFO Signed narinfos id=56 count=1 lb # [ 159.524298] niks3-server[1040]: 2026/09/21 12:35:32 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 159.527509] niks3-server[1040]: 2026/09/21 12:35:32 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 159.533152] niks3-server[1040]: 2026/09/21 12:35:32 INFO Completed upload id=56 worker1 # [ 159.606173] nix-grpc-daemon[1821]: time=2026-09-21T12:35:32.246Z level=INFO msg="Upload complete. (467ms)" lb # [ 159.535932] niks3-server[1040]: 2026/09/21 12:35:32 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 159.612259] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 159.624974] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 159.632525] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 159.637372] nix-daemon[855]: reaped child process 2007, status = succeeded worker1 # [ 159.650875] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 160.698400] nix-daemon[855]: reaped child process 2021, status = succeeded worker1 # [ 160.881177] nix-daemon[855]: accepted connection from pid 2037, user nix-grpc-daemon (trusted) worker1 # [ 160.897980] nix-daemon[855]: reaped child process 2040, status = succeeded lb # [ 160.837767] niks3-server[1040]: 2026/09/21 12:35:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 160.927880] nix-grpc-daemon[1821]: time=2026-09-21T12:35:33.565Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 160.929614] nix-grpc-daemon[1821]: time=2026-09-21T12:35:33.565Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 160.873485] niks3-server[1040]: 2026/09/21 12:35:33 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 160.887149] niks3-server[1040]: 2026/09/21 12:35:33 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 160.899760] niks3-server[1040]: 2026/09/21 12:35:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 160.978105] nix-grpc-daemon[1821]: time=2026-09-21T12:35:33.618Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.908765] niks3-server[1040]: 2026/09/21 12:35:33 INFO Signed narinfos id=57 count=1 lb # [ 160.910917] niks3-server[1040]: 2026/09/21 12:35:33 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 160.920230] niks3-server[1040]: 2026/09/21 12:35:33 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 160.924867] niks3-server[1040]: 2026/09/21 12:35:33 INFO Completed upload id=57 worker1 # [ 160.997976] nix-grpc-daemon[1821]: time=2026-09-21T12:35:33.638Z level=INFO msg="Upload complete. (336ms)" lb # [ 160.927177] niks3-server[1040]: 2026/09/21 12:35:33 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker2 # [ 160.938724] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:33Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 161.009673] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=1 worker2 # [ 160.946445] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:33Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 161.028741] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 161.036241] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 161.041719] nix-daemon[855]: reaped child process 2019, status = succeeded worker1 # [ 161.044863] nix-grpc-daemon[1821]: time=2026-09-21T12:35:33.685Z level=INFO msg="All 2 paths already cached" worker1 # [ 161.052163] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 161.062804] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 161.250162] nix-daemon[855]: accepted connection from pid 2044, user nix-grpc-daemon (trusted) worker1 # [ 161.266600] nix-daemon[855]: reaped child process 2047, status = succeeded worker1 # [ 161.441617] nix-daemon[855]: accepted connection from pid 2049, user nix-grpc-daemon (trusted) worker1 # [ 161.458163] nix-daemon[855]: reaped child process 2052, status = succeeded lb # [ 161.396417] niks3-server[1040]: 2026/09/21 12:35:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.478552] nix-grpc-daemon[1821]: time=2026-09-21T12:35:34.118Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.480336] nix-grpc-daemon[1821]: time=2026-09-21T12:35:34.118Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 161.423714] niks3-server[1040]: 2026/09/21 12:35:34 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 161.507247] nix-grpc-daemon[1821]: time=2026-09-21T12:35:34.147Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.439260] niks3-server[1040]: 2026/09/21 12:35:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 161.449120] niks3-server[1040]: 2026/09/21 12:35:34 INFO Signed narinfos id=58 count=1 lb # [ 161.457166] niks3-server[1040]: 2026/09/21 12:35:34 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 161.461374] niks3-server[1040]: 2026/09/21 12:35:34 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete worker1 # [ 161.538505] nix-grpc-daemon[1821]: time=2026-09-21T12:35:34.179Z level=INFO msg="Upload complete. (463ms)" lb # [ 161.466073] niks3-server[1040]: 2026/09/21 12:35:34 INFO Completed upload id=58 lb # [ 161.469867] niks3-server[1040]: 2026/09/21 12:35:34 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 161.544209] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 161.552542] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 161.564162] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 161.566990] nix-daemon[855]: reaped child process 2042, status = succeeded worker1 # [ 161.577324] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 162.817800] nix-daemon[855]: reaped child process 2056, status = succeeded worker1 # [ 162.986199] nix-daemon[855]: accepted connection from pid 2072, user nix-grpc-daemon (trusted) worker1 # [ 163.003253] nix-daemon[855]: reaped child process 2075, status = succeeded lb # [ 162.942946] niks3-server[1040]: 2026/09/21 12:35:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.028409] nix-grpc-daemon[1821]: time=2026-09-21T12:35:35.665Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.029901] nix-grpc-daemon[1821]: time=2026-09-21T12:35:35.665Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 162.988334] niks3-server[1040]: 2026/09/21 12:35:35 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 162.996719] niks3-server[1040]: 2026/09/21 12:35:35 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker1 # [ 163.078983] nix-grpc-daemon[1821]: time=2026-09-21T12:35:35.719Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.006078] niks3-server[1040]: 2026/09/21 12:35:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 163.015457] niks3-server[1040]: 2026/09/21 12:35:35 INFO Signed narinfos id=59 count=1 lb # [ 163.020505] niks3-server[1040]: 2026/09/21 12:35:35 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 163.029140] niks3-server[1040]: 2026/09/21 12:35:35 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 163.034572] niks3-server[1040]: 2026/09/21 12:35:35 INFO Completed upload id=59 worker1 # [ 163.107753] nix-grpc-daemon[1821]: time=2026-09-21T12:35:35.748Z level=INFO msg="Upload complete. (318ms)" lb # [ 163.037911] niks3-server[1040]: 2026/09/21 12:35:35 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker2 # [ 163.046410] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:35Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 163.118962] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=1 worker1 # [ 163.134371] nix-daemon[855]: reaped child process 2054, status = succeeded worker1 # [ 163.161279] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 163.175294] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 163.189331] nix-grpc-daemon[1821]: time=2026-09-21T12:35:35.829Z level=INFO msg="All 2 paths already cached" worker1 # [ 163.197742] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 163.211562] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 163.412141] nix-daemon[855]: accepted connection from pid 2079, user nix-grpc-daemon (trusted) worker1 # [ 163.431703] nix-daemon[855]: reaped child process 2082, status = succeeded worker1 # [ 163.602849] nix-daemon[855]: accepted connection from pid 2084, user nix-grpc-daemon (trusted) worker1 # [ 163.621473] nix-daemon[855]: reaped child process 2087, status = succeeded lb # [ 163.562791] niks3-server[1040]: 2026/09/21 12:35:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.644100] nix-grpc-daemon[1821]: time=2026-09-21T12:35:36.284Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 163.645623] nix-grpc-daemon[1821]: time=2026-09-21T12:35:36.284Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 163.592746] niks3-server[1040]: 2026/09/21 12:35:36 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 163.677370] nix-grpc-daemon[1821]: time=2026-09-21T12:35:36.317Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.608662] niks3-server[1040]: 2026/09/21 12:35:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 163.619116] niks3-server[1040]: 2026/09/21 12:35:36 INFO Signed narinfos id=60 count=1 lb # [ 163.623048] niks3-server[1040]: 2026/09/21 12:35:36 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 163.631031] niks3-server[1040]: 2026/09/21 12:35:36 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete worker1 # [ 163.708395] nix-grpc-daemon[1821]: time=2026-09-21T12:35:36.348Z level=INFO msg="Upload complete. (481ms)" lb # [ 163.636047] niks3-server[1040]: 2026/09/21 12:35:36 INFO Completed upload id=60 lb # [ 163.639001] niks3-server[1040]: 2026/09/21 12:35:36 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 163.716149] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 163.725827] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 163.735413] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 163.740232] nix-daemon[855]: reaped child process 2077, status = succeeded worker1 # [ 163.753219] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 164.591823] nix-daemon[855]: reaped child process 2091, status = succeeded worker1 # [ 164.756524] nix-daemon[855]: accepted connection from pid 2107, user nix-grpc-daemon (trusted) worker1 # [ 164.773445] nix-daemon[855]: reaped child process 2110, status = succeeded lb # [ 164.714965] niks3-server[1040]: 2026/09/21 12:35:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 164.799180] nix-grpc-daemon[1821]: time=2026-09-21T12:35:37.437Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 164.800956] nix-grpc-daemon[1821]: time=2026-09-21T12:35:37.437Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 164.756183] niks3-server[1040]: 2026/09/21 12:35:37 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 164.766277] niks3-server[1040]: 2026/09/21 12:35:37 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker1 # [ 164.845979] nix-grpc-daemon[1821]: time=2026-09-21T12:35:37.486Z level=INFO msg="Uploading 1 narinfos" lb # [ 164.775720] niks3-server[1040]: 2026/09/21 12:35:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 164.784371] niks3-server[1040]: 2026/09/21 12:35:37 INFO Signed narinfos id=61 count=1 lb # [ 164.787062] niks3-server[1040]: 2026/09/21 12:35:37 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 164.795502] niks3-server[1040]: 2026/09/21 12:35:37 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 164.802613] niks3-server[1040]: 2026/09/21 12:35:37 INFO Completed upload id=61 worker1 # [ 164.875773] nix-grpc-daemon[1821]: time=2026-09-21T12:35:37.516Z level=INFO msg="Upload complete. (313ms)" lb # [ 164.805634] niks3-server[1040]: 2026/09/21 12:35:37 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker2 # [ 164.814162] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:37Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 164.889199] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=1 worker1 # [ 164.906224] nix-daemon[855]: reaped child process 2089, status = succeeded worker1 # [ 164.929291] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 164.944950] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 164.959383] nix-grpc-daemon[1821]: time=2026-09-21T12:35:37.599Z level=INFO msg="All 2 paths already cached" worker1 # [ 164.968127] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 164.983147] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 165.180094] nix-daemon[855]: accepted connection from pid 2114, user nix-grpc-daemon (trusted) worker1 # [ 165.199397] nix-daemon[855]: reaped child process 2117, status = succeeded worker1 # [ 165.374770] nix-daemon[855]: accepted connection from pid 2119, user nix-grpc-daemon (trusted) worker1 # [ 165.391980] nix-daemon[855]: reaped child process 2122, status = succeeded lb # [ 165.330767] niks3-server[1040]: 2026/09/21 12:35:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 165.412076] nix-grpc-daemon[1821]: time=2026-09-21T12:35:38.052Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 165.413562] nix-grpc-daemon[1821]: time=2026-09-21T12:35:38.052Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 165.362727] niks3-server[1040]: 2026/09/21 12:35:38 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst lb # [ 165.375477] niks3-server[1040]: 2026/09/21 12:35:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign worker1 # [ 165.455848] nix-grpc-daemon[1821]: time=2026-09-21T12:35:38.096Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.382990] niks3-server[1040]: 2026/09/21 12:35:38 INFO Signed narinfos id=62 count=1 lb # [ 165.390451] niks3-server[1040]: 2026/09/21 12:35:38 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 165.401230] niks3-server[1040]: 2026/09/21 12:35:38 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 165.406636] niks3-server[1040]: 2026/09/21 12:35:38 INFO Completed upload id=62 worker1 # [ 165.479719] nix-grpc-daemon[1821]: time=2026-09-21T12:35:38.120Z level=INFO msg="Upload complete. (479ms)" lb # [ 165.409473] niks3-server[1040]: 2026/09/21 12:35:38 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 165.488279] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 165.502481] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 worker1 # [ 165.509109] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 165.514209] nix-daemon[855]: reaped child process 2112, status = succeeded worker1 # [ 165.527975] nix-daemon[855]: accepted connection from pid 1761, user nix-grpc-daemon (trusted) worker1 # [ 166.967540] nix-daemon[855]: reaped child process 2126, status = succeeded worker1 # [ 167.149823] nix-daemon[855]: accepted connection from pid 2142, user nix-grpc-daemon (trusted) worker1 # [ 167.166467] nix-daemon[855]: reaped child process 2145, status = succeeded lb # [ 167.105925] niks3-server[1040]: 2026/09/21 12:35:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 167.192287] nix-grpc-daemon[1821]: time=2026-09-21T12:35:39.828Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 167.195228] nix-grpc-daemon[1821]: time=2026-09-21T12:35:39.828Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 167.150266] niks3-server[1040]: 2026/09/21 12:35:39 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst worker1 # [ 167.232729] nix-grpc-daemon[1821]: time=2026-09-21T12:35:39.872Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.159721] niks3-server[1040]: 2026/09/21 12:35:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 167.170722] niks3-server[1040]: 2026/09/21 12:35:39 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 167.178686] niks3-server[1040]: 2026/09/21 12:35:39 INFO Signed narinfos id=63 count=1 lb # [ 167.185972] niks3-server[1040]: 2026/09/21 12:35:39 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls worker1 # [ 167.263626] nix-grpc-daemon[1821]: time=2026-09-21T12:35:39.904Z level=INFO msg="Upload complete. (325ms)" lb # [ 167.191153] niks3-server[1040]: 2026/09/21 12:35:39 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 167.198225] niks3-server[1040]: 2026/09/21 12:35:39 INFO Completed upload id=63 lb # [ 167.201603] niks3-server[1040]: 2026/09/21 12:35:39 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 167.277193] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34994 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=1 worker1 # [ 167.294646] nix-daemon[855]: reaped child process 2124, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 21.18 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 167.445364] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 212918432bcb4481896406accb9ffb64 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client # [ 167.693602] nix[1340]: don't know how to build these paths: client # [ 167.695247] nix[1340]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker2 # [ 167.685794] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37258 worker1 # [ 167.761685] nix-grpc-daemon[1761]: ts=2026-09-21T12:35:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34994 client # [ 167.722527] nix[1340]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker worker2 # [ 167.714674] nix-grpc-daemon[1340]: ts=2026-09-21T12:35:40Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 169.892418] envoy[902]: conn peer=[2001:db8:1::1]:60878 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27161 tx=11443 ms=20835 client # [ 197.725252] nix[1340]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu} client # [ 197.737712] nix[1340]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 197.777045] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 197.784696] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 197.787962] systemd[1]: gpu.service: Consumed 172ms CPU time over 30.337s wall clock time, 37.5M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.26 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 52.27 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.10 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 199.858654] nix-grpc-daemon[1761]: ts=2026-09-21T12:36:12Z level=info event=unhealthy reason=min_free lb # [ 199.890505] envoy[902]: conn peer=[2001:db8:1::1]:50008 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=30054 worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.13 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 200.944849] nix-grpc-daemon[1761]: ts=2026-09-21T12:36:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34994 worker2 # [ 200.878915] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 200.905080] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:13Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 200.911655] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:13Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 200.948883] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 200.963741] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37258 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 200.980253] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 200.995998] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 201.211396] nix-daemon[847]: accepted connection from pid 1639, user nix-grpc-daemon (trusted) worker2 # [ 201.229126] nix-daemon[847]: reaped child process 1642, status = succeeded worker2 # [ 201.405666] nix-daemon[847]: accepted connection from pid 1644, user nix-grpc-daemon (trusted) worker2 # [ 201.421793] nix-daemon[847]: reaped child process 1647, status = succeeded lb # [ 201.434021] niks3-server[1040]: 2026/09/21 12:36:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 201.445167] nix-grpc-daemon[1416]: time=2026-09-21T12:36:14.079Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 201.446626] nix-grpc-daemon[1416]: time=2026-09-21T12:36:14.079Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 201.471606] niks3-server[1040]: 2026/09/21 12:36:14 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst worker2 # [ 201.484851] nix-grpc-daemon[1416]: time=2026-09-21T12:36:14.119Z level=INFO msg="Uploading 1 narinfos" lb # [ 201.484921] niks3-server[1040]: 2026/09/21 12:36:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 201.495477] niks3-server[1040]: 2026/09/21 12:36:14 INFO Signed narinfos id=64 count=1 lb # [ 201.503277] niks3-server[1040]: 2026/09/21 12:36:14 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls worker2 # [ 201.509869] nix-grpc-daemon[1416]: time=2026-09-21T12:36:14.144Z level=INFO msg="Upload complete. (496ms)" lb # [ 201.509220] niks3-server[1040]: 2026/09/21 12:36:14 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 201.514874] niks3-server[1040]: 2026/09/21 12:36:14 INFO Completed upload id=64 lb # [ 201.518327] niks3-server[1040]: 2026/09/21 12:36:14 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 201.520122] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 201.530125] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 201.536840] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 201.541366] nix-daemon[847]: reaped child process 1637, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 201.553306] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 203.184200] nix-daemon[847]: reaped child process 1651, status = succeeded worker2 # [ 203.351753] nix-daemon[847]: accepted connection from pid 1667, user nix-grpc-daemon (trusted) worker2 # [ 203.369721] nix-daemon[847]: reaped child process 1670, status = succeeded lb # [ 203.381176] niks3-server[1040]: 2026/09/21 12:36:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 203.392376] nix-grpc-daemon[1416]: time=2026-09-21T12:36:16.026Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 203.393854] nix-grpc-daemon[1416]: time=2026-09-21T12:36:16.026Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 203.414944] niks3-server[1040]: 2026/09/21 12:36:16 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 203.431636] niks3-server[1040]: 2026/09/21 12:36:16 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 203.440080] niks3-server[1040]: 2026/09/21 12:36:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 203.447651] nix-grpc-daemon[1416]: time=2026-09-21T12:36:16.082Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.448951] niks3-server[1040]: 2026/09/21 12:36:16 INFO Signed narinfos id=65 count=1 lb # [ 203.451811] niks3-server[1040]: 2026/09/21 12:36:16 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 203.459497] niks3-server[1040]: 2026/09/21 12:36:16 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 203.466401] niks3-server[1040]: 2026/09/21 12:36:16 INFO Completed upload id=65 worker2 # [ 203.467954] nix-grpc-daemon[1416]: time=2026-09-21T12:36:16.102Z level=INFO msg="Upload complete. (304ms)" lb # [ 203.468783] niks3-server[1040]: 2026/09/21 12:36:16 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 203.484851] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=1 worker2 # [ 203.498770] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:16Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker2 # [ 203.502526] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:16Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 203.506179] nix-daemon[847]: reaped child process 1649, status = succeeded worker2 # [ 203.525305] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 203.539943] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 203.553009] nix-grpc-daemon[1416]: time=2026-09-21T12:36:16.187Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 203.562592] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 203.576114] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 203.772290] nix-daemon[847]: accepted connection from pid 1676, user nix-grpc-daemon (trusted) worker2 # [ 203.787197] nix-daemon[847]: reaped child process 1679, status = succeeded worker2 # [ 203.964040] nix-daemon[847]: accepted connection from pid 1681, user nix-grpc-daemon (trusted) worker2 # [ 203.979035] nix-daemon[847]: reaped child process 1684, status = succeeded lb # [ 203.993606] niks3-server[1040]: 2026/09/21 12:36:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 204.003751] nix-grpc-daemon[1416]: time=2026-09-21T12:36:16.638Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 204.005423] nix-grpc-daemon[1416]: time=2026-09-21T12:36:16.638Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 204.023788] niks3-server[1040]: 2026/09/21 12:36:16 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 204.041038] nix-grpc-daemon[1416]: time=2026-09-21T12:36:16.675Z level=INFO msg="Uploading 1 narinfos" lb # [ 204.033420] niks3-server[1040]: 2026/09/21 12:36:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign lb # [ 204.045016] niks3-server[1040]: 2026/09/21 12:36:16 INFO Signed narinfos id=66 count=1 lb # [ 204.047866] niks3-server[1040]: 2026/09/21 12:36:16 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 204.056073] niks3-server[1040]: 2026/09/21 12:36:16 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 204.063965] niks3-server[1040]: 2026/09/21 12:36:16 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo lb # [ 204.067953] niks3-server[1040]: 2026/09/21 12:36:16 INFO Completed upload id=66 worker2 # [ 204.069448] nix-grpc-daemon[1416]: time=2026-09-21T12:36:16.704Z level=INFO msg="Upload complete. (478ms)" worker2 # [ 204.077073] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 204.090674] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 204.099844] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 204.102277] nix-daemon[847]: reaped child process 1674, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... worker2 # [ 204.115851] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 205.564766] nix-daemon[847]: reaped child process 1688, status = succeeded worker2 # [ 205.742012] nix-daemon[847]: accepted connection from pid 1704, user nix-grpc-daemon (trusted) worker2 # [ 205.759317] nix-daemon[847]: reaped child process 1707, status = succeeded lb # [ 205.770564] niks3-server[1040]: 2026/09/21 12:36:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 205.784467] nix-grpc-daemon[1416]: time=2026-09-21T12:36:18.416Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 205.786275] nix-grpc-daemon[1416]: time=2026-09-21T12:36:18.416Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 205.814168] niks3-server[1040]: 2026/09/21 12:36:18 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 205.827510] niks3-server[1040]: 2026/09/21 12:36:18 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 205.836295] niks3-server[1040]: 2026/09/21 12:36:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 205.844381] nix-grpc-daemon[1416]: time=2026-09-21T12:36:18.478Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.842450] niks3-server[1040]: 2026/09/21 12:36:18 INFO Signed narinfos id=67 count=1 lb # [ 205.847444] niks3-server[1040]: 2026/09/21 12:36:18 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 205.860489] niks3-server[1040]: 2026/09/21 12:36:18 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 205.866012] niks3-server[1040]: 2026/09/21 12:36:18 INFO Completed upload id=67 worker2 # [ 205.867589] nix-grpc-daemon[1416]: time=2026-09-21T12:36:18.502Z level=INFO msg="Upload complete. (339ms)" lb # [ 205.869102] niks3-server[1040]: 2026/09/21 12:36:18 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 205.881139] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=1 worker2 # [ 205.898602] nix-daemon[847]: reaped child process 1686, status = succeeded worker2 # [ 205.927389] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:18Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 205.934101] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:18Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 205.974739] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 205.992159] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 206.006464] nix-grpc-daemon[1416]: time=2026-09-21T12:36:18.641Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 206.015950] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 206.030372] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 206.236486] nix-daemon[847]: accepted connection from pid 1713, user nix-grpc-daemon (trusted) worker2 # [ 206.255985] nix-daemon[847]: reaped child process 1716, status = succeeded worker2 # [ 206.426457] nix-daemon[847]: accepted connection from pid 1718, user nix-grpc-daemon (trusted) worker2 # [ 206.445145] nix-daemon[847]: reaped child process 1721, status = succeeded lb # [ 206.455328] niks3-server[1040]: 2026/09/21 12:36:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 206.465872] nix-grpc-daemon[1416]: time=2026-09-21T12:36:19.100Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 206.467359] nix-grpc-daemon[1416]: time=2026-09-21T12:36:19.100Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 206.480842] niks3-server[1040]: 2026/09/21 12:36:19 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 206.494567] nix-grpc-daemon[1416]: time=2026-09-21T12:36:19.129Z level=INFO msg="Uploading 1 narinfos" lb # [ 206.497212] niks3-server[1040]: 2026/09/21 12:36:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 206.507128] niks3-server[1040]: 2026/09/21 12:36:19 INFO Signed narinfos id=68 count=1 lb # [ 206.512245] niks3-server[1040]: 2026/09/21 12:36:19 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 206.519947] niks3-server[1040]: 2026/09/21 12:36:19 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 206.524216] niks3-server[1040]: 2026/09/21 12:36:19 INFO Completed upload id=68 worker2 # [ 206.525508] nix-grpc-daemon[1416]: time=2026-09-21T12:36:19.160Z level=INFO msg="Upload complete. (477ms)" lb # [ 206.526995] niks3-server[1040]: 2026/09/21 12:36:19 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 206.532123] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 206.544195] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 worker2 # [ 206.550382] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) worker2 # [ 206.554897] nix-daemon[847]: reaped child process 1711, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 206.568584] nix-daemon[847]: accepted connection from pid 1340, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 207.591281] nix-daemon[847]: reaped child process 1725, status = succeeded client # farm-top> LOG-farm-top-drain worker2 # [ 207.744702] nix-daemon[847]: accepted connection from pid 1741, user nix-grpc-daemon (trusted) worker2 # [ 207.762334] nix-daemon[847]: reaped child process 1744, status = succeeded lb # [ 207.778682] niks3-server[1040]: 2026/09/21 12:36:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 207.789678] nix-grpc-daemon[1416]: time=2026-09-21T12:36:20.423Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 207.791174] nix-grpc-daemon[1416]: time=2026-09-21T12:36:20.423Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 207.819579] niks3-server[1040]: 2026/09/21 12:36:20 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst worker2 # [ 207.832038] nix-grpc-daemon[1416]: time=2026-09-21T12:36:20.466Z level=INFO msg="Uploading 1 narinfos" lb # [ 207.834366] niks3-server[1040]: 2026/09/21 12:36:20 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 207.842510] niks3-server[1040]: 2026/09/21 12:36:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 207.848284] niks3-server[1040]: 2026/09/21 12:36:20 INFO Signed narinfos id=69 count=1 lb # [ 207.850421] niks3-server[1040]: 2026/09/21 12:36:20 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls worker2 # [ 207.856137] nix-grpc-daemon[1416]: time=2026-09-21T12:36:20.490Z level=INFO msg="Upload complete. (278ms)" lb # [ 207.855354] niks3-server[1040]: 2026/09/21 12:36:20 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 207.860523] niks3-server[1040]: 2026/09/21 12:36:20 INFO Completed upload id=69 lb # [ 207.863081] niks3-server[1040]: 2026/09/21 12:36:20 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 207.865481] nix-grpc-daemon[1340]: ts=2026-09-21T12:36:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37258 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=1 worker2 # [ 207.878801] nix-daemon[847]: reaped child process 1723, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 7.31 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 208.867355] nix-grpc-daemon[1761]: ts=2026-09-21T12:36:21Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.12 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 11.16 seconds) (finished: run the VM test script, in 210.41 seconds) test script finished in 210.71s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) lb # [ 209.891639] envoy[902]: conn peer=[2001:db8:1::1]:50500 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9519 tx=4091 ms=7011 kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.07 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh