tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker1 # Disk image does not exist, creating the virtualisation disk image... worker2 # Disk image does not exist, creating the virtualisation disk image... client # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 51) lb: QEMU running (pid 50) lb # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 52) worker1 # Formatting '/build/vm-state-worker1/tmp.tYbdm0g7Bn', fmt=raw size=1073741824 worker2 # Formatting '/build/vm-state-worker2/tmp.POc6IIJF3L', fmt=raw size=1073741824 client # Formatting '/build/vm-state-client/tmp.6X4JjVsQtt', fmt=raw size=1073741824 worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # mke2fs 1.47.4 (6-Mar-2025) client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done worker2 # Discarding device blocks: 0/262144 done client # Discarding device blocks: 0/262144 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: 69af6843-d400-4508-8e52-ae8b11c77126 worker2 # Filesystem UUID: e0d9bf4d-739a-47eb-8932-643e98c0d220 client # Filesystem UUID: b05d3265-e406-49ad-ac8b-ff13de131358 worker1 # Superblock backups stored on blocks: worker2 # Superblock backups stored on blocks: client # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 worker2 # 32768, 98304, 163840, 229376 client # 32768, 98304, 163840, 229376 worker1 # worker2 # client # worker1 # Allocating group tables: 0/8 done worker2 # Allocating group tables: 0/8 done client # Allocating group tables: 0/8 done worker1 # Writing inode tables: 0/8 done worker2 # Writing inode tables: 0/8 done client # Writing inode tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker2 # Creating journal (8192 blocks): done client # Creating journal (8192 blocks): done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # Writing superblocks and filesystem accounting information: 0/8 done worker1 # worker2 # client # worker1 # Virtualisation disk image created. worker2 # Virtualisation disk image created. client # Virtualisation disk image created. worker1 # Starting virtiofs daemons... worker2 # Starting virtiofs daemons... client # Starting virtiofs daemons... worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests lb # Formatting '/build/vm-state-lb/tmp.pc3kU4mbJh', fmt=raw size=1073741824 client: QEMU running (pid 49) lb # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done lb # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Filesystem UUID: 77424937-216a-4d64-b967-244caaea4afe lb # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 lb # lb # Allocating group tables: 0/8 done (finished: start all VMs, in 0.54 seconds) lb # Writing inode tables: 0/8 done client: waiting for unit network-addresses-eth1.service lb # Creating journal (8192 blocks): done client: waiting for the VM to finish booting lb # Writing superblocks and filesystem accounting information: 0/8 done lb # lb # Virtualisation disk image created. lb # Starting virtiofs daemons... lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-22T15:04:31Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-22T15:04:31Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-22T15:04:31Z INFO virtiofsd] Client connected, servicing requests worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] Zone ranges: worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] DMA32 empty worker2 # [ 0.000000] Normal empty worker2 # [ 0.000000] Device empty worker2 # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gmd7z4ny4bi55sv3a6k2fbz28d26w0pi-nixos-system-worker2-test/init regInfo=/nix/store/g2bsb9vyy4qcljqrysdp84ii6pzd3g5i-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/g2bsb9vyy4qcljqrysdp84ii6pzd3g5i-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000034] arm-pv: using stolen time PV worker2 # [ 0.000664] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000851] Console: colour dummy device 80x25 worker2 # [ 0.000859] printk: legacy console [tty0] enabled worker2 # [ 0.001052] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.001059] pid_max: default: 32768 minimum: 301 worker2 # [ 0.001141] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.001304] landlock: Up and running. worker2 # [ 0.001307] Yama: becoming mindful. worker2 # [ 0.001953] LSM support for eBPF active lb # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 lb # [ 0.000000] KASLR enabled worker2 # [ 0.002131] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] random: crng init done lb # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.002164] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000000] efi: UEFI not found. worker2 # [ 0.004055] rcu: Hierarchical SRCU implementation. lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.004060] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.005333] fsl-mc MSI: its@8080000 domain created lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.005424] EFI services will not be available. lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.005544] smp: Bringing up secondary CPUs ... lb # [ 0.000000] Zone ranges: worker2 # [ 0.005553] smp: Brought up 1 node, 1 CPU lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.005556] SMP: Total of 1 processors activated. lb # [ 0.000000] DMA32 empty lb # [ 0.000000] Normal empty worker2 # [ 0.005561] CPU: All CPU(s) started at EL1 lb # [ 0.000000] Device empty worker2 # [ 0.005571] CPU features: detected: Branch Target Identification lb # [ 0.000000] Movable zone start for each node lb # [ 0.000000] Early memory node ranges worker2 # [ 0.005576] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.005579] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.005582] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.005586] CPU features: detected: Common not Private translations lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker2 # [ 0.005589] CPU features: detected: CRC32 instructions lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.005592] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.005596] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.005599] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.005602] CPU features: detected: E0PD lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 worker2 # [ 0.005604] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.005607] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.005611] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.005614] CPU features: detected: Fine Grained Traps lb # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.005618] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.005622] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.005625] CPU features: detected: LSE atomic instructions lb # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.005628] CPU features: detected: Privileged Access Never worker2 # [ 0.005631] CPU features: detected: PMUv3 worker2 # [ 0.005634] CPU features: detected: RAS Extension Support client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.005637] CPU features: detected: RASv1p1 Extension Support lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/rwj7rgrjnik4yfrdy5nxpi16ig7dj0yx-nixos-system-lb-test/init regInfo=/nix/store/y0b8gyps1r0yyzfhbdbfwqvj69pgkv2z-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.005639] CPU features: detected: Random Number Generator client # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 client # [ 0.000000] KASLR enabled worker2 # [ 0.005642] CPU features: detected: Speculation barrier (SB) client # [ 0.000000] random: crng init done worker2 # [ 0.005645] CPU features: detected: Stage-2 Force Write-Back client # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/y0b8gyps1r0yyzfhbdbfwqvj69pgkv2z-closure-info/registration", will be passed to user space. client # [ 0.000000] efi: UEFI not found. worker2 # [ 0.005647] CPU features: detected: TLB range maintenance instructions lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.005652] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.005692] alternatives: applying system-wide alternatives client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker2 # [ 0.008741] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.000000] Zone ranges: lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] DMA32 empty client # [ 0.000000] Normal empty worker1 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 worker2 # [ 0.008927] Memory: 1405668K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124632K reserved, 32768K cma-reserved) worker1 # [ 0.000000] KASLR enabled client # [ 0.000000] Device empty lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] random: crng init done worker2 # [ 0.009326] devtmpfs: initialized client # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] efi: UEFI not found. worker2 # [ 0.011140] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.011163] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.000000] Policy zone: DMA client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.011341] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.011345] 0 pages in range for non-PLT usage worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] Zone ranges: worker2 # [ 0.011346] 508272 pages in range for PLT usage lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.011461] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.000000] DMA32 empty client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.012262] DMI not present or invalid. lb # [ 0.000000] ftrace: allocating 74950 entries in 294 pages worker1 # [ 0.000000] Normal empty client # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] Device empty worker2 # [ 0.016014] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] Movable zone start for each node lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] Early memory node ranges worker2 # [ 0.018260] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.018450] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.018652] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.018673] audit: initializing netlink subsys (disabled) worker1 # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.019244] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.019246] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.019250] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.019253] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.019258] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 worker2 # [ 0.019291] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.019300] cpuidle: using governor ladder lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.019306] cpuidle: using governor menu worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.019496] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.019513] ASID allocator initialised with 65536 entries worker1 # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.020824] Serial: AMBA PL011 UART driver worker1 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9h1c64jjdkn9jsqs8mxdg12zr39npfq0-nixos-system-client-test/init regInfo=/nix/store/iv8yhgcj2jxz61bmrp8pqvaxgrzmp3gb-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.026291] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.026453] printk: console [ttyAMA0] enabled lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/iv8yhgcj2jxz61bmrp8pqvaxgrzmp3gb-closure-info/registration", will be passed to user space. lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9c58wlr9mbayd5fmz9rxgypan2qjrx99-nixos-system-worker1-test/init regInfo=/nix/store/v7wavp8ypjzmz1nd1f1sfw94m1i49xja-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/v7wavp8ypjzmz1nd1f1sfw94m1i49xja-closure-info/registration", will be passed to user space. client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] Policy zone: DMA lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.149841] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000035] arm-pv: using stolen time PV client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.149860] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.149865] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.000533] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000000] ftrace: allocating 74950 entries in 294 pages worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000728] Console: colour dummy device 80x25 worker2 # [ 0.149870] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000736] printk: legacy console [tty0] enabled client # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.149874] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.149879] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000931] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000000] Policy zone: DMA client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000937] pid_max: default: 32768 minimum: 301 worker2 # [ 0.149883] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.001019] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.149887] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.001179] landlock: Up and running. worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.001182] Yama: becoming mindful. worker1 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.001755] LSM support for eBPF active client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages lb # [ 0.001903] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.157072] fbcon: Taking over console worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.157088] ACPI: Interpreter disabled. worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.001936] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.158940] iommu: Default domain type: Translated lb # [ 0.003793] rcu: Hierarchical SRCU implementation. lb # [ 0.003797] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.158950] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.005089] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.160602] SCSI subsystem initialized lb # [ 0.005189] EFI services will not be available. worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.005292] smp: Bringing up secondary CPUs ... worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.005301] smp: Brought up 1 node, 1 CPU client # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.005304] SMP: Total of 1 processors activated. client # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.005310] CPU: All CPU(s) started at EL1 worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.005320] CPU features: detected: Branch Target Identification client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.005325] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.005328] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.005332] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.166082] usbcore: registered new interface driver usbfs lb # [ 0.005336] CPU features: detected: Common not Private translations worker1 # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.166123] usbcore: registered new interface driver hub lb # [ 0.005339] CPU features: detected: CRC32 instructions worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.166139] usbcore: registered new device driver usb worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.005341] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.166414] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.005345] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.166421] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.166431] PTP clock support registered lb # [ 0.005348] CPU features: detected: Data independent timing control (DIT) client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.005351] CPU features: detected: E0PD worker2 # [ 0.166479] EDAC MC: Ver: 3.0.0 worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.005354] CPU features: detected: Enhanced Counter Virtualization client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.170948] scmi_core: SCMI protocol bus registered worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.005357] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.171890] FPGA manager framework lb # [ 0.005360] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.172821] vgaarb: loaded worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.005364] CPU features: detected: Fine Grained Traps worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.173450] clocksource: Switched to clocksource arch_sys_counter client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.005368] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000030] arm-pv: using stolen time PV lb # [ 0.005373] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.005376] CPU features: detected: LSE atomic instructions client # [ 0.000409] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.005379] CPU features: detected: Privileged Access Never worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000591] Console: colour dummy device 80x25 lb # [ 0.005382] CPU features: detected: PMUv3 client # [ 0.000598] printk: legacy console [tty0] enabled worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.005385] CPU features: detected: RAS Extension Support worker2 # [ 0.177282] VFS: Disk quotas dquot_6.6.0 lb # [ 0.005388] CPU features: detected: RASv1p1 Extension Support client # [ 0.000794] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.177318] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.005390] CPU features: detected: Random Number Generator client # [ 0.000801] pid_max: default: 32768 minimum: 301 worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000873] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.000031] arm-pv: using stolen time PV client # [ 0.001007] landlock: Up and running. lb # [ 0.005393] CPU features: detected: Speculation barrier (SB) client # [ 0.001010] Yama: becoming mindful. lb # [ 0.005396] CPU features: detected: Stage-2 Force Write-Back client # [ 0.001476] LSM support for eBPF active worker1 # [ 0.000396] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.180962] netfs: FS-Cache loaded worker1 # [ 0.000544] Console: colour dummy device 80x25 lb # [ 0.005398] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.181088] pnp: PnP ACPI: disabled client # [ 0.001602] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.000553] printk: legacy console [tty0] enabled lb # [ 0.005403] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.001634] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.005443] alternatives: applying system-wide alternatives client # [ 0.003571] rcu: Hierarchical SRCU implementation. worker1 # [ 0.000746] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.008452] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.000753] pid_max: default: 32768 minimum: 301 client # [ 0.003576] rcu: Max phase no-delay instances is 1000. client # [ 0.004835] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.000826] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.000976] landlock: Up and running. client # [ 0.004924] EFI services will not be available. worker1 # [ 0.000979] Yama: becoming mindful. lb # [ 0.008624] Memory: 1405636K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124636K reserved, 32768K cma-reserved) client # [ 0.004993] smp: Bringing up secondary CPUs ... lb # [ 0.009006] devtmpfs: initialized worker1 # [ 0.001418] LSM support for eBPF active worker2 # [ 0.184905] NET: Registered PF_INET protocol family client # [ 0.005001] smp: Brought up 1 node, 1 CPU client # [ 0.005004] SMP: Total of 1 processors activated. lb # [ 0.010898] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.001585] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.185156] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.005009] CPU: All CPU(s) started at EL1 worker1 # [ 0.001622] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.010920] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.005019] CPU features: detected: Branch Target Identification worker1 # [ 0.003446] rcu: Hierarchical SRCU implementation. lb # [ 0.011103] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.005023] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.003451] rcu: Max phase no-delay instances is 1000. lb # [ 0.011107] 0 pages in range for non-PLT usage worker1 # [ 0.004738] fsl-mc MSI: its@8080000 domain created lb # [ 0.011108] 508272 pages in range for PLT usage client # [ 0.005026] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.004828] EFI services will not be available. lb # [ 0.011200] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.004899] smp: Bringing up secondary CPUs ... lb # [ 0.012002] DMI not present or invalid. client # [ 0.005030] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.004907] smp: Brought up 1 node, 1 CPU lb # [ 0.015506] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.005034] CPU features: detected: Common not Private translations worker1 # [ 0.004911] SMP: Total of 1 processors activated. worker1 # [ 0.004916] CPU: All CPU(s) started at EL1 client # [ 0.005037] CPU features: detected: CRC32 instructions lb # [ 0.017723] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.004926] CPU features: detected: Branch Target Identification client # [ 0.005040] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.017925] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.004931] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.005043] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.018124] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.004934] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.005046] CPU features: detected: Data independent timing control (DIT) lb # [ 0.018145] audit: initializing netlink subsys (disabled) client # [ 0.005049] CPU features: detected: E0PD lb # [ 0.018729] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.004938] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.005052] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.018731] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.004942] CPU features: detected: Common not Private translations client # [ 0.005055] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.004945] CPU features: detected: CRC32 instructions lb # [ 0.018734] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.005058] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.018737] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.004948] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.005061] CPU features: detected: Fine Grained Traps lb # [ 0.018742] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.004951] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.005065] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.018768] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.004955] CPU features: detected: Data independent timing control (DIT) lb # [ 0.018777] cpuidle: using governor ladder worker1 # [ 0.004958] CPU features: detected: E0PD client # [ 0.005070] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.018783] cpuidle: using governor menu client # [ 0.005072] CPU features: detected: LSE atomic instructions worker1 # [ 0.004960] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.018968] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.005075] CPU features: detected: Privileged Access Never worker1 # [ 0.004963] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.018984] ASID allocator initialised with 65536 entries client # [ 0.005078] CPU features: detected: PMUv3 lb # [ 0.020229] Serial: AMBA PL011 UART driver worker1 # [ 0.004967] CPU features: detected: Enhanced Virtualization Traps client # [ 0.005081] CPU features: detected: RAS Extension Support worker1 # [ 0.004970] CPU features: detected: Fine Grained Traps client # [ 0.005084] CPU features: detected: RASv1p1 Extension Support lb # [ 0.025581] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.005086] CPU features: detected: Random Number Generator lb # [ 0.025745] printk: console [ttyAMA0] enabled worker1 # [ 0.004974] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.004979] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.005089] CPU features: detected: Speculation barrier (SB) client # [ 0.005091] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.004982] CPU features: detected: LSE atomic instructions worker1 # [ 0.004984] CPU features: detected: Privileged Access Never client # [ 0.005094] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.004987] CPU features: detected: PMUv3 client # [ 0.005098] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.004990] CPU features: detected: RAS Extension Support client # [ 0.005135] alternatives: applying system-wide alternatives worker1 # [ 0.004993] CPU features: detected: RASv1p1 Extension Support client # [ 0.008085] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.004995] CPU features: detected: Random Number Generator worker1 # [ 0.004998] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.005001] CPU features: detected: Stage-2 Force Write-Back client # [ 0.008262] Memory: 1405636K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124660K reserved, 32768K cma-reserved) client # [ 0.008664] devtmpfs: initialized lb # [ 0.142758] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.005004] CPU features: detected: TLB range maintenance instructions lb # [ 0.142776] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.010526] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.005008] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.142782] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.005045] alternatives: applying system-wide alternatives client # [ 0.010548] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.142787] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.008019] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.010730] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.142791] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.142795] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.008227] Memory: 1405672K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124664K reserved, 32768K cma-reserved) worker1 # [ 0.008610] devtmpfs: initialized lb # [ 0.142800] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.142804] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.010460] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.010482] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.010657] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.150203] fbcon: Taking over console worker1 # [ 0.010661] 0 pages in range for non-PLT usage lb # [ 0.150218] ACPI: Interpreter disabled. worker1 # [ 0.010662] 508272 pages in range for PLT usage client # [ 0.010734] 0 pages in range for non-PLT usage client # [ 0.010736] 508272 pages in range for PLT usage worker2 # [ 0.214546] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.010849] pinctrl core: initialized pinctrl subsystem client # [ 0.011581] DMI not present or invalid. worker2 # [ 0.214586] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.014811] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.214613] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.017002] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.214684] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.017193] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.214826] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.017393] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.159221] iommu: Default domain type: Translated worker2 # [ 0.214902] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.010781] pinctrl core: initialized pinctrl subsystem client # [ 0.017415] audit: initializing netlink subsys (disabled) lb # [ 0.159233] iommu: DMA domain TLB invalidation policy: strict mode worker1 # [ 0.011539] DMI not present or invalid. worker2 # [ 0.214937] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.159602] SCSI subsystem initialized client # [ 0.018006] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.014574] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.214973] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.018008] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.016938] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.161512] usbcore: registered new interface driver usbfs worker2 # [ 0.215070] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.018011] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.161543] usbcore: registered new interface driver hub worker2 # [ 0.215089] NET: Registered PF_XDP protocol family worker1 # [ 0.017131] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.018014] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.215105] PCI: CLS 0 bytes, default 64 lb # [ 0.161558] usbcore: registered new device driver usb client # [ 0.018019] thermal_sys: Registered thermal governor 'power_allocator' worker1 # [ 0.017330] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.161844] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.215341] Trying to unpack rootfs image as initramfs... worker1 # [ 0.017353] audit: initializing netlink subsys (disabled) client # [ 0.018050] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.161851] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.018058] cpuidle: using governor ladder worker1 # [ 0.017904] thermal_sys: Registered thermal governor 'fair_share' lb # [ 0.161861] PTP clock support registered client # [ 0.018064] cpuidle: using governor menu lb # [ 0.161911] EDAC MC: Ver: 3.0.0 worker1 # [ 0.017906] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.018257] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.017909] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.166384] scmi_core: SCMI protocol bus registered worker2 # [ 0.230985] kvm [1]: HYP mode not available client # [ 0.018273] ASID allocator initialised with 65536 entries worker1 # [ 0.017912] thermal_sys: Registered thermal governor 'user_space' client # [ 0.019463] Serial: AMBA PL011 UART driver lb # [ 0.167364] FPGA manager framework worker1 # [ 0.017918] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.168280] vgaarb: loaded client # [ 0.024605] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.017949] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.024724] printk: console [ttyAMA0] enabled lb # [ 0.168910] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.017957] cpuidle: using governor ladder worker1 # [ 0.017963] cpuidle: using governor menu client # [ 0.145654] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.018150] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.145674] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.018165] ASID allocator initialised with 65536 entries worker1 # [ 0.019333] Serial: AMBA PL011 UART driver client # [ 0.145678] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.145683] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker1 # [ 0.024495] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.024648] printk: console [ttyAMA0] enabled client # [ 0.145687] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.145691] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.144400] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.145695] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.175117] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.144419] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.145699] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.175161] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.144425] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.176778] netfs: FS-Cache loaded worker1 # [ 0.144429] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.176903] pnp: PnP ACPI: disabled worker1 # [ 0.144433] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.153251] fbcon: Taking over console worker1 # [ 0.144437] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.153266] ACPI: Interpreter disabled. client # [ 0.155152] iommu: Default domain type: Translated worker1 # [ 0.144441] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.144446] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.155162] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.180760] NET: Registered PF_INET protocol family client # [ 0.156909] SCSI subsystem initialized worker1 # [ 0.151972] fbcon: Taking over console worker1 # [ 0.151985] ACPI: Interpreter disabled. worker1 # [ 0.153834] iommu: Default domain type: Translated worker1 # [ 0.153843] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.181641] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.155521] SCSI subsystem initialized client # [ 0.164625] usbcore: registered new interface driver usbfs client # [ 0.164650] usbcore: registered new interface driver hub client # [ 0.164683] usbcore: registered new device driver usb client # [ 0.164942] pps_core: LinuxPPS API ver. 1 registered client # [ 0.164949] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.164959] PTP clock support registered client # [ 0.164999] EDAC MC: Ver: 3.0.0 worker1 # [ 0.163355] usbcore: registered new interface driver usbfs client # [ 0.169657] scmi_core: SCMI protocol bus registered worker1 # [ 0.163388] usbcore: registered new interface driver hub worker1 # [ 0.163403] usbcore: registered new device driver usb client # [ 0.170625] FPGA manager framework client # [ 0.171592] vgaarb: loaded worker1 # [ 0.163684] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.163690] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.172221] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.163700] PTP clock support registered worker1 # [ 0.163755] EDAC MC: Ver: 3.0.0 client # [ 0.173616] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.168379] scmi_core: SCMI protocol bus registered client # [ 0.173647] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.175214] netfs: FS-Cache loaded worker1 # [ 0.169342] FPGA manager framework client # [ 0.175311] pnp: PnP ACPI: disabled worker1 # [ 0.170285] vgaarb: loaded worker1 # [ 0.170917] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.171525] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.171553] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.173864] netfs: FS-Cache loaded worker1 # [ 0.173987] pnp: PnP ACPI: disabled client # [ 0.181178] NET: Registered PF_INET protocol family client # [ 0.181466] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.180011] NET: Registered PF_INET protocol family worker1 # [ 0.180272] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.211068] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.211108] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.211135] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.211206] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.211350] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.211431] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.211465] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211501] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211590] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.211615] NET: Registered PF_XDP protocol family lb # [ 0.211631] PCI: CLS 0 bytes, default 64 lb # [ 0.211871] Trying to unpack rootfs image as initramfs... lb # [ 0.226479] kvm [1]: HYP mode not available client # [ 0.210654] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.210696] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.210722] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.210792] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.210935] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.211019] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.211054] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.211090] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.211209] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.211236] NET: Registered PF_XDP protocol family client # [ 0.211254] PCI: CLS 0 bytes, default 64 worker1 # [ 0.210190] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.211481] Trying to unpack rootfs image as initramfs... worker1 # [ 0.210233] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.210262] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.210339] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.210482] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.210567] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.210602] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.210637] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.322065] Initialise system trusted keyrings worker1 # [ 0.210732] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.226085] kvm [1]: HYP mode not available worker2 # [ 0.322816] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.210785] NET: Registered PF_XDP protocol family worker1 # [ 0.210804] PCI: CLS 0 bytes, default 64 worker2 # [ 0.324060] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.211029] Trying to unpack rootfs image as initramfs... worker2 # [ 0.324844] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.228738] kvm [1]: HYP mode not available worker2 # [ 0.353667] Key type asymmetric registered worker2 # [ 0.353696] Asymmetric key parser 'x509' registered worker2 # [ 0.353775] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.355896] io scheduler mq-deadline registered worker2 # [ 0.355907] io scheduler kyber registered worker2 # [ 0.365613] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.367055] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.367479] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.367497] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.367510] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.367518] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.367538] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.367567] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.367737] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.367747] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.367753] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.367758] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.367764] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.368003] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.368480] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.368663] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.368679] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.317512] Initialise system trusted keyrings worker2 # [ 0.368708] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.368724] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.318280] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.369169] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.369348] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.369363] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.369391] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.389128] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.389311] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.389327] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.389356] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.325364] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.326217] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.397905] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.398102] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.398118] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.398148] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.398167] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.398622] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.398805] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.398833] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.320990] Initialise system trusted keyrings worker2 # [ 0.399275] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.346234] Key type asymmetric registered client # [ 0.321761] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.399460] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.346256] Asymmetric key parser 'x509' registered worker2 # [ 0.399489] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.323039] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.346332] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.399892] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.348415] io scheduler mq-deadline registered client # [ 0.323785] 9p: Installing v9fs 9p2000 file system support lb # [ 0.348426] io scheduler kyber registered worker2 # [ 0.400072] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.400372] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.400556] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.400585] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.401028] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.401213] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.323986] Initialise system trusted keyrings worker2 # [ 0.401244] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.324733] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.401707] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.401889] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.325994] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.401918] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.326774] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.402377] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.402669] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.402685] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.402714] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.403161] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.403338] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.403354] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.361627] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.403383] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.403943] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.403954] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.362953] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.403960] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.363340] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.404003] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.363357] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.404053] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.363370] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.404098] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.363378] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.404143] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.363402] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.404188] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.363424] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.404233] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.363499] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.404278] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.363509] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.404344] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.363515] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.404390] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.363520] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.363525] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.404461] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.404508] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.363824] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.352503] Key type asymmetric registered worker2 # [ 0.404529] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.364258] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.352531] Asymmetric key parser 'x509' registered worker2 # [ 0.404550] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.364441] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.352598] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.404571] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.364457] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.354689] io scheduler mq-deadline registered worker2 # [ 0.404592] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.364486] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.354701] io scheduler kyber registered lb # [ 0.364503] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.404612] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.404633] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.380827] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.404658] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.404679] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.404700] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.404722] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.404743] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.355444] Key type asymmetric registered worker2 # [ 0.404764] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.355471] Asymmetric key parser 'x509' registered worker2 # [ 0.404784] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.355555] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.404805] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned worker1 # [ 0.357709] io scheduler mq-deadline registered worker2 # [ 0.404826] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned worker1 # [ 0.357721] io scheduler kyber registered worker2 # [ 0.404846] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.385063] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.404867] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.364369] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.385095] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.404892] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.385125] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.404901] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.385616] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.404905] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.385825] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] client # [ 0.365771] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.385841] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.366175] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.385871] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.386322] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.366192] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.386504] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.366205] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.386520] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.386549] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.366214] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.386567] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.367059] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.366241] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.387026] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.366266] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.387212] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.366340] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.387242] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.366350] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.368437] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.387698] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.366356] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.465794] pci 0000:00:07.0: enabling device (0000 -> 0002) worker1 # [ 0.368847] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.387883] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.366361] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.387913] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.366366] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.368864] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.388298] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.366421] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.368889] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.388479] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.366866] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.368898] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.388751] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.367054] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.368925] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.367071] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.368949] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.367102] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.367118] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.369028] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.369038] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.367588] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.369043] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.367773] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.369048] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.367789] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.369053] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.367819] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.369121] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.387496] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.408986] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.369563] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.387684] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.369751] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.409028] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.387700] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.369767] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.409505] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.387730] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.369798] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.409693] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.369816] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.388193] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.409723] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.370290] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.410188] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.370475] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.410373] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.370492] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.410403] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.370522] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.410868] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.411170] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.411189] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.389724] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.389911] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.411218] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.389927] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.411672] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.389957] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.411855] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.487024] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.411871] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.390423] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.489294] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.390607] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.411901] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.390623] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.412467] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.390652] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.412479] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.390671] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.412484] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.396454] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.412529] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.396485] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.412578] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.396515] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.412625] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.396535] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.412674] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.397048] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.397237] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.412721] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.397267] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.412768] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.397743] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.412815] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.397937] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.412863] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.499247] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.397967] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.501215] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.412909] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.398399] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.398583] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.398836] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.399027] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.399057] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.403240] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.399516] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.403451] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.399705] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.403483] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.399735] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.403964] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.400194] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.404154] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.400399] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.441159] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.404184] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.400430] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.441225] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.404592] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.441248] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.400889] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.511429] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) worker1 # [ 0.404775] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.401171] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.441270] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.401189] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.405038] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.441293] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.405226] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.401219] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.441316] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.405256] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.441338] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.401702] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.401888] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.405707] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.441361] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned client # [ 0.401904] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.405894] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.441389] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.401934] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.405924] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.441411] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.402513] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.441437] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.406378] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.402525] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.406566] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.441461] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.406596] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.402530] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.441483] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.441504] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.407076] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.402575] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.517551] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) lb # [ 0.441525] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.407367] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.519336] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.402622] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.441547] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned worker1 # [ 0.407385] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.441568] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned client # [ 0.402670] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.407416] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.441591] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.402717] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.407889] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.441613] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.408082] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.402763] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.441643] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.408098] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.441653] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.402810] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.408128] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.441658] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.402857] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.408704] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.442512] pci 0000:00:07.0: enabling device (0000 -> 0002) client # [ 0.402903] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.408716] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.402950] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.408722] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.408767] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.403026] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.403072] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.408815] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.403094] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.408862] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.403115] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.408910] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.403138] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.529597] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.408957] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.403159] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.531465] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.409003] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.403180] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.533280] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.409050] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.403201] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.409096] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.403226] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.403248] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.409143] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.403270] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.409218] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.403292] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.409264] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.403315] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.409285] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.403337] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.409309] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.403360] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.409331] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.403381] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned worker1 # [ 0.409352] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.403403] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned worker1 # [ 0.409374] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.403424] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.409395] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned client # [ 0.403445] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.543827] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.409422] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.403471] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.409444] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.403480] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.409468] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned client # [ 0.403485] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.409490] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.409512] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.409534] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.409554] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.409575] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned lb # [ 0.483210] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.409596] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned worker1 # [ 0.409618] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.409639] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.409664] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.409674] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.409679] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker1 # [ 0.410519] pci 0000:00:07.0: enabling device (0000 -> 0002) client # [ 0.464409] pci 0000:00:07.0: enabling device (0000 -> 0002) worker2 # [ 0.557032] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.559566] msm_serial: driver initialized worker2 # [ 0.559702] SuperH (H)SCI(F) driver initialized worker2 # [ 0.559756] STM32 USART driver initialized worker1 # [ 0.467072] pci 0000:00:07.0: quirk_usb_early_handoff+0x0/0xa60 took 55232 usecs lb # [ 0.493328] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.496906] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.498852] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.500816] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) client # [ 0.485520] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) client # [ 0.487649] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.487694] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.518745] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) worker1 # [ 0.489894] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.520696] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.498355] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.524130] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.592168] loop: module loaded worker2 # [ 0.592363] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 0.593119] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.526728] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.528654] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.500901] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.504345] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.506496] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) worker2 # [ 0.598029] megasas: 07.734.00.00-rc1 worker2 # [ 0.598729] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.538435] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.506954] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.509039] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) client # [ 0.516387] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) client # [ 0.518259] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.609490] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.609513] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.611308] Using buffer write method worker2 # [ 0.611370] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.613157] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.613182] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.519119] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) worker1 # [ 0.520985] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) lb # [ 0.554205] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.522846] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.528367] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.556796] msm_serial: driver initialized client # [ 0.530863] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.626542] Using buffer write method worker2 # [ 0.626578] Concatenating MTD devices: worker2 # [ 0.626582] (0): "0.flash" lb # [ 0.557496] SuperH (H)SCI(F) driver initialized worker2 # [ 0.626586] (1): "0.flash" lb # [ 0.557560] STM32 USART driver initialized worker2 # [ 0.626594] into device "0.flash" worker1 # [ 0.533291] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.540852] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.543696] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.543091] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.546538] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.557472] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.560094] msm_serial: driver initialized client # [ 0.560767] SuperH (H)SCI(F) driver initialized client # [ 0.560828] STM32 USART driver initialized lb # [ 0.589517] loop: module loaded worker1 # [ 0.560371] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.589729] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 0.590594] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.562986] msm_serial: driver initialized worker1 # [ 0.563133] SuperH (H)SCI(F) driver initialized worker1 # [ 0.563186] STM32 USART driver initialized lb # [ 0.601524] megasas: 07.734.00.00-rc1 lb # [ 0.602270] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.604677] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.604701] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.606253] Using buffer write method lb # [ 0.606316] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.608085] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.608107] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.593435] loop: module loaded client # [ 0.593786] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 0.594637] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.625507] Using buffer write method lb # [ 0.625543] Concatenating MTD devices: lb # [ 0.625547] (0): "0.flash" lb # [ 0.625551] (1): "0.flash" lb # [ 0.625560] into device "0.flash" worker1 # [ 0.596796] loop: module loaded client # [ 0.600836] megasas: 07.734.00.00-rc1 worker1 # [ 0.596989] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 0.601618] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.597720] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.603838] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.603862] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.603522] megasas: 07.734.00.00-rc1 worker1 # [ 0.604273] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.606138] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.606188] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.613279] Using buffer write method client # [ 0.613357] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.616052] Using buffer write method worker1 # [ 0.616122] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.617841] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.624260] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.617863] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.624284] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.625830] Using buffer write method client # [ 0.625858] Concatenating MTD devices: client # [ 0.625862] (0): "0.flash" client # [ 0.625866] (1): "0.flash" client # [ 0.625875] into device "0.flash" worker1 # [ 0.629617] Using buffer write method worker1 # [ 0.629646] Concatenating MTD devices: worker1 # [ 0.629650] (0): "0.flash" worker1 # [ 0.629659] (1): "0.flash" worker1 # [ 0.629663] into device "0.flash" worker2 # [ 0.870426] Freeing initrd memory: 26944K worker2 # [ 0.876497] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.880268] thunder_xcv, ver 1.0 worker2 # [ 0.880342] thunder_bgx, ver 1.0 worker2 # [ 0.880365] nicpf, ver 1.0 worker2 # [ 0.880943] e1000: Intel(R) PRO/1000 Network Driver worker2 # [ 0.880950] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.880974] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.880981] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.881013] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.881019] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.881043] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.881049] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker2 # [ 0.881182] sky2: driver version 1.30 worker2 # [ 0.890172] ehci-pci 0000:00:07.0: EHCI Host Controller worker2 # [ 0.890203] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.890441] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 worker2 # [ 0.893096] usbcore: registered new interface driver usb-storage worker2 # [ 0.893195] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.893209] usbserial: USB Serial support registered for generic worker2 # [ 0.896032] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.897612] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.897635] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T15:04:32 UTC (1790089472) worker2 # [ 0.897934] i2c_dev: i2c /dev entries driver worker2 # [ 0.903192] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.903203] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.903472] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.903838] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.905349] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.908720] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.909018] hub 1-0:1.0: USB hub found worker2 # [ 0.909039] hub 1-0:1.0: 6 ports detected worker2 # [ 0.911207] usbcore: registered new interface driver usbhid worker2 # [ 0.911216] usbhid: USB HID core driver worker2 # [ 0.913490] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.914992] drop_monitor: Initializing network drop monitor service worker2 # [ 0.915129] NET: Registered PF_INET6 protocol family worker2 # [ 0.918060] Segment Routing with IPv6 worker2 # [ 0.918077] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.918103] NET: Registered PF_PACKET protocol family worker2 # [ 0.919735] 9pnet: Installing 9P2000 support worker2 # [ 0.919783] Key type dns_resolver registered worker2 # [ 0.926292] registered taskstats version 1 worker2 # [ 0.926437] Loading compiled-in X.509 certificates worker2 # [ 0.935315] Demotion targets for Node 0: null worker2 # [ 0.935428] Key type .fscrypt registered worker2 # [ 0.935435] Key type fscrypt-provisioning registered worker2 # [ 0.935534] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.871096] Freeing initrd memory: 26948K worker2 # [ 0.935554] ima: Allocated hash algorithm: sha1 worker2 # [ 0.935577] ima: No architecture policies found worker2 # [ 0.939617] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.877195] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.881021] thunder_xcv, ver 1.0 lb # [ 0.881062] thunder_bgx, ver 1.0 lb # [ 0.881084] nicpf, ver 1.0 lb # [ 0.881660] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.881668] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.881695] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.881704] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.881736] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.881742] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.957044] clk: Disabling unused clocks lb # [ 0.881766] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.957069] PM: genpd: Disabling unused power domains lb # [ 0.881780] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.881917] sky2: driver version 1.30 lb # [ 0.883522] usbcore: registered new interface driver usb-storage lb # [ 0.883608] usbcore: registered new interface driver usbserial_generic lb # [ 0.883621] usbserial: USB Serial support registered for generic worker2 # [ 0.961156] Freeing unused kernel memory: 4736K lb # [ 0.884220] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.961332] Run /init as init process lb # [ 0.885688] ehci-pci 0000:00:07.0: EHCI Host Controller lb # [ 0.885719] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 lb # [ 0.886021] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 lb # [ 0.898195] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 lb # [ 0.898521] hub 1-0:1.0: USB hub found lb # [ 0.898543] hub 1-0:1.0: 6 ports detected client # [ 0.876261] Freeing initrd memory: 26972K lb # [ 0.900783] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.900819] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T15:04:32 UTC (1790089472) lb # [ 0.903005] i2c_dev: i2c /dev entries driver client # [ 0.882293] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.906630] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.975696] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.906642] sdhci: Copyright(c) Pierre Ossman lb # [ 0.906902] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.907271] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.908780] hid: raw HID events driver (C) Jiri Kosina lb # [ 0.912380] usbcore: registered new interface driver usbhid lb # [ 0.912391] usbhid: USB HID core driver client # [ 0.886017] thunder_xcv, ver 1.0 client # [ 0.886060] thunder_bgx, ver 1.0 client # [ 0.886102] nicpf, ver 1.0 client # [ 0.886652] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.884996] Freeing initrd memory: 26976K client # [ 0.886660] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.886685] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.886693] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.914726] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.886722] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.916247] drop_monitor: Initializing network drop monitor service client # [ 0.886728] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.916439] NET: Registered PF_INET6 protocol family client # [ 0.886764] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.919599] Segment Routing with IPv6 client # [ 0.886770] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.919619] In-situ OAM (IOAM) with IPv6 client # [ 0.886905] sky2: driver version 1.30 lb # [ 0.919659] NET: Registered PF_PACKET protocol family client # [ 0.888922] ehci-pci 0000:00:07.0: EHCI Host Controller worker1 # [ 0.891003] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.888952] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 client # [ 0.889308] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 client # [ 0.899083] usbcore: registered new interface driver usb-storage worker1 # [ 0.894604] thunder_xcv, ver 1.0 lb # [ 0.921507] 9pnet: Installing 9P2000 support worker1 # [ 0.894648] thunder_bgx, ver 1.0 lb # [ 0.921554] Key type dns_resolver registered worker1 # [ 0.894670] nicpf, ver 1.0 client # [ 0.899136] usbcore: registered new interface driver usbserial_generic client # [ 0.899150] usbserial: USB Serial support registered for generic client # [ 0.899737] hv_vmbus: registering driver hyperv_keyboard client # [ 0.900266] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 client # [ 0.904286] hub 1-0:1.0: USB hub found lb # [ 0.928390] registered taskstats version 1 client # [ 0.904775] hub 1-0:1.0: 6 ports detected lb # [ 0.928536] Loading compiled-in X.509 certificates worker1 # [ 0.896407] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.896418] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.896442] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.905862] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.896452] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.905888] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T15:04:32 UTC (1790089472) worker1 # [ 0.896480] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.906208] i2c_dev: i2c /dev entries driver worker1 # [ 0.896485] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 0.896507] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.896513] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.896648] sky2: driver version 1.30 worker1 # [ 0.898197] usbcore: registered new interface driver usb-storage client # [ 0.911700] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.898343] usbcore: registered new interface driver usbserial_generic client # [ 0.911713] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.898358] usbserial: USB Serial support registered for generic lb # [ 0.937152] Demotion targets for Node 0: null client # [ 0.911974] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.937256] Key type .fscrypt registered worker1 # [ 0.899667] ehci-pci 0000:00:07.0: EHCI Host Controller lb # [ 0.937262] Key type fscrypt-provisioning registered worker1 # [ 0.899692] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 lb # [ 0.937358] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.899957] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 lb # [ 0.937377] ima: Allocated hash algorithm: sha1 lb # [ 0.937397] ima: No architecture policies found client # [ 0.914393] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.910458] hv_vmbus: registering driver hyperv_keyboard client # [ 0.915903] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.911616] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 lb # [ 0.941555] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.916160] usbcore: registered new interface driver usbhid worker1 # [ 0.912602] hub 1-0:1.0: USB hub found client # [ 0.916167] usbhid: USB HID core driver worker1 # [ 0.913088] hub 1-0:1.0: 6 ports detected worker1 # [ 0.914398] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.919794] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.914426] rtc-pl031 9010000.pl031: setting system clock to 2026-09-22T15:04:32 UTC (1790089472) worker1 # [ 0.914731] i2c_dev: i2c /dev entries driver client # [ 0.922446] drop_monitor: Initializing network drop monitor service client # [ 0.922627] NET: Registered PF_INET6 protocol family client # [ 0.924548] Segment Routing with IPv6 client # [ 0.924565] In-situ OAM (IOAM) with IPv6 client # [ 0.924605] NET: Registered PF_PACKET protocol family client # [ 0.926241] 9pnet: Installing 9P2000 support worker1 # [ 0.920067] sdhci: Secure Digital Host Controller Interface driver client # [ 0.926287] Key type dns_resolver registered worker1 # [ 0.920079] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.920336] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.920710] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.922185] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.922464] usbcore: registered new interface driver usbhid worker1 # [ 0.922471] usbhid: USB HID core driver worker1 # [ 0.927940] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.933276] registered taskstats version 1 lb # [ 0.959147] clk: Disabling unused clocks worker1 # [ 0.929432] drop_monitor: Initializing network drop monitor service client # [ 0.933431] Loading compiled-in X.509 certificates lb # [ 0.959173] PM: genpd: Disabling unused power domains worker1 # [ 0.929611] NET: Registered PF_INET6 protocol family worker1 # [ 0.932590] Segment Routing with IPv6 worker1 # [ 0.932609] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.932652] NET: Registered PF_PACKET protocol family lb # [ 0.963337] Freeing unused kernel memory: 4736K lb # [ 0.963534] Run /init as init process worker1 # [ 0.934284] 9pnet: Installing 9P2000 support worker1 # [ 0.934361] Key type dns_resolver registered client # [ 0.942142] Demotion targets for Node 0: null client # [ 0.942246] Key type .fscrypt registered client # [ 0.942253] Key type fscrypt-provisioning registered client # [ 0.942350] ima: No TPM chip found, activating TPM-bypass! client # [ 0.942369] ima: Allocated hash algorithm: sha1 client # [ 0.942391] ima: No architecture policies found client # [ 0.946388] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.941109] registered taskstats version 1 worker1 # [ 0.941246] Loading compiled-in X.509 certificates lb # [ 0.979223] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 0.949818] Demotion targets for Node 0: null worker1 # [ 0.949923] Key type .fscrypt registered worker1 # [ 0.949930] Key type fscrypt-provisioning registered worker1 # [ 0.950034] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.950053] ima: Allocated hash algorithm: sha1 worker1 # [ 0.950075] ima: No architecture policies found worker1 # [ 0.954104] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.964722] clk: Disabling unused clocks client # [ 0.964744] PM: genpd: Disabling unused power domains client # [ 0.968900] Freeing unused kernel memory: 4736K client # [ 0.969115] Run /init as init process worker1 # [ 0.972449] clk: Disabling unused clocks worker1 # [ 0.972475] PM: genpd: Disabling unused power domains worker1 # [ 0.976602] Freeing unused kernel memory: 4736K worker1 # [ 0.976814] Run /init as init process client # [ 0.986441] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 0.993120] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.157502] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.144967] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.152255] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.159004] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.307126] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.310188] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.310223] systemd[1]: Detected virtualization qemu. worker2 # [ 1.310268] systemd[1]: Detected architecture arm64. worker2 # [ 1.310280] systemd[1]: Running in initrd. worker2 # [ 1.310802] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.310953] systemd[1]: Hostname set to . lb # [ 1.297561] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.389627] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 lb # [ 1.314074] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.326117] systemd[1]: Detected virtualization qemu. lb # [ 1.328145] systemd[1]: Detected architecture arm64. lb # [ 1.330127] systemd[1]: Running in initrd. lb # [ 1.332748] systemd[1]: Initializing machine ID from random generator. client # [ 1.306866] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.335857] systemd[1]: Hostname set to . worker1 # [ 1.311637] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.321299] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.333571] systemd[1]: Detected virtualization qemu. client # [ 1.335687] systemd[1]: Detected architecture arm64. client # [ 1.337750] systemd[1]: Running in initrd. client # [ 1.340408] systemd[1]: Initializing machine ID from random generator. client # [ 1.343335] systemd[1]: Hostname set to . worker1 # [ 1.327997] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.340222] systemd[1]: Detected virtualization qemu. worker1 # [ 1.342291] systemd[1]: Detected architecture arm64. worker1 # [ 1.344284] systemd[1]: Running in initrd. worker1 # [ 1.346922] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.349924] systemd[1]: Hostname set to . lb # [ 1.393179] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 client # [ 1.388618] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 worker1 # [ 1.395272] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 worker2 # [ 1.509536] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.512968] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.512311] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.519018] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.669388] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.672813] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 lb # [ 1.621292] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.689921] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.671979] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.674404] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 worker1 # [ 1.655125] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.693948] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.760678] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.671558] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.703088] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.704140] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.675758] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.771656] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.772734] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.705327] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.773955] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.705359] systemd[1]: Reached target Path Units. worker2 # [ 1.774909] systemd[1]: Reached target Path Units. lb # [ 1.705377] systemd[1]: Reached target Slice Units. worker2 # [ 1.775644] systemd[1]: Reached target Slice Units. lb # [ 1.705394] systemd[1]: Reached target Swaps. client # [ 1.676090] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 worker2 # [ 1.776442] systemd[1]: Reached target Swaps. lb # [ 1.705410] systemd[1]: Reached target Timer Units. worker2 # [ 1.777176] systemd[1]: Reached target Timer Units. lb # [ 1.705585] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.705725] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.778135] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.705879] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.779232] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.706000] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.780255] systemd[1]: Listening on Journal Sockets. lb # [ 1.706105] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.706124] systemd[1]: Reached target Socket Units. worker2 # [ 1.781156] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.680969] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.782162] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.715690] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.782187] systemd[1]: Reached target Socket Units. lb # [ 1.715766] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.785079] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.686755] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 worker2 # [ 1.786166] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.725057] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.796552] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.733289] systemd[1]: Starting Journal Service... lb # [ 1.748523] systemd[1]: Starting Load Kernel Modules... lb # [ 1.749455] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.821697] systemd[1]: Starting Journal Service... lb # [ 1.762234] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.832390] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.833357] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.845902] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.785049] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.786034] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.791019] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.857573] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.858350] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.770520] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.777160] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.808841] systemd-journald[72]: Collecting audit messages is disabled. client # [ 1.786648] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.781342] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.787839] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.782573] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.789243] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.784023] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.790304] systemd[1]: Reached target Path Units. worker1 # [ 1.785103] systemd[1]: Reached target Path Units. client # [ 1.791107] systemd[1]: Reached target Slice Units. worker1 # [ 1.785911] systemd[1]: Reached target Slice Units. lb # [ 1.815024] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.791910] systemd[1]: Reached target Swaps. worker1 # [ 1.786726] systemd[1]: Reached target Swaps. client # [ 1.792712] systemd[1]: Reached target Timer Units. worker1 # [ 1.787559] systemd[1]: Reached target Timer Units. client # [ 1.793759] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.788691] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.794961] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.789931] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.796178] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.791107] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.792159] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.888389] systemd-journald[72]: Collecting audit messages is disabled. client # [ 1.797280] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.793342] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.888548] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.797396] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.794358] systemd[1]: Reached target Socket Units. client # [ 1.797419] systemd[1]: Reached target Socket Units. client # [ 1.801494] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.802604] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.797222] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.829266] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.797317] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.899063] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.812425] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.811316] systemd[1]: Mounting Kernel Configuration File System... lb # [ 1.842148] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 lb # [ 1.842384] [drm] features: -virgl +edid -resource_blob -host_visible lb # [ 1.842394] [drm] features: -context_init client # [ 1.820562] systemd[1]: Starting Journal Service... lb # [ 1.843091] [drm] number of scanouts: 1 lb # [ 1.843108] [drm] number of cap sets: 0 worker2 # [ 1.914095] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.916890] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.857647] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.860240] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.926732] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 worker2 # [ 1.926966] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.926976] [drm] features: -context_init worker2 # [ 1.927706] [drm] number of scanouts: 1 worker2 # [ 1.927724] [drm] number of cap sets: 0 worker2 # [ 1.931499] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.844695] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.839711] systemd[1]: Starting Journal Service... client # [ 1.845699] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.842490] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.843630] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.873278] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic lb # [ 1.873295] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 worker1 # [ 1.854602] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.864432] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.957863] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic worker2 # [ 1.957881] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 client # [ 1.874960] systemd-journald[72]: Collecting audit messages is disabled. lb # [ 1.893445] Console: switching to colour frame buffer device 160x50 worker1 # [ 1.868582] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.869299] systemd[1]: Mounted Kernel Configuration File System. client # [ 1.884361] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.885056] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.913494] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.913691] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.913715] systemd[1]: Reached target Local File Systems. worker1 # [ 1.887106] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.977743] Console: switching to colour frame buffer device 160x50 lb # [ 1.917701] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.900509] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.994141] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.994506] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.994530] systemd[1]: Reached target Local File Systems. lb # [ 1.929567] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 1.998409] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.939710] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.911888] systemd-journald[72]: Collecting audit messages is disabled. lb # [ 1.945509] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.011900] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 1.919625] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.926463] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.932584] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.934358] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.937123] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.931482] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 2.029722] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.032990] systemd[1]: Starting Apply Kernel Variables... client # [ 1.945453] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 client # [ 1.945696] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.945705] [drm] features: -context_init client # [ 1.946420] [drm] number of scanouts: 1 client # [ 1.946439] [drm] number of cap sets: 0 worker1 # [ 1.943377] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.950230] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.952132] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 worker1 # [ 1.952370] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.952380] [drm] features: -context_init worker1 # [ 1.953089] [drm] number of scanouts: 1 worker1 # [ 1.953108] [drm] number of cap sets: 0 lb # [ 1.996815] systemd[1]: Finished Apply Kernel Variables. client # [ 1.972570] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic client # [ 1.972588] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 worker2 # [ 2.053618] systemd-modules-load[73]: Inserted module 'dm_mod' worker2 # [ 2.073677] systemd[1]: Started Journal Service. lb # [ 1.996351] systemd-modules-load[73]: Inserted module 'dm_mod' worker2 # [ 2.060391] systemd-modules-load[73]: Module 'virtio_balloon' is built in lb # [ 2.010414] systemd[1]: Started Journal Service. worker2 # [ 2.061571] systemd-modules-load[73]: Module 'virtio_console' is built in worker1 # [ 1.979348] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic worker2 # [ 2.062609] systemd-modules-load[73]: Inserted module 'virtio_gpu' worker1 # [ 1.979368] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 worker2 # [ 2.063637] systemd-modules-load[73]: Module 'virtio_rng' is built in lb # [ 2.004200] systemd-modules-load[73]: Module 'virtio_balloon' is built in lb # [ 2.008271] systemd-modules-load[73]: Module 'virtio_console' is built in client # [ 1.992603] Console: switching to colour frame buffer device 160x50 lb # [ 2.011657] systemd-modules-load[73]: Inserted module 'virtio_gpu' lb # [ 2.012803] systemd-modules-load[73]: Module 'virtio_rng' is built in worker1 # [ 1.995643] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.996034] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.996062] systemd[1]: Reached target Local File Systems. worker2 # [ 2.081667] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.002711] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.020291] systemd[1]: Starting Create System Files and Directories... lb # [ 2.023075] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker2 # [ 2.085243] systemd[1]: Finished Apply Kernel Variables. client # [ 2.016939] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 2.092521] systemd-udevd[78]: Using default interface naming scheme 'v261'. client # [ 2.017303] systemd[1]: Reached target Preparation for Local File Systems. client # [ 2.017327] systemd[1]: Reached target Local File Systems. worker1 # [ 2.007446] Console: switching to colour frame buffer device 160x50 worker1 # [ 2.014422] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.024595] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.029984] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 2.050008] systemd[1]: Finished Create System Files and Directories. client # [ 2.041548] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.043620] systemd[1]: Finished Load Kernel Modules. lb # [ 2.062231] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.036663] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.037758] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.038891] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.128898] systemd[1]: Finished Create System Files and Directories. client # [ 2.039962] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker2 # [ 2.130951] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.051414] systemd[1]: Starting Apply Kernel Variables... client # [ 2.060798] systemd[1]: Starting Apply Kernel Variables... client # [ 2.060979] systemd[1]: Started Journal Service. client # [ 2.048585] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.084827] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.095098] systemd[1]: Started Journal Service. worker1 # [ 2.079753] systemd-modules-load[73]: Inserted module 'dm_mod' worker1 # [ 2.084219] systemd-modules-load[73]: Module 'virtio_balloon' is built in worker2 # [ 2.185504] systemd[1]: Starting Virtual Console Setup... client # [ 2.097169] systemd[1]: Finished Apply Kernel Variables. lb # [ 2.126019] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.095445] systemd-modules-load[73]: Module 'virtio_console' is built in worker1 # [ 2.100119] systemd-modules-load[73]: Inserted module 'virtio_gpu' worker1 # [ 2.101188] systemd-modules-load[73]: Module 'virtio_rng' is built in worker1 # [ 2.102184] systemd[1]: Starting Create System Files and Directories... client # [ 2.112920] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.116418] systemd-udevd[79]: Using default interface naming scheme 'v261'. client # [ 2.122773] systemd-udevd[78]: Using default interface naming scheme 'v261'. worker1 # [ 2.124229] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.140181] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.236513] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.177311] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.240125] systemd[1]: Finished Virtual Console Setup. client # [ 2.150410] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.179992] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.155112] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.212124] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.220207] systemd[1]: Starting Virtual Console Setup... client # [ 2.260501] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.263869] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.269840] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.271972] systemd[1]: Finished Virtual Console Setup. lb # [ 2.782993] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.783937] systemd[1]: Reached target System Initialization. lb # [ 2.784834] systemd[1]: Reached target Basic System. worker2 # [ 2.849235] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.850195] systemd[1]: Reached target System Initialization. worker2 # [ 2.851037] systemd[1]: Reached target Basic System. client # [ 2.873451] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.876140] systemd[1]: Reached target System Initialization. client # [ 2.876990] systemd[1]: Reached target Basic System. worker1 # [ 2.873990] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.874949] systemd[1]: Reached target System Initialization. worker1 # [ 2.880127] systemd[1]: Reached target Basic System. lb # [ 2.928230] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.022840] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.968265] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.030418] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.971504] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.033929] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.092095] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.098018] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.103191] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.041831] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.052257] systemd[1]: Reached target Initrd Root Device. lb # [ 3.056467] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.035662] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.039808] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.043864] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.052390] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.155603] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.060780] (udev-worker)[97]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.098821] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.068184] (udev-worker)[97]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.162410] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.166706] systemd[1]: Mounting /sysroot... lb # [ 3.107416] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.112208] systemd[1]: Mounting /sysroot... worker2 # [ 3.213973] EXT4-fs (vda): mounted filesystem e0d9bf4d-739a-47eb-8932-643e98c0d220 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.204998] systemd[1]: Mounted /sysroot. worker2 # [ 3.206924] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.208653] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.159956] EXT4-fs (vda): mounted filesystem 77424937-216a-4d64-b967-244caaea4afe r/w with ordered data mode. Quota mode: none. lb # [ 3.153196] systemd[1]: Mounted /sysroot. lb # [ 3.154682] systemd[1]: Reached target Initrd Root File System. lb # [ 3.159300] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.140122] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.143093] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.236244] systemd-sysroot-fstab-check[118]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.147092] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.240921] systemd[1]: Reload requested from client PID 118 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.148319] systemd[1]: Found device /dev/disk/by-label/nixos. worker2 # [ 3.244970] systemd[1]: Reloading... worker1 # [ 3.153270] systemd[1]: Reached target Initrd Root Device. lb # [ 3.187814] systemd-sysroot-fstab-check[118]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.160178] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.194375] systemd[1]: Reload requested from client PID 118 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.199581] systemd[1]: Reloading... client # [ 3.194496] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.201548] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.198390] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.208306] systemd[1]: Mounting /sysroot... worker1 # [ 3.207107] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.209747] systemd[1]: Mounting /sysroot... client # [ 3.259859] EXT4-fs (vda): mounted filesystem b05d3265-e406-49ad-ac8b-ff13de131358 r/w with ordered data mode. Quota mode: none. worker1 # [ 3.256592] EXT4-fs (vda): mounted filesystem 69af6843-d400-4508-8e52-ae8b11c77126 r/w with ordered data mode. Quota mode: none. client # [ 3.249167] systemd[1]: Mounted /sysroot. worker1 # [ 3.247462] systemd[1]: Mounted /sysroot. client # [ 3.252497] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.249943] systemd[1]: Reached target Initrd Root File System. client # [ 3.255901] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.255740] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.283994] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.284442] systemd-sysroot-fstab-check[118]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.290798] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.294949] systemd[1]: Reloading... worker1 # [ 3.291111] systemd[1]: Reload requested from client PID 118 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.296187] systemd[1]: Reloading... worker2 # [ 3.452908] systemd[1]: Reloading finished in 208 ms. lb # [ 3.408738] systemd[1]: Reloading finished in 209 ms. worker2 # [ 3.485104] systemd-sysroot-fstab-check[118]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.488714] systemd-sysroot-fstab-check[118]: Requesting swap.target/start/replace... worker2 # [ 3.493694] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.497302] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.499555] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.444836] systemd-sysroot-fstab-check[118]: Requesting initrd-fs.target/start/replace... lb # [ 3.450039] systemd-sysroot-fstab-check[118]: Requesting swap.target/start/replace... lb # [ 3.455543] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.458618] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.462942] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.501031] systemd[1]: Reloading finished in 205 ms. worker1 # [ 3.504109] systemd[1]: Reloading finished in 210 ms. client # [ 3.532801] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... client # [ 3.537369] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... worker1 # [ 3.536737] systemd-sysroot-fstab-check[118]: Requesting initrd-fs.target/start/replace... client # [ 3.542082] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.545355] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.541348] systemd-sysroot-fstab-check[118]: Requesting swap.target/start/replace... client # [ 3.547750] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.549192] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.551567] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.556173] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.755963] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.767287] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.834515] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.781289] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.852901] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.856163] systemd[1]: Mounting /sysroot/run... lb # [ 3.805104] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.877904] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.820784] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.896525] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.857102] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.878821] fuse: init (API version 7.45) worker2 # [ 3.951499] fuse: init (API version 7.45) worker2 # [ 3.942423] systemd[1]: Mounted /sysroot/nix/.rw-store. lb # [ 3.894420] virtiofs virtio6: discovered new tag: nix-store lb # [ 3.895212] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 3.857212] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.890632] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.968385] virtiofs virtio6: discovered new tag: nix-store worker2 # [ 3.969193] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 3.869238] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.910683] virtiofs virtio7: discovered new tag: shared lb # [ 3.911443] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 3.983186] virtiofs virtio7: discovered new tag: shared worker2 # [ 3.983947] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 3.875690] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.924694] virtiofs virtio8: discovered new tag: xchg client # [ 3.886535] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.927483] virtiofs virtio8: virtio_fs_setup_dax: No cache capability client # [ 3.891741] systemd[1]: Mounting /sysroot/run... lb # [ 3.925084] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.002495] virtiofs virtio8: discovered new tag: xchg worker2 # [ 4.003293] virtiofs virtio8: virtio_fs_setup_dax: No cache capability lb # [ 3.929330] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.993552] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.905247] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.995713] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.935631] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.903815] systemd[1]: Mounting /sysroot/run... lb # [ 3.941423] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 4.007365] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 3.914946] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 4.015620] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.926484] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.959623] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.022103] systemd[1]: Mounted /sysroot/run. lb # [ 3.962474] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.025984] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.936600] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 4.028991] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.968247] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 3.942561] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.991737] fuse: init (API version 7.45) worker1 # [ 3.986364] fuse: init (API version 7.45) lb # [ 4.011652] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.013764] systemd[1]: Reached target Initrd File Systems. lb # [ 4.015894] systemd[1]: Starting Find NixOS closure... client # [ 4.007277] virtiofs virtio6: discovered new tag: nix-store client # [ 4.008128] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 4.005859] virtiofs virtio6: discovered new tag: nix-store worker1 # [ 4.006682] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 4.026765] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.022426] virtiofs virtio7: discovered new tag: shared client # [ 4.023213] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 4.020746] virtiofs virtio7: discovered new tag: shared client # [ 4.012917] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 4.021576] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 4.013581] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.035054] virtiofs virtio8: discovered new tag: xchg client # [ 4.035831] virtiofs virtio8: virtio_fs_setup_dax: No cache capability worker1 # [ 4.031051] virtiofs virtio8: discovered new tag: xchg worker1 # [ 4.031957] virtiofs virtio8: virtio_fs_setup_dax: No cache capability lb # [ 4.056569] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.031673] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 4.040190] systemd[1]: Mounted /sysroot/run. lb # [ 4.072382] systemd[1]: Finished Find NixOS closure. client # [ 4.047271] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.075108] systemd[1]: Reached target Initrd Default Target. client # [ 4.050686] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 4.046636] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 4.052747] systemd[1]: Mounted /sysroot/run. lb # [ 4.082619] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.058538] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 4.059948] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 4.062092] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 4.070907] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.072088] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.078362] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.107556] systemd[1]: Stopped target Initrd Default Target. client # [ 4.081105] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.111577] systemd[1]: Stopped target Basic System. client # [ 4.084733] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.112831] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.116959] systemd[1]: Stopped target Path Units. lb # [ 4.118650] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.121506] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.125385] systemd[1]: Stopped target Slice Units. lb # [ 4.126989] systemd[1]: Stopped target Socket Units. lb # [ 4.129733] systemd[1]: Stopped target System Initialization. lb # [ 4.133273] systemd[1]: Stopped target Swaps. lb # [ 4.137737] systemd[1]: Stopped target Timer Units. lb # [ 4.138511] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.139890] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.144663] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.145735] systemd[1]: Stopped Find NixOS closure. lb # [ 4.146421] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.147298] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 4.129485] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.131443] systemd[1]: Reached target Initrd File Systems. lb # [ 4.160319] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.133620] systemd[1]: Starting Find NixOS closure... lb # [ 4.161356] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 4.162445] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.163142] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.143324] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.173290] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 4.175851] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.180516] systemd[1]: Stopped Create System Files and Directories. lb # [ 4.181436] systemd[1]: Stopped target Local File Systems. lb # [ 4.183447] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.184672] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.185707] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.186469] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.187472] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.196258] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.197115] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.198068] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.200580] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.202064] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.202990] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.203947] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.205068] systemd[1]: systemd-udevd.service: Consumed 1.089s CPU time over 2.286s wall clock time, 17.6M memory peak. lb # [ 4.206457] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.207430] systemd[1]: Closed udev Control Socket. lb # [ 4.212246] systemd[1]: Starting Cleanup udev Database... client # [ 4.184835] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.216258] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.217525] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.218539] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 4.193243] systemd[1]: Finished Find NixOS closure. client # [ 4.195897] systemd[1]: Reached target Initrd Default Target. lb # [ 4.224154] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.225197] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.226344] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 4.208116] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.247816] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.252456] systemd[1]: Finished Cleanup udev Database. lb # [ 4.253303] systemd[1]: Reached target Switch Root. lb # [ 4.254004] systemd[1]: Starting NixOS Activation... client # [ 4.226198] systemd[1]: Stopped target Initrd Default Target. client # [ 4.230055] systemd[1]: Stopped target Basic System. client # [ 4.232185] systemd[1]: Stopped target Initrd Root Device. client # [ 4.234199] systemd[1]: Stopped target Path Units. client # [ 4.237019] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 4.240653] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 4.244739] systemd[1]: Stopped target Slice Units. client # [ 4.246398] systemd[1]: Stopped target Socket Units. client # [ 4.251691] systemd[1]: Stopped target System Initialization. client # [ 4.253823] systemd[1]: Stopped target Swaps. client # [ 4.255079] systemd[1]: Stopped target Timer Units. client # [ 4.259440] systemd[1]: dbus.socket: Deactivated successfully. client # [ 4.261731] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 4.263255] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 4.272279] systemd[1]: Stopped Find NixOS closure. client # [ 4.276345] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 4.278052] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 4.280517] systemd[1]: Stopped Apply Kernel Variables. client # [ 4.286156] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 4.288851] systemd[1]: Stopped Load Kernel Modules. client # [ 4.292754] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 4.293946] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 4.296182] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 4.297778] systemd[1]: Stopped Create System Files and Directories. client # [ 4.298693] systemd[1]: Stopped target Local File Systems. client # [ 4.299463] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 4.300608] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.327462] initrd-nixos-activation-start[170]: booting system configuration /nix/store/rwj7rgrjnik4yfrdy5nxpi16ig7dj0yx-nixos-system-lb-test client # [ 4.301640] systemd[1]: Stopped Coldplug All udev Devices. client # [ 4.302420] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 4.303446] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.308232] systemd[1]: Stopped Virtual Console Setup. client # [ 4.310052] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 4.398916] (udev-worker)[97]: mtd0ro: Failed to find and pin callout binary "/nix/store/gnadg5slifq2r638xvz4pv6vrsdl9xkj-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.311843] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.404660] (udev-worker)[97]: mtd0ro: /etc/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.316574] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.317620] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.318434] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 4.319355] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 4.321379] systemd[1]: systemd-udevd.service: Consumed 1.111s CPU time over 2.298s wall clock time, 20.6M memory peak. client # [ 4.322810] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 4.323796] systemd[1]: Closed udev Control Socket. client # [ 4.324667] systemd[1]: Starting Cleanup udev Database... client # [ 4.325443] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 4.326485] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 4.327348] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 4.332230] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 4.333290] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.361195] initrd-nixos-activation-start[170]: running activation script... client # [ 4.335109] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 4.438116] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.444165] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.445425] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 4.446291] systemd[1]: Starting Virtual Console Setup... client # [ 4.363694] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 4.367078] systemd[1]: Finished Cleanup udev Database. client # [ 4.368472] systemd[1]: Reached target Switch Root. worker2 # [ 4.460815] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.372451] systemd[1]: Starting NixOS Activation... worker2 # [ 4.462282] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.466280] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.493577] systemd-vconsole-setup[153]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 4.497362] systemd[1]: Finished Virtual Console Setup. client # [ 4.450704] initrd-nixos-activation-start[169]: booting system configuration /nix/store/9h1c64jjdkn9jsqs8mxdg12zr39npfq0-nixos-system-client-test worker1 # [ 4.456476] (udev-worker)[100]: mtd0ro: Failed to find and pin callout binary "/nix/store/gnadg5slifq2r638xvz4pv6vrsdl9xkj-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.464766] (udev-worker)[100]: mtd0ro: /etc/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.483498] initrd-nixos-activation-start[169]: running activation script... worker1 # [ 4.493026] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.496405] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.499927] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.500912] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.516810] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.518343] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.520672] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.542566] systemd-vconsole-setup[153]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 4.546157] systemd[1]: Finished Virtual Console Setup. lb # [ 4.614349] initrd-nixos-activation-start[193]: setting up /etc... lb # [ 4.734667] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 4.737743] systemd[1]: Finished NixOS Activation. lb # [ 4.744222] systemd[1]: Starting Switch Root... client # [ 4.716605] initrd-nixos-activation-start[192]: setting up /etc... lb # [ 4.764664] systemd[1]: Switching root. worker2 # [ 4.836785] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.904941] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.908183] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.913191] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.921681] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.839316] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.840603] systemd[1]: Finished NixOS Activation. client # [ 4.841851] systemd[1]: Starting Switch Root... client # [ 4.863478] systemd[1]: Switching root. worker1 # [ 4.860162] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.968778] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.974141] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.983119] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.986088] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.987822] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.943106] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.016853] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 5.018601] systemd[1]: Stopped target Basic System. worker2 # [ 5.019928] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.022650] systemd[1]: Stopped target Path Units. worker1 # [ 4.928770] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 5.025103] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.932288] systemd[1]: Reached target Initrd File Systems. worker2 # [ 5.028303] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.031369] systemd[1]: Stopped target Slice Units. worker1 # [ 4.937299] systemd[1]: Starting Find NixOS closure... worker2 # [ 5.036351] systemd[1]: Stopped target Socket Units. worker2 # [ 5.037330] systemd[1]: Stopped target System Initialization. worker2 # [ 5.038358] systemd[1]: Stopped target Swaps. worker2 # [ 5.039180] systemd[1]: Stopped target Timer Units. worker1 # [ 4.945958] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 5.043118] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 5.049558] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 5.050579] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 5.051769] systemd[1]: Stopped Find NixOS closure. worker2 # [ 5.057325] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 5.062111] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.065941] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.066974] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 5.076237] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 5.080428] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 5.083261] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 5.088495] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 5.090258] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 5.093718] systemd[1]: Stopped target Local File Systems. worker2 # [ 5.094604] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.998517] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.004463] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 5.099766] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 5.101053] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 5.101823] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.102857] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.103855] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 5.105277] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 5.106226] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 5.107152] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 5.108127] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 5.109097] systemd[1]: systemd-udevd.service: Consumed 1.420s CPU time over 3.101s wall clock time, 22.5M memory peak. worker1 # [ 5.015847] systemd[1]: Finished Find NixOS closure. worker2 # [ 5.110479] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 5.111462] systemd[1]: Closed udev Control Socket. worker1 # [ 5.018831] systemd[1]: Reached target Initrd Default Target. worker1 # [ 5.020593] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 5.120291] systemd[1]: Starting Cleanup udev Database... worker2 # [ 5.121105] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 5.122407] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 5.124199] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.051884] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.128165] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 5.129166] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 5.132203] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.133093] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 5.136336] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.049173] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.051323] systemd[1]: Stopped target Basic System. worker1 # [ 5.056638] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 5.057815] systemd[1]: Stopped target Path Units. worker1 # [ 5.060248] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.063310] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.160490] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 5.161598] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.068280] systemd[1]: Stopped target Slice Units. worker2 # [ 5.163100] systemd[1]: Reached target Switch Root. worker1 # [ 5.069339] systemd[1]: Stopped target Socket Units. worker1 # [ 5.070988] systemd[1]: Stopped target System Initialization. worker2 # [ 5.167888] systemd[1]: Starting NixOS Activation... worker1 # [ 5.075082] systemd[1]: Stopped target Swaps. worker1 # [ 5.076977] systemd[1]: Stopped target Timer Units. worker1 # [ 5.081379] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.084226] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.087266] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.095584] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.101403] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.102556] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.103625] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.113031] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.114174] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.114963] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.120288] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.121957] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.124231] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.128516] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.129402] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.130344] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.132244] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.133080] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.134093] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.135085] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.135812] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.136902] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.137806] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.138777] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.139575] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.148401] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.149460] systemd[1]: systemd-udevd.service: Consumed 1.432s CPU time over 3.130s wall clock time, 22.3M memory peak. worker2 # [ 5.243691] initrd-nixos-activation-start[176]: booting system configuration /nix/store/gmd7z4ny4bi55sv3a6k2fbz28d26w0pi-nixos-system-worker2-test worker1 # [ 5.151128] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.156256] systemd[1]: Closed udev Control Socket. worker1 # [ 5.157037] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.157785] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.158806] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.159651] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.164497] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.165517] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.168091] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.275439] initrd-nixos-activation-start[176]: running activation script... worker1 # [ 5.191542] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.196447] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.197281] systemd[1]: Reached target Switch Root. worker1 # [ 5.200150] systemd[1]: Starting NixOS Activation... worker1 # [ 5.280829] initrd-nixos-activation-start[176]: booting system configuration /nix/store/9c58wlr9mbayd5fmz9rxgypan2qjrx99-nixos-system-worker1-test worker1 # [ 5.314818] initrd-nixos-activation-start[176]: running activation script... lb # [ 5.453965] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 5.516323] initrd-nixos-activation-start[199]: setting up /etc... lb # [ 5.466750] systemd[1]: Detected virtualization qemu. lb # [ 5.469935] systemd[1]: Detected architecture arm64. lb # [ 5.473034] systemd[1]: Detected first boot. lb # [ 5.479887] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.637584] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.640126] systemd[1]: Finished NixOS Activation. worker2 # [ 5.641546] systemd[1]: Starting Switch Root... client # [ 5.573837] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.586558] systemd[1]: Detected virtualization qemu. worker1 # [ 5.568556] initrd-nixos-activation-start[199]: setting up /etc... worker2 # [ 5.663215] systemd[1]: Switching root. client # [ 5.589739] systemd[1]: Detected architecture arm64. client # [ 5.593753] systemd[1]: Detected first boot. client # [ 5.599497] systemd[1]: Initializing machine ID from random generator. worker1 # [ 5.690390] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 5.693244] systemd[1]: Finished NixOS Activation. worker1 # [ 5.694429] systemd[1]: Starting Switch Root... worker1 # [ 5.715490] systemd[1]: Switching root. worker2 # [ 5.855590] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). lb # [ 5.804801] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.894126] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). client # [ 5.904274] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 5.995566] systemd[1]: Applying preset policy. client # [ 6.106766] systemd[1]: Applying preset policy. lb # [ 6.251267] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 6.394335] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.406216] systemd[1]: Detected virtualization qemu. worker2 # [ 6.409025] systemd[1]: Detected architecture arm64. worker2 # [ 6.412695] systemd[1]: Detected first boot. worker2 # [ 6.417869] systemd[1]: Initializing machine ID from random generator. client # [ 6.344337] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 6.388057] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.400615] systemd[1]: Detected virtualization qemu. worker1 # [ 6.403806] systemd[1]: Detected architecture arm64. worker1 # [ 6.407947] systemd[1]: Detected first boot. worker1 # [ 6.413797] systemd[1]: Initializing machine ID from random generator. lb # [ 6.487220] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.488883] systemd[1]: Stopped initrd-switch-root.service. lb # [ 6.493689] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 6.497676] systemd[1]: Created slice Slice /system/getty. lb # [ 6.499589] systemd[1]: Created slice User and Session Slice. lb # [ 6.500848] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.503541] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 6.505831] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.507669] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 6.509641] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.510743] systemd[1]: Stopped target initrd-fs.target. lb # [ 6.512262] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 6.513927] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 6.516345] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 6.517609] systemd[1]: Reached target Path Units. lb # [ 6.520002] systemd[1]: Reached target Remote File Systems. lb # [ 6.521086] systemd[1]: Reached target Slice Units. lb # [ 6.523372] systemd[1]: Reached target Swaps. lb # [ 6.525745] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 6.528647] systemd[1]: Listening on Process Core Dump Socket. lb # [ 6.530850] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 6.533238] systemd[1]: Listening on Factory Reset Management. lb # [ 6.534451] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.538249] systemd[1]: Starting Journal Log Access Socket... lb # [ 6.540476] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.543962] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 6.545581] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 6.547941] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.551263] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.556951] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 6.558315] systemd[1]: Listening on udev Control Socket. lb # [ 6.559903] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.564275] systemd[1]: Mounting Huge Pages File System... lb # [ 6.569918] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 6.582692] systemd[1]: Mounting Kernel Debug File System... client # [ 6.561874] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 6.563536] systemd[1]: Stopped initrd-switch-root.service. lb # [ 6.589935] systemd[1]: Mounting Kernel Trace File System... client # [ 6.567873] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 6.572008] systemd[1]: Created slice Slice /system/getty. client # [ 6.574089] systemd[1]: Created slice User and Session Slice. client # [ 6.575321] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.602174] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.577334] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 6.579890] systemd[1]: Expecting device /dev/hvc0... lb # [ 6.604141] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 6.581825] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 6.583725] systemd[1]: Reached target Local Encrypted Volumes. client # [ 6.584974] systemd[1]: Stopped target initrd-fs.target. client # [ 6.586484] systemd[1]: Stopped target initrd-root-fs.target. client # [ 6.588056] systemd[1]: Stopped target initrd-switch-root.target. client # [ 6.589709] systemd[1]: Reached target Virtual Machines and Containers. client # [ 6.591375] systemd[1]: Reached target Path Units. client # [ 6.593061] systemd[1]: Reached target Remote File Systems. client # [ 6.595415] systemd[1]: Reached target Slice Units. lb # [ 6.621076] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.596451] systemd[1]: Reached target Swaps. lb # [ 6.622327] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 6.600020] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 6.603057] systemd[1]: Listening on Process Core Dump Socket. client # [ 6.605233] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 6.629707] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.607644] systemd[1]: Listening on Factory Reset Management. lb # [ 6.631548] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.608941] systemd[1]: Listening on Hostname Service Socket. client # [ 6.613016] systemd[1]: Starting Journal Log Access Socket... client # [ 6.615129] systemd[1]: Listening on Journal Audit Socket. client # [ 6.617953] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 6.619534] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 6.621270] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.624654] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.653518] systemd[1]: Mounting FUSE Control File System... client # [ 6.630275] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 6.631621] systemd[1]: Listening on udev Control Socket. lb # [ 6.656075] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.633354] systemd[1]: Listening on udev Varlink Socket. client # [ 6.637780] systemd[1]: Mounting Huge Pages File System... client # [ 6.645452] systemd[1]: Mounting POSIX Message Queue File System... client # [ 6.654726] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 6.744153] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 6.685310] systemd[1]: Starting Journal Service... client # [ 6.667541] systemd[1]: Mounting Kernel Trace File System... client # [ 6.677548] systemd[1]: Starting Create List of Static Device Nodes... client # [ 6.678818] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 6.704584] systemd[1]: Starting Load Kernel Modules... lb # [ 6.724282] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 6.700761] systemd[1]: Mounting Kernel Configuration File System... client # [ 6.703720] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm lb # [ 6.737079] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.712305] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.714201] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 6.739999] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.734982] systemd[1]: Mounting FUSE Control File System... lb # [ 6.761527] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.740801] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 6.736469] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 6.774417] systemd[1]: Listening on Journal Log Access Socket. lb # [ 6.782757] systemd-journald[264]: Collecting audit messages is enabled. lb # [ 6.784265] systemd[1]: Mounted Huge Pages File System. client # [ 6.765128] systemd[1]: Starting Journal Service... client # [ 6.776505] systemd[1]: Starting Load Kernel Modules... lb # [ 6.801422] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.801940] systemd[1]: Mounted Kernel Debug File System. lb # [ 6.802324] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.807988] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 6.808574] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.801957] systemd[1]: Queued start job for default target Multi-User System. client # [ 6.791787] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 6.805453] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.821242] systemd[1]: Started Journal Service. client # [ 6.806007] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 6.806389] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.824935] systemd-modules-load[265]: Module 'atkbd' is built in lb # [ 6.832275] systemd-modules-load[265]: Module 'loop' is built in client # [ 6.822458] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.829983] systemd[1]: Listening on Journal Log Access Socket. lb # [ 6.843930] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 6.860969] EXT4-fs (vda): re-mounted 77424937-216a-4d64-b967-244caaea4afe. client # [ 6.837868] systemd[1]: Mounted Huge Pages File System. lb # [ 6.853040] systemd[1]: Mounted FUSE Control File System. lb # [ 6.856281] systemd[1]: Finished Load Kernel Modules. lb # [ 6.863338] systemd[1]: Starting Firewall... client # [ 6.853937] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 6.869373] systemd[1]: Starting Apply Kernel Variables... client # [ 6.860502] systemd[1]: Mounted Kernel Debug File System. client # [ 6.864019] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.876139] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 6.877147] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 6.965716] systemd[1]: Applying preset policy. client # [ 6.877056] systemd-journald[263]: Collecting audit messages is enabled. client # [ 6.885993] systemd[1]: Finished Create List of Static Device Nodes. client # [ 6.887078] systemd[1]: Finished Load Kernel Modules. lb # [ 6.900319] systemd-oomd[266]: No swap; memory pressure usage will be degraded client # [ 6.896105] systemd[1]: Starting Apply Kernel Variables... client # [ 6.904960] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.907165] systemd[1]: Mounted FUSE Control File System. lb # [ 6.919658] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.894748] systemd[1]: Queued start job for default target Multi-User System. lb # [ 6.924475] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.913753] systemd[1]: Started Journal Service. worker1 # [ 6.911166] systemd[1]: Applying preset policy. client # [ 6.904969] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.932799] systemd[1]: Starting Load/Save OS Random Seed... client # [ 6.906228] systemd-modules-load[264]: Module 'atkbd' is built in lb # [ 6.933726] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.907210] systemd-modules-load[264]: Module 'loop' is built in lb # [ 6.934926] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.943370] systemd-oomd[265]: No swap; memory pressure usage will be degraded client # [ 6.964881] EXT4-fs (vda): re-mounted b05d3265-e406-49ad-ac8b-ff13de131358. client # [ 6.957391] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.961656] systemd[1]: Mounted Kernel Configuration File System. client # [ 6.969846] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 7.021675] systemd-journald[264]: Received client request to flush runtime journal. client # [ 6.982616] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 6.991239] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 6.996663] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.000954] systemd[1]: Starting Load/Save OS Random Seed... client # [ 7.001853] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.069230] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 7.070135] systemd[1]: Reached target First Boot Complete. lb # [ 7.070927] systemd[1]: Finished Apply Kernel Variables. lb # [ 7.077972] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.060573] systemd[1]: Finished Apply Kernel Variables. client # [ 7.096671] systemd-journald[263]: Received client request to flush runtime journal. client # [ 7.124395] systemd[1]: Finished Load/Save OS Random Seed. client # [ 7.125343] systemd[1]: Reached target First Boot Complete. worker2 # [ 7.232719] systemd[1]: Populated /etc with preset unit settings. client # [ 7.128784] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 7.170330] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 7.176404] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 7.187995] systemd[1]: Populated /etc with preset unit settings. client # [ 7.322324] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 7.324336] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 7.455836] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.457578] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 7.462158] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 7.466173] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.468108] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.470449] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.472790] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.475073] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 7.476932] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.478933] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.480032] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.482451] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.483501] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.486029] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.487721] systemd[1]: Reached target Path Units. worker2 # [ 7.490062] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.491092] systemd[1]: Reached target Slice Units. worker2 # [ 7.492579] systemd[1]: Reached target Swaps. worker2 # [ 7.496282] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.499223] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.501411] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.504625] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.505867] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.510004] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 7.416162] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.512105] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 7.417478] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 7.515741] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.517297] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 7.421151] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 7.518925] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.424578] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.521272] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.426558] systemd[1]: Created slice User and Session Slice. worker1 # [ 7.427883] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 7.429699] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.527418] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.528774] systemd[1]: Listening on udev Control Socket. worker1 # [ 7.431731] systemd[1]: Expecting device /dev/hvc0... lb # [ 7.450631] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 7.434213] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 7.451699] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 7.530552] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 7.435307] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 7.437698] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.535085] systemd[1]: Mounting Huge Pages File System... worker1 # [ 7.438713] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 7.456941] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 7.440344] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 7.441950] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 7.443728] systemd[1]: Reached target Path Units. worker1 # [ 7.446054] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.543314] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.447136] systemd[1]: Reached target Slice Units. worker1 # [ 7.449695] systemd[1]: Reached target Swaps. worker2 # [ 7.546876] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 7.452254] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 7.455218] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 7.457465] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 7.459781] systemd[1]: Listening on Factory Reset Management. worker1 # [ 7.460972] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.557773] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 7.465205] systemd[1]: Starting Journal Log Access Socket... lb # [ 7.484257] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.467357] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 7.471053] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 7.473141] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 7.569642] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 7.474557] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.570010] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 7.477100] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.482835] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 7.484212] systemd[1]: Listening on udev Control Socket. worker1 # [ 7.485847] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.581685] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.582040] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 7.490386] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.582289] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.582554] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 7.493927] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.503116] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.605282] systemd[1]: Mounting FUSE Control File System... worker2 # [ 7.606957] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.515204] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 7.622966] systemd[1]: Starting Journal Service... worker1 # [ 7.527173] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 7.527533] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 7.537502] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 7.537849] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 7.538101] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.538354] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.568775] systemd[1]: Mounted /run/wrappers. lb # [ 7.569646] systemd[1]: Reached target Local File Systems. lb # [ 7.575187] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 7.560464] systemd[1]: Mounting FUSE Control File System... worker2 # [ 7.659984] systemd[1]: Starting Load Kernel Modules... lb # [ 7.583137] systemd[1]: Starting register-nix-paths.service... worker1 # [ 7.565259] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 7.590539] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 7.591416] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.596191] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 7.677614] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 7.587347] systemd[1]: Starting Journal Service... worker2 # [ 7.690342] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.692595] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.617524] systemd[1]: Starting Create System Files and Directories... worker2 # [ 7.705325] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 7.709853] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 7.712436] systemd[1]: Mounted Huge Pages File System. worker2 # [ 7.715398] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 7.623833] systemd[1]: Starting Load Kernel Modules... worker2 # [ 7.718340] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 7.718787] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 7.719157] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 7.719518] systemd[1]: Mounted FUSE Control File System. worker1 # [ 7.639581] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 7.646033] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 7.647683] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.745992] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 7.653562] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 7.752130] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 7.657807] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 7.664321] systemd[1]: Mounted Huge Pages File System. worker1 # [ 7.665749] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 7.667993] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 7.668460] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.668830] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 7.675954] systemd[1]: Mounted FUSE Control File System. client # [ 7.670548] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.678654] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 7.681294] systemd[1]: Reached target Preparation for Local File Systems. client # [ 7.684236] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.701611] systemd[1]: Finished Create List of Static Device Nodes. client # [ 7.693585] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 7.707512] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 7.814407] systemd-journald[269]: Collecting audit messages is enabled. worker2 # [ 7.817601] EXT4-fs (vda): re-mounted e0d9bf4d-739a-47eb-8932-643e98c0d220. lb # [ 7.745277] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 7.835320] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 7.835943] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 7.836251] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.761425] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 7.734925] systemd[1]: Mounted /run/wrappers. client # [ 7.735721] systemd[1]: Reached target Local File Systems. worker2 # [ 7.843603] systemd[1]: Starting Load/Save OS Random Seed... client # [ 7.740305] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 7.846971] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.743624] systemd[1]: Starting register-nix-paths.service... worker2 # [ 7.834608] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 7.853121] systemd[1]: Finished Load Kernel Modules. client # [ 7.749565] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 7.855263] systemd[1]: Started Journal Service. client # [ 7.751390] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 7.755014] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.766554] systemd[1]: Finished Load Kernel Modules. worker1 # [ 7.773965] systemd[1]: Starting Firewall... client # [ 7.769095] systemd[1]: Starting Create System Files and Directories... worker2 # [ 7.860565] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 7.782025] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 7.875977] systemd-modules-load[270]: Module 'atkbd' is built in worker1 # [ 7.804049] systemd-journald[269]: Collecting audit messages is enabled. worker2 # [ 7.885930] systemd-modules-load[270]: Module 'loop' is built in worker1 # [ 7.807085] EXT4-fs (vda): re-mounted 69af6843-d400-4508-8e52-ae8b11c77126. worker2 # [ 7.896159] systemd[1]: Starting Firewall... worker2 # [ 7.902369] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 7.840664] systemd-udevd[301]: Using default interface naming scheme 'v261'. worker1 # [ 7.823469] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 7.824101] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.824390] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.917210] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 7.837398] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 7.839799] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.840808] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 7.850371] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 7.864078] systemd[1]: Started Journal Service. worker1 # [ 7.852231] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 7.855201] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 7.868132] systemd-modules-load[270]: Module 'atkbd' is built in lb # [ 7.903221] systemd[1]: Finished Create System Files and Directories. worker2 # [ 7.968825] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 7.879532] systemd-modules-load[270]: Module 'loop' is built in worker2 # [ 7.976948] systemd[1]: Reached target First Boot Complete. lb # [ 7.915300] systemd[1]: Starting Rebuild Journal Catalog... client # [ 7.890827] systemd-udevd[294]: Using default interface naming scheme 'v261'. lb # [ 7.919875] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 7.889227] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 8.001646] systemd-journald[269]: Received client request to flush runtime journal. client # [ 7.932384] systemd[1]: Finished Create System Files and Directories. client # [ 7.937335] systemd[1]: Starting Rebuild Journal Catalog... client # [ 7.942937] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 8.047063] systemd-oomd[272]: No swap; memory pressure usage will be degraded worker1 # [ 7.951736] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.956690] systemd-oomd[272]: No swap; memory pressure usage will be degraded worker2 # [ 8.053133] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 8.054098] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 8.055110] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 7.969140] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 7.970074] systemd[1]: Reached target First Boot Complete. worker2 # [ 8.056001] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 8.072635] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 7.978845] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.979832] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 7.982363] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 8.012391] systemd-journald[269]: Received client request to flush runtime journal. lb # [ 8.063387] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 8.038139] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 8.064409] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 8.094143] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 8.068337] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 8.108146] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 8.081973] systemd[1]: Finished Rebuild Journal Catalog. client # [ 8.084247] systemd[1]: Starting Update is Completed... lb # [ 8.115291] systemd[1]: Starting Update is Completed... worker2 # [ 8.242997] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 8.151529] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 8.245871] systemd[1]: Reached target Preparation for Local File Systems. client # [ 8.160800] systemd[1]: Finished Update is Completed. worker1 # [ 8.157046] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 8.256228] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.164180] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 8.229528] systemd[1]: Finished Update is Completed. worker2 # [ 8.356891] systemd-udevd[308]: Using default interface naming scheme 'v261'. lb # [ 8.303332] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 8.273899] systemd-udevd[310]: Using default interface naming scheme 'v261'. worker2 # [ 8.442596] systemd[1]: Mounting /run/wrappers... worker2 # [ 8.473285] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 8.407694] systemd[1]: Mounting /run/wrappers... worker1 # [ 8.453808] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 8.471281] systemd[1]: Mounted /run/wrappers. worker1 # [ 8.472252] systemd[1]: Reached target Local File Systems. worker2 # [ 8.569574] systemd[1]: Mounted /run/wrappers. worker1 # [ 8.476147] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 8.578349] systemd[1]: Reached target Local File Systems. worker2 # [ 8.579920] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 8.488113] systemd[1]: Starting register-nix-paths.service... worker2 # [ 8.582984] systemd[1]: Starting register-nix-paths.service... worker2 # [ 8.590266] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 8.496298] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 8.591159] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.503153] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.512261] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 8.612623] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 8.613555] systemd[1]: Starting Create System Files and Directories... worker1 # [ 8.521672] systemd[1]: Starting Create System Files and Directories... worker2 # [ 8.710213] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 8.618853] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 8.721901] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 8.629103] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.642458] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 8.647534] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 8.694946] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 worker2 # [ 8.810735] systemd[1]: Finished Create System Files and Directories. worker2 # [ 8.820115] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 8.833276] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 8.740967] systemd[1]: Finished Create System Files and Directories. worker1 # [ 8.750604] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 8.765586] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 8.858354] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 8.861108] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.940763] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 8.875390] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 8.931555] systemd[1]: Finished register-nix-paths.service. lb # [ 8.936534] systemd[1]: Reached target System Initialization. lb # [ 8.937428] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.938411] systemd[1]: Started niks3 garbage collection timer. lb # [ 8.939251] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 9.002753] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 9.006982] systemd[1]: Starting Update is Completed... lb # [ 8.946157] systemd[1]: Reached target Timer Units. lb # [ 8.946939] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 8.952211] systemd[1]: Listening on niks3 server socket. lb # [ 8.953087] systemd[1]: Listening on Nix Daemon Socket. lb # [ 8.953879] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 8.955043] systemd[1]: Reached target Socket Units. lb # [ 8.955777] systemd[1]: Reached target Basic System. lb # [ 8.967170] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 8.939987] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 8.972202] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.973150] systemd[1]: Starting Post-Boot Actions... lb # [ 8.979334] systemd[1]: Started Reset console on configuration changes. worker1 # [ 8.949237] systemd[1]: Starting Update is Completed... lb # [ 8.999067] systemd[1]: Starting resolvconf update... lb # [ 9.023741] systemd[1]: Started rustfs.service. worker2 # [ 9.094849] systemd[1]: Finished Update is Completed. lb # [ 9.071935] systemd[1]: Starting rustfs-bucket.service... lb # [ 9.096004] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 worker1 # [ 9.054805] systemd[1]: Finished Update is Completed. lb # [ 9.121412] nsncd[442]: Sep 22 15:04:40.728 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.144659] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 9.120087] systemd[1]: Starting Virtual Console Setup... lb # [ 9.153867] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.154901] systemd[1]: Reached target User and Group Name Lookups. client # [ 9.135752] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 9.148074] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 9.150076] systemd[1]: Stopped Virtual Console Setup. lb # [ 9.184371] systemd[1]: Starting D-Bus System Message Bus... client # [ 9.173942] systemd[1]: Starting Virtual Console Setup... lb # [ 9.216847] systemd[1]: Starting User Login Management... lb # [ 9.233490] systemd[1]: Finished Post-Boot Actions. lb # [ 9.319751] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 9.345650] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 9.350432] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 9.356472] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 9.370135] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client # [ 9.382526] systemd[1]: Finished register-nix-paths.service. worker2 # [ 9.508804] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 9.513587] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 9.446323] (udev-worker)[351]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 9.451037] (udev-worker)[351]: Network interface NamePolicy= disabled on kernel command line. client # [ 9.469908] (udev-worker)[348]: Network interface NamePolicy= disabled on kernel command line. lb # [ 9.544625] systemd-logind[471]: New seat seat0. lb # [ 9.553492] systemd[1]: Started User Login Management. lb # [ 9.558446] dbus-broker-launch[466]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 9.568432] systemd[1]: Starting linger-users.service... lb # [ 9.575248] dbus-broker-launch[466]: NSS returned no entry for 'systemd-timesync' lb # [ 9.584169] dbus-broker-launch[466]: Invalid user-name in /nix/store/4yiprls1sll47jid3xzq0m9nmi1qz2ww-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 9.617637] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 9.618727] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 9.619576] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 9.628484] systemd[1]: Stopping User and Group Name Lookups... lb # [ 9.629379] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 9.630265] systemd[1]: nscd.service: Deactivated successfully. lb # [ 9.631090] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 9.611663] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 9.613926] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 9.618709] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.619626] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.628813] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 9.630998] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 9.664169] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 9.636242] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 9.665260] systemd[1]: Started D-Bus System Message Bus. client # [ 9.637810] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 9.635505] systemd[1]: Finished Firewall. lb # [ 9.723785] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 9.729252] dbus-broker-launch[466]: Ready worker2 # [ 9.791235] systemd[1]: Finished Coldplug All udev Devices. lb # [ 9.736562] systemd[1]: Finished linger-users.service. worker2 # [ 9.830453] systemd[1]: Finished Firewall. lb # [ 9.791932] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 9.798024] nsncd[539]: Sep 22 15:04:41.403 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.799993] systemd[1]: Reached target Host and Network Name Lookups. client # [ 9.793351] mousedev: PS/2 mouse device common for all mice lb # [ 9.806046] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 9.881819] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 9.921755] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 9.858843] systemd[1]: Finished Coldplug All udev Devices. lb # [ 9.896658] systemd[1]: Finished resolvconf update. lb # [ 9.909927] systemd[1]: Starting DHCP Client... client # [ 9.894561] systemd-vconsole-setup[385]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 9.901680] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.928740] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 9.961639] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 10.084701] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 10.130965] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 10.098990] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.101043] systemd[1]: Reached target System Initialization. worker1 # [ 10.102600] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 10.198666] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.105499] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 10.199665] systemd[1]: Reached target System Initialization. worker2 # [ 10.200786] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 10.203228] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 10.206100] systemd[1]: Reached target Timer Units. worker1 # [ 10.112656] systemd[1]: Reached target Timer Units. worker2 # [ 10.211192] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 10.122550] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 10.217149] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 10.130265] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 10.131112] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 10.225992] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 10.131967] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 10.150967] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 10.242660] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 10.154266] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.157388] systemd[1]: Reached target System Initialization. worker1 # [ 10.153515] systemd[1]: Reached target Socket Units. client # [ 10.160310] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 10.252190] systemd[1]: Reached target Socket Units. client # [ 10.164228] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 10.160097] systemd[1]: Reached target Basic System. client # [ 10.166864] systemd[1]: Reached target Timer Units. worker2 # [ 10.256567] systemd[1]: Reached target Basic System. client # [ 10.169270] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 10.199022] dhcpcd[591]: dhcpcd-10.3.2 starting client # [ 10.172710] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 10.169065] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 10.265649] systemd[1]: Started backdoor.service. client # [ 10.175543] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 10.180234] systemd[1]: Reached target Socket Units. client # [ 10.180982] systemd[1]: Reached target Basic System. client # [ 10.181720] systemd[1]: Started backdoor.service. worker2 # [ 10.271078] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 10.182422] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 10.183406] systemd[1]: Starting nftables firewall... worker1 # [ 10.180596] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 10.215445] dhcpcd[608]: dev: loaded udev worker2 # [ 10.284271] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 10.222694] dhcpcd[608]: no valid interfaces found lb # [ 10.223515] dhcpcd[608]: no valid interfaces found lb # [ 10.228263] dhcpcd[608]: libudev: received NULL device worker1 # [ 10.196491] systemd[1]: Starting Post-Boot Actions... lb # [ 10.229211] dhcpcd[608]: libudev: received NULL device client # [ 10.202992] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.202255] systemd[1]: Started Reset console on configuration changes. worker2 # [ 10.299207] systemd[1]: Starting Post-Boot Actions... worker1 # [ 10.210060] systemd[1]: Starting resolvconf update... worker2 # [ 10.304447] systemd[1]: Started Reset console on configuration changes. worker1 # [ 10.220472] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 10.315294] systemd[1]: Starting resolvconf update... lb # [ 10.253543] systemd[1]: Starting Virtual Console Setup... client # [ 10.226371] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.323729] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 10.252314] systemd[1]: Finished Post-Boot Actions. client # [ 10.259872] systemd[1]: Started Reset console on configuration changes. lb # [ 10.293372] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 10.261636] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 10.360512] systemd[1]: Finished Post-Boot Actions. lb # [ 10.299667] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 10.277221] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.280643] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 10.314771] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 10.292681] nsncd[487]: Sep 22 15:04:41.878 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 10.326319] systemd[1]: Starting Virtual Console Setup... client # [ 10.299193] systemd[1]: Starting resolvconf update... worker2 # [ 10.403669] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.312320] systemd[1]: Reached target User and Group Name Lookups. worker2 # connecting to host... worker2 # [ 10.412000] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.320300] systemd[1]: Starting User Login Management... worker1 # [ 10.326519] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 10.419722] nsncd[490]: Sep 22 15:04:42.026 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 10.331863] systemd[1]: Started backdoor.service. client # connecting to host... worker2 # [ 10.438513] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 10.439443] systemd[1]: Starting User Login Management... worker1 # [ 10.349547] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 10.369987] systemd[1]: Finished Post-Boot Actions. worker2 # [ 10.462120] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 10.377771] dbus-broker-launch[491]: Looking up NSS user entry for 'systemd-timesync'... client # [ 10.382681] nsncd[456]: Sep 22 15:04:41.991 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 10.388374] dbus-broker-launch[491]: NSS returned no entry for 'systemd-timesync' client # [ 10.393414] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.488514] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 10.394368] dbus-broker-launch[491]: Invalid user-name in /nix/store/flsxa7d757b7zpdiv9wsbs42iawcisak-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 10.411050] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 10.419815] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.414195] systemd[1]: Started D-Bus System Message Bus. client # [ 10.423982] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 10.500834] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' lb # [ 10.469468] systemd[1]: Finished Firewall. worker2 # [ 10.501820] dbus-broker-launch[494]: Invalid user-name in /nix/store/flsxa7d757b7zpdiv9wsbs42iawcisak-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 10.431646] systemd[1]: Starting D-Bus System Message Bus... client: connected to guest root shell lb # [ 10.472436] systemd[1]: Reached target Preparation for Network. worker1 # connecting to host... client: (connecting took 10.86 seconds) lb # [ 10.479943] systemd[1]: Starting Extra networking commands.... worker2 # [ 10.524554] systemd[1]: Started D-Bus System Message Bus. client # [ 10.445212] systemd[1]: Starting User Login Management... client: (finished: waiting for the VM to finish booting, in 10.86 seconds) worker2 # [ 10.567253] (udev-worker)[422]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 10.476405] dbus-broker-launch[491]: Ready worker2 # [ 10.572522] dbus-broker-launch[494]: Ready worker2 # [ 10.581744] (udev-worker)[421]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 10.583869] (udev-worker)[421]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 10.612854] systemd-logind[504]: New seat seat0. worker1 # [ 10.528362] systemd-logind[509]: New seat seat0. worker2 # [ 10.624369] systemd[1]: Started User Login Management. worker2 # [ 10.625255] systemd[1]: Starting linger-users.service... worker1 # [ 10.536298] systemd[1]: Started User Login Management. worker1 # [ 10.540133] systemd[1]: Starting linger-users.service... worker2 # [ 10.658869] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 10.659923] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 10.566021] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 10.567055] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 10.581115] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 10.677743] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 10.678729] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 10.679553] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 10.589738] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 10.590600] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 10.591471] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 10.599719] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 10.695338] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 10.603372] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 10.700072] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 10.700955] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 10.722545] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 10.630706] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 10.631684] systemd[1]: Finished linger-users.service. worker2 # [ 10.729637] systemd[1]: Finished linger-users.service. lb # [ 10.682644] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 10.665320] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.666574] nsncd[562]: Sep 22 15:04:42.265 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 10.676364] systemd-logind[486]: New seat seat0. worker1 # [ 10.675881] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.679723] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 10.774326] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.775602] nsncd[565]: Sep 22 15:04:42.393 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 10.688585] systemd-logind[486]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 10.785121] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 10.786077] systemd[1]: Reached target User and Group Name Lookups. client # [ 10.696413] systemd-logind[486]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 10.724001] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client # [ 10.697586] systemd[1]: Started User Login Management. worker1 # [ 10.693387] systemd[1]: Finished resolvconf update. worker1 # [ 10.695145] systemd[1]: Reached target Preparation for Network. worker1 # [ 10.701711] systemd[1]: Starting DHCP Client... lb # [ 10.734898] systemd[1]: Started backdoor.service. client # [ 10.712038] systemd[1]: Starting linger-users.service... worker1 # [ 10.709107] systemd[1]: Starting Extra networking commands.... worker2 # [ 10.803413] systemd[1]: Finished resolvconf update. client # [ 10.716327] dbus-broker-launch[485]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 10.809804] systemd[1]: Reached target Preparation for Network. worker2 # [ 10.810712] systemd[1]: Starting DHCP Client... worker2 # [ 10.811383] systemd[1]: Starting Extra networking commands.... client # [ 10.736821] dbus-broker-launch[485]: NSS returned no entry for 'systemd-timesync' client # [ 10.737964] dbus-broker-launch[485]: Invalid user-name in /nix/store/6wvgzhp3xj1v1xybf1ixpbqi5gif5fbv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 10.734875] (udev-worker)[345]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 10.760832] (udev-worker)[338]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 10.762966] (udev-worker)[338]: Network interface NamePolicy= disabled on kernel command line. client # [ 10.783454] systemd[1]: Started D-Bus System Message Bus. client # [ 10.800133] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 10.801113] systemd[1]: Stopping Host and Network Name Lookups... client # [ 10.801946] systemd[1]: Stopped target User and Group Name Lookups. client # [ 10.802799] systemd[1]: Stopping User and Group Name Lookups... client # [ 10.818299] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 10.819290] systemd[1]: nscd.service: Deactivated successfully. lb # connecting to host... client # [ 10.830167] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 10.837360] dbus-broker-launch[485]: Ready lb # [ 10.867319] systemd[1]: Finished Extra networking commands.. client # [ 10.841794] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 10.870208] systemd[1]: Reached target Network. client # [ 10.846818] systemd[1]: Finished linger-users.service. client # [ 10.855481] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 10.888158] systemd[1]: Starting PostgreSQL Server... lb # [ 10.899406] (udev-worker)[399]: Network interface NamePolicy= disabled on kernel command line. lb # [ 10.919554] 8021q: 802.1Q VLAN Support v1.8 lb # [ 10.912746] systemd[1]: Starting Permit User Sessions... lb # [ 10.916589] (udev-worker)[406]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 10.930528] (udev-worker)[406]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 10.998086] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 11.011298] systemd[1]: Starting Address configuration of eth1... client # [ 10.927535] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 10.934778] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.935634] dhcpcd[596]: dhcpcd-10.3.2 starting client # [ 10.939337] nsncd[551]: Sep 22 15:04:42.540 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 10.946612] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.946792] dhcpcd[635]: dev: loaded udev worker2 # [ 11.041945] dhcpcd[599]: dhcpcd-10.3.2 starting client # [ 10.961879] systemd[1]: Finished resolvconf update. client # [ 10.968154] systemd[1]: Starting DHCP Client... worker2 # [ 11.059051] dhcpcd[638]: dev: loaded udev worker1 # [ 10.990518] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 11.102877] 8021q: 802.1Q VLAN Support v1.8 lb # [ 11.034160] systemd[1]: Finished Permit User Sessions. lb # [ 11.036544] systemd[1]: Started Getty on tty1. lb # [ 11.042312] systemd[1]: Reached target Login Prompts. worker2 # [ 11.130119] systemd-logind[504]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 11.076646] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 11.083920] systemd[1]: Starting Address configuration of eth1... worker1 # [ 11.052398] systemd[1]: Finished Extra networking commands.. worker1 # [ 11.057498] systemd[1]: Reached target Network. worker1 # [ 11.065299] systemd[1]: Starting Permit User Sessions... worker2 # [ 11.175406] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 11.173884] systemd[1]: Finished Extra networking commands.. worker2 # [ 11.174824] systemd[1]: Reached target Network. worker1 # [ 11.099150] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 11.130617] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 11.186190] systemd[1]: Starting Permit User Sessions... worker2 # [ 11.212486] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 11.132033] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 11.132536] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 11.215263] network-addresses-eth1-start[627]: adding address 192.168.1.4/24... done worker1 # [ 11.136229] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 11.136568] cfg80211: failed to load regulatory.db lb # [ 11.176786] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 11.246069] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 11.246580] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 11.181202] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 11.249571] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 11.183362] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 11.249896] cfg80211: failed to load regulatory.db lb # [ 11.183682] cfg80211: failed to load regulatory.db worker1 # [ 11.142731] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 11.152432] dhcpcd[585]: dhcpcd-10.3.2 starting worker1 # [ 11.152354] systemd[1]: Starting Address configuration of eth1... worker1 # [ 11.153284] systemd[1]: Finished Permit User Sessions. worker1 # [ 11.153986] systemd[1]: Started Getty on tty1. worker2 # [ 11.247885] network-addresses-eth1-start[627]: adding address 2001:db8:1::4/64... done worker1 # [ 11.154617] systemd[1]: Reached target Login Prompts. client # [ 11.161471] dhcpcd[600]: dev: loaded udev worker2 # [ 11.273764] systemd[1]: Finished Permit User Sessions. worker2 # [ 11.278709] systemd[1]: Started Getty on tty1. worker2 # [ 11.279431] systemd[1]: Reached target Login Prompts. lb # [ 11.238286] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 11.289185] systemd[1]: Finished Address configuration of eth1. client # [ 11.217976] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 11.236012] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 11.254286] systemd-vconsole-setup[617]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 11.224983] dhcpcd[635]: eth0: waiting for carrier worker1 # [ 11.231537] dhcpcd[635]: eth0: waiting for carrier lb # [ 11.263183] network-addresses-eth1-start[694]: adding address 192.168.1.2/24... done worker2 # [ 11.342566] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 11.234173] dhcpcd[635]: eth0: carrier acquired worker2 # [ 11.329110] dhcpcd[638]: eth0: waiting for carrier worker2 # [ 11.329937] dhcpcd[638]: eth0: waiting for carrier worker2 # [ 11.330608] dhcpcd[638]: eth0: carrier acquired lb # [ 11.271468] systemd[1]: Finished Virtual Console Setup. worker1 # [ 11.246865] dhcpcd[635]: DUID 00:01:00:01:32:45:55:8a:52:54:00:12:34:56 worker1 # [ 11.247857] dhcpcd[635]: eth0: IAID 00:12:34:56 worker2 # [ 11.342062] dhcpcd[638]: DUID 00:01:00:01:32:45:55:8a:52:54:00:12:34:56 worker2 # [ 11.343095] dhcpcd[638]: eth0: IAID 00:12:34:56 worker2 # [ 11.343724] dhcpcd[638]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 11.251421] dhcpcd[635]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 11.287043] network-addresses-eth1-start[694]: adding address 2001:db8:1::2/64... done worker1 # [ 11.269644] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 11.376792] mousedev: PS/2 mouse device common for all mice worker1 # [ 11.266788] systemd-logind[509]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 11.270866] network-addresses-eth1-start[657]: adding address 192.168.1.3/24... done worker1 # [ 11.282042] network-addresses-eth1-start[657]: adding address 2001:db8:1::3/64... done lb # [ 11.330652] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 11.322037] dhcpcd[608]: eth0: waiting for carrier lb # [ 11.325221] dhcpcd[608]: eth0: carrier acquired worker2 # [ 11.394313] dhcpcd[638]: eth0: soliciting a DHCP lease lb # [ 11.332902] systemd[1]: Finished Address configuration of eth1. worker1 # [ 11.302731] systemd[1]: Finished Address configuration of eth1. worker2 # [ 11.397405] dhcpcd[638]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 11.404348] dhcpcd[638]: eth0: probing address 10.0.2.15/24 lb # [ 11.346087] dhcpcd[608]: DUID 00:01:00:01:32:45:55:8a:52:54:00:12:34:56 lb # [ 11.347031] dhcpcd[608]: eth0: IAID 00:12:34:56 lb # [ 11.347664] dhcpcd[608]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 11.336063] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 11.353704] postgresql-pre-start[698]: The files belonging to this database system will be owned by user "postgres". lb # [ 11.355111] postgresql-pre-start[698]: This user must also own the server process. lb # [ 11.368505] postgresql-pre-start[698]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 11.370658] postgresql-pre-start[698]: The default database encoding has accordingly been set to "UTF8". lb # [ 11.371868] postgresql-pre-start[698]: The default text search configuration will be set to "english". lb # [ 11.376223] postgresql-pre-start[698]: Data page checksums are enabled. lb # [ 11.377171] postgresql-pre-start[698]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 11.378400] postgresql-pre-start[698]: creating subdirectories ... ok lb # [ 11.379256] postgresql-pre-start[698]: selecting dynamic shared memory implementation ... posix client # [ 11.390653] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 11.391155] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 11.395437] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 11.395763] cfg80211: failed to load regulatory.db worker1 # [ 11.404137] mousedev: PS/2 mouse device common for all mice worker2 # [ 11.530474] systemd-logind[504]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 11.443361] systemd-logind[509]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 11.454467] systemd[1]: Finished nftables firewall. client # [ 11.456993] systemd[1]: Reached target Preparation for Network. client # [ 11.465269] systemd[1]: Starting Address configuration of eth1... client # [ 11.472114] systemd[1]: Starting Extra networking commands.... client # [ 11.501094] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 11.513348] postgresql-pre-start[698]: selecting default "max_connections" ... 100 client # [ 11.487047] dhcpcd[600]: eth0: waiting for carrier client # [ 11.494159] dhcpcd[600]: libudev: received NULL device client # [ 11.494984] dhcpcd[600]: libudev: received NULL device client # [ 11.504212] dhcpcd[600]: eth0: carrier acquired client # [ 11.519832] dhcpcd[600]: DUID 00:01:00:01:32:45:55:8b:52:54:00:12:34:56 client # [ 11.521117] dhcpcd[600]: eth0: IAID 00:12:34:56 client # [ 11.521784] dhcpcd[600]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 11.596402] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 11.629456] systemd-logind[471]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 11.605092] network-addresses-eth1-start[623]: adding address 192.168.1.1/24... done lb # [ 11.651044] postgresql-pre-start[698]: selecting default "shared_buffers" ... 128MB client # [ 11.631110] network-addresses-eth1-start[623]: adding address 2001:db8:1::1/64... done lb # [ 11.689271] mousedev: PS/2 mouse device common for all mice client # [ 11.660147] systemd[1]: Finished Address configuration of eth1. client # [ 11.732378] systemd[1]: Finished Extra networking commands.. client # [ 11.736449] systemd[1]: Reached target Network. client # [ 11.741552] systemd[1]: Starting Permit User Sessions... client # [ 11.797589] systemd[1]: Finished Permit User Sessions. client # [ 11.806400] systemd[1]: Started Getty on tty1. client # [ 11.810141] systemd[1]: Reached target Login Prompts. worker1 # [ 11.816134] dhcpcd[635]: eth0: soliciting a DHCP lease lb # [ 11.849145] systemd-logind[471]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 11.824593] dhcpcd[635]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 11.832237] dhcpcd[635]: eth0: probing address 10.0.2.15/24 client: (finished: waiting for unit network-addresses-eth1.service, in 12.27 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb: (finished: waiting for unit network-addresses-eth1.service, in 0.07 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker2 # [ 12.140883] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 12.197101] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 lb # [ 12.240386] dhcpcd[608]: eth0: soliciting a DHCP lease client # [ 12.220192] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 12.248486] dhcpcd[608]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 12.221364] systemd[1]: Stopped Virtual Console Setup. client # [ 12.222083] systemd[1]: Stopping Virtual Console Setup... client # [ 12.228232] systemd[1]: Starting Virtual Console Setup... lb # [ 12.256222] dhcpcd[608]: eth0: probing address 10.0.2.15/24 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } client # [ 12.246517] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 12.251655] systemd[1]: Stopped Virtual Console Setup. client # [ 12.254279] systemd[1]: Starting Virtual Console Setup... worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds) lb: waiting for unit niks3.service client # [ 12.303270] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 12.307421] systemd-logind[486]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 12.389803] systemd-vconsole-setup[701]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 12.393986] systemd[1]: Finished Virtual Console Setup. worker2 # [ 12.501189] systemd[1]: Starting Virtual Console Setup... worker2 # [ 12.527935] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 12.533946] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 12.535053] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 12.544113] systemd[1]: Starting Virtual Console Setup... worker1 # [ 12.511269] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 12.525399] systemd[1]: Starting Virtual Console Setup... worker2 # [ 12.622587] systemd-logind[504]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 12.544337] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 12.550397] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 12.551197] systemd[1]: Starting Virtual Console Setup... worker2 # [ 12.689769] systemd-vconsole-setup[702]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 12.599550] systemd-logind[509]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 12.694402] systemd[1]: Finished Virtual Console Setup. worker1 # [ 12.686661] systemd-vconsole-setup[701]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 12.692232] systemd[1]: Finished Virtual Console Setup. worker2 # [ 12.832661] dhcpcd[638]: eth0: soliciting an IPv6 router worker2 # [ 12.833803] dhcpcd[638]: eth0: Router Advertisement from fe80::2 worker2 # [ 12.834957] dhcpcd[638]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 12.836438] dhcpcd[638]: eth0: adding route to fec0::/64 worker2 # [ 12.837465] dhcpcd[638]: eth0: adding default route via fe80::2 lb # [ 13.041981] dhcpcd[608]: eth0: soliciting an IPv6 router lb # [ 13.042488] dhcpcd[608]: eth0: Router Advertisement from fe80::2 lb # [ 13.042549] dhcpcd[608]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 13.042592] dhcpcd[608]: eth0: adding route to fec0::/64 lb # [ 13.042631] dhcpcd[608]: eth0: adding default route via fe80::2 lb # [ 13.059868] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 13.064239] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 13.067923] systemd[1]: Stopped Virtual Console Setup. lb # [ 13.069710] systemd[1]: Stopping Virtual Console Setup... lb # [ 13.072581] systemd[1]: Starting Virtual Console Setup... client # [ 13.099452] dhcpcd[600]: eth0: soliciting a DHCP lease client # [ 13.102709] dhcpcd[600]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 13.136714] systemd-logind[471]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 13.108487] dhcpcd[600]: eth0: probing address 10.0.2.15/24 lb # [ 13.276088] systemd-vconsole-setup[758]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 13.279226] systemd[1]: Finished Virtual Console Setup. worker1 # [ 13.534703] dhcpcd[635]: eth0: soliciting an IPv6 router worker1 # [ 13.538217] dhcpcd[635]: eth0: Router Advertisement from fe80::2 worker1 # [ 13.541123] dhcpcd[635]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 13.543924] dhcpcd[635]: eth0: adding route to fec0::/64 worker1 # [ 13.546320] dhcpcd[635]: eth0: adding default route via fe80::2 lb # [ 13.609778] postgresql-pre-start[698]: selecting default time zone ... UTC lb # [ 13.612694] postgresql-pre-start[698]: creating configuration files ... ok client # [ 13.647243] dhcpcd[600]: eth0: soliciting an IPv6 router client # [ 13.651190] dhcpcd[600]: eth0: Router Advertisement from fe80::2 client # [ 13.653905] dhcpcd[600]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 13.657237] dhcpcd[600]: eth0: adding route to fec0::/64 client # [ 13.659448] dhcpcd[600]: eth0: adding default route via fe80::2 lb # [ 13.838761] postgresql-pre-start[698]: running bootstrap script ... ok lb # [ 14.376267] postgresql-pre-start[698]: performing post-bootstrap initialization ... ok lb # [ 14.542257] postgresql-pre-start[698]: syncing data to disk ... ok lb # [ 14.544588] postgresql-pre-start[698]: initdb: warning: enabling "trust" authentication for local connections lb # [ 14.545905] postgresql-pre-start[698]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 14.547873] postgresql-pre-start[698]: Success. You can now start the database server using: lb # [ 14.549112] postgresql-pre-start[698]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 14.705917] postgres[782]: [782] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 14.710208] postgres[782]: [782] LOG: listening on IPv6 address "::1", port 5432 lb # [ 14.711504] postgres[782]: [782] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 14.715737] postgres[782]: [782] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 14.730332] postgres[801]: [801] LOG: database system was shut down at 2026-09-22 15:04:45 GMT lb # [ 14.737773] postgres[782]: [782] LOG: database system is ready to accept connections lb # [ 14.742773] systemd[1]: Started PostgreSQL Server. lb # [ 14.751399] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 14.915733] postgresql-setup-start[812]: CREATE DATABASE lb # [ 14.954616] postgresql-setup-start[817]: CREATE ROLE lb # [ 14.971280] postgresql-setup-start[819]: ALTER DATABASE lb # [ 14.977056] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 14.978924] systemd[1]: Reached target PostgreSQL. worker2 # [ 16.378668] dhcpcd[638]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 16.382367] dhcpcd[638]: eth0: adding route to 10.0.2.0/24 worker2 # [ 16.387721] dhcpcd[638]: eth0: adding default route via 10.0.2.2 worker2 # [ 16.517363] systemd[1]: Started DHCP Client. worker2 # [ 16.519265] systemd[1]: Reached target Multi-User System. worker2 # [ 16.520493] systemd[1]: Startup finished in 948ms (kernel) + 5.000s (initrd) + 10.570s (userspace) = 16.519s. worker1 # [ 16.465812] dhcpcd[635]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 16.469103] dhcpcd[635]: eth0: adding route to 10.0.2.0/24 worker1 # [ 16.471435] dhcpcd[635]: eth0: adding default route via 10.0.2.2 worker1 # [ 16.620916] systemd[1]: Started DHCP Client. worker1 # [ 16.623238] systemd[1]: Reached target Multi-User System. worker1 # [ 16.624831] systemd[1]: Startup finished in 966ms (kernel) + 4.990s (initrd) + 10.665s (userspace) = 16.622s. client # [ 17.294888] dhcpcd[600]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 17.298182] dhcpcd[600]: eth0: adding route to 10.0.2.0/24 client # [ 17.302625] dhcpcd[600]: eth0: adding default route via 10.0.2.2 lb # [ 17.334739] dhcpcd[608]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 17.337004] dhcpcd[608]: eth0: adding route to 10.0.2.0/24 lb # [ 17.338666] dhcpcd[608]: eth0: adding default route via 10.0.2.2 lb # [ 17.429158] systemd[1]: Started DHCP Client. lb # [ 17.432706] systemd[1]: Reached target Network is Online. lb # [ 17.435347] systemd[1]: Started Envoy reverse proxy. lb # [ 17.444405] systemd[1]: Started mock-oidc.service. client # [ 17.443775] systemd[1]: Started DHCP Client. client # [ 17.447042] systemd[1]: Reached target Multi-User System. client # [ 17.449116] systemd[1]: Startup finished in 957ms (kernel) + 4.181s (initrd) + 12.309s (userspace) = 17.448s. lb # [ 17.632538] mock-oidc-server[896]: Mock OIDC Server running lb # [ 17.634089] mock-oidc-server[896]: OIDC Address: 192.168.1.2:8080 lb # [ 17.635781] mock-oidc-server[896]: Issue Address: 0.0.0.0:8081 lb # [ 17.637046] mock-oidc-server[896]: Issuer: http://192.168.1.2:8080/oidc lb # [ 17.638245] mock-oidc-server[896]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 17.639651] mock-oidc-server[896]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 17.641380] mock-oidc-server[896]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 17.868624] envoy[895]: [2026-09-22 15:04:49.480][895][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 17.871640] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 17.873487] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 17.875583] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 17.878593] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 17.884928] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 17.914859] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 17.924704] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 17.928226] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 17.931056] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 17.939002] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 17.949701] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 17.961497] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 17.963991] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 17.974631] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 17.984838] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 17.995811] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 18.001389] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 18.014960] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 18.017764] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 18.022678] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 18.026576] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 18.029155] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 18.037299] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 18.040610] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 18.042664] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 18.045457] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 18.052208] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 18.054159] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 18.055771] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter worker2 # [ 18.118478] systemd[1]: Reached target Network is Online. lb # [ 18.063492] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 worker2 # [ 18.131800] systemd[1]: Starting scheduler-token.service... lb # [ 18.070289] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts worker1 # [ 18.040629] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 18.078859] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 18.082509] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 18.089294] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 18.093091] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 18.095104] envoy[895]: [2026-09-22 15:04:49.482][895][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 18.105943] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 18.124618] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 18.126718] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 18.129448] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 18.131115] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 18.134184] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 18.165746] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 18.179428] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 18.181853] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 18.184856] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 18.186815] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header worker2 # [ 18.251554] systemd[1]: scheduler-token.service: Deactivated successfully. lb # [ 18.189844] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 18.192278] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple worker2 # [ 18.256844] systemd[1]: Finished scheduler-token.service. lb # [ 18.194637] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 18.197827] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default worker2 # [ 18.258570] systemd[1]: scheduler-token.service: Consumed 77ms CPU time over 124ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb # [ 18.199850] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 18.202803] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 18.204550] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 18.207385] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 18.211673] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 18.214712] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 18.221120] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua worker2 # [ 18.283865] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 18.222780] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 18.225556] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 18.236609] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 18.238485] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 18.241094] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 18.242904] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 18.246775] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 18.249428] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 18.254942] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 18.259694] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 18.267397] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 18.269325] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 18.270905] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 worker1 # [ 18.240719] nix-grpc-daemon[766]: ts=2026-09-22T15:04:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb # [ 18.273209] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 18.275532] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 18.277570] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 18.279372] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain worker1 # [ 18.249311] nix-grpc-daemon[766]: ts=2026-09-22T15:04:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc lb # [ 18.282050] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe worker1 # [ 18.251507] nix-grpc-daemon[766]: ts=2026-09-22T15:04:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 18.284733] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 18.287690] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 18.289796] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 18.292888] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json worker1 # [ 18.262584] nix-grpc-daemon[766]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR lb # [ 18.294671] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd worker1 # [ 18.266024] nix-grpc-daemon[766]: E0000 00:00:1790089489.862529 766 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 18.271107] nix-grpc-daemon[766]: E0000 00:00:1790089489.871523 766 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 18.300379] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 18.320186] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 18.327398] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 worker1 # [ 18.295687] nix-grpc-daemon[766]: ts=2026-09-22T15:04:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 18.329289] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation worker1 # [ 18.299808] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 18.332544] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 18.335562] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 18.338362] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 18.340535] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 18.343063] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 18.352132] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name worker1 # [ 18.303740] nix-grpc-daemon[766]: E0000 00:00:1790089489.902769 807 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 18.354615] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 18.357476] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 18.359322] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 18.363434] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection worker2 # [ 18.426117] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 18.332203] nix-grpc-daemon[766]: E0000 00:00:1790089489.923936 807 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 18.365812] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder worker1 # [ 18.334523] nix-grpc-daemon[766]: E0000 00:00:1790089489.924446 807 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 18.368171] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 18.371602] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret worker2 # [ 18.434839] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 18.436841] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 18.373689] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 18.377253] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 18.379724] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy worker1 # [ 18.349844] nix-grpc-daemon[766]: E0000 00:00:1790089489.948819 807 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 18.382850] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff worker2 # [ 18.449806] nix-grpc-daemon[771]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR lb # [ 18.387505] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based worker2 # [ 18.453289] nix-grpc-daemon[771]: E0000 00:00:1790089490.069095 771 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 18.393361] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case worker1 # [ 18.363759] nix-grpc-daemon[766]: ts=2026-09-22T15:04:49Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.458777] nix-grpc-daemon[771]: E0000 00:00:1790089490.078199 771 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 18.396238] envoy[895]: [2026-09-22 15:04:49.483][895][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 18.401532] envoy[895]: [2026-09-22 15:04:49.510][895][info][main] [source/server/server.cc:531] HTTP header map info: worker1 # [ 18.371914] nix-grpc-daemon[766]: ts=2026-09-22T15:04:49Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.476379] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 18.478396] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 18.403390] envoy[895]: [2026-09-22 15:04:49.511][895][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 18.423286] envoy[895]: [2026-09-22 15:04:49.511][895][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 18.426547] envoy[895]: [2026-09-22 15:04:49.511][895][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 18.436053] envoy[895]: [2026-09-22 15:04:49.511][895][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 18.438345] envoy[895]: [2026-09-22 15:04:49.578][895][info][main] [source/server/server.cc:968] runtime: {} lb # [ 18.439964] envoy[895]: [2026-09-22 15:04:49.583][895][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 18.441815] envoy[895]: [2026-09-22 15:04:49.583][895][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 18.443410] envoy[895]: [2026-09-22 15:04:49.588][895][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 18.445166] envoy[895]: [2026-09-22 15:04:49.589][895][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration worker2 # [ 18.491430] nix-grpc-daemon[771]: E0000 00:00:1790089490.101251 813 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 18.446742] envoy[895]: [2026-09-22 15:04:49.589][895][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 18.448317] envoy[895]: [2026-09-22 15:04:49.589][895][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 18.449888] envoy[895]: [2026-09-22 15:04:49.662][895][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 18.451393] envoy[895]: [2026-09-22 15:04:49.676][895][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 18.453100] envoy[895]: [2026-09-22 15:04:49.677][895][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 18.456219] envoy[895]: [2026-09-22 15:04:49.677][895][info][main] [source/server/server.cc:1077] starting main dispatch loop lb # [ 18.457665] envoy[895]: [2026-09-22 15:04:49.950][895][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 18.459324] envoy[895]: [2026-09-22 15:04:49.950][895][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 18.461260] envoy[895]: [2026-09-22 15:04:49.950][895][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker2 # [ 18.523168] nix-grpc-daemon[771]: E0000 00:00:1790089490.128906 813 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 18.462981] envoy[895]: [2026-09-22 15:04:49.974][895][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 18.530552] nix-grpc-daemon[771]: E0000 00:00:1790089490.129381 813 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 18.533499] nix-grpc-daemon[771]: E0000 00:00:1790089490.149322 813 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 18.541799] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.543528] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.573786] nix-grpc-daemon[766]: ts=2026-09-22T15:04:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.579697] nix-grpc-daemon[766]: ts=2026-09-22T15:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.745648] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.751909] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.780784] nix-grpc-daemon[766]: ts=2026-09-22T15:04:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.786412] nix-grpc-daemon[766]: ts=2026-09-22T15:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 18.953381] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 18.959239] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 18.987394] nix-grpc-daemon[766]: ts=2026-09-22T15:04:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 18.993085] nix-grpc-daemon[766]: ts=2026-09-22T15:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.160508] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.165855] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.194199] nix-grpc-daemon[766]: ts=2026-09-22T15:04:50Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.199704] nix-grpc-daemon[766]: ts=2026-09-22T15:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.368366] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.373967] nix-grpc-daemon[771]: ts=2026-09-22T15:04:50Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.403191] nix-grpc-daemon[766]: ts=2026-09-22T15:04:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.408123] nix-grpc-daemon[766]: ts=2026-09-22T15:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.576829] nix-grpc-daemon[771]: ts=2026-09-22T15:04:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.581884] nix-grpc-daemon[771]: ts=2026-09-22T15:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.603846] nix-grpc-daemon[766]: ts=2026-09-22T15:04:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.609616] nix-grpc-daemon[766]: ts=2026-09-22T15:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.783255] nix-grpc-daemon[771]: ts=2026-09-22T15:04:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.788757] nix-grpc-daemon[771]: ts=2026-09-22T15:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.811318] nix-grpc-daemon[766]: ts=2026-09-22T15:04:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.817962] nix-grpc-daemon[766]: ts=2026-09-22T15:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.990515] nix-grpc-daemon[771]: ts=2026-09-22T15:04:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.996407] nix-grpc-daemon[771]: ts=2026-09-22T15:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.018994] nix-grpc-daemon[766]: ts=2026-09-22T15:04:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.024522] nix-grpc-daemon[766]: ts=2026-09-22T15:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.198112] nix-grpc-daemon[771]: ts=2026-09-22T15:04:51Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.203478] nix-grpc-daemon[771]: ts=2026-09-22T15:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.226662] nix-grpc-daemon[766]: ts=2026-09-22T15:04:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.232674] nix-grpc-daemon[766]: ts=2026-09-22T15:04:51Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.405202] nix-grpc-daemon[771]: ts=2026-09-22T15:04:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.411287] nix-grpc-daemon[771]: ts=2026-09-22T15:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.436822] nix-grpc-daemon[766]: ts=2026-09-22T15:04:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.441215] nix-grpc-daemon[766]: ts=2026-09-22T15:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.616714] nix-grpc-daemon[771]: ts=2026-09-22T15:04:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.621278] nix-grpc-daemon[771]: ts=2026-09-22T15:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.638183] nix-grpc-daemon[766]: ts=2026-09-22T15:04:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.644530] nix-grpc-daemon[766]: ts=2026-09-22T15:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.819430] nix-grpc-daemon[771]: ts=2026-09-22T15:04:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.825256] nix-grpc-daemon[771]: ts=2026-09-22T15:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.846132] nix-grpc-daemon[766]: ts=2026-09-22T15:04:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.852183] nix-grpc-daemon[766]: ts=2026-09-22T15:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.022602] nix-grpc-daemon[771]: ts=2026-09-22T15:04:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.028522] nix-grpc-daemon[771]: ts=2026-09-22T15:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.053194] nix-grpc-daemon[766]: ts=2026-09-22T15:04:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.061539] nix-grpc-daemon[766]: ts=2026-09-22T15:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.231035] nix-grpc-daemon[771]: ts=2026-09-22T15:04:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.241131] nix-grpc-daemon[771]: ts=2026-09-22T15:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.259403] nix-grpc-daemon[766]: ts=2026-09-22T15:04:52Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.266648] nix-grpc-daemon[766]: ts=2026-09-22T15:04:52Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.443064] nix-grpc-daemon[771]: ts=2026-09-22T15:04:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.449044] nix-grpc-daemon[771]: ts=2026-09-22T15:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.471499] nix-grpc-daemon[766]: ts=2026-09-22T15:04:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.476456] nix-grpc-daemon[766]: ts=2026-09-22T15:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.652987] nix-grpc-daemon[771]: ts=2026-09-22T15:04:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.657327] nix-grpc-daemon[771]: ts=2026-09-22T15:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.671562] nix-grpc-daemon[766]: ts=2026-09-22T15:04:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.677748] nix-grpc-daemon[766]: ts=2026-09-22T15:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.853911] nix-grpc-daemon[771]: ts=2026-09-22T15:04:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.859647] nix-grpc-daemon[771]: ts=2026-09-22T15:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.879100] nix-grpc-daemon[766]: ts=2026-09-22T15:04:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.885141] nix-grpc-daemon[766]: ts=2026-09-22T15:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.062314] nix-grpc-daemon[771]: ts=2026-09-22T15:04:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.068308] nix-grpc-daemon[771]: ts=2026-09-22T15:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.086901] nix-grpc-daemon[766]: ts=2026-09-22T15:04:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.092949] nix-grpc-daemon[766]: ts=2026-09-22T15:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.270233] nix-grpc-daemon[771]: ts=2026-09-22T15:04:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.276613] nix-grpc-daemon[771]: ts=2026-09-22T15:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.294838] nix-grpc-daemon[766]: ts=2026-09-22T15:04:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.300517] nix-grpc-daemon[766]: ts=2026-09-22T15:04:53Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.478763] nix-grpc-daemon[771]: ts=2026-09-22T15:04:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.484670] nix-grpc-daemon[771]: ts=2026-09-22T15:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.505343] nix-grpc-daemon[766]: ts=2026-09-22T15:04:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.509764] nix-grpc-daemon[766]: ts=2026-09-22T15:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.689557] nix-grpc-daemon[771]: ts=2026-09-22T15:04:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.693968] nix-grpc-daemon[771]: ts=2026-09-22T15:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.706046] nix-grpc-daemon[766]: ts=2026-09-22T15:04:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.712159] nix-grpc-daemon[766]: ts=2026-09-22T15:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.890942] nix-grpc-daemon[771]: ts=2026-09-22T15:04:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.896900] nix-grpc-daemon[771]: ts=2026-09-22T15:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.913734] nix-grpc-daemon[766]: ts=2026-09-22T15:04:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.919676] nix-grpc-daemon[766]: ts=2026-09-22T15:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.098863] nix-grpc-daemon[771]: ts=2026-09-22T15:04:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.104651] nix-grpc-daemon[771]: ts=2026-09-22T15:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.121559] nix-grpc-daemon[766]: ts=2026-09-22T15:04:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.127035] nix-grpc-daemon[766]: ts=2026-09-22T15:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.306574] nix-grpc-daemon[771]: ts=2026-09-22T15:04:54Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.312514] nix-grpc-daemon[771]: ts=2026-09-22T15:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.328093] nix-grpc-daemon[766]: ts=2026-09-22T15:04:54Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.333696] nix-grpc-daemon[766]: ts=2026-09-22T15:04:54Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.514081] nix-grpc-daemon[771]: ts=2026-09-22T15:04:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.523428] nix-grpc-daemon[771]: ts=2026-09-22T15:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.538387] nix-grpc-daemon[766]: ts=2026-09-22T15:04:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.542820] nix-grpc-daemon[766]: ts=2026-09-22T15:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.725388] nix-grpc-daemon[771]: ts=2026-09-22T15:04:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.730735] nix-grpc-daemon[771]: ts=2026-09-22T15:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.738866] nix-grpc-daemon[766]: ts=2026-09-22T15:04:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.744762] nix-grpc-daemon[766]: ts=2026-09-22T15:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.932544] nix-grpc-daemon[771]: ts=2026-09-22T15:04:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.937961] nix-grpc-daemon[771]: ts=2026-09-22T15:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.946659] nix-grpc-daemon[766]: ts=2026-09-22T15:04:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.952389] nix-grpc-daemon[766]: ts=2026-09-22T15:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.140185] nix-grpc-daemon[771]: ts=2026-09-22T15:04:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.145912] nix-grpc-daemon[771]: ts=2026-09-22T15:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.153671] nix-grpc-daemon[766]: ts=2026-09-22T15:04:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.159483] nix-grpc-daemon[766]: ts=2026-09-22T15:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.347829] nix-grpc-daemon[771]: ts=2026-09-22T15:04:55Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.354158] nix-grpc-daemon[771]: ts=2026-09-22T15:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.360830] nix-grpc-daemon[766]: ts=2026-09-22T15:04:55Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.369173] nix-grpc-daemon[766]: ts=2026-09-22T15:04:55Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.555710] nix-grpc-daemon[771]: ts=2026-09-22T15:04:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.562252] nix-grpc-daemon[771]: ts=2026-09-22T15:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.570952] nix-grpc-daemon[766]: ts=2026-09-22T15:04:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.575487] nix-grpc-daemon[766]: ts=2026-09-22T15:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.765978] nix-grpc-daemon[771]: ts=2026-09-22T15:04:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.770276] nix-grpc-daemon[771]: ts=2026-09-22T15:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.772925] nix-grpc-daemon[766]: ts=2026-09-22T15:04:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.778547] nix-grpc-daemon[766]: ts=2026-09-22T15:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.967301] nix-grpc-daemon[771]: ts=2026-09-22T15:04:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.973104] nix-grpc-daemon[771]: ts=2026-09-22T15:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.979917] nix-grpc-daemon[766]: ts=2026-09-22T15:04:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.985900] nix-grpc-daemon[766]: ts=2026-09-22T15:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.174580] nix-grpc-daemon[771]: ts=2026-09-22T15:04:56Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.180376] nix-grpc-daemon[771]: ts=2026-09-22T15:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.187269] nix-grpc-daemon[766]: ts=2026-09-22T15:04:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.192968] nix-grpc-daemon[766]: ts=2026-09-22T15:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.382082] nix-grpc-daemon[771]: ts=2026-09-22T15:04:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.387673] nix-grpc-daemon[771]: ts=2026-09-22T15:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.393798] nix-grpc-daemon[766]: ts=2026-09-22T15:04:56Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.399685] nix-grpc-daemon[766]: ts=2026-09-22T15:04:56Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.588637] nix-grpc-daemon[771]: ts=2026-09-22T15:04:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.593691] nix-grpc-daemon[771]: ts=2026-09-22T15:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.602756] nix-grpc-daemon[766]: ts=2026-09-22T15:04:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.606960] nix-grpc-daemon[766]: ts=2026-09-22T15:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.797062] nix-grpc-daemon[771]: ts=2026-09-22T15:04:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.801229] nix-grpc-daemon[771]: ts=2026-09-22T15:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.803319] nix-grpc-daemon[766]: ts=2026-09-22T15:04:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.808635] nix-grpc-daemon[766]: ts=2026-09-22T15:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.997784] nix-grpc-daemon[771]: ts=2026-09-22T15:04:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.002921] nix-grpc-daemon[771]: ts=2026-09-22T15:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.009696] nix-grpc-daemon[766]: ts=2026-09-22T15:04:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.015062] nix-grpc-daemon[766]: ts=2026-09-22T15:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.203969] nix-grpc-daemon[771]: ts=2026-09-22T15:04:57Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.209141] nix-grpc-daemon[771]: ts=2026-09-22T15:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.215791] nix-grpc-daemon[766]: ts=2026-09-22T15:04:57Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.221116] nix-grpc-daemon[766]: ts=2026-09-22T15:04:57Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.410077] nix-grpc-daemon[771]: ts=2026-09-22T15:04:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.415191] nix-grpc-daemon[771]: ts=2026-09-22T15:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.421936] nix-grpc-daemon[766]: ts=2026-09-22T15:04:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.427251] nix-grpc-daemon[766]: ts=2026-09-22T15:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.616508] nix-grpc-daemon[771]: ts=2026-09-22T15:04:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.621614] nix-grpc-daemon[771]: ts=2026-09-22T15:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.629858] nix-grpc-daemon[766]: ts=2026-09-22T15:04:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.634602] nix-grpc-daemon[766]: ts=2026-09-22T15:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.824501] nix-grpc-daemon[771]: ts=2026-09-22T15:04:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.828557] nix-grpc-daemon[771]: ts=2026-09-22T15:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.830743] nix-grpc-daemon[766]: ts=2026-09-22T15:04:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.836144] nix-grpc-daemon[766]: ts=2026-09-22T15:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.025225] nix-grpc-daemon[771]: ts=2026-09-22T15:04:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.030304] nix-grpc-daemon[771]: ts=2026-09-22T15:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.036974] nix-grpc-daemon[766]: ts=2026-09-22T15:04:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.042041] nix-grpc-daemon[766]: ts=2026-09-22T15:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.231591] nix-grpc-daemon[771]: ts=2026-09-22T15:04:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.237081] nix-grpc-daemon[771]: ts=2026-09-22T15:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.243074] nix-grpc-daemon[766]: ts=2026-09-22T15:04:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.248374] nix-grpc-daemon[766]: ts=2026-09-22T15:04:58Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.438216] nix-grpc-daemon[771]: ts=2026-09-22T15:04:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.443392] nix-grpc-daemon[771]: ts=2026-09-22T15:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.449164] nix-grpc-daemon[766]: ts=2026-09-22T15:04:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.454331] nix-grpc-daemon[766]: ts=2026-09-22T15:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.644372] nix-grpc-daemon[771]: ts=2026-09-22T15:04:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.649354] nix-grpc-daemon[771]: ts=2026-09-22T15:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.657747] nix-grpc-daemon[766]: ts=2026-09-22T15:04:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.668296] nix-grpc-daemon[766]: ts=2026-09-22T15:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.852357] nix-grpc-daemon[771]: ts=2026-09-22T15:04:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.856403] nix-grpc-daemon[771]: ts=2026-09-22T15:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.858377] nix-grpc-daemon[766]: ts=2026-09-22T15:04:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.863709] nix-grpc-daemon[766]: ts=2026-09-22T15:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.053119] nix-grpc-daemon[771]: ts=2026-09-22T15:04:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.058421] nix-grpc-daemon[771]: ts=2026-09-22T15:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.064793] nix-grpc-daemon[766]: ts=2026-09-22T15:04:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.069988] nix-grpc-daemon[766]: ts=2026-09-22T15:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.259503] nix-grpc-daemon[771]: ts=2026-09-22T15:04:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.264889] nix-grpc-daemon[771]: ts=2026-09-22T15:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.270813] nix-grpc-daemon[766]: ts=2026-09-22T15:04:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.276475] nix-grpc-daemon[766]: ts=2026-09-22T15:04:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 28.405251] rustfs-bucket-start[997]: mb s3://farm worker2 # [ 28.465918] nix-grpc-daemon[771]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.471738] nix-grpc-daemon[771]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 28.426465] systemd[1]: Finished rustfs-bucket.service. lb # [ 28.443893] systemd[1]: Starting niks3 server... worker1 # [ 28.477441] nix-grpc-daemon[766]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.483058] nix-grpc-daemon[766]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.672967] nix-grpc-daemon[771]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.678104] nix-grpc-daemon[771]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 28.630483] postgres[1016]: [1016] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 28.631794] postgres[1016]: [1016] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 28.662132] niks3-server[1010]: 2026/09/22 15:05:00 OK 20241026095416_initial_model.sql (18.95ms) lb # [ 28.665857] niks3-server[1010]: 2026/09/22 15:05:00 OK 20251210153512_drop_unused_gin_index.sql (4.09ms) lb # [ 28.671231] niks3-server[1010]: 2026/09/22 15:05:00 OK 20251218171726_add_pins.sql (5.34ms) lb # [ 28.675983] niks3-server[1010]: 2026/09/22 15:05:00 OK 20260628120000_add_object_size_and_stats.sql (4.71ms) lb # [ 28.681320] niks3-server[1010]: 2026/09/22 15:05:00 OK 20260905000000_add_claims.sql (5.3ms) lb # [ 28.685076] niks3-server[1010]: 2026/09/22 15:05:00 OK 20260920000000_drop_claims.sql (3.65ms) lb # [ 28.686444] niks3-server[1010]: 2026/09/22 15:05:00 goose: successfully migrated database to version: 20260920000000 lb # [ 28.691398] niks3-server[1010]: 2026/09/22 15:05:00 OK 1_commit_pending_closure.sql (6.28ms) lb # [ 28.694197] niks3-server[1010]: 2026/09/22 15:05:00 OK 2_object_stats_trigger.sql (2.66ms) lb # [ 28.696603] niks3-server[1010]: 2026/09/22 15:05:00 goose: up to current file version: 2 lb # [ 28.698385] niks3-server[1010]: 2026/09/22 15:05:00 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key worker1 # [ 28.685856] nix-grpc-daemon[766]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 lb # [ 28.722465] niks3-server[1010]: 2026/09/22 15:05:00 INFO Read proxy enabled — serving cache objects from S3 worker1 # [ 28.690036] nix-grpc-daemon[766]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 28.726962] niks3-server[1010]: 2026/09/22 15:05:00 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 28.733211] niks3-server[1010]: 2026/09/22 15:05:00 INFO systemd watchdog enabled interval=15s lb # [ 28.735747] systemd[1]: Started niks3 server. lb # [ 28.736678] niks3-server[1010]: 2026/09/22 15:05:00 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 28.738447] systemd[1]: Reached target Multi-User System. lb # [ 28.739401] systemd[1]: Startup finished in 955ms (kernel) + 4.065s (initrd) + 23.710s (userspace) = 28.730s. worker2 # [ 28.880889] nix-grpc-daemon[771]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.884976] nix-grpc-daemon[771]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.886413] nix-grpc-daemon[766]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.891980] nix-grpc-daemon[766]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.081688] nix-grpc-daemon[771]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.086830] nix-grpc-daemon[771]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.092830] nix-grpc-daemon[766]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.098231] nix-grpc-daemon[766]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.287927] nix-grpc-daemon[771]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.293017] nix-grpc-daemon[771]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.299186] nix-grpc-daemon[766]: ts=2026-09-22T15:05:00Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.304914] nix-grpc-daemon[766]: ts=2026-09-22T15:05:00Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.493924] nix-grpc-daemon[771]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.499167] nix-grpc-daemon[771]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.505564] nix-grpc-daemon[766]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.510866] nix-grpc-daemon[766]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.700186] nix-grpc-daemon[771]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: waiting for unit niks3.service, in 17.33 seconds) lb: waiting for TCP port 5751 on localhost worker2 # [ 29.705186] nix-grpc-daemon[771]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.05 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.03 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! worker1 # [ 29.713729] nix-grpc-daemon[766]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 lb # [ 29.748480] envoy[895]: conn peer=[::1]:46352 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds) worker1 # [ 29.717954] nix-grpc-daemon[766]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.911234] nix-grpc-daemon[771]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.920494] nix-grpc-daemon[771]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.005903] systemd[1]: Starting scheduler-token.service... worker1 # [ 29.914396] nix-grpc-daemon[766]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.919704] nix-grpc-daemon[766]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.085543] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 30.091193] systemd[1]: Finished scheduler-token.service. worker2 # [ 30.094875] systemd[1]: scheduler-token.service: Consumed 45ms CPU time over 80ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 30.112535] nix-grpc-daemon[771]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.116420] nix-grpc-daemon[771]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.08 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 30.120675] nix-grpc-daemon[766]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.126316] nix-grpc-daemon[766]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2 # [ 30.317460] nix-grpc-daemon[771]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.323419] nix-grpc-daemon[771]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.327063] nix-grpc-daemon[766]: ts=2026-09-22T15:05:01Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.332445] nix-grpc-daemon[766]: ts=2026-09-22T15:05:01Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.523802] nix-grpc-daemon[771]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.529854] nix-grpc-daemon[771]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.533372] nix-grpc-daemon[766]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.538665] nix-grpc-daemon[766]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.730123] nix-grpc-daemon[771]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.735973] nix-grpc-daemon[771]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.741477] nix-grpc-daemon[766]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.745598] nix-grpc-daemon[766]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.939783] nix-grpc-daemon[771]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.944226] nix-grpc-daemon[771]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.941979] nix-grpc-daemon[766]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.951307] nix-grpc-daemon[766]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.141822] nix-grpc-daemon[771]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.149195] nix-grpc-daemon[771]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 31.148227] nix-grpc-daemon[766]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.153255] nix-grpc-daemon[766]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker2 # [ 31.350234] nix-grpc-daemon[771]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.355275] nix-grpc-daemon[771]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.354085] nix-grpc-daemon[766]: ts=2026-09-22T15:05:02Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.359496] nix-grpc-daemon[766]: ts=2026-09-22T15:05:02Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.556489] nix-grpc-daemon[771]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.561736] nix-grpc-daemon[771]: ts=2026-09-22T15:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.560299] nix-grpc-daemon[766]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.565651] nix-grpc-daemon[766]: ts=2026-09-22T15:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.762806] nix-grpc-daemon[771]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.767991] nix-grpc-daemon[771]: ts=2026-09-22T15:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.768718] nix-grpc-daemon[766]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.772875] nix-grpc-daemon[766]: ts=2026-09-22T15:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.970977] nix-grpc-daemon[771]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.975106] nix-grpc-daemon[771]: ts=2026-09-22T15:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.969062] nix-grpc-daemon[766]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.974191] nix-grpc-daemon[766]: ts=2026-09-22T15:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.171901] nix-grpc-daemon[771]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.177085] nix-grpc-daemon[771]: ts=2026-09-22T15:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.175148] nix-grpc-daemon[766]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.180730] nix-grpc-daemon[766]: ts=2026-09-22T15:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 32.378107] nix-grpc-daemon[771]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.383073] nix-grpc-daemon[771]: ts=2026-09-22T15:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 32.381433] nix-grpc-daemon[766]: ts=2026-09-22T15:05:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.386685] nix-grpc-daemon[766]: ts=2026-09-22T15:05:03Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.584204] nix-grpc-daemon[771]: ts=2026-09-22T15:05:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.588996] nix-grpc-daemon[771]: ts=2026-09-22T15:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.587543] nix-grpc-daemon[766]: ts=2026-09-22T15:05:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.593149] nix-grpc-daemon[766]: ts=2026-09-22T15:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.789959] nix-grpc-daemon[771]: ts=2026-09-22T15:05:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.795093] nix-grpc-daemon[771]: ts=2026-09-22T15:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.795548] nix-grpc-daemon[766]: ts=2026-09-22T15:05:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.799671] nix-grpc-daemon[766]: ts=2026-09-22T15:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.997936] nix-grpc-daemon[771]: ts=2026-09-22T15:05:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.002035] nix-grpc-daemon[771]: ts=2026-09-22T15:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.996347] nix-grpc-daemon[766]: ts=2026-09-22T15:05:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.001486] nix-grpc-daemon[766]: ts=2026-09-22T15:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.198670] nix-grpc-daemon[771]: ts=2026-09-22T15:05:04Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.203902] nix-grpc-daemon[771]: ts=2026-09-22T15:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.202340] nix-grpc-daemon[766]: ts=2026-09-22T15:05:04Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.207754] nix-grpc-daemon[766]: ts=2026-09-22T15:05:04Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 33.404906] nix-grpc-daemon[771]: ts=2026-09-22T15:05:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.409975] nix-grpc-daemon[771]: ts=2026-09-22T15:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 33.408793] nix-grpc-daemon[766]: ts=2026-09-22T15:05:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.414654] nix-grpc-daemon[766]: ts=2026-09-22T15:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.611057] nix-grpc-daemon[771]: ts=2026-09-22T15:05:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.616238] nix-grpc-daemon[771]: ts=2026-09-22T15:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.615168] nix-grpc-daemon[766]: ts=2026-09-22T15:05:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.620404] nix-grpc-daemon[766]: ts=2026-09-22T15:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 33.817127] nix-grpc-daemon[771]: ts=2026-09-22T15:05:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 33.822211] nix-grpc-daemon[771]: ts=2026-09-22T15:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 33.823016] nix-grpc-daemon[766]: ts=2026-09-22T15:05:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 33.827237] nix-grpc-daemon[766]: ts=2026-09-22T15:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.024926] nix-grpc-daemon[771]: ts=2026-09-22T15:05:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.029551] nix-grpc-daemon[771]: ts=2026-09-22T15:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.023528] nix-grpc-daemon[766]: ts=2026-09-22T15:05:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.028873] nix-grpc-daemon[766]: ts=2026-09-22T15:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.230641] nix-grpc-daemon[771]: ts=2026-09-22T15:05:05Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.235783] nix-grpc-daemon[771]: ts=2026-09-22T15:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.229704] nix-grpc-daemon[766]: ts=2026-09-22T15:05:05Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.234808] nix-grpc-daemon[766]: ts=2026-09-22T15:05:05Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.436907] nix-grpc-daemon[771]: ts=2026-09-22T15:05:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.442047] nix-grpc-daemon[771]: ts=2026-09-22T15:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 34.435686] nix-grpc-daemon[766]: ts=2026-09-22T15:05:06Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 34.441138] nix-grpc-daemon[766]: ts=2026-09-22T15:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.642972] nix-grpc-daemon[771]: ts=2026-09-22T15:05:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.647690] nix-grpc-daemon[771]: ts=2026-09-22T15:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.641808] nix-grpc-daemon[766]: ts=2026-09-22T15:05:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.646853] nix-grpc-daemon[766]: ts=2026-09-22T15:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.848982] nix-grpc-daemon[771]: ts=2026-09-22T15:05:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.854120] nix-grpc-daemon[771]: ts=2026-09-22T15:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 34.849058] nix-grpc-daemon[766]: ts=2026-09-22T15:05:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.853573] nix-grpc-daemon[766]: ts=2026-09-22T15:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.057056] nix-grpc-daemon[771]: ts=2026-09-22T15:05:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.061146] nix-grpc-daemon[771]: ts=2026-09-22T15:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.054532] nix-grpc-daemon[766]: ts=2026-09-22T15:05:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.059679] nix-grpc-daemon[766]: ts=2026-09-22T15:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.257736] nix-grpc-daemon[771]: ts=2026-09-22T15:05:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.263003] nix-grpc-daemon[771]: ts=2026-09-22T15:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.260464] nix-grpc-daemon[766]: ts=2026-09-22T15:05:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.265441] nix-grpc-daemon[766]: ts=2026-09-22T15:05:06Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.463944] nix-grpc-daemon[771]: ts=2026-09-22T15:05:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.469123] nix-grpc-daemon[771]: ts=2026-09-22T15:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 35.466319] nix-grpc-daemon[766]: ts=2026-09-22T15:05:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.471451] nix-grpc-daemon[766]: ts=2026-09-22T15:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2 # [ 35.670078] nix-grpc-daemon[771]: ts=2026-09-22T15:05:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.675248] nix-grpc-daemon[771]: ts=2026-09-22T15:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.672252] nix-grpc-daemon[766]: ts=2026-09-22T15:05:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.677321] nix-grpc-daemon[766]: ts=2026-09-22T15:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.876357] nix-grpc-daemon[771]: ts=2026-09-22T15:05:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.881162] nix-grpc-daemon[771]: ts=2026-09-22T15:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.879871] nix-grpc-daemon[766]: ts=2026-09-22T15:05:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.883890] nix-grpc-daemon[766]: ts=2026-09-22T15:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.084127] nix-grpc-daemon[771]: ts=2026-09-22T15:05:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.088148] nix-grpc-daemon[771]: ts=2026-09-22T15:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.080349] nix-grpc-daemon[766]: ts=2026-09-22T15:05:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.085437] nix-grpc-daemon[766]: ts=2026-09-22T15:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.284803] nix-grpc-daemon[771]: ts=2026-09-22T15:05:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.289843] nix-grpc-daemon[771]: ts=2026-09-22T15:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.286269] nix-grpc-daemon[766]: ts=2026-09-22T15:05:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.291718] nix-grpc-daemon[766]: ts=2026-09-22T15:05:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.491006] nix-grpc-daemon[771]: ts=2026-09-22T15:05:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.496289] nix-grpc-daemon[771]: ts=2026-09-22T15:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.492365] nix-grpc-daemon[766]: ts=2026-09-22T15:05:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.497632] nix-grpc-daemon[766]: ts=2026-09-22T15:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2 # [ 36.697312] nix-grpc-daemon[771]: ts=2026-09-22T15:05:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.702429] nix-grpc-daemon[771]: ts=2026-09-22T15:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.698729] nix-grpc-daemon[766]: ts=2026-09-22T15:05:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.704203] nix-grpc-daemon[766]: ts=2026-09-22T15:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.903639] nix-grpc-daemon[771]: ts=2026-09-22T15:05:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.909010] nix-grpc-daemon[771]: ts=2026-09-22T15:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.906891] nix-grpc-daemon[766]: ts=2026-09-22T15:05:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.911126] nix-grpc-daemon[766]: ts=2026-09-22T15:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.111739] nix-grpc-daemon[771]: ts=2026-09-22T15:05:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.115946] nix-grpc-daemon[771]: ts=2026-09-22T15:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.107623] nix-grpc-daemon[766]: ts=2026-09-22T15:05:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.113137] nix-grpc-daemon[766]: ts=2026-09-22T15:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.312711] nix-grpc-daemon[771]: ts=2026-09-22T15:05:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.317812] nix-grpc-daemon[771]: ts=2026-09-22T15:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.313919] nix-grpc-daemon[766]: ts=2026-09-22T15:05:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.319161] nix-grpc-daemon[766]: ts=2026-09-22T15:05:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.518865] nix-grpc-daemon[771]: ts=2026-09-22T15:05:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.524496] nix-grpc-daemon[771]: ts=2026-09-22T15:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.520277] nix-grpc-daemon[766]: ts=2026-09-22T15:05:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.525870] nix-grpc-daemon[766]: ts=2026-09-22T15:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 37.725188] nix-grpc-daemon[771]: ts=2026-09-22T15:05:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.730185] nix-grpc-daemon[771]: ts=2026-09-22T15:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 37.726666] nix-grpc-daemon[766]: ts=2026-09-22T15:05:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.731971] nix-grpc-daemon[766]: ts=2026-09-22T15:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.931806] nix-grpc-daemon[771]: ts=2026-09-22T15:05:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.937480] nix-grpc-daemon[771]: ts=2026-09-22T15:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.934967] nix-grpc-daemon[766]: ts=2026-09-22T15:05:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.939165] nix-grpc-daemon[766]: ts=2026-09-22T15:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.138864] nix-grpc-daemon[771]: ts=2026-09-22T15:05:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.143282] nix-grpc-daemon[771]: ts=2026-09-22T15:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.135549] nix-grpc-daemon[766]: ts=2026-09-22T15:05:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.141079] nix-grpc-daemon[766]: ts=2026-09-22T15:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.339563] nix-grpc-daemon[771]: ts=2026-09-22T15:05:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.344875] nix-grpc-daemon[771]: ts=2026-09-22T15:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.341827] nix-grpc-daemon[766]: ts=2026-09-22T15:05:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.347017] nix-grpc-daemon[766]: ts=2026-09-22T15:05:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.547376] nix-grpc-daemon[771]: ts=2026-09-22T15:05:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.552195] nix-grpc-daemon[771]: ts=2026-09-22T15:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.547803] nix-grpc-daemon[766]: ts=2026-09-22T15:05:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.553079] nix-grpc-daemon[766]: ts=2026-09-22T15:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 38.753134] nix-grpc-daemon[771]: ts=2026-09-22T15:05:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.757514] nix-grpc-daemon[771]: ts=2026-09-22T15:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.797229] nix-grpc-daemon[771]: ts=2026-09-22T15:05:10Z level=info event=scheduler_take_over lb # [ 38.740358] niks3-server[1010]: 2026/09/22 15:05:10 INFO lead: acquired remote=192.168.1.4:37172 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker1 # [ 38.753746] nix-grpc-daemon[766]: ts=2026-09-22T15:05:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.758854] nix-grpc-daemon[766]: ts=2026-09-22T15:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.958584] nix-grpc-daemon[771]: ts=2026-09-22T15:05:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.963718] nix-grpc-daemon[771]: ts=2026-09-22T15:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.960942] nix-grpc-daemon[766]: ts=2026-09-22T15:05:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.965492] nix-grpc-daemon[766]: ts=2026-09-22T15:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.166673] nix-grpc-daemon[771]: ts=2026-09-22T15:05:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.170868] nix-grpc-daemon[771]: ts=2026-09-22T15:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.166500] nix-grpc-daemon[766]: ts=2026-09-22T15:05:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.171666] nix-grpc-daemon[766]: ts=2026-09-22T15:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.367328] nix-grpc-daemon[771]: ts=2026-09-22T15:05:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.372578] nix-grpc-daemon[771]: ts=2026-09-22T15:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.372290] nix-grpc-daemon[766]: ts=2026-09-22T15:05:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.377346] nix-grpc-daemon[766]: ts=2026-09-22T15:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.573485] nix-grpc-daemon[771]: ts=2026-09-22T15:05:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.595970] nix-grpc-daemon[771]: ts=2026-09-22T15:05:11Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 39.599996] nix-grpc-daemon[771]: ts=2026-09-22T15:05:11Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:44700 worker2 # [ 39.606146] nix-grpc-daemon[771]: ts=2026-09-22T15:05:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 39.578282] nix-grpc-daemon[766]: ts=2026-09-22T15:05:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.674025] nix-grpc-daemon[771]: ts=2026-09-22T15:05:11Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:44700 worker2 # [ 39.679127] nix-grpc-daemon[771]: ts=2026-09-22T15:05:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 10.40 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 40.873072] nix-grpc-daemon[771]: ts=2026-09-22T15:05:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 40.887076] systemd[1]: Started Nix Daemon. worker2 # [ 41.075063] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 41.097830] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 1/5) worker2 # [ 41.114712] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 151 ms (attempt 2/5) worker2 # [ 41.269786] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 3/5) worker2 # [ 41.293344] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 227 ms (attempt 4/5) worker2 # [ 41.528350] nix-grpc-daemon[771]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 41.533420] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 41.474276] nix-grpc-daemon[766]: ts=2026-09-22T15:05:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 41.493304] systemd[1]: Started Nix Daemon. worker1 # [ 41.681790] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 41.706119] nix-grpc-daemon[766]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 1/5) worker1 # [ 41.808553] nix-grpc-daemon[766]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 2/5) worker1 # [ 41.914378] nix-grpc-daemon[766]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 3/5) worker1 # [ 41.926520] nix-grpc-daemon[766]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 4/5) worker1 # [ 41.990077] nix-grpc-daemon[766]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 41.994822] nix-grpc-daemon[766]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 42.005864] nix-grpc-daemon[766]: ts=2026-09-22T15:05:13Z level=debug event=path_info_miss path=9h1c64jjdkn9jsqs8mxdg12zr39npfq0-nixos-system-client-test error="error: path '/nix/store/9h1c64jjdkn9jsqs8mxdg12zr39npfq0-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 42.114250] nix-grpc-daemon[771]: ts=2026-09-22T15:05:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 42.126208] nix-grpc-daemon[771]: ts=2026-09-22T15:05:13Z level=debug event=path_info_miss path=9h1c64jjdkn9jsqs8mxdg12zr39npfq0-nixos-system-client-test error="error: path '/nix/store/9h1c64jjdkn9jsqs8mxdg12zr39npfq0-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds) client: must succeed: install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds) worker2 # [ 42.452532] nix-grpc-daemon[771]: ts=2026-09-22T15:05:14Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:44702 worker2 # [ 42.471248] nix-grpc-daemon[771]: ts=2026-09-22T15:05:14Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:44702 worker2 # [ 42.484234] nix-grpc-daemon[771]: ts=2026-09-22T15:05:14Z level=debug event=path_info_miss path=9h1c64jjdkn9jsqs8mxdg12zr39npfq0-nixos-system-client-test error="error: path '/nix/store/9h1c64jjdkn9jsqs8mxdg12zr39npfq0-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 42.404104] nix-grpc-daemon[766]: ts=2026-09-22T15:05:14Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 42.410111] nix-grpc-daemon[766]: ts=2026-09-22T15:05:14Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:53602 worker1 # [ 42.418262] nix-grpc-daemon[766]: ts=2026-09-22T15:05:14Z level=debug event=path_info_miss path=9h1c64jjdkn9jsqs8mxdg12zr39npfq0-nixos-system-client-test error="error: path '/nix/store/9h1c64jjdkn9jsqs8mxdg12zr39npfq0-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds) worker1 # [ 42.647490] nix-grpc-daemon[766]: ts=2026-09-22T15:05:14Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 42.912700] nix-grpc-daemon[771]: ts=2026-09-22T15:05:14Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.34 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2 worker1 # [ 42.989412] nix-grpc-daemon[766]: ts=2026-09-22T15:05:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53602 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 43.000582] nix-grpc-daemon[766]: ts=2026-09-22T15:05:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 worker2 # [ 43.132962] nix-grpc-daemon[771]: ts=2026-09-22T15:05:14Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 43.138368] nix-grpc-daemon[771]: ts=2026-09-22T15:05:14Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 43.184340] nix-grpc-daemon[771]: ts=2026-09-22T15:05:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 43.201107] nix-grpc-daemon[771]: ts=2026-09-22T15:05:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 client # copying 1 paths to 'lb:50051'... worker2 # [ 43.217295] nix-grpc-daemon[771]: ts=2026-09-22T15:05:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker2 # [ 43.239534] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 43.283659] nix-grpc-daemon[771]: ts=2026-09-22T15:05:14Z level=info event=niks3_push_started pid=872 worker2 # [ 43.502042] nix-grpc-daemon[872]: time=2026-09-22T15:05:15.120Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 43.611637] nix-daemon[857]: accepted connection from pid 885, user nix-grpc-daemon (trusted) worker2 # [ 43.633374] nix-daemon[857]: reaped child process 888, status = succeeded worker2 # [ 43.729694] nix-daemon[857]: accepted connection from pid 890, user nix-grpc-daemon (trusted) worker2 # [ 43.747882] nix-daemon[857]: reaped child process 893, status = succeeded lb # [ 43.689675] niks3-server[1010]: 2026/09/22 15:05:15 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 43.771188] nix-grpc-daemon[872]: time=2026-09-22T15:05:15.389Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 43.773019] nix-grpc-daemon[872]: time=2026-09-22T15:05:15.389Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 43.756125] niks3-server[1010]: 2026/09/22 15:05:15 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst worker2 # [ 43.836193] nix-grpc-daemon[872]: time=2026-09-22T15:05:15.455Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.766574] niks3-server[1010]: 2026/09/22 15:05:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 43.778267] niks3-server[1010]: 2026/09/22 15:05:15 INFO Signed narinfos id=1 count=1 lb # [ 43.783405] niks3-server[1010]: 2026/09/22 15:05:15 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 43.789786] niks3-server[1010]: 2026/09/22 15:05:15 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 43.812975] niks3-server[1010]: 2026/09/22 15:05:15 INFO Completed upload id=1 worker2 # [ 43.875532] nix-grpc-daemon[872]: time=2026-09-22T15:05:15.495Z level=INFO msg="Upload complete. (370ms)" worker2 # [ 43.888377] nix-grpc-daemon[771]: ts=2026-09-22T15:05:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 43.905907] nix-grpc-daemon[771]: ts=2026-09-22T15:05:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 43.914357] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 43.920612] nix-daemon[857]: reaped child process 870, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker2 # [ 43.936229] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker2 # [ 44.779756] nix-daemon[857]: reaped child process 897, status = succeeded worker2 # [ 44.871526] nix-daemon[857]: accepted connection from pid 914, user nix-grpc-daemon (trusted) worker2 # [ 44.888227] nix-daemon[857]: reaped child process 917, status = succeeded lb # [ 44.833179] niks3-server[1010]: 2026/09/22 15:05:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 44.912422] nix-grpc-daemon[872]: time=2026-09-22T15:05:16.529Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 44.913877] nix-grpc-daemon[872]: time=2026-09-22T15:05:16.529Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 44.892893] niks3-server[1010]: 2026/09/22 15:05:16 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 44.902637] niks3-server[1010]: 2026/09/22 15:05:16 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker2 # [ 44.973894] nix-grpc-daemon[872]: time=2026-09-22T15:05:16.592Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.913817] niks3-server[1010]: 2026/09/22 15:05:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 44.922558] niks3-server[1010]: 2026/09/22 15:05:16 INFO Signed narinfos id=2 count=1 lb # [ 44.929794] niks3-server[1010]: 2026/09/22 15:05:16 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 44.937444] niks3-server[1010]: 2026/09/22 15:05:16 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete worker2 # [ 45.001003] nix-grpc-daemon[872]: time=2026-09-22T15:05:16.620Z level=INFO msg="Upload complete. (253ms)" lb # [ 44.941972] niks3-server[1010]: 2026/09/22 15:05:16 INFO Completed upload id=2 lb # [ 44.945118] niks3-server[1010]: 2026/09/22 15:05:16 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker2 # [ 45.028523] nix-grpc-daemon[771]: ts=2026-09-22T15:05:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 45.040476] nix-grpc-daemon[771]: ts=2026-09-22T15:05:16Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker2 # [ 45.043995] nix-grpc-daemon[771]: ts=2026-09-22T15:05:16Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 45.049100] nix-daemon[857]: reaped child process 895, status = succeeded worker2 # [ 45.070679] nix-grpc-daemon[771]: ts=2026-09-22T15:05:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 45.086086] nix-grpc-daemon[771]: ts=2026-09-22T15:05:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 45.101169] nix-grpc-daemon[872]: time=2026-09-22T15:05:16.720Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 45.117762] nix-grpc-daemon[771]: ts=2026-09-22T15:05:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker2 # [ 45.140339] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 45.308375] nix-daemon[857]: accepted connection from pid 923, user nix-grpc-daemon (trusted) worker2 # [ 45.330286] nix-daemon[857]: reaped child process 926, status = succeeded worker2 # [ 45.431357] nix-daemon[857]: accepted connection from pid 928, user nix-grpc-daemon (trusted) worker2 # [ 45.447747] nix-daemon[857]: reaped child process 931, status = succeeded lb # [ 45.391821] niks3-server[1010]: 2026/09/22 15:05:17 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 45.464277] nix-grpc-daemon[872]: time=2026-09-22T15:05:17.084Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 45.466387] nix-grpc-daemon[872]: time=2026-09-22T15:05:17.085Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 45.423040] niks3-server[1010]: 2026/09/22 15:05:17 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst worker2 # [ 45.501005] nix-grpc-daemon[872]: time=2026-09-22T15:05:17.120Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.442916] niks3-server[1010]: 2026/09/22 15:05:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 45.452626] niks3-server[1010]: 2026/09/22 15:05:17 INFO Signed narinfos id=3 count=1 lb # [ 45.458443] niks3-server[1010]: 2026/09/22 15:05:17 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls worker2 # [ 45.532970] nix-grpc-daemon[872]: time=2026-09-22T15:05:17.152Z level=INFO msg="Upload complete. (376ms)" lb # [ 45.472893] niks3-server[1010]: 2026/09/22 15:05:17 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete worker2 # [ 45.540301] nix-grpc-daemon[771]: ts=2026-09-22T15:05:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 45.480277] niks3-server[1010]: 2026/09/22 15:05:17 INFO Completed upload id=3 lb # [ 45.484309] niks3-server[1010]: 2026/09/22 15:05:17 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker2 # [ 45.554181] nix-grpc-daemon[771]: ts=2026-09-22T15:05:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 45.562209] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 45.567110] nix-daemon[857]: reaped child process 921, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... worker2 # [ 45.580857] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker2 # [ 46.868686] nix-daemon[857]: reaped child process 935, status = succeeded worker2 # [ 46.962940] nix-daemon[857]: accepted connection from pid 951, user nix-grpc-daemon (trusted) worker2 # [ 46.985183] nix-daemon[857]: reaped child process 954, status = succeeded lb # [ 46.925276] niks3-server[1010]: 2026/09/22 15:05:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.000449] nix-grpc-daemon[872]: time=2026-09-22T15:05:18.618Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 47.002845] nix-grpc-daemon[872]: time=2026-09-22T15:05:18.618Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 46.968557] niks3-server[1010]: 2026/09/22 15:05:18 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 46.979101] niks3-server[1010]: 2026/09/22 15:05:18 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst worker2 # [ 47.056636] nix-grpc-daemon[872]: time=2026-09-22T15:05:18.675Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.994450] niks3-server[1010]: 2026/09/22 15:05:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 47.004178] niks3-server[1010]: 2026/09/22 15:05:18 INFO Signed narinfos id=4 count=1 lb # [ 47.010488] niks3-server[1010]: 2026/09/22 15:05:18 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 47.022854] niks3-server[1010]: 2026/09/22 15:05:18 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 47.030327] niks3-server[1010]: 2026/09/22 15:05:18 INFO Completed upload id=4 worker2 # [ 47.091739] nix-grpc-daemon[872]: time=2026-09-22T15:05:18.711Z level=INFO msg="Upload complete. (301ms)" lb # [ 47.033436] niks3-server[1010]: 2026/09/22 15:05:18 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker2 # [ 47.110358] nix-grpc-daemon[771]: ts=2026-09-22T15:05:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 47.129722] nix-grpc-daemon[771]: ts=2026-09-22T15:05:18Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker2 # [ 47.134274] nix-grpc-daemon[771]: ts=2026-09-22T15:05:18Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 47.139125] nix-daemon[857]: reaped child process 933, status = succeeded worker2 # [ 47.154520] nix-grpc-daemon[771]: ts=2026-09-22T15:05:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 47.169928] nix-grpc-daemon[771]: ts=2026-09-22T15:05:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 47.184968] nix-grpc-daemon[872]: time=2026-09-22T15:05:18.804Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker2 # [ 47.196072] nix-grpc-daemon[771]: ts=2026-09-22T15:05:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 47.209666] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 47.361714] nix-daemon[857]: accepted connection from pid 960, user nix-grpc-daemon (trusted) worker2 # [ 47.382393] nix-daemon[857]: reaped child process 963, status = succeeded worker2 # [ 47.484525] nix-daemon[857]: accepted connection from pid 965, user nix-grpc-daemon (trusted) worker2 # [ 47.503413] nix-daemon[857]: reaped child process 968, status = succeeded lb # [ 47.444929] niks3-server[1010]: 2026/09/22 15:05:19 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 47.516089] nix-grpc-daemon[872]: time=2026-09-22T15:05:19.135Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 47.517899] nix-grpc-daemon[872]: time=2026-09-22T15:05:19.135Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 47.475037] niks3-server[1010]: 2026/09/22 15:05:19 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 47.492656] niks3-server[1010]: 2026/09/22 15:05:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker2 # [ 47.560400] nix-grpc-daemon[872]: time=2026-09-22T15:05:19.179Z level=INFO msg="Uploading 1 narinfos" lb # [ 47.502804] niks3-server[1010]: 2026/09/22 15:05:19 INFO Signed narinfos id=5 count=1 lb # [ 47.509666] niks3-server[1010]: 2026/09/22 15:05:19 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 47.520074] niks3-server[1010]: 2026/09/22 15:05:19 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 47.525787] niks3-server[1010]: 2026/09/22 15:05:19 INFO Completed upload id=5 lb # [ 47.529806] niks3-server[1010]: 2026/09/22 15:05:19 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker2 # [ 47.587735] nix-grpc-daemon[872]: time=2026-09-22T15:05:19.207Z level=INFO msg="Upload complete. (362ms)" worker2 # [ 47.596474] nix-grpc-daemon[771]: ts=2026-09-22T15:05:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 47.612665] nix-grpc-daemon[771]: ts=2026-09-22T15:05:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 47.618902] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 47.623684] nix-daemon[857]: reaped child process 958, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 47.637477] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 48.049896] envoy[895]: conn peer=[2001:db8:1::1]:50854 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=1284 lb # [ 48.054990] envoy[895]: conn peer=[2001:db8:1::1]:34774 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=72 lb # [ 48.059920] envoy[895]: conn peer=[2001:db8:1::1]:34786 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=10 lb # [ 48.064620] envoy[895]: conn peer=[2001:db8:1::1]:34794 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=12 client # farm-top> LOG-farm-top-t1 worker2 # [ 48.542483] nix-daemon[857]: reaped child process 972, status = succeeded worker2 # [ 48.612959] nix-daemon[857]: accepted connection from pid 988, user nix-grpc-daemon (trusted) worker2 # [ 48.633761] nix-daemon[857]: reaped child process 991, status = succeeded lb # [ 48.577488] niks3-server[1010]: 2026/09/22 15:05:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 48.648418] nix-grpc-daemon[872]: time=2026-09-22T15:05:20.267Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 48.650166] nix-grpc-daemon[872]: time=2026-09-22T15:05:20.267Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 48.620266] niks3-server[1010]: 2026/09/22 15:05:20 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 48.696545] nix-grpc-daemon[872]: time=2026-09-22T15:05:20.315Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.634788] niks3-server[1010]: 2026/09/22 15:05:20 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 48.646890] niks3-server[1010]: 2026/09/22 15:05:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 48.659729] niks3-server[1010]: 2026/09/22 15:05:20 INFO Signed narinfos id=6 count=1 worker2 # [ 48.721505] nix-grpc-daemon[872]: time=2026-09-22T15:05:20.341Z level=INFO msg="Upload complete. (273ms)" lb # [ 48.663813] niks3-server[1010]: 2026/09/22 15:05:20 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 48.671977] niks3-server[1010]: 2026/09/22 15:05:20 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete worker2 # [ 48.734262] nix-grpc-daemon[771]: ts=2026-09-22T15:05:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 lb # [ 48.678741] niks3-server[1010]: 2026/09/22 15:05:20 INFO Completed upload id=6 lb # [ 48.681444] niks3-server[1010]: 2026/09/22 15:05:20 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker2 # [ 48.754814] nix-daemon[857]: reaped child process 970, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2, in 5.85 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath, in 0.19 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.02 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.21 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.36 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.25 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.22 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2 worker2 # [ 49.969075] nix-grpc-daemon[771]: ts=2026-09-22T15:05:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44702 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # [ 49.985383] nix-grpc-daemon[771]: ts=2026-09-22T15:05:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 49.996525] nix-grpc-daemon[872]: time=2026-09-22T15:05:21.615Z level=INFO msg="All 2 paths already cached" worker2 # [ 50.013432] nix-grpc-daemon[771]: ts=2026-09-22T15:05:21Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2, in 0.30 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath, in 0.14 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.17 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&2 worker1 # [ 50.747691] nix-grpc-daemon[766]: ts=2026-09-22T15:05:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53602 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 50.853428] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 50.863933] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.483Z level=INFO msg="All 2 paths already cached" worker2 # [ 50.880343] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 50.887045] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 50.926749] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 50.941851] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 50.956110] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.575Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker2 # [ 50.966881] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 50.982286] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 51.144604] nix-daemon[857]: accepted connection from pid 1020, user nix-grpc-daemon (trusted) worker2 # [ 51.163777] nix-daemon[857]: reaped child process 1023, status = succeeded worker2 # [ 51.261173] nix-daemon[857]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker2 # [ 51.278214] nix-daemon[857]: reaped child process 1028, status = succeeded lb # [ 51.221724] niks3-server[1010]: 2026/09/22 15:05:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 51.294739] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.913Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 51.296297] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.913Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 51.259168] niks3-server[1010]: 2026/09/22 15:05:22 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 51.272997] niks3-server[1010]: 2026/09/22 15:05:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker2 # [ 51.340330] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.959Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.281494] niks3-server[1010]: 2026/09/22 15:05:22 INFO Signed narinfos id=7 count=1 lb # [ 51.287736] niks3-server[1010]: 2026/09/22 15:05:22 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 51.297859] niks3-server[1010]: 2026/09/22 15:05:22 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 51.307607] niks3-server[1010]: 2026/09/22 15:05:22 INFO Completed upload id=7 worker2 # [ 51.369970] nix-grpc-daemon[872]: time=2026-09-22T15:05:22.989Z level=INFO msg="Upload complete. (370ms)" lb # [ 51.311683] niks3-server[1010]: 2026/09/22 15:05:22 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker2 # [ 51.382070] nix-grpc-daemon[771]: ts=2026-09-22T15:05:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 51.396829] nix-grpc-daemon[771]: ts=2026-09-22T15:05:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 51.405758] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 51.408802] nix-daemon[857]: reaped child process 1018, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 51.423323] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker2 # [ 52.931063] nix-daemon[857]: reaped child process 1032, status = succeeded worker2 # [ 53.003776] nix-daemon[857]: accepted connection from pid 1048, user nix-grpc-daemon (trusted) worker2 # [ 53.027058] nix-daemon[857]: reaped child process 1051, status = succeeded lb # [ 52.963784] niks3-server[1010]: 2026/09/22 15:05:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 53.036612] nix-grpc-daemon[872]: time=2026-09-22T15:05:24.655Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 53.038628] nix-grpc-daemon[872]: time=2026-09-22T15:05:24.655Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 53.012944] niks3-server[1010]: 2026/09/22 15:05:24 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst worker2 # [ 53.087420] nix-grpc-daemon[872]: time=2026-09-22T15:05:24.706Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.033394] niks3-server[1010]: 2026/09/22 15:05:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign lb # [ 53.050338] niks3-server[1010]: 2026/09/22 15:05:24 INFO Signed narinfos id=8 count=1 lb # [ 53.060677] niks3-server[1010]: 2026/09/22 15:05:24 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete worker2 # [ 53.127106] nix-grpc-daemon[872]: time=2026-09-22T15:05:24.746Z level=INFO msg="Upload complete. (292ms)" lb # [ 53.073035] niks3-server[1010]: 2026/09/22 15:05:24 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 53.079009] niks3-server[1010]: 2026/09/22 15:05:24 INFO Completed upload id=8 lb # [ 53.082151] niks3-server[1010]: 2026/09/22 15:05:24 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker2 # [ 53.141799] nix-grpc-daemon[771]: ts=2026-09-22T15:05:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker2 # [ 53.162111] nix-daemon[857]: reaped child process 1030, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.55 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.19 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.10 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&2 worker2 # [ 53.783069] nix-grpc-daemon[771]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44702 client # don't know how to build these paths: client # /nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker2 # [ 53.794644] nix-grpc-daemon[771]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 53.820259] nix-grpc-daemon[771]: ts=2026-09-22T15:05:25Z level=debug event=want client=4 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv cached=0 worker2 # [ 53.826272] nix-grpc-daemon[771]: ts=2026-09-22T15:05:25Z level=debug event=assigned drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 53.739090] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 53.753555] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' to 'lb:50051'... worker1 # [ 53.769538] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 53.785673] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 53.817874] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=info event=niks3_push_started pid=859 worker1 # [ 53.992357] nix-grpc-daemon[859]: time=2026-09-22T15:05:25.590Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca="" worker1 # [ 54.102991] nix-daemon[833]: accepted connection from pid 872, user nix-grpc-daemon (trusted) worker1 # [ 54.122433] nix-daemon[833]: reaped child process 875, status = succeeded worker1 # [ 54.224362] nix-daemon[833]: accepted connection from pid 877, user nix-grpc-daemon (trusted) worker1 # [ 54.241916] nix-daemon[833]: reaped child process 880, status = succeeded lb # [ 54.279049] niks3-server[1010]: 2026/09/22 15:05:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 54.262691] nix-grpc-daemon[859]: time=2026-09-22T15:05:25.861Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 54.264544] nix-grpc-daemon[859]: time=2026-09-22T15:05:25.861Z level=INFO msg="Uploading 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv (512B)" lb # [ 54.334351] niks3-server[1010]: 2026/09/22 15:05:25 INFO Registered completed upload object_key=nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst worker1 # [ 54.312804] nix-grpc-daemon[859]: time=2026-09-22T15:05:25.912Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.349486] niks3-server[1010]: 2026/09/22 15:05:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign lb # [ 54.356961] niks3-server[1010]: 2026/09/22 15:05:25 INFO Signed narinfos id=9 count=1 lb # [ 54.361889] niks3-server[1010]: 2026/09/22 15:05:25 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.ls lb # [ 54.371746] niks3-server[1010]: 2026/09/22 15:05:25 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 54.378258] niks3-server[1010]: 2026/09/22 15:05:25 INFO Completed upload id=9 worker1 # [ 54.346360] nix-grpc-daemon[859]: time=2026-09-22T15:05:25.946Z level=INFO msg="Upload complete. (354ms)" lb # [ 54.380854] niks3-server[1010]: 2026/09/22 15:05:25 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo worker1 # [ 54.356904] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 54.372556] nix-grpc-daemon[766]: ts=2026-09-22T15:05:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 54.380682] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 54.387522] nix-daemon[833]: reaped child process 857, status = succeeded client # building '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' on lb:50051... worker1 # [ 54.398402] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker1 # [ 55.843599] nix-daemon[833]: reaped child process 884, status = succeeded worker1 # [ 55.944290] nix-daemon[833]: accepted connection from pid 900, user nix-grpc-daemon (trusted) worker1 # [ 55.964931] nix-daemon[833]: reaped child process 903, status = succeeded lb # [ 56.000971] niks3-server[1010]: 2026/09/22 15:05:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 55.980387] nix-grpc-daemon[859]: time=2026-09-22T15:05:27.578Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 55.981854] nix-grpc-daemon[859]: time=2026-09-22T15:05:27.578Z level=INFO msg="Uploading 2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a (128B)" lb # [ 56.037135] niks3-server[1010]: 2026/09/22 15:05:27 INFO Registered completed upload object_key=log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv lb # [ 56.051830] niks3-server[1010]: 2026/09/22 15:05:27 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 56.067308] niks3-server[1010]: 2026/09/22 15:05:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign worker1 # [ 56.042775] nix-grpc-daemon[859]: time=2026-09-22T15:05:27.641Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.076337] niks3-server[1010]: 2026/09/22 15:05:27 INFO Signed narinfos id=10 count=1 lb # [ 56.082849] niks3-server[1010]: 2026/09/22 15:05:27 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.ls lb # [ 56.093615] niks3-server[1010]: 2026/09/22 15:05:27 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete worker1 # [ 56.066935] nix-grpc-daemon[859]: time=2026-09-22T15:05:27.667Z level=INFO msg="Upload complete. (256ms)" lb # [ 56.103420] niks3-server[1010]: 2026/09/22 15:05:27 INFO Completed upload id=10 lb # [ 56.107873] niks3-server[1010]: 2026/09/22 15:05:27 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo worker1 # [ 56.081158] nix-grpc-daemon[766]: ts=2026-09-22T15:05:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=1 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv assign_id=5 outputs=1 worker2 # [ 56.181704] nix-grpc-daemon[771]: ts=2026-09-22T15:05:27Z level=debug event=want client=4 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv cached=0 worker2 # [ 56.187444] nix-grpc-daemon[771]: ts=2026-09-22T15:05:27Z level=debug event=assigned drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 56.098837] nix-daemon[833]: reaped child process 882, status = succeeded worker1 # [ 56.134375] nix-grpc-daemon[766]: ts=2026-09-22T15:05:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 56.151399] nix-grpc-daemon[766]: ts=2026-09-22T15:05:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 56.167656] nix-grpc-daemon[859]: time=2026-09-22T15:05:27.767Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' to 'lb:50051'... worker1 # [ 56.179080] nix-grpc-daemon[766]: ts=2026-09-22T15:05:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 56.193085] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 56.356738] nix-daemon[833]: accepted connection from pid 907, user nix-grpc-daemon (trusted) worker1 # [ 56.379500] nix-daemon[833]: reaped child process 910, status = succeeded worker1 # [ 56.481188] nix-daemon[833]: accepted connection from pid 912, user nix-grpc-daemon (trusted) worker1 # [ 56.498120] nix-daemon[833]: reaped child process 915, status = succeeded lb # [ 56.536340] niks3-server[1010]: 2026/09/22 15:05:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 56.515038] nix-grpc-daemon[859]: time=2026-09-22T15:05:28.115Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 56.516703] nix-grpc-daemon[859]: time=2026-09-22T15:05:28.115Z level=INFO msg="Uploading z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv (624B)" lb # [ 56.568658] niks3-server[1010]: 2026/09/22 15:05:28 INFO Registered completed upload object_key=nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst worker1 # [ 56.561027] nix-grpc-daemon[859]: time=2026-09-22T15:05:28.161Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.592891] niks3-server[1010]: 2026/09/22 15:05:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign lb # [ 56.601861] niks3-server[1010]: 2026/09/22 15:05:28 INFO Signed narinfos id=11 count=1 lb # [ 56.608294] niks3-server[1010]: 2026/09/22 15:05:28 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.ls lb # [ 56.621024] niks3-server[1010]: 2026/09/22 15:05:28 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete worker1 # [ 56.644061] nix-grpc-daemon[859]: time=2026-09-22T15:05:28.244Z level=INFO msg="Upload complete. (434ms)" lb # [ 56.675362] niks3-server[1010]: 2026/09/22 15:05:28 INFO Completed upload id=11 lb # [ 56.681386] niks3-server[1010]: 2026/09/22 15:05:28 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo worker1 # [ 56.656428] nix-grpc-daemon[766]: ts=2026-09-22T15:05:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 56.672692] nix-grpc-daemon[766]: ts=2026-09-22T15:05:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 56.688516] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 56.692733] nix-daemon[833]: reaped child process 905, status = succeeded client # building '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' on lb:50051... client # farm-b> node-a: building z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker1 # [ 56.712886] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker1 # [ 57.620685] nix-daemon[833]: reaped child process 919, status = succeeded worker1 # [ 57.694571] nix-daemon[833]: accepted connection from pid 935, user nix-grpc-daemon (trusted) worker1 # [ 57.714752] nix-daemon[833]: reaped child process 938, status = succeeded lb # [ 57.751760] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 57.730462] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.329Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 57.732272] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.329Z level=INFO msg="Uploading h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b (176B)" lb # [ 57.790898] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst lb # [ 57.804121] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker1 # [ 57.780608] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.380Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.816286] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 57.826178] niks3-server[1010]: 2026/09/22 15:05:29 INFO Signed narinfos id=12 count=1 lb # [ 57.832488] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls lb # [ 57.842755] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 57.851739] niks3-server[1010]: 2026/09/22 15:05:29 INFO Completed upload id=12 worker1 # [ 57.819315] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.419Z level=INFO msg="Upload complete. (293ms)" lb # [ 57.856696] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo worker2 # [ 57.930660] nix-grpc-daemon[771]: ts=2026-09-22T15:05:29Z level=debug event=want client=4 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv cached=0 worker1 # [ 57.833162] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=1 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv assign_id=6 outputs=1 worker2 # [ 57.933572] nix-grpc-daemon[771]: ts=2026-09-22T15:05:29Z level=debug event=assigned drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 57.852282] nix-daemon[833]: reaped child process 917, status = succeeded worker1 # [ 57.884433] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 57.901332] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 57.914930] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.515Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' to 'lb:50051'... worker1 # [ 57.925883] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 57.939617] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) lb # [ 58.053113] envoy[895]: conn peer=[2001:db8:1::1]:34806 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9506 tx=4375 ms=5679 lb # [ 58.057912] envoy[895]: conn peer=[2001:db8:1::1]:34810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=66 lb # [ 58.062578] envoy[895]: conn peer=[2001:db8:1::1]:34822 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4215 tx=1914 ms=2319 worker1 # [ 58.099024] nix-daemon[833]: accepted connection from pid 942, user nix-grpc-daemon (trusted) worker1 # [ 58.117435] nix-daemon[833]: reaped child process 945, status = succeeded worker1 # [ 58.222565] nix-daemon[833]: accepted connection from pid 947, user nix-grpc-daemon (trusted) worker1 # [ 58.239883] nix-daemon[833]: reaped child process 950, status = succeeded lb # [ 58.276354] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 58.253716] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.853Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 58.255186] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.853Z level=INFO msg="Uploading knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv (752B)" worker1 # [ 58.286456] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.886Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.307954] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst lb # [ 58.323000] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 58.335175] niks3-server[1010]: 2026/09/22 15:05:29 INFO Signed narinfos id=13 count=1 lb # [ 58.344909] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls worker1 # [ 58.320306] nix-grpc-daemon[859]: time=2026-09-22T15:05:29.920Z level=INFO msg="Upload complete. (363ms)" lb # [ 58.354494] niks3-server[1010]: 2026/09/22 15:05:29 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 58.360810] niks3-server[1010]: 2026/09/22 15:05:29 INFO Completed upload id=13 worker1 # [ 58.328325] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 58.365322] niks3-server[1010]: 2026/09/22 15:05:29 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo worker1 # [ 58.343625] nix-grpc-daemon[766]: ts=2026-09-22T15:05:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 58.350092] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 58.354560] nix-daemon[833]: reaped child process 940, status = succeeded worker1 # [ 58.365100] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) client # building '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' on lb:50051... client # farm-top> node-a: building knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker1 # [ 59.644216] nix-daemon[833]: reaped child process 954, status = succeeded worker1 # [ 59.757343] nix-daemon[833]: accepted connection from pid 970, user nix-grpc-daemon (trusted) worker1 # [ 59.777226] nix-daemon[833]: reaped child process 973, status = succeeded lb # [ 59.815271] niks3-server[1010]: 2026/09/22 15:05:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 59.795505] nix-grpc-daemon[859]: time=2026-09-22T15:05:31.393Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 59.797469] nix-grpc-daemon[859]: time=2026-09-22T15:05:31.393Z level=INFO msg="Uploading 4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top (232B)" lb # [ 59.853695] niks3-server[1010]: 2026/09/22 15:05:31 INFO Registered completed upload object_key=log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv lb # [ 59.873673] niks3-server[1010]: 2026/09/22 15:05:31 INFO Registered completed upload object_key=nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst lb # [ 59.887547] niks3-server[1010]: 2026/09/22 15:05:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign worker1 # [ 59.856564] nix-grpc-daemon[859]: time=2026-09-22T15:05:31.456Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.895791] niks3-server[1010]: 2026/09/22 15:05:31 INFO Signed narinfos id=14 count=1 lb # [ 59.901412] niks3-server[1010]: 2026/09/22 15:05:31 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls lb # [ 59.913029] niks3-server[1010]: 2026/09/22 15:05:31 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete worker1 # [ 59.887996] nix-grpc-daemon[859]: time=2026-09-22T15:05:31.488Z level=INFO msg="Upload complete. (310ms)" lb # [ 59.922692] niks3-server[1010]: 2026/09/22 15:05:31 INFO Completed upload id=14 lb # [ 59.928663] niks3-server[1010]: 2026/09/22 15:05:31 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo worker1 # [ 59.901422] nix-grpc-daemon[766]: ts=2026-09-22T15:05:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=1 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv assign_id=7 outputs=1 worker1 # [ 59.922100] nix-daemon[833]: reaped child process 952, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&2, in 6.50 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath, in 0.19 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top worker1 # [ 60.287809] nix-grpc-daemon[766]: ts=2026-09-22T15:05:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:56814 worker1 # [ 60.330306] nix-grpc-daemon[766]: ts=2026-09-22T15:05:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:56814 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.25 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top worker2 # [ 60.677796] nix-grpc-daemon[771]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:41404 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a client # /nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b client # /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top worker2 # [ 60.719587] nix-grpc-daemon[771]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:41404 worker2 # [ 60.729655] nix-grpc-daemon[771]: copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'http://lb:5751'... worker2 # [ 60.753824] nix-grpc-daemon[771]: copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'http://lb:5751'... worker2 # [ 60.772136] nix-grpc-daemon[771]: copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.32 seconds) client: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/900" client # removing stale temporary roots file "/nix/var/nix/temproots/944" client # removing stale temporary roots file "/nix/var/nix/temproots/929" client # removing stale temporary roots file "/nix/var/nix/temproots/921" client # removing stale temporary roots file "/nix/var/nix/temproots/851" client # removing stale temporary roots file "/nix/var/nix/temproots/867" client # removing stale temporary roots file "/nix/var/nix/temproots/908" client # removing stale temporary roots file "/nix/var/nix/temproots/888" client # deleting specified paths... client # deleting '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker1 # [ 61.149438] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 61.156393] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 61.170023] nix-grpc-daemon[859]: time=2026-09-22T15:05:32.769Z level=INFO msg="All 1 paths already cached" worker1 # [ 61.183544] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 61.198448] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53602 client # copying 3 paths... worker1 # [ 61.222337] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53602 client # copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'grpc://lb:50051'... worker1 # [ 61.259810] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 61.267854] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_out=232 worker1 # [ 61.277918] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 61.285162] nix-grpc-daemon[766]: ts=2026-09-22T15:05:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 61.388786] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 61.396965] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.69 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 7.95 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup client # [ 61.470626] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 692dddb3ac07415ab487437902429f06 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 0.08 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup worker1 # [ 61.655738] nix-grpc-daemon[766]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53602 client # [ 61.667550] nix[996]: don't know how to build these paths: client # [ 61.671310] nix[996]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 61.774876] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 61.780505] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 61.818497] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 61.835886] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 client # [ 61.759433] nix[996]: copying 1 paths to 'lb:50051'... client # [ 61.764388] nix[996]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 61.854689] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 61.870106] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 62.036570] nix-daemon[857]: accepted connection from pid 1071, user nix-grpc-daemon (trusted) worker2 # [ 62.064238] nix-daemon[857]: reaped child process 1074, status = succeeded worker2 # [ 62.168995] nix-daemon[857]: accepted connection from pid 1076, user nix-grpc-daemon (trusted) worker2 # [ 62.189465] nix-daemon[857]: reaped child process 1079, status = succeeded lb # [ 62.127285] niks3-server[1010]: 2026/09/22 15:05:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 62.200405] nix-grpc-daemon[872]: time=2026-09-22T15:05:33.819Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 62.201851] nix-grpc-daemon[872]: time=2026-09-22T15:05:33.819Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 62.159780] niks3-server[1010]: 2026/09/22 15:05:33 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst lb # [ 62.179438] niks3-server[1010]: 2026/09/22 15:05:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker2 # [ 62.251995] nix-grpc-daemon[872]: time=2026-09-22T15:05:33.871Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.194296] niks3-server[1010]: 2026/09/22 15:05:33 INFO Signed narinfos id=15 count=1 lb # [ 62.201234] niks3-server[1010]: 2026/09/22 15:05:33 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 62.212882] niks3-server[1010]: 2026/09/22 15:05:33 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete worker2 # [ 62.279667] nix-grpc-daemon[872]: time=2026-09-22T15:05:33.899Z level=INFO msg="Upload complete. (391ms)" lb # [ 62.219432] niks3-server[1010]: 2026/09/22 15:05:33 INFO Completed upload id=15 lb # [ 62.222129] niks3-server[1010]: 2026/09/22 15:05:33 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 62.292130] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 62.306513] nix-grpc-daemon[771]: ts=2026-09-22T15:05:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 62.312550] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 62.317583] nix-daemon[857]: reaped child process 1069, status = succeeded client # [ 62.237644] nix[996]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 62.330122] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) client # [ 62.567595] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: ce9fc397e1154f9587d94017dc748593 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 1.11 seconds) worker1 # [ 62.790590] nix-grpc-daemon[766]: ts=2026-09-22T15:05:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53602 client # [ 62.802656] nix[1012]: don't know how to build these paths: client # [ 62.804775] nix[1012]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 62.904282] nix-grpc-daemon[771]: ts=2026-09-22T15:05:34Z level=debug event=want client=6 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 client # [ 62.822575] nix[1012]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 62.911414] nix-grpc-daemon[771]: ts=2026-09-22T15:05:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 client: must succeed: sleep 2 client: (finished: must succeed: sleep 2, in 2.05 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 66.395446] nix-daemon[857]: reaped child process 1083, status = succeeded worker2 # [ 66.523381] nix-daemon[857]: accepted connection from pid 1115, user nix-grpc-daemon (trusted) worker2 # [ 66.547221] nix-daemon[857]: reaped child process 1118, status = succeeded lb # [ 66.484854] niks3-server[1010]: 2026/09/22 15:05:38 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 66.608756] nix-grpc-daemon[872]: time=2026-09-22T15:05:38.224Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 66.617770] nix-grpc-daemon[872]: time=2026-09-22T15:05:38.224Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 66.589013] niks3-server[1010]: 2026/09/22 15:05:38 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst worker2 # [ 66.666201] nix-grpc-daemon[872]: time=2026-09-22T15:05:38.285Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.605536] niks3-server[1010]: 2026/09/22 15:05:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 66.614337] niks3-server[1010]: 2026/09/22 15:05:38 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 66.623433] niks3-server[1010]: 2026/09/22 15:05:38 INFO Signed narinfos id=16 count=1 lb # [ 66.627429] niks3-server[1010]: 2026/09/22 15:05:38 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 66.636372] niks3-server[1010]: 2026/09/22 15:05:38 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 66.640485] niks3-server[1010]: 2026/09/22 15:05:38 INFO Completed upload id=16 worker2 # [ 66.702869] nix-grpc-daemon[872]: time=2026-09-22T15:05:38.322Z level=INFO msg="Upload complete. (358ms)" lb # [ 66.645351] niks3-server[1010]: 2026/09/22 15:05:38 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 66.716992] nix-grpc-daemon[771]: ts=2026-09-22T15:05:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 66.736333] nix-grpc-daemon[771]: ts=2026-09-22T15:05:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 66.745902] nix-daemon[857]: reaped child process 1081, status = succeeded client # [ 66.662144] systemd[1]: dedup2.service: Deactivated successfully. client # [ 66.666380] systemd[1]: dedup2.service: Consumed 206ms CPU time over 4.094s wall clock time, 35.2M memory peak, 5.9K incoming IP traffic, 5.5K outgoing IP traffic. client # [ 66.699554] systemd[1]: dedup1.service: Deactivated successfully. client # [ 66.707310] systemd[1]: dedup1.service: Consumed 175ms CPU time over 5.235s wall clock time, 41.4M memory peak, 7.4K incoming IP traffic, 8.6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.13 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.13 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 67.860870] nix-grpc-daemon[771]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 67.870353] nix-grpc-daemon[771]: ts=2026-09-22T15:05:39Z level=debug event=want client=7 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=0 worker2 # [ 67.872760] nix-grpc-daemon[771]: ts=2026-09-22T15:05:39Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 67.783911] nix-grpc-daemon[766]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 67.799010] nix-grpc-daemon[766]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 67.814268] nix-grpc-daemon[766]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 67.828563] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 67.997431] nix-daemon[833]: accepted connection from pid 998, user nix-grpc-daemon (trusted) worker1 # [ 68.014780] nix-daemon[833]: reaped child process 1001, status = succeeded lb # [ 68.049779] envoy[895]: conn peer=[2001:db8:1::1]:36742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9528 tx=4369 ms=6227 lb # [ 68.054884] envoy[895]: conn peer=[2001:db8:1::1]:45940 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=409 ms=128 lb # [ 68.060569] envoy[895]: conn peer=[2001:db8:1::1]:45926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2893 ms=238 lb # [ 68.065583] envoy[895]: conn peer=[2001:db8:1::1]:45946 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=376 ms=110 lb # [ 68.070740] envoy[895]: conn peer=[2001:db8:1::1]:45956 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=408 tx=329 ms=92 lb # [ 68.076205] envoy[895]: conn peer=[2001:db8:1::1]:45982 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1443 tx=1197 ms=3852 lb # [ 68.080982] envoy[895]: conn peer=[2001:db8:1::1]:45966 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3035 tx=1558 ms=5028 worker1 # [ 68.118320] nix-daemon[833]: accepted connection from pid 1003, user nix-grpc-daemon (trusted) worker1 # [ 68.133509] nix-daemon[833]: reaped child process 1006, status = succeeded lb # [ 68.173092] niks3-server[1010]: 2026/09/22 15:05:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 68.150983] nix-grpc-daemon[859]: time=2026-09-22T15:05:39.750Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 68.152589] nix-grpc-daemon[859]: time=2026-09-22T15:05:39.750Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)" lb # [ 68.207098] niks3-server[1010]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst lb # [ 68.225332] niks3-server[1010]: 2026/09/22 15:05:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 68.198950] nix-grpc-daemon[859]: time=2026-09-22T15:05:39.799Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.231573] niks3-server[1010]: 2026/09/22 15:05:39 INFO Signed narinfos id=17 count=1 lb # [ 68.238938] niks3-server[1010]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls lb # [ 68.250970] niks3-server[1010]: 2026/09/22 15:05:39 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete worker1 # [ 68.225087] nix-grpc-daemon[859]: time=2026-09-22T15:05:39.825Z level=INFO msg="Upload complete. (378ms)" lb # [ 68.257668] niks3-server[1010]: 2026/09/22 15:05:39 INFO Completed upload id=17 lb # [ 68.263815] niks3-server[1010]: 2026/09/22 15:05:39 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo worker1 # [ 68.236399] nix-grpc-daemon[766]: ts=2026-09-22T15:05:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 68.251575] nix-grpc-daemon[766]: ts=2026-09-22T15:05:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 68.259716] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 68.265136] nix-daemon[833]: reaped child process 996, status = succeeded worker1 # [ 68.277796] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 74.494419] nix-grpc-daemon[766]: ts=2026-09-22T15:05:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=9 outputs=0 worker1 # [ 74.535454] nix-daemon[833]: reaped child process 1008, status = succeeded worker1 # [ 74.539066] nix-daemon[833]: reaped child process 1010, status = succeeded worker2 # [ 74.824495] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 74.837932] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=want client=8 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=0 worker2 # [ 74.847473] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 74.856355] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 74.863320] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 74.875077] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 74.891983] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 75.038682] nix-daemon[857]: accepted connection from pid 1135, user nix-grpc-daemon (trusted) worker2 # [ 75.058179] nix-daemon[857]: reaped child process 1138, status = succeeded worker2 # [ 75.158422] nix-daemon[857]: accepted connection from pid 1140, user nix-grpc-daemon (trusted) worker2 # [ 75.176384] nix-daemon[857]: reaped child process 1143, status = succeeded lb # [ 75.121210] niks3-server[1010]: 2026/09/22 15:05:46 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 75.194000] nix-grpc-daemon[872]: time=2026-09-22T15:05:46.813Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 75.195476] nix-grpc-daemon[872]: time=2026-09-22T15:05:46.813Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)" lb # [ 75.153563] niks3-server[1010]: 2026/09/22 15:05:46 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst lb # [ 75.169696] niks3-server[1010]: 2026/09/22 15:05:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign worker2 # [ 75.237463] nix-grpc-daemon[872]: time=2026-09-22T15:05:46.857Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.180400] niks3-server[1010]: 2026/09/22 15:05:46 INFO Signed narinfos id=18 count=1 lb # [ 75.182815] niks3-server[1010]: 2026/09/22 15:05:46 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls lb # [ 75.195632] niks3-server[1010]: 2026/09/22 15:05:46 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete worker2 # [ 75.262317] nix-grpc-daemon[872]: time=2026-09-22T15:05:46.882Z level=INFO msg="Upload complete. (359ms)" lb # [ 75.201392] niks3-server[1010]: 2026/09/22 15:05:46 INFO Completed upload id=18 lb # [ 75.206603] niks3-server[1010]: 2026/09/22 15:05:46 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo worker2 # [ 75.268972] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 75.283001] nix-grpc-daemon[771]: ts=2026-09-22T15:05:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 75.289884] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 75.294767] nix-daemon[857]: reaped child process 1133, status = succeeded worker2 # [ 75.306217] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) lb # [ 78.050057] envoy[895]: conn peer=[2001:db8:1::1]:45996 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2975 tx=952 ms=6745 worker2 # [ 81.523203] nix-grpc-daemon[771]: ts=2026-09-22T15:05:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=6 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=10 outputs=0 worker2 # [ 81.541170] nix-daemon[857]: reaped child process 1145, status = succeeded worker2 # [ 81.542371] nix-daemon[857]: reaped child process 1147, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 14.12 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share client # [ 81.729410] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: a2e9a40d52994887bd9bb528d6c79962 client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 0.09 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share worker2 # [ 82.038020] nix-grpc-daemon[771]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44702 client # [ 81.955989] nix[1085]: don't know how to build these paths: client # [ 81.957174] nix[1085]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker2 # [ 82.057849] nix-grpc-daemon[771]: ts=2026-09-22T15:05:53Z level=debug event=want client=9 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=0 worker1 # [ 81.969075] nix-grpc-daemon[766]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker2 # [ 82.064318] nix-grpc-daemon[771]: ts=2026-09-22T15:05:53Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 81.987788] nix-grpc-daemon[766]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 client # [ 82.005151] nix[1085]: copying 1 paths to 'lb:50051'... client # [ 82.007946] nix[1085]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'... worker1 # [ 82.005259] nix-grpc-daemon[766]: ts=2026-09-22T15:05:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 82.021541] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 82.187675] nix-daemon[833]: accepted connection from pid 1033, user nix-grpc-daemon (trusted) worker1 # [ 82.205941] nix-daemon[833]: reaped child process 1036, status = succeeded worker1 # [ 82.311467] nix-daemon[833]: accepted connection from pid 1038, user nix-grpc-daemon (trusted) worker1 # [ 82.329535] nix-daemon[833]: reaped child process 1041, status = succeeded lb # [ 82.366874] niks3-server[1010]: 2026/09/22 15:05:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 82.346412] nix-grpc-daemon[859]: time=2026-09-22T15:05:53.946Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 82.347879] nix-grpc-daemon[859]: time=2026-09-22T15:05:53.946Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)" lb # [ 82.402274] niks3-server[1010]: 2026/09/22 15:05:54 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst worker1 # [ 82.383733] nix-grpc-daemon[859]: time=2026-09-22T15:05:53.983Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.415588] niks3-server[1010]: 2026/09/22 15:05:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 82.427942] niks3-server[1010]: 2026/09/22 15:05:54 INFO Signed narinfos id=19 count=1 lb # [ 82.434305] niks3-server[1010]: 2026/09/22 15:05:54 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls worker1 # [ 82.415028] nix-grpc-daemon[859]: time=2026-09-22T15:05:54.015Z level=INFO msg="Upload complete. (374ms)" lb # [ 82.446983] niks3-server[1010]: 2026/09/22 15:05:54 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 82.456470] niks3-server[1010]: 2026/09/22 15:05:54 INFO Completed upload id=19 worker1 # [ 82.425239] nix-grpc-daemon[766]: ts=2026-09-22T15:05:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=432 lb # [ 82.459960] niks3-server[1010]: 2026/09/22 15:05:54 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo worker1 # [ 82.442092] nix-grpc-daemon[766]: ts=2026-09-22T15:05:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 82.447887] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 82.455651] nix-daemon[833]: reaped child process 1031, status = succeeded worker1 # [ 82.464238] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) client # [ 82.467802] nix[1085]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051... client # [ 82.837601] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 8ea066ff29994b2c80d3dd43aff35751 client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 1.12 seconds) worker1 # [ 83.032984] nix-grpc-daemon[766]: ts=2026-09-22T15:05:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53602 client # [ 83.051364] nix[1101]: this derivation will be built: worker2 # [ 83.146310] nix-grpc-daemon[771]: ts=2026-09-22T15:05:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 83.159271] nix-grpc-daemon[771]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' from 'http://lb:5751'... client # [ 83.089212] nix[1101]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker2 # [ 83.190062] nix-grpc-daemon[771]: ts=2026-09-22T15:05:54Z level=debug event=want client=10 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=0 worker1 # [ 83.100120] nix-grpc-daemon[766]: ts=2026-09-22T15:05:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 client # [ 83.111845] nix[1101]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051... client: must succeed: sleep 2; systemctl kill -s INT share1 client # [ 86.217214] systemd[1]: share1.service: Sent signal SIGINT to main process 1085 (nix) on client request. client # [ 86.226435] nix[1085]: shutting downrxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 86.235021] nix[1085]: [mutex.cc : 451] RAW: Unlock 0xe5933f5fc788 @ 0xe59743d759a4 0xe59744e4d40c 0xe597642c57bc 0xe597642c7414 0xe597642be1d4 0xe59763304f7c 0xe59763092d80 client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.09 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 86.264805] systemd-coredump[1116]: Process 1085 (nix) of user 0 terminated abnormally with signal 11/SEGV, processing... client # [ 86.283783] systemd[1]: Created slice Slice /system/systemd-coredump. client # [ 86.294638] systemd[1]: Started Process Core Dump (PID 1116/UID 0). lb # [ 88.052507] envoy[895]: conn peer=[2001:db8:1::1]:38052 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2989 tx=954 ms=6760 client # [ 88.565719] systemd-coredump[1120]: Cannot store coredump of 1085 (nix): No space left on device client # [ 88.686166] systemd-coredump[1120]: Process 1085 (nix) of user 0 terminated abnormally without generating a coredump. client # [ 88.703532] systemd[1]: systemd-coredump@0-1-1116_1117-0.service: Deactivated successfully. client # [ 88.709760] systemd[1]: systemd-coredump@0-1-1116_1117-0.service: Consumed 1.932s CPU time over 2.402s wall clock time, 968.8M memory peak, 926.3M written to disk. client # [ 88.713923] systemd[1]: share1.service: Main process exited, code=dumped, status=11/SEGV client # [ 88.716843] systemd[1]: share1.service: Failed with result 'core-dump'. client # [ 88.718059] systemd[1]: share1.service: Consumed 371ms CPU time over 6.987s wall clock time, 39.5M memory peak, 4K written to disk, 6.2K incoming IP traffic, 8.1K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 3.25 seconds) worker1 # [ 89.699248] nix-daemon[833]: reaped child process 1045, status = succeeded client: waiting for success: ! systemctl is-active share2 worker1 # [ 89.787822] nix-daemon[833]: accepted connection from pid 1079, user nix-grpc-daemon (trusted) worker1 # [ 89.805938] nix-daemon[833]: reaped child process 1082, status = succeeded lb # [ 89.846048] niks3-server[1010]: 2026/09/22 15:06:01 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 89.824454] nix-grpc-daemon[859]: time=2026-09-22T15:06:01.424Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 89.825930] nix-grpc-daemon[859]: time=2026-09-22T15:06:01.424Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)" lb # [ 89.893426] niks3-server[1010]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv lb # [ 89.907256] niks3-server[1010]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst worker1 # [ 89.888449] nix-grpc-daemon[859]: time=2026-09-22T15:06:01.488Z level=INFO msg="Uploading 1 narinfos" lb # [ 89.921474] niks3-server[1010]: 2026/09/22 15:06:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign lb # [ 89.928296] niks3-server[1010]: 2026/09/22 15:06:01 INFO Signed narinfos id=20 count=1 lb # [ 89.933014] niks3-server[1010]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls lb # [ 89.939375] niks3-server[1010]: 2026/09/22 15:06:01 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 89.947796] niks3-server[1010]: 2026/09/22 15:06:01 INFO Completed upload id=20 worker1 # [ 89.916247] nix-grpc-daemon[859]: time=2026-09-22T15:06:01.516Z level=INFO msg="Upload complete. (234ms)" lb # [ 89.950582] niks3-server[1010]: 2026/09/22 15:06:01 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo worker1 # [ 89.929321] nix-grpc-daemon[766]: ts=2026-09-22T15:06:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=7 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=1 worker1 # [ 89.946824] nix-grpc-daemon[766]: ts=2026-09-22T15:06:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=6 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=1 worker1 # [ 89.953416] nix-daemon[833]: reaped child process 1043, status = succeeded client # [ 90.008579] systemd[1]: share2.service: Deactivated successfully. client # [ 90.012924] systemd[1]: share2.service: Consumed 182ms CPU time over 7.175s wall clock time, 35.3M memory peak, 4K written to disk, 6.5K incoming IP traffic, 5.9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.12 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.05 seconds) (finished: subtest: the first client leaving does not fail the second, in 9.25 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 91.048921] systemd[1]: Started Nix Daemon. client # [ 91.162728] nix-daemon[1167]: accepted connection from pid 1164, user root (trusted) worker1 # [ 91.303698] nix-grpc-daemon[766]: ts=2026-09-22T15:06:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 91.310561] nix-grpc-daemon[766]: ts=2026-09-22T15:06:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 worker2 # [ 91.417203] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=want client=11 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 91.423799] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 91.432604] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 91.446696] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 91.461426] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 91.475902] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 91.638451] nix-daemon[857]: accepted connection from pid 1193, user nix-grpc-daemon (trusted) worker2 # [ 91.657796] nix-daemon[857]: reaped child process 1196, status = succeeded worker2 # [ 91.757040] nix-daemon[857]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) worker2 # [ 91.773059] nix-daemon[857]: reaped child process 1201, status = succeeded lb # [ 91.717197] niks3-server[1010]: 2026/09/22 15:06:03 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 91.788990] nix-grpc-daemon[872]: time=2026-09-22T15:06:03.408Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 91.790618] nix-grpc-daemon[872]: time=2026-09-22T15:06:03.408Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 91.744886] niks3-server[1010]: 2026/09/22 15:06:03 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 91.760462] niks3-server[1010]: 2026/09/22 15:06:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker2 # [ 91.829074] nix-grpc-daemon[872]: time=2026-09-22T15:06:03.448Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.773277] niks3-server[1010]: 2026/09/22 15:06:03 INFO Signed narinfos id=21 count=1 lb # [ 91.780993] niks3-server[1010]: 2026/09/22 15:06:03 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 91.794479] niks3-server[1010]: 2026/09/22 15:06:03 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete worker2 # [ 91.863037] nix-grpc-daemon[872]: time=2026-09-22T15:06:03.482Z level=INFO msg="Upload complete. (370ms)" lb # [ 91.802335] niks3-server[1010]: 2026/09/22 15:06:03 INFO Completed upload id=21 lb # [ 91.805528] niks3-server[1010]: 2026/09/22 15:06:03 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker2 # [ 91.872314] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 91.887936] nix-grpc-daemon[771]: ts=2026-09-22T15:06:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 91.896121] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 91.899743] nix-daemon[857]: reaped child process 1191, status = succeeded worker2 # [ 91.910459] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 92.988421] nix-daemon[857]: reaped child process 1205, status = succeeded worker2 # [ 93.088913] nix-daemon[857]: accepted connection from pid 1221, user nix-grpc-daemon (trusted) worker2 # [ 93.109709] nix-daemon[857]: reaped child process 1224, status = succeeded lb # [ 93.049907] niks3-server[1010]: 2026/09/22 15:06:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 93.123693] nix-grpc-daemon[872]: time=2026-09-22T15:06:04.740Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 93.125619] nix-grpc-daemon[872]: time=2026-09-22T15:06:04.740Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 93.081711] niks3-server[1010]: 2026/09/22 15:06:04 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst worker2 # [ 93.173616] nix-grpc-daemon[872]: time=2026-09-22T15:06:04.793Z level=INFO msg="Uploading 1 narinfos" lb # [ 93.103346] niks3-server[1010]: 2026/09/22 15:06:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 93.118293] niks3-server[1010]: 2026/09/22 15:06:04 INFO Signed narinfos id=22 count=1 lb # [ 93.123793] niks3-server[1010]: 2026/09/22 15:06:04 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 93.133729] niks3-server[1010]: 2026/09/22 15:06:04 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls worker2 # [ 93.205604] nix-grpc-daemon[872]: time=2026-09-22T15:06:04.825Z level=INFO msg="Upload complete. (283ms)" lb # [ 93.145037] niks3-server[1010]: 2026/09/22 15:06:04 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 93.149415] niks3-server[1010]: 2026/09/22 15:06:04 INFO Completed upload id=22 lb # [ 93.153508] niks3-server[1010]: 2026/09/22 15:06:04 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker2 # [ 93.221931] nix-grpc-daemon[771]: ts=2026-09-22T15:06:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=12 outputs=1 worker2 # [ 93.240377] nix-grpc-daemon[771]: ts=2026-09-22T15:06:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 93.246552] nix-daemon[857]: reaped child process 1203, status = succeeded worker2 # [ 93.267640] nix-grpc-daemon[771]: ts=2026-09-22T15:06:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 93.274392] nix-grpc-daemon[771]: ts=2026-09-22T15:06:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 93.559756] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:44702 worker1 # [ 93.470854] nix-grpc-daemon[766]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 worker2 # [ 93.589253] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=want client=12 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 93.596748] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 93.605684] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 93.616150] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 93.629192] nix-grpc-daemon[872]: time=2026-09-22T15:06:05.248Z level=INFO msg="All 1 paths already cached" worker2 # [ 93.639289] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 93.653548] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 93.813275] nix-daemon[857]: accepted connection from pid 1230, user nix-grpc-daemon (trusted) worker2 # [ 93.835244] nix-daemon[857]: reaped child process 1233, status = succeeded worker2 # [ 93.942106] nix-daemon[857]: accepted connection from pid 1235, user nix-grpc-daemon (trusted) worker2 # [ 93.962140] nix-daemon[857]: reaped child process 1238, status = succeeded lb # [ 93.897528] niks3-server[1010]: 2026/09/22 15:06:05 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 93.970448] nix-grpc-daemon[872]: time=2026-09-22T15:06:05.589Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 93.971924] nix-grpc-daemon[872]: time=2026-09-22T15:06:05.589Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 93.931856] niks3-server[1010]: 2026/09/22 15:06:05 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker2 # [ 94.006807] nix-grpc-daemon[872]: time=2026-09-22T15:06:05.626Z level=INFO msg="Uploading 1 narinfos" lb # [ 93.947455] niks3-server[1010]: 2026/09/22 15:06:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign lb # [ 93.958933] niks3-server[1010]: 2026/09/22 15:06:05 INFO Signed narinfos id=23 count=1 worker2 # [ 94.032501] nix-grpc-daemon[872]: time=2026-09-22T15:06:05.652Z level=INFO msg="Upload complete. (361ms)" lb # [ 93.970929] niks3-server[1010]: 2026/09/22 15:06:05 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls worker2 # [ 94.040126] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 93.983103] niks3-server[1010]: 2026/09/22 15:06:05 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete worker2 # [ 94.048572] nix-grpc-daemon[771]: ts=2026-09-22T15:06:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 lb # [ 93.987853] niks3-server[1010]: 2026/09/22 15:06:05 INFO Completed upload id=23 lb # [ 93.991047] niks3-server[1010]: 2026/09/22 15:06:05 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker2 # [ 94.062610] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 94.065121] nix-daemon[857]: reaped child process 1228, status = succeeded worker2 # [ 94.077513] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 94.717351] nix-daemon[857]: reaped child process 1242, status = succeeded worker2 # [ 94.843194] nix-daemon[857]: accepted connection from pid 1258, user nix-grpc-daemon (trusted) worker2 # [ 94.865851] nix-daemon[857]: reaped child process 1261, status = succeeded lb # [ 94.803335] niks3-server[1010]: 2026/09/22 15:06:06 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 94.878718] nix-grpc-daemon[872]: time=2026-09-22T15:06:06.496Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 94.880865] nix-grpc-daemon[872]: time=2026-09-22T15:06:06.496Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 94.868166] niks3-server[1010]: 2026/09/22 15:06:06 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 94.881012] niks3-server[1010]: 2026/09/22 15:06:06 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker2 # [ 94.951631] nix-grpc-daemon[872]: time=2026-09-22T15:06:06.570Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.894269] niks3-server[1010]: 2026/09/22 15:06:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 94.904357] niks3-server[1010]: 2026/09/22 15:06:06 INFO Signed narinfos id=24 count=1 lb # [ 94.906475] niks3-server[1010]: 2026/09/22 15:06:06 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 94.921521] niks3-server[1010]: 2026/09/22 15:06:06 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 94.931148] niks3-server[1010]: 2026/09/22 15:06:06 INFO Completed upload id=24 worker2 # [ 94.993771] nix-grpc-daemon[872]: time=2026-09-22T15:06:06.613Z level=INFO msg="Upload complete. (307ms)" lb # [ 94.933982] niks3-server[1010]: 2026/09/22 15:06:06 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker2 # [ 95.009221] nix-grpc-daemon[771]: ts=2026-09-22T15:06:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=13 outputs=1 worker2 # [ 95.032452] nix-grpc-daemon[771]: ts=2026-09-22T15:06:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 95.039045] nix-daemon[857]: reaped child process 1240, status = succeeded worker1 # [ 94.964779] nix-grpc-daemon[766]: ts=2026-09-22T15:06:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 94.978475] nix-grpc-daemon[766]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 94.994097] nix-grpc-daemon[766]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker1 # [ 95.009298] nix-grpc-daemon[766]: ts=2026-09-22T15:06:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 95.350701] nix-grpc-daemon[766]: ts=2026-09-22T15:06:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53602 worker2 # [ 95.450035] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 95.462198] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.081Z level=INFO msg="All 2 paths already cached" worker2 # [ 95.483300] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=want client=13 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker2 # [ 95.490914] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 95.500954] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 95.514965] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 95.531254] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.150Z level=INFO msg="All 2 paths already cached" worker2 # [ 95.544683] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 95.562995] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 95.753977] nix-daemon[857]: accepted connection from pid 1267, user nix-grpc-daemon (trusted) worker2 # [ 95.787613] nix-daemon[857]: reaped child process 1270, status = succeeded worker2 # [ 95.936161] nix-daemon[857]: accepted connection from pid 1272, user nix-grpc-daemon (trusted) worker2 # [ 95.958270] nix-daemon[857]: reaped child process 1275, status = succeeded lb # [ 95.907779] niks3-server[1010]: 2026/09/22 15:06:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 95.990932] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.609Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 95.992753] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.609Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 95.982305] niks3-server[1010]: 2026/09/22 15:06:07 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst worker2 # [ 96.070729] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.689Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.009386] niks3-server[1010]: 2026/09/22 15:06:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 96.021657] niks3-server[1010]: 2026/09/22 15:06:07 INFO Signed narinfos id=25 count=1 lb # [ 96.042317] niks3-server[1010]: 2026/09/22 15:06:07 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 96.068445] niks3-server[1010]: 2026/09/22 15:06:07 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 96.083114] niks3-server[1010]: 2026/09/22 15:06:07 INFO Completed upload id=25 worker2 # [ 96.144747] nix-grpc-daemon[872]: time=2026-09-22T15:06:07.764Z level=INFO msg="Upload complete. (562ms)" lb # [ 96.089437] niks3-server[1010]: 2026/09/22 15:06:07 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker2 # [ 96.158058] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 96.177735] nix-grpc-daemon[771]: ts=2026-09-22T15:06:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 96.197988] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 96.208309] nix-daemon[857]: reaped child process 1265, status = succeeded worker2 # [ 96.233665] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 97.325099] nix-daemon[857]: reaped child process 1279, status = succeeded worker2 # [ 97.430313] nix-daemon[857]: accepted connection from pid 1295, user nix-grpc-daemon (trusted) worker2 # [ 97.449731] nix-daemon[857]: reaped child process 1298, status = succeeded lb # [ 97.394743] niks3-server[1010]: 2026/09/22 15:06:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 97.467015] nix-grpc-daemon[872]: time=2026-09-22T15:06:09.085Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 97.468915] nix-grpc-daemon[872]: time=2026-09-22T15:06:09.085Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 97.434599] niks3-server[1010]: 2026/09/22 15:06:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign worker2 # [ 97.507411] nix-grpc-daemon[872]: time=2026-09-22T15:06:09.126Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.450364] niks3-server[1010]: 2026/09/22 15:06:09 INFO Signed narinfos id=26 count=1 lb # [ 97.458560] niks3-server[1010]: 2026/09/22 15:06:09 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 97.468085] niks3-server[1010]: 2026/09/22 15:06:09 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 97.476848] niks3-server[1010]: 2026/09/22 15:06:09 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 97.483605] niks3-server[1010]: 2026/09/22 15:06:09 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete worker2 # [ 97.538816] nix-grpc-daemon[872]: time=2026-09-22T15:06:09.158Z level=INFO msg="Upload complete. (283ms)" lb # [ 97.489322] niks3-server[1010]: 2026/09/22 15:06:09 INFO Completed upload id=26 lb # [ 97.491743] niks3-server[1010]: 2026/09/22 15:06:09 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker2 # [ 97.553271] nix-grpc-daemon[771]: ts=2026-09-22T15:06:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=14 outputs=1 worker1 # [ 97.467630] nix-grpc-daemon[766]: ts=2026-09-22T15:06:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53602 worker2 # [ 97.572962] nix-daemon[857]: reaped child process 1277, status = succeeded worker1 # [ 97.481581] nix-grpc-daemon[766]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker2 # [ 97.616574] nix-grpc-daemon[771]: ts=2026-09-22T15:06:09Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 97.624277] nix-grpc-daemon[771]: ts=2026-09-22T15:06:09Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_out=232 client # [ 97.625443] nix-daemon[1167]: reaped child process 1169, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.74 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.85 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv lb # [ 98.050574] envoy[895]: conn peer=[2001:db8:1::1]:48804 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2990 tx=788 ms=6758 lb # [ 98.055679] envoy[895]: conn peer=[2001:db8:1::1]:48818 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1605 tx=1599 ms=6950 lb # [ 98.060667] envoy[895]: conn peer=[2001:db8:1::1]:41650 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3427 tx=1967 ms=1934 client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... lb # [ 98.065440] envoy[895]: conn peer=[2001:db8:1::1]:41662 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=333 ms=66 lb # [ 98.070420] envoy[895]: conn peer=[2001:db8:1::1]:41672 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3875 tx=2179 ms=1562 lb # [ 98.075271] envoy[895]: conn peer=[2001:db8:1::1]:41682 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=376 ms=77 lb # [ 98.080917] envoy[895]: conn peer=[2001:db8:1::1]:41702 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=28 lb # [ 98.085561] envoy[895]: conn peer=[2001:db8:1::1]:41694 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4339 tx=2416 ms=2200 client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only, in 0.30 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.12 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 98.589206] nix-daemon[1167]: accepted connection from pid 1249, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 98.826492] nix-grpc-daemon[771]: ts=2026-09-22T15:06:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:44702 client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 98.735951] nix-grpc-daemon[766]: ts=2026-09-22T15:06:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 98.901633] nix-daemon[833]: accepted connection from pid 1092, user nix-grpc-daemon (trusted) worker1 # [ 98.922232] nix-daemon[833]: reaped child process 1095, status = succeeded lb # [ 98.953501] niks3-server[1010]: 2026/09/22 15:06:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 98.931514] nix-grpc-daemon[859]: time=2026-09-22T15:06:10.531Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 98.933209] nix-grpc-daemon[859]: time=2026-09-22T15:06:10.531Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 98.980837] niks3-server[1010]: 2026/09/22 15:06:10 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker1 # [ 98.962534] nix-grpc-daemon[859]: time=2026-09-22T15:06:10.562Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.994280] niks3-server[1010]: 2026/09/22 15:06:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 99.006682] niks3-server[1010]: 2026/09/22 15:06:10 INFO Signed narinfos id=27 count=1 lb # [ 99.015296] niks3-server[1010]: 2026/09/22 15:06:10 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls worker1 # [ 98.994797] nix-grpc-daemon[859]: time=2026-09-22T15:06:10.595Z level=INFO msg="Upload complete. (257ms)" lb # [ 99.029713] niks3-server[1010]: 2026/09/22 15:06:10 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete lb # [ 99.036358] niks3-server[1010]: 2026/09/22 15:06:10 INFO Completed upload id=27 lb # [ 99.038843] niks3-server[1010]: 2026/09/22 15:06:10 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker2 # [ 99.115050] nix-grpc-daemon[771]: ts=2026-09-22T15:06:10Z level=debug event=want client=14 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 99.121595] nix-grpc-daemon[771]: ts=2026-09-22T15:06:10Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 99.068949] nix-grpc-daemon[766]: ts=2026-09-22T15:06:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 99.084265] nix-grpc-daemon[766]: ts=2026-09-22T15:06:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 99.102813] nix-grpc-daemon[766]: ts=2026-09-22T15:06:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 99.117370] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 99.276891] nix-daemon[833]: accepted connection from pid 1099, user nix-grpc-daemon (trusted) worker1 # [ 99.296869] nix-daemon[833]: reaped child process 1102, status = succeeded worker1 # [ 99.401013] nix-daemon[833]: accepted connection from pid 1104, user nix-grpc-daemon (trusted) worker1 # [ 99.418671] nix-daemon[833]: reaped child process 1107, status = succeeded lb # [ 99.454355] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 99.463843] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 99.440930] nix-grpc-daemon[859]: time=2026-09-22T15:06:11.040Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 99.442379] nix-grpc-daemon[859]: time=2026-09-22T15:06:11.040Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" worker1 # [ 99.444163] nix-grpc-daemon[859]: time=2026-09-22T15:06:11.040Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" lb # [ 99.496947] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 99.516106] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 99.526829] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 99.539047] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker1 # [ 99.514064] nix-grpc-daemon[859]: time=2026-09-22T15:06:11.113Z level=INFO msg="Uploading 3 narinfos" lb # [ 99.548851] niks3-server[1010]: 2026/09/22 15:06:11 INFO Signed narinfos id=28 count=1 lb # [ 99.551652] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign lb # [ 99.565555] niks3-server[1010]: 2026/09/22 15:06:11 INFO Signed narinfos id=29 count=2 lb # [ 99.571822] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 99.579827] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 99.587902] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 99.594532] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 99.601405] niks3-server[1010]: 2026/09/22 15:06:11 INFO Completed upload id=28 worker1 # [ 99.570909] nix-grpc-daemon[859]: time=2026-09-22T15:06:11.171Z level=INFO msg="Upload complete. (433ms)" lb # [ 99.603964] niks3-server[1010]: 2026/09/22 15:06:11 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 99.610152] niks3-server[1010]: 2026/09/22 15:06:11 INFO Completed upload id=29 lb # [ 99.612241] niks3-server[1010]: 2026/09/22 15:06:11 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo worker1 # [ 99.584885] nix-grpc-daemon[766]: ts=2026-09-22T15:06:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=2 nar_bytes_in=984 worker1 # [ 99.600410] nix-grpc-daemon[766]: ts=2026-09-22T15:06:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 99.615330] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 99.619058] nix-daemon[833]: reaped child process 1097, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker1 # [ 99.634195] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 101.067462] nix-daemon[833]: reaped child process 1111, status = succeeded worker1 # [ 101.177714] nix-daemon[833]: accepted connection from pid 1127, user nix-grpc-daemon (trusted) worker1 # [ 101.199913] nix-daemon[833]: reaped child process 1130, status = succeeded lb # [ 101.233224] niks3-server[1010]: 2026/09/22 15:06:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 101.208495] nix-grpc-daemon[859]: time=2026-09-22T15:06:12.807Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 101.253079] niks3-server[1010]: 2026/09/22 15:06:12 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls worker1 # [ 101.227611] nix-grpc-daemon[859]: time=2026-09-22T15:06:12.827Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.259847] niks3-server[1010]: 2026/09/22 15:06:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign lb # [ 101.266971] niks3-server[1010]: 2026/09/22 15:06:12 INFO Signed narinfos id=30 count=1 lb # [ 101.270776] niks3-server[1010]: 2026/09/22 15:06:12 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker1 # [ 101.247327] nix-grpc-daemon[859]: time=2026-09-22T15:06:12.847Z level=INFO msg="Upload complete. (197ms)" lb # [ 101.279187] niks3-server[1010]: 2026/09/22 15:06:12 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 101.285252] niks3-server[1010]: 2026/09/22 15:06:12 INFO Completed upload id=30 worker1 # [ 101.252652] nix-grpc-daemon[766]: ts=2026-09-22T15:06:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=15 outputs=1 lb # [ 101.286834] niks3-server[1010]: 2026/09/22 15:06:12 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker1 # [ 101.264464] nix-daemon[833]: reaped child process 1109, status = succeeded client # copying 1 paths... worker2 # [ 101.397729] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 101.405887] nix-grpc-daemon[771]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 101.357104] nix-grpc-daemon[766]: ts=2026-09-22T15:06:12Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 101.364731] nix-grpc-daemon[766]: ts=2026-09-22T15:06:12Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_out=120 client # [ 101.459952] nix-daemon[1167]: reaped child process 1252, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.06 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 101.624850] nix-daemon[1167]: accepted connection from pid 1271, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 101.870391] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:44702 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 101.780980] nix-grpc-daemon[766]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 101.791096] nix-grpc-daemon[859]: time=2026-09-22T15:06:13.391Z level=INFO msg="All 1 paths already cached" worker2 # [ 101.902345] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=want client=15 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 101.909922] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 101.919327] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 101.930838] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 101.952192] nix-grpc-daemon[771]: ts=2026-09-22T15:06:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 101.967626] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 101.988740] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 1/5) worker2 # [ 102.053261] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 2/5) worker2 # [ 102.076900] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 266 ms (attempt 3/5) worker2 # [ 102.344795] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 557 ms (attempt 4/5) worker2 # [ 102.905631] nix-grpc-daemon[771]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 102.914064] nix-grpc-daemon[771]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 102.921062] nix-grpc-daemon[771]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 103.096329] nix-daemon[857]: accepted connection from pid 1315, user nix-grpc-daemon (trusted) worker2 # [ 103.115012] nix-daemon[857]: reaped child process 1318, status = succeeded worker2 # [ 103.220235] nix-daemon[857]: accepted connection from pid 1320, user nix-grpc-daemon (trusted) worker2 # [ 103.236996] nix-daemon[857]: reaped child process 1323, status = succeeded lb # [ 103.181756] niks3-server[1010]: 2026/09/22 15:06:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 103.253713] nix-grpc-daemon[872]: time=2026-09-22T15:06:14.872Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 103.255212] nix-grpc-daemon[872]: time=2026-09-22T15:06:14.872Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 103.219230] niks3-server[1010]: 2026/09/22 15:06:14 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst lb # [ 103.234686] niks3-server[1010]: 2026/09/22 15:06:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign worker2 # [ 103.302276] nix-grpc-daemon[872]: time=2026-09-22T15:06:14.921Z level=INFO msg="Uploading 1 narinfos" lb # [ 103.243192] niks3-server[1010]: 2026/09/22 15:06:14 INFO Signed narinfos id=31 count=1 lb # [ 103.248446] niks3-server[1010]: 2026/09/22 15:06:14 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 103.259865] niks3-server[1010]: 2026/09/22 15:06:14 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 103.266772] niks3-server[1010]: 2026/09/22 15:06:14 INFO Completed upload id=31 worker2 # [ 103.327349] nix-grpc-daemon[872]: time=2026-09-22T15:06:14.947Z level=INFO msg="Upload complete. (387ms)" lb # [ 103.270570] niks3-server[1010]: 2026/09/22 15:06:14 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker2 # [ 103.336288] nix-grpc-daemon[771]: ts=2026-09-22T15:06:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 paths=1 nar_bytes_in=568 worker2 # [ 103.347235] nix-grpc-daemon[771]: ts=2026-09-22T15:06:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 103.360554] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) worker2 # [ 103.366754] nix-daemon[857]: reaped child process 1308, status = succeeded worker2 # [ 103.383006] nix-grpc-daemon[771]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker2 # [ 103.401804] nix-daemon[857]: accepted connection from pid 771, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 105.080351] nix-daemon[857]: reaped child process 1328, status = succeeded worker2 # [ 105.199181] nix-daemon[857]: accepted connection from pid 1344, user nix-grpc-daemon (trusted) worker2 # [ 105.215365] nix-daemon[857]: reaped child process 1347, status = succeeded lb # [ 105.162403] niks3-server[1010]: 2026/09/22 15:06:16 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 105.236481] nix-grpc-daemon[872]: time=2026-09-22T15:06:16.853Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 105.194532] niks3-server[1010]: 2026/09/22 15:06:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker2 # [ 105.265427] nix-grpc-daemon[872]: time=2026-09-22T15:06:16.884Z level=INFO msg="Uploading 1 narinfos" lb # [ 105.210031] niks3-server[1010]: 2026/09/22 15:06:16 INFO Signed narinfos id=32 count=1 lb # [ 105.218409] niks3-server[1010]: 2026/09/22 15:06:16 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 105.226711] niks3-server[1010]: 2026/09/22 15:06:16 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 105.236285] niks3-server[1010]: 2026/09/22 15:06:16 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 105.240268] niks3-server[1010]: 2026/09/22 15:06:16 INFO Completed upload id=32 worker2 # [ 105.302584] nix-grpc-daemon[872]: time=2026-09-22T15:06:16.922Z level=INFO msg="Upload complete. (288ms)" lb # [ 105.243042] niks3-server[1010]: 2026/09/22 15:06:16 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker2 # [ 105.317258] nix-grpc-daemon[771]: ts=2026-09-22T15:06:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=16 outputs=1 worker2 # [ 105.335208] nix-daemon[857]: reaped child process 1325, status = succeeded client # copying 1 paths... worker2 # [ 105.359955] nix-grpc-daemon[771]: ts=2026-09-22T15:06:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:44702 client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 105.393635] nix-grpc-daemon[771]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 105.400405] nix-grpc-daemon[771]: ts=2026-09-22T15:06:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_out=120 client # [ 105.437993] nix-daemon[1167]: reaped child process 1274, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.98 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 105.601952] nix-daemon[1167]: accepted connection from pid 1293, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 105.743267] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53602 worker2 # [ 105.839397] nix-grpc-daemon[771]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44702 worker2 # [ 105.848874] nix-grpc-daemon[872]: time=2026-09-22T15:06:17.468Z level=INFO msg="All 1 paths already cached" worker2 # [ 105.864815] nix-grpc-daemon[771]: ts=2026-09-22T15:06:17Z level=debug event=want client=16 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker1 # [ 105.780086] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker2 # [ 105.871343] nix-grpc-daemon[771]: ts=2026-09-22T15:06:17Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 105.791848] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53602 client # copying 1 paths to 'lb:50051'... worker1 # [ 105.805636] nix-grpc-daemon[859]: time=2026-09-22T15:06:17.403Z level=INFO msg="All 1 paths already cached" client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 105.811104] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 105.826312] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 105.987422] nix-daemon[833]: accepted connection from pid 1134, user nix-grpc-daemon (trusted) worker1 # [ 106.006734] nix-daemon[833]: reaped child process 1137, status = succeeded worker1 # [ 106.107334] nix-daemon[833]: accepted connection from pid 1139, user nix-grpc-daemon (trusted) worker1 # [ 106.122120] nix-daemon[833]: reaped child process 1142, status = succeeded lb # [ 106.162816] niks3-server[1010]: 2026/09/22 15:06:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 106.143242] nix-grpc-daemon[859]: time=2026-09-22T15:06:17.743Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 106.144829] nix-grpc-daemon[859]: time=2026-09-22T15:06:17.743Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 106.192290] niks3-server[1010]: 2026/09/22 15:06:17 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 106.206825] niks3-server[1010]: 2026/09/22 15:06:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker1 # [ 106.181173] nix-grpc-daemon[859]: time=2026-09-22T15:06:17.781Z level=INFO msg="Uploading 1 narinfos" lb # [ 106.217891] niks3-server[1010]: 2026/09/22 15:06:17 INFO Signed narinfos id=33 count=1 lb # [ 106.224635] niks3-server[1010]: 2026/09/22 15:06:17 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 106.234358] niks3-server[1010]: 2026/09/22 15:06:17 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 106.242510] niks3-server[1010]: 2026/09/22 15:06:17 INFO Completed upload id=33 lb # [ 106.244620] niks3-server[1010]: 2026/09/22 15:06:17 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker1 # [ 106.209389] nix-grpc-daemon[859]: time=2026-09-22T15:06:17.809Z level=INFO msg="Upload complete. (366ms)" worker1 # [ 106.221140] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=0 paths=1 nar_bytes_in=568 worker1 # [ 106.234242] nix-grpc-daemon[766]: ts=2026-09-22T15:06:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 106.242585] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) worker1 # [ 106.244895] nix-daemon[833]: reaped child process 1132, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker1 # [ 106.257678] nix-daemon[833]: accepted connection from pid 766, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 107.735621] nix-daemon[833]: reaped child process 1146, status = succeeded worker1 # [ 107.846357] nix-daemon[833]: accepted connection from pid 1162, user nix-grpc-daemon (trusted) worker1 # [ 107.865641] nix-daemon[833]: reaped child process 1165, status = succeeded lb # [ 107.896609] niks3-server[1010]: 2026/09/22 15:06:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 107.875778] nix-grpc-daemon[859]: time=2026-09-22T15:06:19.475Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 107.924493] niks3-server[1010]: 2026/09/22 15:06:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker1 # [ 107.901588] nix-grpc-daemon[859]: time=2026-09-22T15:06:19.501Z level=INFO msg="Uploading 1 narinfos" lb # [ 107.937993] niks3-server[1010]: 2026/09/22 15:06:19 INFO Signed narinfos id=34 count=1 lb # [ 107.948381] niks3-server[1010]: 2026/09/22 15:06:19 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 107.959994] niks3-server[1010]: 2026/09/22 15:06:19 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 107.973233] niks3-server[1010]: 2026/09/22 15:06:19 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete worker1 # [ 107.947616] nix-grpc-daemon[859]: time=2026-09-22T15:06:19.547Z level=INFO msg="Upload complete. (277ms)" lb # [ 107.982100] niks3-server[1010]: 2026/09/22 15:06:19 INFO Completed upload id=34 lb # [ 107.988545] niks3-server[1010]: 2026/09/22 15:06:19 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo client # copying 1 paths... worker1 # [ 107.961205] nix-grpc-daemon[766]: ts=2026-09-22T15:06:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53602 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=17 outputs=1 worker1 # [ 107.979677] nix-grpc-daemon[766]: ts=2026-09-22T15:06:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 107.985767] nix-daemon[833]: reaped child process 1144, status = succeeded client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 108.106080] nix-grpc-daemon[771]: ts=2026-09-22T15:06:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 lb # [ 108.053920] envoy[895]: conn peer=[2001:db8:1::1]:41714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3875 tx=2083 ms=2650 lb # [ 108.062009] envoy[895]: conn peer=[2001:db8:1::1]:51206 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=30 worker2 # [ 108.125956] nix-grpc-daemon[771]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... lb # [ 108.066775] envoy[895]: conn peer=[2001:db8:1::1]:51208 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3765 tx=2123 ms=3589 lb # [ 108.076420] envoy[895]: conn peer=[2001:db8:1::1]:51222 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=70 worker2 # [ 108.144157] nix-grpc-daemon[771]: ts=2026-09-22T15:06:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44702 duration_s=0 paths=1 nar_bytes_out=120 client # [ 108.186879] nix-daemon[1167]: reaped child process 1296, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.75 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 10.44 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache, in 0.33 seconds) client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache, in 0.28 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.12 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.19 seconds) worker2 # [ 109.281325] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 109.509345] nix-grpc-daemon[771]: ts=2026-09-22T15:06:21Z level=info event=signal_exit lb # [ 109.741216] niks3-server[1010]: 2026/09/22 15:06:21 INFO lead: released remote=192.168.1.4:37172 worker2 # [ 110.799392] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=scheduler_restarting worker1 # [ 110.707187] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 110.810815] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:44700 worker2 # [ 110.816720] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 110.821631] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 110.826294] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:44700 worker2 # [ 110.831706] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 110.859684] nix-daemon[857]: reaped child process 859, status = succeeded worker1 # [ 110.907221] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 110.912719] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.034230] nix-grpc-daemon[771]: ts=2026-09-22T15:06:22Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 111.113376] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.118452] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.319244] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.324562] nix-grpc-daemon[766]: ts=2026-09-22T15:06:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.525191] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.530350] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 111.710382] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 111.716295] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 111.724321] systemd[1]: nix-grpc-daemon.service: Consumed 4.858s CPU time over 1min 33.442s wall clock time, 69M memory peak, 115.9K incoming IP traffic, 301.2K outgoing IP traffic. worker2 # [ 111.740527] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 111.747864] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 111.750051] systemd[1]: nix-grpc-daemon.socket: Consumed 551us CPU time over 1min 41.541s wall clock time, 256K memory peak, 128.3K incoming IP traffic, 107.4K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 111.732992] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_connected addr=lb:50051 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 111.737056] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.07 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 111.933503] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 111.938333] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 111.957809] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53602 worker1 # [ 111.966820] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53602 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.25 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.03 seconds) worker2 # [ 112.186104] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 112.139613] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.146547] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.175130] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 112.330069] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=signal_exit worker1 # [ 112.346732] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.351848] nix-grpc-daemon[766]: ts=2026-09-22T15:06:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 112.552541] nix-grpc-daemon[766]: ts=2026-09-22T15:06:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.557498] nix-grpc-daemon[766]: ts=2026-09-22T15:06:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 112.749135] systemd[1]: Starting scheduler-token.service... worker2 # [ 112.833079] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 112.838542] systemd[1]: Finished scheduler-token.service. worker2 # [ 112.845372] systemd[1]: scheduler-token.service: Consumed 58ms CPU time over 89ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 112.853623] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 112.759871] nix-grpc-daemon[766]: ts=2026-09-22T15:06:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 112.764159] nix-grpc-daemon[766]: ts=2026-09-22T15:06:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.003490] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 113.006609] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 113.010433] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 113.016044] nix-grpc-daemon[1374]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 113.017514] nix-grpc-daemon[1374]: E0000 00:00:1790089584.635120 1374 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 112.974405] niks3-server[1010]: 2026/09/22 15:06:24 INFO lead: acquired remote=192.168.1.4:45332 worker1 # [ 112.960385] nix-grpc-daemon[766]: ts=2026-09-22T15:06:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.060070] nix-grpc-daemon[1374]: E0000 00:00:1790089584.641259 1374 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 113.062403] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 113.072611] nix-grpc-daemon[1374]: E0000 00:00:1790089584.653761 1415 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 113.075649] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=scheduler_take_over worker2 # [ 113.077057] nix-grpc-daemon[1374]: E0000 00:00:1790089584.671220 1415 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 113.079310] nix-grpc-daemon[1374]: E0000 00:00:1790089584.671362 1415 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 113.084601] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:41316 worker2 # [ 113.088715] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 113.090779] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 113.092101] nix-grpc-daemon[1374]: E0000 00:00:1790089584.691551 1415 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 113.094759] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.097882] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 113.099161] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:41316 worker2 # [ 113.100951] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:24Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 113.715187] nix-grpc-daemon[766]: ts=2026-09-22T15:06:25Z level=info event=scheduler_restarting worker2 # [ 113.820262] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:25Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:41316 worker2 # [ 113.820672] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:25Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 113.756763] nix-grpc-daemon[766]: ts=2026-09-22T15:06:25Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 113.774892] nix-daemon[833]: reaped child process 835, status = succeeded worker1 # [ 114.507462] nix-grpc-daemon[766]: E0000 00:00:1790089586.106439 811 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 18, started true, shutdown true worker1 # [ 114.513948] nix-grpc-daemon[766]: E0000 00:00:1790089586.106742 811 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 115.556472] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 115.561477] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 115.569114] systemd[1]: nix-grpc-daemon.service: Consumed 3.579s CPU time over 1min 37.525s wall clock time, 59.1M memory peak, 91.6K incoming IP traffic, 164.7K outgoing IP traffic. worker1 # [ 115.583492] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 115.590315] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 115.595350] systemd[1]: nix-grpc-daemon.socket: Consumed 550us CPU time over 1min 45.489s wall clock time, 256K memory peak, 98.6K incoming IP traffic, 87.2K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.07 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 116.003735] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 116.019912] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) worker2 # [ 116.045373] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5) worker2 # [ 116.115540] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 2/5) worker2 # [ 116.283532] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 338 ms (attempt 3/5) worker2 # [ 116.623530] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 209 ms (attempt 4/5) worker2 # [ 116.836252] nix-grpc-daemon[1374]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 116.839926] nix-grpc-daemon[1374]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 116.865955] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 116.883053] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) worker2 # [ 116.914580] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:28Z level=info event=niks3_push_started pid=1434 worker2 # [ 117.066963] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.686Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 117.175956] nix-daemon[857]: accepted connection from pid 1446, user nix-grpc-daemon (trusted) worker2 # [ 117.196944] nix-daemon[857]: reaped child process 1449, status = succeeded lb # [ 117.141102] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 117.151720] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 117.224075] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.842Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 117.225688] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.842Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 117.227478] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.843Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 117.200256] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 117.224772] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 117.231933] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 117.237210] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 117.245032] niks3-server[1010]: 2026/09/22 15:06:28 INFO Signed narinfos id=36 count=2 worker2 # [ 117.306331] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.925Z level=INFO msg="Uploading 3 narinfos" lb # [ 117.246845] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 117.255432] niks3-server[1010]: 2026/09/22 15:06:28 INFO Signed narinfos id=35 count=1 lb # [ 117.259513] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 117.274446] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 117.281773] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 117.288567] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete lb # [ 117.293996] niks3-server[1010]: 2026/09/22 15:06:28 INFO Completed upload id=35 worker2 # [ 117.355790] nix-grpc-daemon[1434]: time=2026-09-22T15:06:28.975Z level=INFO msg="Upload complete. (285ms)" lb # [ 117.295439] niks3-server[1010]: 2026/09/22 15:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 117.298601] niks3-server[1010]: 2026/09/22 15:06:28 INFO Completed upload id=36 lb # [ 117.300275] niks3-server[1010]: 2026/09/22 15:06:28 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo worker2 # [ 117.369458] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 117.386521] nix-daemon[857]: reaped child process 1432, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.64 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds) worker1 # [ 117.415342] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 117.424105] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 117.578950] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 117.581506] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 117.585386] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 117.591068] nix-grpc-daemon[1188]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 117.612150] nix-grpc-daemon[1188]: E0000 00:00:1790089589.190930 1188 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 117.644195] nix-grpc-daemon[1188]: E0000 00:00:1790089589.194822 1188 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 117.649898] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 117.652130] nix-grpc-daemon[1188]: E0000 00:00:1790089589.210088 1230 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 117.654683] nix-grpc-daemon[1188]: E0000 00:00:1790089589.230794 1230 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 117.657034] nix-grpc-daemon[1188]: E0000 00:00:1790089589.230972 1230 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 117.659387] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 117.660487] nix-grpc-daemon[1188]: E0000 00:00:1790089589.249165 1230 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 117.668359] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 117.764350] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:41316 worker2 # [ 117.770200] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.08 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.52 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 117.929086] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:29Z level=info event=scheduler_lock_lost status=200 worker1 # [ 117.835085] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:29Z level=info event=scheduler_lock_lost status=200 lb # [ 117.866503] niks3-server[1010]: 2026/09/22 15:06:29 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 117.884525] niks3-server[1010]: 2026/09/22 15:06:29 INFO lead: released remote=192.168.1.4:45332 lb # [ 117.890874] systemd[1]: Stopping niks3 server... lb # [ 117.892888] systemd[1]: niks3.service: Deactivated successfully. lb # [ 117.895662] systemd[1]: Stopped niks3 server. lb # [ 117.896500] systemd[1]: niks3.service: Consumed 651ms CPU time over 1min 29.450s wall clock time, 27.7M memory peak, 97.1K incoming IP traffic, 139.4K outgoing IP traffic. lb # [ 117.905704] systemd[1]: Starting niks3 server... lb # [ 117.969615] niks3-server[1145]: 2026/09/22 15:06:29 goose: no migrations to run. current version: 20260920000000 lb # [ 117.979362] niks3-server[1145]: 2026/09/22 15:06:29 OK 1_commit_pending_closure.sql (7.86ms) lb # [ 117.983099] niks3-server[1145]: 2026/09/22 15:06:29 OK 2_object_stats_trigger.sql (3.39ms) lb # [ 117.985592] niks3-server[1145]: 2026/09/22 15:06:29 goose: up to current file version: 2 lb # [ 117.987352] niks3-server[1145]: 2026/09/22 15:06:29 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key lb # [ 117.998338] niks3-server[1145]: 2026/09/22 15:06:29 INFO Read proxy enabled — serving cache objects from S3 lb # [ 117.999704] niks3-server[1145]: 2026/09/22 15:06:29 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 118.005067] niks3-server[1145]: 2026/09/22 15:06:29 INFO systemd watchdog enabled interval=15s lb # [ 118.007445] niks3-server[1145]: 2026/09/22 15:06:29 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 118.009803] systemd[1]: Started niks3 server. lb: waiting for unit niks3.service lb: (finished: waiting for unit niks3.service, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb # [ 118.050052] envoy[895]: conn peer=[2001:db8:1::1]:51238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3753 tx=2099 ms=2366 lb # [ 118.051633] envoy[895]: conn peer=[2001:db8:1::1]:51242 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=101 lb # [ 118.053741] envoy[895]: conn peer=[2001:db8:1::4]:39914 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=80611 tx=4421 ms=92475 lb # [ 118.056439] envoy[895]: conn peer=[2001:db8:1::1]:41844 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=29 lb # [ 118.057963] envoy[895]: conn peer=[2001:db8:1::3]:33890 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=17209 tx=4560 ms=95375 lb # [ 118.059554] envoy[895]: conn peer=[2001:db8:1::1]:41858 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1005 tx=282 ms=1383 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker2: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2 worker2 # [ 118.573114] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:41324 client # don't know how to build these paths: client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker2 # [ 118.582995] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 118.614444] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=0 worker2 # [ 118.622037] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 118.662468] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 118.678317] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41324 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'... worker2 # [ 118.694303] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 118.709338] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) worker2 # [ 118.870570] nix-daemon[857]: accepted connection from pid 1466, user nix-grpc-daemon (trusted) worker2 # [ 118.890961] nix-daemon[857]: reaped child process 1469, status = succeeded lb # [ 118.872140] niks3-server[1145]: 2026/09/22 15:06:30 INFO lead: acquired remote=192.168.1.4:45400 worker2 # [ 118.990926] nix-daemon[857]: accepted connection from pid 1471, user nix-grpc-daemon (trusted) worker2 # [ 119.006091] nix-daemon[857]: reaped child process 1476, status = succeeded lb # [ 118.952126] niks3-server[1145]: 2026/09/22 15:06:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 119.042795] nix-grpc-daemon[1434]: time=2026-09-22T15:06:30.661Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 119.044625] nix-grpc-daemon[1434]: time=2026-09-22T15:06:30.661Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)" lb # [ 119.019923] niks3-server[1145]: 2026/09/22 15:06:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 119.034871] niks3-server[1145]: 2026/09/22 15:06:30 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst lb # [ 119.056170] niks3-server[1145]: 2026/09/22 15:06:30 INFO Signed narinfos id=37 count=1 lb # [ 119.062155] niks3-server[1145]: 2026/09/22 15:06:30 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls worker2 # [ 119.124821] nix-grpc-daemon[1434]: time=2026-09-22T15:06:30.743Z level=INFO msg="Uploading 1 narinfos" lb # [ 119.068816] niks3-server[1145]: 2026/09/22 15:06:30 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 119.080425] niks3-server[1145]: 2026/09/22 15:06:30 INFO Completed upload id=37 worker2 # [ 119.142830] nix-grpc-daemon[1434]: time=2026-09-22T15:06:30.762Z level=INFO msg="Upload complete. (416ms)" lb # [ 119.085881] niks3-server[1145]: 2026/09/22 15:06:30 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo worker2 # [ 119.152323] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=0 paths=1 nar_bytes_in=544 worker2 # [ 119.172384] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 119.180729] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) worker2 # [ 119.187030] nix-daemon[857]: reaped child process 1464, status = succeeded client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051... worker2 # [ 119.199459] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) client # farm-a> worker2: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker2 # [ 120.454148] nix-daemon[857]: reaped child process 1480, status = succeeded worker2 # [ 120.584454] nix-daemon[857]: accepted connection from pid 1496, user nix-grpc-daemon (trusted) worker2 # [ 120.601508] nix-daemon[857]: reaped child process 1499, status = succeeded lb # [ 120.547409] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 120.624449] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.241Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 120.626212] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.241Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)" lb # [ 120.594787] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv lb # [ 120.605762] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst worker2 # [ 120.681716] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.300Z level=INFO msg="Uploading 1 narinfos" lb # [ 120.623052] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 120.634262] niks3-server[1145]: 2026/09/22 15:06:32 INFO Signed narinfos id=38 count=1 lb # [ 120.639777] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls worker2 # [ 120.712946] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.332Z level=INFO msg="Upload complete. (300ms)" lb # [ 120.651419] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 120.656881] niks3-server[1145]: 2026/09/22 15:06:32 INFO Completed upload id=38 lb # [ 120.661484] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo worker2 # [ 120.735023] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=1 worker2 # [ 120.752289] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=0 worker2 # [ 120.757435] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 120.762026] nix-daemon[857]: reaped child process 1478, status = succeeded worker2 # [ 120.778506] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 120.794091] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 120.809204] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.428Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'... worker2 # [ 120.819702] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 120.833291] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) worker2 # [ 120.986043] nix-daemon[857]: accepted connection from pid 1505, user nix-grpc-daemon (trusted) worker2 # [ 121.003139] nix-daemon[857]: reaped child process 1508, status = succeeded worker2 # [ 121.105615] nix-daemon[857]: accepted connection from pid 1510, user nix-grpc-daemon (trusted) worker2 # [ 121.124212] nix-daemon[857]: reaped child process 1513, status = succeeded lb # [ 121.060569] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 121.133810] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.753Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 121.135298] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.753Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)" lb # [ 121.090898] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst lb # [ 121.103122] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign worker2 # [ 121.172586] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.792Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.117177] niks3-server[1145]: 2026/09/22 15:06:32 INFO Signed narinfos id=39 count=1 lb # [ 121.124868] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls worker2 # [ 121.198983] nix-grpc-daemon[1434]: time=2026-09-22T15:06:32.818Z level=INFO msg="Upload complete. (350ms)" lb # [ 121.137397] niks3-server[1145]: 2026/09/22 15:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 121.143824] niks3-server[1145]: 2026/09/22 15:06:32 INFO Completed upload id=39 lb # [ 121.147367] niks3-server[1145]: 2026/09/22 15:06:32 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo worker2 # [ 121.208247] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=0 paths=1 nar_bytes_in=656 worker2 # [ 121.221314] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 121.227546] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) worker2 # [ 121.232731] nix-daemon[857]: reaped child process 1503, status = succeeded client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051... worker2 # [ 121.244987] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) client # farm-b> worker2: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker2 # [ 121.919989] nix-daemon[857]: reaped child process 1517, status = succeeded worker2 # [ 122.025013] nix-daemon[857]: accepted connection from pid 1534, user nix-grpc-daemon (trusted) worker2 # [ 122.042663] nix-daemon[857]: reaped child process 1537, status = succeeded lb # [ 121.988606] niks3-server[1145]: 2026/09/22 15:06:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 122.060993] nix-grpc-daemon[1434]: time=2026-09-22T15:06:33.679Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 122.062640] nix-grpc-daemon[1434]: time=2026-09-22T15:06:33.679Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)" lb # [ 122.023859] niks3-server[1145]: 2026/09/22 15:06:33 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst worker2 # [ 122.106256] nix-grpc-daemon[1434]: time=2026-09-22T15:06:33.725Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.043700] niks3-server[1145]: 2026/09/22 15:06:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 122.054683] niks3-server[1145]: 2026/09/22 15:06:33 INFO Signed narinfos id=40 count=1 lb # [ 122.061935] niks3-server[1145]: 2026/09/22 15:06:33 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv lb # [ 122.071359] niks3-server[1145]: 2026/09/22 15:06:33 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls lb # [ 122.082420] niks3-server[1145]: 2026/09/22 15:06:33 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 122.088743] niks3-server[1145]: 2026/09/22 15:06:33 INFO Completed upload id=40 worker2 # [ 122.148657] nix-grpc-daemon[1434]: time=2026-09-22T15:06:33.768Z level=INFO msg="Upload complete. (294ms)" lb # [ 122.090692] niks3-server[1145]: 2026/09/22 15:06:33 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo worker2 # [ 122.167207] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=0 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=1 worker2 # [ 122.184396] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=0 worker2 # [ 122.190691] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 122.195285] nix-daemon[857]: reaped child process 1515, status = succeeded worker2 # [ 122.210733] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 122.225744] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 122.241054] nix-grpc-daemon[1434]: time=2026-09-22T15:06:33.860Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'... worker2 # [ 122.252525] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 122.266064] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) worker2 # [ 122.421202] nix-daemon[857]: accepted connection from pid 1543, user nix-grpc-daemon (trusted) worker2 # [ 122.448774] nix-daemon[857]: reaped child process 1546, status = succeeded worker2 # [ 122.537705] nix-daemon[857]: accepted connection from pid 1548, user nix-grpc-daemon (trusted) worker2 # [ 122.556434] nix-daemon[857]: reaped child process 1551, status = succeeded lb # [ 122.492406] niks3-server[1145]: 2026/09/22 15:06:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 122.564175] nix-grpc-daemon[1434]: time=2026-09-22T15:06:34.183Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 122.565607] nix-grpc-daemon[1434]: time=2026-09-22T15:06:34.183Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)" lb # [ 122.519585] niks3-server[1145]: 2026/09/22 15:06:34 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst worker2 # [ 122.602094] nix-grpc-daemon[1434]: time=2026-09-22T15:06:34.221Z level=INFO msg="Uploading 1 narinfos" lb # [ 122.532967] niks3-server[1145]: 2026/09/22 15:06:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 122.547081] niks3-server[1145]: 2026/09/22 15:06:34 INFO Signed narinfos id=41 count=1 lb # [ 122.552602] niks3-server[1145]: 2026/09/22 15:06:34 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls worker2 # [ 122.627980] nix-grpc-daemon[1434]: time=2026-09-22T15:06:34.247Z level=INFO msg="Upload complete. (345ms)" lb # [ 122.566621] niks3-server[1145]: 2026/09/22 15:06:34 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete worker2 # [ 122.636123] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=0 paths=1 nar_bytes_in=784 lb # [ 122.575468] niks3-server[1145]: 2026/09/22 15:06:34 INFO Completed upload id=41 lb # [ 122.579644] niks3-server[1145]: 2026/09/22 15:06:34 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo worker2 # [ 122.644367] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 worker2 # [ 122.657902] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) worker2 # [ 122.660490] nix-daemon[857]: reaped child process 1541, status = succeeded client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051... client # farm-top> worker2: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker2 # [ 122.674435] nix-daemon[857]: accepted connection from pid 1374, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker2 # [ 123.511379] nix-daemon[857]: reaped child process 1555, status = succeeded worker2 # [ 123.633932] nix-daemon[857]: accepted connection from pid 1571, user nix-grpc-daemon (trusted) worker2 # [ 123.653120] nix-daemon[857]: reaped child process 1574, status = succeeded lb # [ 123.599730] niks3-server[1145]: 2026/09/22 15:06:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 123.671743] nix-grpc-daemon[1434]: time=2026-09-22T15:06:35.289Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 123.673493] nix-grpc-daemon[1434]: time=2026-09-22T15:06:35.289Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)" lb # [ 123.638651] niks3-server[1145]: 2026/09/22 15:06:35 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst lb # [ 123.650589] niks3-server[1145]: 2026/09/22 15:06:35 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker2 # [ 123.722795] nix-grpc-daemon[1434]: time=2026-09-22T15:06:35.342Z level=INFO msg="Uploading 1 narinfos" lb # [ 123.663302] niks3-server[1145]: 2026/09/22 15:06:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign lb # [ 123.670891] niks3-server[1145]: 2026/09/22 15:06:35 INFO Signed narinfos id=42 count=1 lb # [ 123.675352] niks3-server[1145]: 2026/09/22 15:06:35 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls lb # [ 123.682411] niks3-server[1145]: 2026/09/22 15:06:35 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete worker2 # [ 123.748846] nix-grpc-daemon[1434]: time=2026-09-22T15:06:35.368Z level=INFO msg="Upload complete. (264ms)" lb # [ 123.689250] niks3-server[1145]: 2026/09/22 15:06:35 INFO Completed upload id=42 lb # [ 123.691883] niks3-server[1145]: 2026/09/22 15:06:35 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo worker2 # [ 123.765283] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41324 duration_s=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=1 worker2 # [ 123.780846] nix-daemon[857]: reaped child process 1553, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2, in 5.45 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath, in 0.19 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 6.18 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2 # [ 124.235949] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 125.035580] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:36Z level=info event=signal_exit lb # [ 125.884387] niks3-server[1145]: 2026/09/22 15:06:37 INFO lead: released remote=192.168.1.4:45400 worker1 # [ 126.847656] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:38Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 126.945411] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=scheduler_restarting worker2 # [ 126.950192] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 126.954637] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:41316 worker2 # [ 126.959930] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 126.964259] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:41316 worker2 # [ 126.970043] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 126.991785] nix-daemon[857]: reaped child process 1426, status = succeeded worker2 # [ 127.072827] nix-grpc-daemon[1374]: E0000 00:00:1790089598.692323 1419 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker2 # [ 127.079985] nix-grpc-daemon[1374]: E0000 00:00:1790089598.699528 1419 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true worker1 # [ 127.047323] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.053136] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 127.160573] nix-grpc-daemon[1374]: ts=2026-09-22T15:06:38Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 127.253812] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:38Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.259118] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 127.460000] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.465295] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 127.665919] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.671130] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 127.873683] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 127.877831] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 128.051887] envoy[895]: conn peer=[2001:db8:1::1]:41874 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9723 tx=4424 ms=5207 lb # [ 128.052205] envoy[895]: conn peer=[2001:db8:1::4]:59368 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=1691 tx=425 ms=14066 worker1 # [ 128.074543] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.079563] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 128.260544] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 128.265453] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 128.273421] systemd[1]: nix-grpc-daemon.service: Consumed 1.651s CPU time over 15.411s wall clock time, 38.4M memory peak, 44.5K incoming IP traffic, 75.9K outgoing IP traffic. worker2 # [ 128.288354] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 128.297834] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 128.303013] systemd[1]: nix-grpc-daemon.socket: Consumed 836us CPU time over 16.114s wall clock time, 256K memory peak, 38K incoming IP traffic, 28.1K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 128.281118] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.287602] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:39Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.482734] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.488131] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 128.688862] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.693846] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 128.873926] niks3-server[1145]: 2026/09/22 15:06:40 INFO lead: acquired remote=192.168.1.3:53438 worker1 # [ 128.843092] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_take_over worker1 # [ 128.896442] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 128.900298] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 129.097376] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.102189] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 129.303268] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.314179] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:40Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.17 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) worker1 # [ 129.511701] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.517976] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:41Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 129.717832] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:41Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 129.728202] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:41Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:33856 worker1 # [ 129.733201] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2 worker1 # [ 130.725282] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 130.740882] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 130.765292] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 130.781521] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 1/5) worker1 # [ 130.821664] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 186 ms (attempt 2/5) worker1 # [ 131.009892] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 3/5) worker1 # [ 131.110673] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 496 ms (attempt 4/5) worker1 # [ 131.609373] nix-grpc-daemon[1188]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 131.616758] nix-grpc-daemon[1188]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 131.647274] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 131.655154] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 131.693815] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 131.710057] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33870 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 131.726702] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 131.742303] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) worker1 # [ 131.773310] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=info event=niks3_push_started pid=1270 worker1 # [ 131.964281] nix-grpc-daemon[1270]: time=2026-09-22T15:06:43.564Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca="" worker1 # [ 132.071402] nix-daemon[833]: accepted connection from pid 1283, user nix-grpc-daemon (trusted) worker1 # [ 132.090313] nix-daemon[833]: reaped child process 1286, status = succeeded worker1 # [ 132.191603] nix-daemon[833]: accepted connection from pid 1288, user nix-grpc-daemon (trusted) worker1 # [ 132.206976] nix-daemon[833]: reaped child process 1291, status = succeeded lb # [ 132.247137] niks3-server[1145]: 2026/09/22 15:06:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 132.229464] nix-grpc-daemon[1270]: time=2026-09-22T15:06:43.828Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 132.230942] nix-grpc-daemon[1270]: time=2026-09-22T15:06:43.828Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 132.284792] niks3-server[1145]: 2026/09/22 15:06:43 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 132.297909] niks3-server[1145]: 2026/09/22 15:06:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker1 # [ 132.273650] nix-grpc-daemon[1270]: time=2026-09-22T15:06:43.873Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.313654] niks3-server[1145]: 2026/09/22 15:06:43 INFO Signed narinfos id=43 count=1 lb # [ 132.320801] niks3-server[1145]: 2026/09/22 15:06:43 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 132.336307] niks3-server[1145]: 2026/09/22 15:06:43 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 132.346331] niks3-server[1145]: 2026/09/22 15:06:43 INFO Completed upload id=43 worker1 # [ 132.313653] nix-grpc-daemon[1270]: time=2026-09-22T15:06:43.913Z level=INFO msg="Upload complete. (345ms)" lb # [ 132.348932] niks3-server[1145]: 2026/09/22 15:06:43 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker1 # [ 132.325073] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 132.341937] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 132.348746] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) worker1 # [ 132.354051] nix-daemon[833]: reaped child process 1268, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker1 # [ 132.367943] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 133.645005] nix-daemon[833]: reaped child process 1295, status = succeeded worker1 # [ 133.755222] nix-daemon[833]: accepted connection from pid 1311, user nix-grpc-daemon (trusted) worker1 # [ 133.774439] nix-daemon[833]: reaped child process 1314, status = succeeded lb # [ 133.815161] niks3-server[1145]: 2026/09/22 15:06:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.796407] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.394Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 133.797879] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.394Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 133.849433] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 133.870991] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 133.883743] niks3-server[1145]: 2026/09/22 15:06:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker1 # [ 133.858308] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.457Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.892289] niks3-server[1145]: 2026/09/22 15:06:45 INFO Signed narinfos id=44 count=1 lb # [ 133.897314] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 133.907451] niks3-server[1145]: 2026/09/22 15:06:45 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 133.915326] niks3-server[1145]: 2026/09/22 15:06:45 INFO Completed upload id=44 lb # [ 133.918820] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker1 # [ 133.881909] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.482Z level=INFO msg="Upload complete. (302ms)" worker1 # [ 133.904466] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 133.919151] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 133.922663] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 133.926318] nix-daemon[833]: reaped child process 1293, status = succeeded worker1 # [ 133.948496] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 133.962943] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 133.979124] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.579Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 133.989370] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 134.002092] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) worker1 # [ 134.151780] nix-daemon[833]: accepted connection from pid 1320, user nix-grpc-daemon (trusted) worker1 # [ 134.167244] nix-daemon[833]: reaped child process 1323, status = succeeded worker1 # [ 134.271577] nix-daemon[833]: accepted connection from pid 1325, user nix-grpc-daemon (trusted) worker1 # [ 134.285794] nix-daemon[833]: reaped child process 1328, status = succeeded lb # [ 134.325197] niks3-server[1145]: 2026/09/22 15:06:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 134.303481] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.903Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 134.305099] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.903Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 134.355669] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 134.367976] niks3-server[1145]: 2026/09/22 15:06:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign worker1 # [ 134.342452] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.942Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.380260] niks3-server[1145]: 2026/09/22 15:06:45 INFO Signed narinfos id=45 count=1 lb # [ 134.382634] niks3-server[1145]: 2026/09/22 15:06:45 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 134.396369] niks3-server[1145]: 2026/09/22 15:06:46 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 134.405726] niks3-server[1145]: 2026/09/22 15:06:46 INFO Completed upload id=45 worker1 # [ 134.374181] nix-grpc-daemon[1270]: time=2026-09-22T15:06:45.974Z level=INFO msg="Upload complete. (356ms)" lb # [ 134.408987] niks3-server[1145]: 2026/09/22 15:06:46 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker1 # [ 134.384522] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 134.395685] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 134.405699] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) worker1 # [ 134.408928] nix-daemon[833]: reaped child process 1318, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... worker1 # [ 134.421013] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 135.288790] nix-daemon[833]: reaped child process 1332, status = succeeded worker1 # [ 135.395616] nix-daemon[833]: accepted connection from pid 1348, user nix-grpc-daemon (trusted) worker1 # [ 135.416378] nix-daemon[833]: reaped child process 1351, status = succeeded lb # [ 135.447599] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 135.426463] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.025Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 135.428685] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.025Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 135.485450] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst worker1 # [ 135.475475] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.075Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.497724] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 135.511504] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign lb # [ 135.519188] niks3-server[1145]: 2026/09/22 15:06:47 INFO Signed narinfos id=46 count=1 lb # [ 135.524672] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 135.533328] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 135.539911] niks3-server[1145]: 2026/09/22 15:06:47 INFO Completed upload id=46 worker1 # [ 135.507229] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.107Z level=INFO msg="Upload complete. (274ms)" lb # [ 135.542407] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker1 # [ 135.525193] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 135.543255] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 135.547614] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 135.552003] nix-daemon[833]: reaped child process 1330, status = succeeded worker1 # [ 135.568392] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 135.582515] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 135.596625] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.196Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 135.608124] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 135.621718] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) worker1 # [ 135.776287] nix-daemon[833]: accepted connection from pid 1357, user nix-grpc-daemon (trusted) worker1 # [ 135.794148] nix-daemon[833]: reaped child process 1360, status = succeeded worker1 # [ 135.894388] nix-daemon[833]: accepted connection from pid 1362, user nix-grpc-daemon (trusted) worker1 # [ 135.910379] nix-daemon[833]: reaped child process 1365, status = succeeded lb # [ 135.948714] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 135.925813] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.525Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 135.927319] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.525Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 135.975939] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker1 # [ 135.957931] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.558Z level=INFO msg="Uploading 1 narinfos" lb # [ 135.991031] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign lb # [ 136.001367] niks3-server[1145]: 2026/09/22 15:06:47 INFO Signed narinfos id=47 count=1 lb # [ 136.008192] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 136.016681] niks3-server[1145]: 2026/09/22 15:06:47 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete worker1 # [ 135.991660] nix-grpc-daemon[1270]: time=2026-09-22T15:06:47.592Z level=INFO msg="Upload complete. (352ms)" lb # [ 136.023487] niks3-server[1145]: 2026/09/22 15:06:47 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo lb # [ 136.028801] niks3-server[1145]: 2026/09/22 15:06:47 INFO Completed upload id=47 worker1 # [ 135.998594] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 136.011559] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 136.020156] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) worker1 # [ 136.022906] nix-daemon[833]: reaped child process 1355, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... worker1 # [ 136.033804] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 136.880841] nix-daemon[833]: reaped child process 1369, status = succeeded worker1 # [ 136.999918] nix-daemon[833]: accepted connection from pid 1385, user nix-grpc-daemon (trusted) worker1 # [ 137.016646] nix-daemon[833]: reaped child process 1388, status = succeeded lb # [ 137.055702] niks3-server[1145]: 2026/09/22 15:06:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 137.036402] nix-grpc-daemon[1270]: time=2026-09-22T15:06:48.635Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 137.038075] nix-grpc-daemon[1270]: time=2026-09-22T15:06:48.635Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 137.089351] niks3-server[1145]: 2026/09/22 15:06:48 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 137.107418] niks3-server[1145]: 2026/09/22 15:06:48 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 137.122345] niks3-server[1145]: 2026/09/22 15:06:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker1 # [ 137.099552] nix-grpc-daemon[1270]: time=2026-09-22T15:06:48.699Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.133880] niks3-server[1145]: 2026/09/22 15:06:48 INFO Signed narinfos id=48 count=1 lb # [ 137.142721] niks3-server[1145]: 2026/09/22 15:06:48 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 137.153368] niks3-server[1145]: 2026/09/22 15:06:48 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 137.160957] niks3-server[1145]: 2026/09/22 15:06:48 INFO Completed upload id=48 worker1 # [ 137.128576] nix-grpc-daemon[1270]: time=2026-09-22T15:06:48.728Z level=INFO msg="Upload complete. (283ms)" lb # [ 137.165118] niks3-server[1145]: 2026/09/22 15:06:48 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker1 # [ 137.141936] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 137.162433] nix-daemon[833]: reaped child process 1367, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2, in 6.70 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath, in 0.18 seconds) worker2 # [ 137.542918] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 137.552730] systemd[1]: Starting scheduler-token.service... worker2 # [ 137.626890] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 137.631345] systemd[1]: Finished scheduler-token.service. worker2 # [ 137.636590] systemd[1]: scheduler-token.service: Consumed 43ms CPU time over 77ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 137.642289] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 137.762403] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:49Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 137.764686] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:49Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 137.768459] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:49Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 137.773713] nix-grpc-daemon[1595]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 137.775159] nix-grpc-daemon[1595]: E0000 00:00:1790089609.392632 1595 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 137.800218] nix-grpc-daemon[1595]: E0000 00:00:1790089609.398719 1595 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 137.802607] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:49Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 137.823488] nix-grpc-daemon[1595]: E0000 00:00:1790089609.408454 1635 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 137.826585] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 137.827414] nix-grpc-daemon[1595]: E0000 00:00:1790089609.427927 1635 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 137.829958] nix-grpc-daemon[1595]: E0000 00:00:1790089609.428068 1635 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 137.835201] nix-grpc-daemon[1595]: E0000 00:00:1790089609.442331 1635 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 137.839567] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:49Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 137.754352] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 137.758959] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:33856 worker1 # [ 137.764232] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 14.11 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs lb # [ 138.051043] envoy[895]: conn peer=[2001:db8:1::1]:48502 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9593 tx=4413 ms=6436 client # [ 138.080325] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: dfdf0a2041ca4d3f96d903dbbb27208c client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs, in 0.09 seconds) client # [ 138.279454] nix[1420]: don't know how to build these paths: client # [ 138.280884] nix[1420]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 138.274205] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 138.287128] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 138.294196] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 138.331886] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 138.347712] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:33870 client # [ 138.367073] nix[1420]: copying 1 paths to 'lb:50051'... worker1 # [ 138.362512] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 client # [ 138.369458] nix[1420]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 138.377575] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) worker1 # [ 138.542632] nix-daemon[833]: accepted connection from pid 1401, user nix-grpc-daemon (trusted) worker1 # [ 138.560957] nix-daemon[833]: reaped child process 1404, status = succeeded worker1 # [ 138.662676] nix-daemon[833]: accepted connection from pid 1406, user nix-grpc-daemon (trusted) worker1 # [ 138.682795] nix-daemon[833]: reaped child process 1409, status = succeeded lb # [ 138.716954] niks3-server[1145]: 2026/09/22 15:06:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 138.696946] nix-grpc-daemon[1270]: time=2026-09-22T15:06:50.296Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 138.698445] nix-grpc-daemon[1270]: time=2026-09-22T15:06:50.296Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 138.745294] niks3-server[1145]: 2026/09/22 15:06:50 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 138.759089] niks3-server[1145]: 2026/09/22 15:06:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign worker1 # [ 138.734314] nix-grpc-daemon[1270]: time=2026-09-22T15:06:50.334Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.772560] niks3-server[1145]: 2026/09/22 15:06:50 INFO Signed narinfos id=49 count=1 lb # [ 138.775808] niks3-server[1145]: 2026/09/22 15:06:50 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 138.789032] niks3-server[1145]: 2026/09/22 15:06:50 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete worker1 # [ 138.763118] nix-grpc-daemon[1270]: time=2026-09-22T15:06:50.363Z level=INFO msg="Upload complete. (368ms)" lb # [ 138.797250] niks3-server[1145]: 2026/09/22 15:06:50 INFO Completed upload id=49 worker1 # [ 138.772002] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 138.805718] niks3-server[1145]: 2026/09/22 15:06:50 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker1 # [ 138.785430] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 worker1 # [ 138.791573] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) worker1 # [ 138.796765] nix-daemon[833]: reaped child process 1399, status = succeeded worker1 # [ 138.808152] nix-daemon[833]: accepted connection from pid 1188, user nix-grpc-daemon (trusted) client # [ 138.810891] nix[1420]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 140.978186] systemd-journald[269]: Received client request to rotate journal, rotating. worker2 # [ 140.999622] systemd-journald[269]: Vacuuming done, freed 0B of archived journals from /var/log/journal/13d2a3aa7d2141f3b9e914591afa70a2. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 140.953434] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds) client: must succeed: sleep 5.0 worker1 # [ 141.611051] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:53Z level=info event=draining client: (finished: must succeed: sleep 5.0, in 5.05 seconds) worker1 # [ 146.242472] nix-daemon[833]: reaped child process 1413, status = succeeded worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 146.332426] nix-daemon[833]: accepted connection from pid 1454, user nix-grpc-daemon (trusted) worker1 # [ 146.353239] nix-daemon[833]: reaped child process 1457, status = succeeded lb # [ 146.385257] niks3-server[1145]: 2026/09/22 15:06:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.364386] nix-grpc-daemon[1270]: time=2026-09-22T15:06:57.962Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 146.365853] nix-grpc-daemon[1270]: time=2026-09-22T15:06:57.962Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 146.425156] niks3-server[1145]: 2026/09/22 15:06:58 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 146.436739] niks3-server[1145]: 2026/09/22 15:06:58 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst worker1 # [ 146.422400] nix-grpc-daemon[1270]: time=2026-09-22T15:06:58.022Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.449002] niks3-server[1145]: 2026/09/22 15:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 146.458422] niks3-server[1145]: 2026/09/22 15:06:58 INFO Signed narinfos id=50 count=1 lb # [ 146.464069] niks3-server[1145]: 2026/09/22 15:06:58 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 146.474821] niks3-server[1145]: 2026/09/22 15:06:58 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete worker1 # [ 146.449845] nix-grpc-daemon[1270]: time=2026-09-22T15:06:58.050Z level=INFO msg="Upload complete. (225ms)" lb # [ 146.482806] niks3-server[1145]: 2026/09/22 15:06:58 INFO Completed upload id=50 lb # [ 146.486096] niks3-server[1145]: 2026/09/22 15:06:58 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 146.465023] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:33870 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 146.478889] nix-daemon[833]: reaped child process 1411, status = succeeded client # [ 146.501399] systemd[1]: rs.service: Deactivated successfully. client # [ 146.507029] systemd[1]: rs.service: Consumed 190ms CPU time over 8.422s wall clock time, 41.2M memory peak, 7.3K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 146.612874] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:58Z level=info event=signal_exit lb # [ 146.884208] niks3-server[1145]: 2026/09/22 15:06:58 INFO lead: released remote=192.168.1.3:53438 lb # [ 147.724585] niks3-server[1145]: 2026/09/22 15:06:59 INFO lead: acquired remote=192.168.1.4:53262 worker2 # [ 147.787187] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=scheduler_take_over worker2 # [ 147.941442] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 147.852581] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=scheduler_restarting worker1 # [ 147.857323] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 147.861733] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:33856 worker1 # [ 147.866735] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 147.871286] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:33856 worker1 # [ 147.876566] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 147.902464] nix-daemon[833]: reaped child process 1260, status = succeeded lb # [ 148.050704] envoy[895]: conn peer=[2001:db8:1::1]:40828 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1540 ms=8202 worker2 # [ 148.142976] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.148687] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 148.070686] nix-grpc-daemon[1188]: ts=2026-09-22T15:06:59Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 148.349620] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.366242] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 148.370437] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:45288 worker2 # [ 148.375844] nix-grpc-daemon[1595]: ts=2026-09-22T15:06:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.17 seconds) client: waiting for success: ! systemctl is-active rs client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 148.688745] nix-grpc-daemon[1188]: E0000 00:00:1790089620.288763 1233 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 17, started true, shutdown true worker1 # [ 148.695512] nix-grpc-daemon[1188]: E0000 00:00:1790089620.289060 1233 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker1 # [ 149.879709] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 149.886229] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 149.889072] systemd[1]: nix-grpc-daemon.service: Consumed 1.957s CPU time over 32.459s wall clock time, 38.9M memory peak, 47.5K incoming IP traffic, 89.3K outgoing IP traffic. worker1 # [ 149.909371] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 150.064473] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:01Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 150.066999] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 150.070842] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 150.076058] nix-grpc-daemon[1464]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 150.096151] nix-grpc-daemon[1464]: E0000 00:00:1790089621.676001 1464 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 150.098487] nix-grpc-daemon[1464]: E0000 00:00:1790089621.679615 1464 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 150.120692] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 150.122843] nix-grpc-daemon[1464]: E0000 00:00:1790089621.685741 1504 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 150.125507] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 150.126311] nix-grpc-daemon[1464]: E0000 00:00:1790089621.705900 1504 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 150.131822] nix-grpc-daemon[1464]: E0000 00:00:1790089621.706042 1504 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 150.136180] nix-grpc-daemon[1464]: E0000 00:00:1790089621.720336 1504 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 150.138657] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:01Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 150.233069] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:01Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:45288 worker2 # [ 150.238311] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:01Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.98 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid client # [ 151.065308] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 18fc8e704a794ea7a769d14519fd2988 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid, in 0.09 seconds) worker1 # [ 151.271665] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 151.286305] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # [ 151.308263] nix[1456]: don't know how to build these paths: client # [ 151.309868] nix[1456]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 151.413346] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 151.419424] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 151.481942] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34228 worker2 # [ 151.495742] nix-daemon[857]: accepted connection from pid 1595, user nix-grpc-daemon (trusted) worker2 # [ 151.519728] nix-grpc-daemon[1595]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5) worker2 # [ 151.554028] nix-grpc-daemon[1595]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 29 ms (attempt 2/5) worker2 # [ 151.584680] nix-grpc-daemon[1595]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 3/5) worker2 # [ 151.608541] nix-grpc-daemon[1595]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 434 ms (attempt 4/5) worker2 # [ 152.052198] nix-grpc-daemon[1595]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 152.058397] nix-grpc-daemon[1595]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 152.077593] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34228 client # [ 152.003589] nix[1456]: copying 1 paths to 'lb:50051'... worker2 # [ 152.093037] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34228 client # [ 152.004082] nix[1456]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 152.106990] nix-daemon[857]: accepted connection from pid 1595, user nix-grpc-daemon (trusted) worker2 # [ 152.144085] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:03Z level=info event=niks3_push_started pid=1720 worker2 # [ 152.286364] nix-grpc-daemon[1720]: time=2026-09-22T15:07:03.905Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 152.393461] nix-daemon[857]: accepted connection from pid 1732, user nix-grpc-daemon (trusted) worker2 # [ 152.452516] nix-daemon[857]: reaped child process 1737, status = succeeded worker2 # [ 152.545835] nix-daemon[857]: accepted connection from pid 1740, user nix-grpc-daemon (trusted) worker2 # [ 152.565046] nix-daemon[857]: reaped child process 1744, status = succeeded lb # [ 152.501847] niks3-server[1145]: 2026/09/22 15:07:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 152.574471] nix-grpc-daemon[1720]: time=2026-09-22T15:07:04.193Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 152.575929] nix-grpc-daemon[1720]: time=2026-09-22T15:07:04.193Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 152.536235] niks3-server[1145]: 2026/09/22 15:07:04 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 152.613411] nix-grpc-daemon[1720]: time=2026-09-22T15:07:04.232Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.550648] niks3-server[1145]: 2026/09/22 15:07:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign lb # [ 152.563805] niks3-server[1145]: 2026/09/22 15:07:04 INFO Signed narinfos id=51 count=1 lb # [ 152.571580] niks3-server[1145]: 2026/09/22 15:07:04 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 152.586597] niks3-server[1145]: 2026/09/22 15:07:04 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 152.599545] niks3-server[1145]: 2026/09/22 15:07:04 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo lb # [ 152.615585] niks3-server[1145]: 2026/09/22 15:07:04 INFO Completed upload id=51 worker2 # [ 152.678216] nix-grpc-daemon[1720]: time=2026-09-22T15:07:04.297Z level=INFO msg="Upload complete. (388ms)" worker2 # [ 152.690441] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34228 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 152.704530] nix-grpc-daemon[1595]: ts=2026-09-22T15:07:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34228 worker2 # [ 152.717596] nix-daemon[857]: accepted connection from pid 1595, user nix-grpc-daemon (trusted) worker2 # [ 152.720592] nix-daemon[857]: reaped child process 1718, status = succeeded client # [ 152.642125] nix[1456]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 152.733724] nix-daemon[857]: accepted connection from pid 1595, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 155.072704] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1595 (nix-grpc-daemon) on client request. worker2 # [ 155.074290] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 155.029385] niks3-server[1145]: 2026/09/22 15:07:06 INFO lead: released remote=192.168.1.4:53262 worker2 # [ 155.099823] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL client # [ 155.006198] nix[1456]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 155.001855] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:06Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker2 # [ 155.104978] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. client # [ 155.012669] nix[1456]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 155.106308] systemd[1]: nix-grpc-daemon.service: Consumed 590ms CPU time over 17.452s wall clock time, 34.5M memory peak, 15K incoming IP traffic, 27.7K outgoing IP traffic. worker2 # [ 155.120470] systemd[1]: Starting scheduler-token.service... worker2 # [ 155.153265] nix-daemon[857]: reaped child process 1746, status = succeeded worker2 # [ 155.155189] nix-daemon[857]: reaped child process 1712, status = succeeded worker2 # [ 155.161668] nix-daemon[1748]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 155.176821] nix-daemon[857]: reaped child process 1748, status = failed with exit code 1 worker1 # [ 155.091137] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:06Z level=info event=scheduler_take_over lb # [ 155.122660] niks3-server[1145]: 2026/09/22 15:07:06 INFO lead: acquired remote=192.168.1.3:52052 worker2 # [ 155.199225] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker2 # [ 155.201285] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 155.204492] systemd[1]: Finished scheduler-token.service. worker2 # [ 155.205289] systemd[1]: scheduler-token.service: Consumed 24ms CPU time over 88ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 155.208766] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 155.201957] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.310960] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:06Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 155.313253] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 155.316914] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 155.322568] nix-grpc-daemon[1788]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.31 seconds) worker2 # [ 155.338403] nix-grpc-daemon[1788]: E0000 00:00:1790089626.941487 1788 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. client: must succeed: sleep 5.0 worker2 # [ 155.356171] nix-grpc-daemon[1788]: E0000 00:00:1790089626.945103 1788 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 155.358444] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 155.262569] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 155.381454] nix-grpc-daemon[1788]: E0000 00:00:1790089626.963779 1830 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 155.384416] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 155.385362] nix-grpc-daemon[1788]: E0000 00:00:1790089626.986103 1830 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 155.387606] nix-grpc-daemon[1788]: E0000 00:00:1790089626.986231 1830 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 155.392896] nix-grpc-daemon[1788]: E0000 00:00:1790089627.000535 1830 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 155.398196] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.399748] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 155.463432] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 155.468536] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 155.601629] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:50051 client # [ 155.515144] nix[1456]: scheduler at lb:50051: no healthy upstream, reconnecting worker2 # [ 155.606897] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 155.669196] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 155.674344] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 155.807825] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 155.813130] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 155.875130] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 155.880387] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 156.014074] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.019355] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 156.082982] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 156.087960] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 156.220504] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.225670] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 156.283289] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 156.288393] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:07Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 156.428493] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.432523] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 156.489151] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 156.494109] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client # [ 156.521714] nix[1456]: scheduler at lb:50051: no healthy upstream, reconnecting worker2 # [ 156.629087] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.634198] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 156.694938] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 156.700123] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 156.835394] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 156.840703] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 156.900857] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 156.905746] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 157.041897] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 156.969954] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 156.974500] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:52046 worker1 # [ 156.980046] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 157.109396] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 157.113531] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:52046 worker1 # [ 157.118332] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb # [ 158.052757] envoy[895]: conn peer=[2001:db8:1::3]:37342 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3223 tx=1027 ms=30397 lb # [ 158.057770] envoy[895]: conn peer=[2001:db8:1::4]:42544 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2679 tx=376 ms=17265 worker1 # [ 158.529258] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:10Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 158.535255] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:10Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 158.675834] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34254 worker2 # [ 158.690177] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted) worker2 # [ 158.708368] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted) client # [ 158.638536] nix[1456]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 158.732962] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted) client: (finished: must succeed: sleep 5.0, in 5.05 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 160.761109] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:12Z level=info event=niks3_push_started pid=1869 worker2 # [ 160.803162] nix-daemon[857]: reaped child process 1844, status = succeeded worker2 # [ 160.923912] nix-grpc-daemon[1869]: time=2026-09-22T15:07:12.542Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 161.028129] nix-daemon[857]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker2 # [ 161.045873] nix-daemon[857]: reaped child process 1884, status = succeeded lb # [ 160.990354] niks3-server[1145]: 2026/09/22 15:07:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 161.066427] nix-grpc-daemon[1869]: time=2026-09-22T15:07:12.684Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 161.067890] nix-grpc-daemon[1869]: time=2026-09-22T15:07:12.684Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 161.042288] niks3-server[1145]: 2026/09/22 15:07:12 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 161.064587] niks3-server[1145]: 2026/09/22 15:07:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign worker2 # [ 161.128109] nix-grpc-daemon[1869]: time=2026-09-22T15:07:12.746Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.067914] niks3-server[1145]: 2026/09/22 15:07:12 INFO Signed narinfos id=52 count=1 lb # [ 161.083370] niks3-server[1145]: 2026/09/22 15:07:12 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 161.094885] niks3-server[1145]: 2026/09/22 15:07:12 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 161.108695] niks3-server[1145]: 2026/09/22 15:07:12 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 161.114193] niks3-server[1145]: 2026/09/22 15:07:12 INFO Completed upload id=52 worker2 # [ 161.176652] nix-grpc-daemon[1869]: time=2026-09-22T15:07:12.796Z level=INFO msg="Upload complete. (249ms)" lb # [ 161.118950] niks3-server[1145]: 2026/09/22 15:07:12 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo worker2 # [ 161.188343] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34254 duration_s=2 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker2 # [ 161.207877] nix-daemon[857]: reaped child process 1842, status = succeeded client # [ 161.136621] systemd[1]: mid.service: Deactivated successfully. client # [ 161.141551] systemd[1]: mid.service: Consumed 209ms CPU time over 10.072s wall clock time, 41.5M memory peak, 8.9K incoming IP traffic, 11.3K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.12 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.74 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr client # [ 161.773146] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 636215684f5c4b578981114829407e9d client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr, in 0.05 seconds) worker2 # [ 162.031304] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:13Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34254 client # [ 161.950120] nix[1492]: don't know how to build these paths: client # [ 161.951126] nix[1492]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker1 # [ 161.957295] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:13Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker1 # [ 161.963254] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:13Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 162.008878] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 162.025331] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 1/5) worker1 # [ 162.124349] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 2/5) worker1 # [ 162.165209] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 256 ms (attempt 3/5) worker1 # [ 162.430756] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 4/5) worker1 # [ 162.500991] nix-grpc-daemon[1464]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 162.507509] nix-grpc-daemon[1464]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 162.525265] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 client # [ 162.544155] nix[1492]: copying 1 paths to 'lb:50051'... client # [ 162.546466] nix[1492]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker1 # [ 162.541005] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 162.558726] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 162.585927] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:14Z level=info event=niks3_push_started pid=1560 worker1 # [ 162.734670] nix-grpc-daemon[1560]: time=2026-09-22T15:07:14.334Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca="" worker1 # [ 162.843487] nix-daemon[833]: accepted connection from pid 1572, user nix-grpc-daemon (trusted) worker1 # [ 162.860544] nix-daemon[833]: reaped child process 1575, status = succeeded worker1 # [ 162.972344] nix-daemon[833]: accepted connection from pid 1577, user nix-grpc-daemon (trusted) lb # [ 163.031783] niks3-server[1145]: 2026/09/22 15:07:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 163.008186] nix-daemon[833]: reaped child process 1583, status = succeeded worker1 # [ 163.011427] nix-grpc-daemon[1560]: time=2026-09-22T15:07:14.611Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 163.016741] nix-grpc-daemon[1560]: time=2026-09-22T15:07:14.613Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 163.084991] niks3-server[1145]: 2026/09/22 15:07:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker1 # [ 163.062172] nix-grpc-daemon[1560]: time=2026-09-22T15:07:14.662Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.100366] niks3-server[1145]: 2026/09/22 15:07:14 INFO Signed narinfos id=53 count=1 lb # [ 163.107273] niks3-server[1145]: 2026/09/22 15:07:14 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 163.123820] niks3-server[1145]: 2026/09/22 15:07:14 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 163.133486] niks3-server[1145]: 2026/09/22 15:07:14 INFO Completed upload id=53 worker1 # [ 163.095475] nix-grpc-daemon[1560]: time=2026-09-22T15:07:14.695Z level=INFO msg="Upload complete. (357ms)" lb # [ 163.135047] niks3-server[1145]: 2026/09/22 15:07:14 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker1 # [ 163.105194] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 163.139857] niks3-server[1145]: 2026/09/22 15:07:14 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls worker1 # [ 163.119287] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 163.127404] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 163.130908] nix-daemon[833]: reaped child process 1558, status = succeeded worker1 # [ 163.141383] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # [ 163.145717] nix[1492]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... client: must succeed: systemctl kill -s INT intr worker1 # [ 164.279731] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:15Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 164.283584] systemd[1]: intr.service: Sent signal SIGINT to main process 1492 (nix) on client request. client # [ 164.290330] nix[1492]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 164.305148] nix[1492]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) client # [ 164.329793] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 164.334600] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 164.336821] systemd[1]: intr.service: Consumed 163ms CPU time over 2.559s wall clock time, 41.5M memory peak, 6.5K incoming IP traffic, 8.3K outgoing IP traffic. worker1 # [ 164.371166] nix-daemon[833]: reaped child process 1586, status = succeeded worker1 # [ 164.375549] nix-daemon[1588]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 164.381411] nix-daemon[833]: reaped child process 1588, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.85 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw client # [ 165.650744] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 2ae46600dbcf432cbe646ccc896d624b client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw, in 0.09 seconds) client # [ 165.833839] nix[1513]: don't know how to build these paths: client # [ 165.834819] nix[1513]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 165.922612] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34254 worker1 # [ 165.845420] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:17Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker1 # [ 165.845710] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:17Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 165.998712] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34254 worker2 # [ 166.014207] nix-grpc-daemon[1788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 1/5) worker2 # [ 166.107400] nix-grpc-daemon[1788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 2/5) worker2 # [ 166.274570] nix-grpc-daemon[1788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 359 ms (attempt 3/5) worker2 # [ 166.635605] nix-grpc-daemon[1788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 133 ms (attempt 4/5) worker2 # [ 166.770933] nix-grpc-daemon[1788]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 166.777072] nix-grpc-daemon[1788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 166.795591] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34254 client # [ 166.720402] nix[1513]: copying 1 paths to 'lb:50051'... worker2 # [ 166.811413] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34254 client # [ 166.724191] nix[1513]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker2 # [ 166.828938] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted) worker2 # [ 166.988402] nix-daemon[857]: accepted connection from pid 1916, user nix-grpc-daemon (trusted) worker2 # [ 167.054576] nix-daemon[857]: reaped child process 1921, status = succeeded worker2 # [ 167.136598] nix-daemon[857]: accepted connection from pid 1925, user nix-grpc-daemon (trusted) worker2 # [ 167.156281] nix-daemon[857]: reaped child process 1928, status = succeeded lb # [ 167.093695] niks3-server[1145]: 2026/09/22 15:07:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 167.169863] nix-grpc-daemon[1869]: time=2026-09-22T15:07:18.788Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 167.171326] nix-grpc-daemon[1869]: time=2026-09-22T15:07:18.788Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 167.149039] niks3-server[1145]: 2026/09/22 15:07:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign worker2 # [ 167.217947] nix-grpc-daemon[1869]: time=2026-09-22T15:07:18.837Z level=INFO msg="Uploading 1 narinfos" lb # [ 167.161452] niks3-server[1145]: 2026/09/22 15:07:18 INFO Signed narinfos id=54 count=1 lb # [ 167.167072] niks3-server[1145]: 2026/09/22 15:07:18 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst lb # [ 167.176436] niks3-server[1145]: 2026/09/22 15:07:18 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 167.185388] niks3-server[1145]: 2026/09/22 15:07:18 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 167.190969] niks3-server[1145]: 2026/09/22 15:07:18 INFO Completed upload id=54 worker2 # [ 167.253453] nix-grpc-daemon[1869]: time=2026-09-22T15:07:18.873Z level=INFO msg="Upload complete. (407ms)" lb # [ 167.194407] niks3-server[1145]: 2026/09/22 15:07:18 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker2 # [ 167.265036] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34254 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 167.280917] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34254 worker2 # [ 167.287637] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted) worker2 # [ 167.293304] nix-daemon[857]: reaped child process 1914, status = succeeded client # [ 167.214743] nix[1513]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker2 # [ 167.306326] nix-daemon[857]: accepted connection from pid 1788, user nix-grpc-daemon (trusted) lb # [ 168.049707] envoy[895]: conn peer=[2001:db8:1::1]:41388 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4288 tx=2110 ms=9846 lb # [ 168.055129] envoy[895]: conn peer=[2001:db8:1::1]:34584 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2987 tx=826 ms=2370 worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done worker2 # activating the configuration... worker2 # [ 170.000569] nixos[1964]: switching to system configuration /nix/store/yvvqkjafn76srxj10bdx106rab59v1hp-nixos-system-worker2-test worker2 # [ 170.005303] systemd[1]: Stopped target Local File Systems. worker2 # [ 170.006184] systemd[1]: Stopped target Remote File Systems. worker2 # setting up /etc... worker2 # [ 170.565328] systemd[1]: Reload requested from client PID 1964 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 170.566853] systemd[1]: Reloading... worker2 # [ 175.422694] systemd[1]: Reloading finished in 4850 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 175.544728] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 175.664449] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 175.665654] systemd[1]: Reached target Reactivate sysinit units. worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 175.677028] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 175.678215] dbus-broker-launch[494]: Caught SIGHUP, trigger reload. worker2 # [ 175.679140] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 175.691338] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 175.710213] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' worker2 # [ 175.715586] dbus-broker-launch[494]: Invalid user-name in /nix/store/ng2ydfkv03gvmdws4f4mjf9wj6qj3kq6-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 175.726327] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 175.730184] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 175.734373] systemd[1]: Reached target Remote File Systems. worker2 # [ 175.739111] systemd[1]: Reached target Local File Systems. worker2 # [ 175.741997] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 175.743401] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 175.752504] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 175.753762] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 175.755834] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 175.772485] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 175.774340] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 175.780407] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 175.781693] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 176.082561] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 176.083651] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 176.092157] systemd[1]: Starting linger-users.service... worker2 # [ 176.128762] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 176.129975] systemd[1]: Finished linger-users.service. worker2 # [ 176.337050] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:27Z level=info event=draining worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 176.390908] nixos[1964]: finished switching to system configuration /nix/store/yvvqkjafn76srxj10bdx106rab59v1hp-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 6.84 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 176.573302] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 176.581647] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 176.605075] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker1 # [ 176.611720] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 176.652727] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 176.668310] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker1 # [ 176.683930] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 176.698882] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 176.858089] nix-daemon[833]: accepted connection from pid 1643, user nix-grpc-daemon (trusted) worker1 # [ 176.883974] nix-daemon[833]: reaped child process 1646, status = succeeded worker1 # [ 176.980907] nix-daemon[833]: accepted connection from pid 1648, user nix-grpc-daemon (trusted) worker1 # [ 176.997650] nix-daemon[833]: reaped child process 1651, status = succeeded lb # [ 177.035225] niks3-server[1145]: 2026/09/22 15:07:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 177.014176] nix-grpc-daemon[1560]: time=2026-09-22T15:07:28.613Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 177.015667] nix-grpc-daemon[1560]: time=2026-09-22T15:07:28.614Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 177.067727] niks3-server[1145]: 2026/09/22 15:07:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 177.045866] nix-grpc-daemon[1560]: time=2026-09-22T15:07:28.646Z level=INFO msg="Uploading 1 narinfos" lb # [ 177.082514] niks3-server[1145]: 2026/09/22 15:07:28 INFO Signed narinfos id=55 count=1 lb # [ 177.090868] niks3-server[1145]: 2026/09/22 15:07:28 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker1 # [ 177.076490] nix-grpc-daemon[1560]: time=2026-09-22T15:07:28.676Z level=INFO msg="Upload complete. (360ms)" lb # [ 177.109290] niks3-server[1145]: 2026/09/22 15:07:28 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 177.117131] niks3-server[1145]: 2026/09/22 15:07:28 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete worker1 # [ 177.085317] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=528 lb # [ 177.121082] niks3-server[1145]: 2026/09/22 15:07:28 INFO Completed upload id=55 lb # [ 177.123806] niks3-server[1145]: 2026/09/22 15:07:28 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker1 # [ 177.100615] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 177.105644] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 177.110270] nix-daemon[833]: reaped child process 1641, status = succeeded worker1 # [ 177.120160] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker1 # [ 178.188379] nix-daemon[833]: reaped child process 1655, status = succeeded worker1 # [ 178.293627] nix-daemon[833]: accepted connection from pid 1671, user nix-grpc-daemon (trusted) worker1 # [ 178.312735] nix-daemon[833]: reaped child process 1674, status = succeeded lb # [ 178.346624] niks3-server[1145]: 2026/09/22 15:07:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 178.328414] nix-grpc-daemon[1560]: time=2026-09-22T15:07:29.925Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 178.330079] nix-grpc-daemon[1560]: time=2026-09-22T15:07:29.925Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 178.390028] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 178.401224] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 178.412104] niks3-server[1145]: 2026/09/22 15:07:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker1 # [ 178.386265] nix-grpc-daemon[1560]: time=2026-09-22T15:07:29.985Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.419565] niks3-server[1145]: 2026/09/22 15:07:30 INFO Signed narinfos id=56 count=1 lb # [ 178.423846] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 178.432624] niks3-server[1145]: 2026/09/22 15:07:30 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete lb # [ 178.437387] niks3-server[1145]: 2026/09/22 15:07:30 INFO Completed upload id=56 worker1 # [ 178.405136] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.005Z level=INFO msg="Upload complete. (274ms)" lb # [ 178.440278] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker1 # [ 178.424890] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker1 # [ 178.439167] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker1 # [ 178.443141] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 178.447489] nix-daemon[833]: reaped child process 1653, status = succeeded worker1 # [ 178.470026] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 178.481267] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 178.501262] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.101Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker1 # [ 178.512116] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 178.525554] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 178.676099] nix-daemon[833]: accepted connection from pid 1680, user nix-grpc-daemon (trusted) worker1 # [ 178.692407] nix-daemon[833]: reaped child process 1683, status = succeeded worker1 # [ 178.794560] nix-daemon[833]: accepted connection from pid 1685, user nix-grpc-daemon (trusted) worker1 # [ 178.809813] nix-daemon[833]: reaped child process 1688, status = succeeded lb # [ 178.849132] niks3-server[1145]: 2026/09/22 15:07:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 178.827167] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.427Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 178.828852] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.427Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 178.879810] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst worker1 # [ 178.860533] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.460Z level=INFO msg="Uploading 1 narinfos" lb # [ 178.894305] niks3-server[1145]: 2026/09/22 15:07:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign lb # [ 178.905364] niks3-server[1145]: 2026/09/22 15:07:30 INFO Signed narinfos id=57 count=1 lb # [ 178.907739] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 178.918891] niks3-server[1145]: 2026/09/22 15:07:30 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 178.925272] niks3-server[1145]: 2026/09/22 15:07:30 INFO Completed upload id=57 worker1 # [ 178.892072] nix-grpc-daemon[1560]: time=2026-09-22T15:07:30.492Z level=INFO msg="Upload complete. (350ms)" lb # [ 178.927377] niks3-server[1145]: 2026/09/22 15:07:30 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker1 # [ 178.900338] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 178.915131] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 178.921038] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 178.925863] nix-daemon[833]: reaped child process 1678, status = succeeded worker1 # [ 178.935936] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker1 # [ 179.798974] nix-daemon[833]: reaped child process 1692, status = succeeded worker1 # [ 179.918828] nix-daemon[833]: accepted connection from pid 1708, user nix-grpc-daemon (trusted) worker1 # [ 179.939079] nix-daemon[833]: reaped child process 1711, status = succeeded lb # [ 179.975673] niks3-server[1145]: 2026/09/22 15:07:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 179.954374] nix-grpc-daemon[1560]: time=2026-09-22T15:07:31.553Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 179.956106] nix-grpc-daemon[1560]: time=2026-09-22T15:07:31.553Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 180.016187] niks3-server[1145]: 2026/09/22 15:07:31 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 180.027512] niks3-server[1145]: 2026/09/22 15:07:31 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker1 # [ 180.003636] nix-grpc-daemon[1560]: time=2026-09-22T15:07:31.603Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.038660] niks3-server[1145]: 2026/09/22 15:07:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 180.048000] niks3-server[1145]: 2026/09/22 15:07:31 INFO Signed narinfos id=58 count=1 lb # [ 180.056793] niks3-server[1145]: 2026/09/22 15:07:31 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 180.066294] niks3-server[1145]: 2026/09/22 15:07:31 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 180.071590] niks3-server[1145]: 2026/09/22 15:07:31 INFO Completed upload id=58 worker1 # [ 180.031718] nix-grpc-daemon[1560]: time=2026-09-22T15:07:31.632Z level=INFO msg="Upload complete. (284ms)" lb # [ 180.074804] niks3-server[1145]: 2026/09/22 15:07:31 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker1 # [ 180.051063] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker1 # [ 180.068487] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker1 # [ 180.075486] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 180.081549] nix-daemon[833]: reaped child process 1690, status = succeeded worker1 # [ 180.097103] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 180.112445] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 180.125848] nix-grpc-daemon[1560]: time=2026-09-22T15:07:31.726Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker1 # [ 180.137327] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 180.150744] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 180.299478] nix-daemon[833]: accepted connection from pid 1717, user nix-grpc-daemon (trusted) worker1 # [ 180.317440] nix-daemon[833]: reaped child process 1720, status = succeeded worker1 # [ 180.416129] nix-daemon[833]: accepted connection from pid 1722, user nix-grpc-daemon (trusted) worker1 # [ 180.431793] nix-daemon[833]: reaped child process 1725, status = succeeded lb # [ 180.470197] niks3-server[1145]: 2026/09/22 15:07:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 180.447149] nix-grpc-daemon[1560]: time=2026-09-22T15:07:32.047Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 180.448779] nix-grpc-daemon[1560]: time=2026-09-22T15:07:32.047Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 180.496751] niks3-server[1145]: 2026/09/22 15:07:32 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst worker1 # [ 180.478954] nix-grpc-daemon[1560]: time=2026-09-22T15:07:32.079Z level=INFO msg="Uploading 1 narinfos" lb # [ 180.511883] niks3-server[1145]: 2026/09/22 15:07:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 180.523725] niks3-server[1145]: 2026/09/22 15:07:32 INFO Signed narinfos id=59 count=1 lb # [ 180.529625] niks3-server[1145]: 2026/09/22 15:07:32 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 180.538289] niks3-server[1145]: 2026/09/22 15:07:32 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 180.545943] niks3-server[1145]: 2026/09/22 15:07:32 INFO Completed upload id=59 worker1 # [ 180.513125] nix-grpc-daemon[1560]: time=2026-09-22T15:07:32.113Z level=INFO msg="Upload complete. (347ms)" lb # [ 180.548117] niks3-server[1145]: 2026/09/22 15:07:32 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker1 # [ 180.523428] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 180.535158] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 180.545249] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 180.548140] nix-daemon[833]: reaped child process 1715, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 180.561820] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker1 # [ 182.230535] nix-daemon[833]: reaped child process 1729, status = succeeded worker1 # [ 182.358239] nix-daemon[833]: accepted connection from pid 1745, user nix-grpc-daemon (trusted) worker1 # [ 182.379163] nix-daemon[833]: reaped child process 1748, status = succeeded lb # [ 182.409664] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 182.388887] nix-grpc-daemon[1560]: time=2026-09-22T15:07:33.988Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 182.391242] nix-grpc-daemon[1560]: time=2026-09-22T15:07:33.988Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 182.451558] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 182.463556] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 182.475183] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign worker1 # [ 182.443972] nix-grpc-daemon[1560]: time=2026-09-22T15:07:34.043Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.483148] niks3-server[1145]: 2026/09/22 15:07:34 INFO Signed narinfos id=60 count=1 lb # [ 182.487789] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls worker1 # [ 182.467238] nix-grpc-daemon[1560]: time=2026-09-22T15:07:34.067Z level=INFO msg="Upload complete. (293ms)" lb # [ 182.499352] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 182.504371] niks3-server[1145]: 2026/09/22 15:07:34 INFO Completed upload id=60 lb # [ 182.510602] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker1 # [ 182.481200] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker1 # [ 182.501066] nix-daemon[833]: reaped child process 1727, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2, in 6.18 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath, in 0.19 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 182.963874] nix-daemon[857]: reaped child process 1932, status = succeeded worker2 # [ 183.074435] nix-daemon[857]: accepted connection from pid 2104, user nix-grpc-daemon (trusted) worker2 # [ 183.094315] nix-daemon[857]: reaped child process 2107, status = succeeded lb # [ 183.034974] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 183.107667] nix-grpc-daemon[1869]: time=2026-09-22T15:07:34.726Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 183.109711] nix-grpc-daemon[1869]: time=2026-09-22T15:07:34.726Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 183.069380] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 183.084877] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 183.096946] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker2 # [ 183.160083] nix-grpc-daemon[1869]: time=2026-09-22T15:07:34.778Z level=INFO msg="Uploading 1 narinfos" lb # [ 183.105710] niks3-server[1145]: 2026/09/22 15:07:34 INFO Signed narinfos id=61 count=1 lb # [ 183.110465] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 183.118965] niks3-server[1145]: 2026/09/22 15:07:34 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete worker2 # [ 183.189356] nix-grpc-daemon[1869]: time=2026-09-22T15:07:34.809Z level=INFO msg="Upload complete. (254ms)" lb # [ 183.126982] niks3-server[1145]: 2026/09/22 15:07:34 INFO Completed upload id=61 lb # [ 183.131664] niks3-server[1145]: 2026/09/22 15:07:34 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker2 # [ 183.205128] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34254 duration_s=15 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker2 # [ 183.221340] nix-daemon[857]: reaped child process 1930, status = succeeded client # [ 183.147725] systemd[1]: sw.service: Deactivated successfully. client # [ 183.153276] systemd[1]: sw.service: Consumed 186ms CPU time over 17.498s wall clock time, 41.4M memory peak, 7.3K incoming IP traffic, 8.5K outgoing IP traffic. worker2 # [ 183.337901] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:34Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.10 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 184.097527] systemd[1]: Starting scheduler-token.service... worker2 # [ 184.168965] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 184.174313] systemd[1]: Finished scheduler-token.service. worker2 # [ 184.175983] systemd[1]: scheduler-token.service: Consumed 40ms CPU time over 75ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker1 # [ 184.257727] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:52046 worker1 # [ 184.262698] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:35Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 184.356759] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:35Z level=info event=scheduler_restarting worker2 # [ 184.377392] nix-grpc-daemon[1788]: ts=2026-09-22T15:07:35Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 184.400384] nix-grpc-daemon[1788]: E0000 00:00:1790089656.019964 1833 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true worker2 # [ 184.411572] nix-daemon[857]: reaped child process 1840, status = succeeded worker2 # [ 184.429296] nix-grpc-daemon[1788]: E0000 00:00:1790089656.048942 1833 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 185.384976] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 185.390022] systemd[1]: nix-grpc-daemon.service: Consumed 894ms CPU time over 30.288s wall clock time, 35.3M memory peak, 22.2K incoming IP traffic, 35.7K outgoing IP traffic. worker2 # [ 185.411832] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 185.560500] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:37Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 185.562994] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 185.566886] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 185.572054] nix-grpc-daemon[2124]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 185.596139] nix-grpc-daemon[2124]: E0000 00:00:1790089657.191489 2124 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 185.598545] nix-grpc-daemon[2124]: E0000 00:00:1790089657.195073 2124 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.61 seconds) worker2 # [ 185.623280] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 185.625240] nix-grpc-daemon[2124]: E0000 00:00:1790089657.201314 2164 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 185.627549] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 185.628405] nix-grpc-daemon[2124]: E0000 00:00:1790089657.224459 2164 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 185.633885] nix-grpc-daemon[2124]: E0000 00:00:1790089657.224643 2164 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 185.638370] nix-grpc-daemon[2124]: E0000 00:00:1790089657.240941 2164 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 185.640993] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 185.546908] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:37Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:52046 worker1 # [ 185.550023] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:37Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.14 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 21.21 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 187.106033] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 187.121284] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) worker2 # [ 187.141978] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 187.156821] nix-grpc-daemon[2124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 1/5) worker2 # [ 187.183752] nix-grpc-daemon[2124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 2/5) worker2 # [ 187.257170] nix-grpc-daemon[2124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 273 ms (attempt 3/5) worker2 # [ 187.532659] nix-grpc-daemon[2124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 177 ms (attempt 4/5) worker2 # [ 187.712296] nix-grpc-daemon[2124]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 187.715998] nix-grpc-daemon[2124]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 187.678027] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker1 # [ 187.678350] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 187.678483] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker1 # [ 187.678679] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 187.722170] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 187.738992] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 187.754099] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 187.769046] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 187.930155] nix-daemon[833]: accepted connection from pid 1757, user nix-grpc-daemon (trusted) worker1 # [ 187.950251] nix-daemon[833]: reaped child process 1760, status = succeeded lb # [ 188.051099] envoy[895]: conn peer=[2001:db8:1::1]:42864 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9608 tx=4423 ms=5925 worker1 # [ 188.055050] nix-daemon[833]: accepted connection from pid 1762, user nix-grpc-daemon (trusted) worker1 # [ 188.074585] nix-daemon[833]: reaped child process 1765, status = succeeded lb # [ 188.056915] envoy[895]: conn peer=[2001:db8:1::1]:34598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2995 tx=1561 ms=17297 lb # [ 188.057081] envoy[895]: conn peer=[2001:db8:1::4]:40234 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=7565 tx=639 ms=28970 lb # [ 188.106355] niks3-server[1145]: 2026/09/22 15:07:39 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 188.095845] nix-grpc-daemon[1560]: time=2026-09-22T15:07:39.695Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 188.097665] nix-grpc-daemon[1560]: time=2026-09-22T15:07:39.695Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 188.148307] niks3-server[1145]: 2026/09/22 15:07:39 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst worker1 # [ 188.132642] nix-grpc-daemon[1560]: time=2026-09-22T15:07:39.732Z level=INFO msg="Uploading 1 narinfos" lb # [ 188.164754] niks3-server[1145]: 2026/09/22 15:07:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 188.172387] niks3-server[1145]: 2026/09/22 15:07:39 INFO Signed narinfos id=62 count=1 lb # [ 188.180309] niks3-server[1145]: 2026/09/22 15:07:39 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 188.191332] niks3-server[1145]: 2026/09/22 15:07:39 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 188.199949] niks3-server[1145]: 2026/09/22 15:07:39 INFO Completed upload id=62 worker1 # [ 188.166902] nix-grpc-daemon[1560]: time=2026-09-22T15:07:39.767Z level=INFO msg="Upload complete. (381ms)" lb # [ 188.202440] niks3-server[1145]: 2026/09/22 15:07:39 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 188.179614] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 188.195841] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 188.202759] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 188.207853] nix-daemon[833]: reaped child process 1755, status = succeeded worker1 # [ 188.223029] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 189.472247] nix-daemon[833]: reaped child process 1769, status = succeeded worker1 # [ 189.586198] nix-daemon[833]: accepted connection from pid 1785, user nix-grpc-daemon (trusted) worker1 # [ 189.606727] nix-daemon[833]: reaped child process 1788, status = succeeded lb # [ 189.643250] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 189.623758] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.221Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 189.625620] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.221Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 189.683915] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 189.697001] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign worker1 # [ 189.671864] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.271Z level=INFO msg="Uploading 1 narinfos" lb # [ 189.710059] niks3-server[1145]: 2026/09/22 15:07:41 INFO Signed narinfos id=63 count=1 lb # [ 189.715608] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 189.722645] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 189.730102] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 189.737035] niks3-server[1145]: 2026/09/22 15:07:41 INFO Completed upload id=63 worker1 # [ 189.705508] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.305Z level=INFO msg="Upload complete. (271ms)" lb # [ 189.740657] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 189.725305] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=1 worker1 # [ 189.741716] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 189.746341] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 189.750265] nix-daemon[833]: reaped child process 1767, status = succeeded worker1 # [ 189.761140] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 189.774924] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 189.789978] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 189.803900] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 189.954603] nix-daemon[833]: accepted connection from pid 1794, user nix-grpc-daemon (trusted) worker1 # [ 189.977371] nix-daemon[833]: reaped child process 1797, status = succeeded worker1 # [ 190.074795] nix-daemon[833]: accepted connection from pid 1799, user nix-grpc-daemon (trusted) worker1 # [ 190.095168] nix-daemon[833]: reaped child process 1802, status = succeeded lb # [ 190.125632] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 190.103403] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.703Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 190.105089] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.703Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 190.154856] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 190.137696] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.737Z level=INFO msg="Uploading 1 narinfos" lb # [ 190.170112] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 190.180885] niks3-server[1145]: 2026/09/22 15:07:41 INFO Signed narinfos id=64 count=1 lb # [ 190.186630] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 190.196425] niks3-server[1145]: 2026/09/22 15:07:41 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 190.202166] niks3-server[1145]: 2026/09/22 15:07:41 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo lb # [ 190.207829] niks3-server[1145]: 2026/09/22 15:07:41 INFO Completed upload id=64 worker1 # [ 190.175362] nix-grpc-daemon[1560]: time=2026-09-22T15:07:41.775Z level=INFO msg="Upload complete. (356ms)" worker1 # [ 190.184596] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 190.192607] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 190.203394] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 190.208843] nix-daemon[833]: reaped child process 1792, status = succeeded worker1 # [ 190.220176] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 191.496210] nix-daemon[833]: reaped child process 1806, status = succeeded worker1 # [ 191.608746] nix-daemon[833]: accepted connection from pid 1822, user nix-grpc-daemon (trusted) worker1 # [ 191.629593] nix-daemon[833]: reaped child process 1825, status = succeeded lb # [ 191.661330] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 191.640510] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.239Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 191.642086] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.239Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 191.700906] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 191.719746] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker1 # [ 191.697862] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.297Z level=INFO msg="Uploading 1 narinfos" lb # [ 191.732109] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign lb # [ 191.740661] niks3-server[1145]: 2026/09/22 15:07:43 INFO Signed narinfos id=65 count=1 lb # [ 191.746022] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls worker1 # [ 191.724841] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.325Z level=INFO msg="Upload complete. (294ms)" lb # [ 191.757337] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 191.761788] niks3-server[1145]: 2026/09/22 15:07:43 INFO Completed upload id=65 lb # [ 191.765363] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker1 # [ 191.743638] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=1 worker1 # [ 191.768971] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 191.774275] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 191.780379] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 191.785790] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 191.804224] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 191.810240] nix-daemon[833]: reaped child process 1804, status = succeeded worker1 # [ 191.812964] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 191.946356] nix-daemon[833]: accepted connection from pid 1831, user nix-grpc-daemon (trusted) worker1 # [ 191.966473] nix-daemon[833]: reaped child process 1834, status = succeeded worker1 # [ 192.071414] nix-daemon[833]: accepted connection from pid 1836, user nix-grpc-daemon (trusted) worker1 # [ 192.088101] nix-daemon[833]: reaped child process 1839, status = succeeded lb # [ 192.126975] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 192.104279] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.704Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 192.105768] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.704Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 192.153804] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 192.167536] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker1 # [ 192.144292] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.744Z level=INFO msg="Uploading 1 narinfos" lb # [ 192.182043] niks3-server[1145]: 2026/09/22 15:07:43 INFO Signed narinfos id=66 count=1 lb # [ 192.189470] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 192.198645] niks3-server[1145]: 2026/09/22 15:07:43 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete worker1 # [ 192.176257] nix-grpc-daemon[1560]: time=2026-09-22T15:07:43.776Z level=INFO msg="Upload complete. (364ms)" lb # [ 192.210021] niks3-server[1145]: 2026/09/22 15:07:43 INFO Completed upload id=66 lb # [ 192.214184] niks3-server[1145]: 2026/09/22 15:07:43 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 192.184333] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 192.200669] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 192.206944] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 192.211707] nix-daemon[833]: reaped child process 1829, status = succeeded worker1 # [ 192.222252] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 193.133069] nix-daemon[833]: reaped child process 1843, status = succeeded worker1 # [ 193.205485] nix-daemon[833]: accepted connection from pid 1859, user nix-grpc-daemon (trusted) worker1 # [ 193.225571] nix-daemon[833]: reaped child process 1862, status = succeeded lb # [ 193.264734] niks3-server[1145]: 2026/09/22 15:07:44 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 193.242891] nix-grpc-daemon[1560]: time=2026-09-22T15:07:44.841Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 193.244776] nix-grpc-daemon[1560]: time=2026-09-22T15:07:44.842Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 193.300890] niks3-server[1145]: 2026/09/22 15:07:44 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 193.312138] niks3-server[1145]: 2026/09/22 15:07:44 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst worker1 # [ 193.292553] nix-grpc-daemon[1560]: time=2026-09-22T15:07:44.892Z level=INFO msg="Uploading 1 narinfos" lb # [ 193.324972] niks3-server[1145]: 2026/09/22 15:07:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign lb # [ 193.334417] niks3-server[1145]: 2026/09/22 15:07:44 INFO Signed narinfos id=67 count=1 lb # [ 193.341317] niks3-server[1145]: 2026/09/22 15:07:44 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls worker1 # [ 193.323044] nix-grpc-daemon[1560]: time=2026-09-22T15:07:44.923Z level=INFO msg="Upload complete. (288ms)" lb # [ 193.355307] niks3-server[1145]: 2026/09/22 15:07:44 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 193.360376] niks3-server[1145]: 2026/09/22 15:07:44 INFO Completed upload id=67 lb # [ 193.364350] niks3-server[1145]: 2026/09/22 15:07:44 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker1 # [ 193.338595] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=1 worker1 # [ 193.361385] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:44Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 193.371037] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 193.376729] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:44Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 193.381020] nix-daemon[833]: reaped child process 1841, status = succeeded worker1 # [ 193.393132] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 193.406562] nix-grpc-daemon[1560]: time=2026-09-22T15:07:45.006Z level=INFO msg="All 1 paths already cached" worker1 # [ 193.415732] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 193.428996] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 193.573558] nix-daemon[833]: accepted connection from pid 1868, user nix-grpc-daemon (trusted) worker1 # [ 193.594915] nix-daemon[833]: reaped child process 1871, status = succeeded worker1 # [ 193.696146] nix-daemon[833]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker1 # [ 193.715913] nix-daemon[833]: reaped child process 1876, status = succeeded lb # [ 193.753106] niks3-server[1145]: 2026/09/22 15:07:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 193.730835] nix-grpc-daemon[1560]: time=2026-09-22T15:07:45.330Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 193.732450] nix-grpc-daemon[1560]: time=2026-09-22T15:07:45.331Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 193.780424] niks3-server[1145]: 2026/09/22 15:07:45 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 193.762126] nix-grpc-daemon[1560]: time=2026-09-22T15:07:45.362Z level=INFO msg="Uploading 1 narinfos" lb # [ 193.796501] niks3-server[1145]: 2026/09/22 15:07:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 193.808480] niks3-server[1145]: 2026/09/22 15:07:45 INFO Signed narinfos id=68 count=1 lb # [ 193.815631] niks3-server[1145]: 2026/09/22 15:07:45 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls worker1 # [ 193.796647] nix-grpc-daemon[1560]: time=2026-09-22T15:07:45.397Z level=INFO msg="Upload complete. (354ms)" lb # [ 193.830409] niks3-server[1145]: 2026/09/22 15:07:45 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete worker1 # [ 193.804139] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 193.838431] niks3-server[1145]: 2026/09/22 15:07:45 INFO Completed upload id=68 lb # [ 193.841387] niks3-server[1145]: 2026/09/22 15:07:45 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 193.819511] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 193.826099] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 193.830665] nix-daemon[833]: reaped child process 1866, status = succeeded worker1 # [ 193.841693] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 195.328710] nix-daemon[833]: reaped child process 1880, status = succeeded worker1 # [ 195.431372] nix-daemon[833]: accepted connection from pid 1896, user nix-grpc-daemon (trusted) worker1 # [ 195.451958] nix-daemon[833]: reaped child process 1899, status = succeeded lb # [ 195.489770] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 195.472394] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.069Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 195.474100] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.069Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 195.528925] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 195.540777] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst worker1 # [ 195.522360] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.122Z level=INFO msg="Uploading 1 narinfos" lb # [ 195.555462] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 195.563630] niks3-server[1145]: 2026/09/22 15:07:47 INFO Signed narinfos id=69 count=1 lb # [ 195.567483] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls worker1 # [ 195.543233] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.143Z level=INFO msg="Upload complete. (285ms)" lb # [ 195.576890] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 195.579836] niks3-server[1145]: 2026/09/22 15:07:47 INFO Completed upload id=69 lb # [ 195.583450] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker1 # [ 195.561228] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=1 worker1 # [ 195.578232] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 195.591738] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 195.596588] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 195.601832] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 195.606835] nix-daemon[833]: reaped child process 1878, status = succeeded worker1 # [ 195.608879] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.205Z level=INFO msg="All 1 paths already cached" worker1 # [ 195.621435] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 195.627447] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 195.752958] nix-daemon[833]: accepted connection from pid 1905, user nix-grpc-daemon (trusted) worker1 # [ 195.780230] nix-daemon[833]: reaped child process 1908, status = succeeded worker1 # [ 195.874927] nix-daemon[833]: accepted connection from pid 1910, user nix-grpc-daemon (trusted) worker1 # [ 195.894877] nix-daemon[833]: reaped child process 1913, status = succeeded lb # [ 195.932614] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 195.909351] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.509Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 195.910889] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.509Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 195.963290] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst worker1 # [ 195.944485] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.544Z level=INFO msg="Uploading 1 narinfos" lb # [ 195.979609] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/70/sign lb # [ 195.989939] niks3-server[1145]: 2026/09/22 15:07:47 INFO Signed narinfos id=70 count=1 worker1 # [ 195.965834] nix-grpc-daemon[1560]: time=2026-09-22T15:07:47.566Z level=INFO msg="Upload complete. (332ms)" lb # [ 195.997891] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls worker1 # [ 195.972264] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 196.006516] niks3-server[1145]: 2026/09/22 15:07:47 INFO Received complete upload request method=POST path=/api/pending_closures/70/complete lb # [ 196.009987] niks3-server[1145]: 2026/09/22 15:07:47 INFO Completed upload id=70 lb # [ 196.011959] niks3-server[1145]: 2026/09/22 15:07:47 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 195.985959] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 195.991298] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 195.996978] nix-daemon[833]: reaped child process 1903, status = succeeded worker1 # [ 196.005583] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 197.242504] nix-daemon[833]: reaped child process 1917, status = succeeded worker1 # [ 197.351880] nix-daemon[833]: accepted connection from pid 1933, user nix-grpc-daemon (trusted) worker1 # [ 197.371912] nix-daemon[833]: reaped child process 1936, status = succeeded lb # [ 197.410758] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 197.390127] nix-grpc-daemon[1560]: time=2026-09-22T15:07:48.989Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 197.391795] nix-grpc-daemon[1560]: time=2026-09-22T15:07:48.989Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 197.445059] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 197.459459] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 197.475255] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/71/sign worker1 # [ 197.448464] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.048Z level=INFO msg="Uploading 1 narinfos" lb # [ 197.484924] niks3-server[1145]: 2026/09/22 15:07:49 INFO Signed narinfos id=71 count=1 lb # [ 197.487383] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 197.502754] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received complete upload request method=POST path=/api/pending_closures/71/complete lb # [ 197.509419] niks3-server[1145]: 2026/09/22 15:07:49 INFO Completed upload id=71 worker1 # [ 197.476859] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.077Z level=INFO msg="Upload complete. (261ms)" lb # [ 197.512063] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 197.496889] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=1 worker1 # [ 197.512326] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 197.522608] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 197.527892] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 197.533695] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 197.539219] nix-daemon[833]: reaped child process 1915, status = succeeded worker1 # [ 197.541571] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.138Z level=INFO msg="All 1 paths already cached" worker1 # [ 197.547277] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 197.557813] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 197.688227] nix-daemon[833]: accepted connection from pid 1942, user nix-grpc-daemon (trusted) worker1 # [ 197.713922] nix-daemon[833]: reaped child process 1945, status = succeeded worker1 # [ 197.813366] nix-daemon[833]: accepted connection from pid 1947, user nix-grpc-daemon (trusted) worker1 # [ 197.834200] nix-daemon[833]: reaped child process 1950, status = succeeded lb # [ 197.870948] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 197.848065] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.448Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 197.849616] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.448Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 197.898849] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst worker1 # [ 197.879329] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.479Z level=INFO msg="Uploading 1 narinfos" lb # [ 197.912369] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/72/sign lb # [ 197.924779] niks3-server[1145]: 2026/09/22 15:07:49 INFO Signed narinfos id=72 count=1 lb # [ 197.927595] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 197.939377] niks3-server[1145]: 2026/09/22 15:07:49 INFO Received complete upload request method=POST path=/api/pending_closures/72/complete lb # [ 197.944595] niks3-server[1145]: 2026/09/22 15:07:49 INFO Completed upload id=72 worker1 # [ 197.913796] nix-grpc-daemon[1560]: time=2026-09-22T15:07:49.514Z level=INFO msg="Upload complete. (347ms)" lb # [ 197.951284] niks3-server[1145]: 2026/09/22 15:07:49 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 197.920298] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 197.934823] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 197.940914] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 197.945749] nix-daemon[833]: reaped child process 1940, status = succeeded worker1 # [ 197.957711] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 199.028475] nix-daemon[833]: reaped child process 1954, status = succeeded worker1 # [ 199.130890] nix-daemon[833]: accepted connection from pid 1970, user nix-grpc-daemon (trusted) worker1 # [ 199.149619] nix-daemon[833]: reaped child process 1973, status = succeeded lb # [ 199.187408] niks3-server[1145]: 2026/09/22 15:07:50 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 199.171360] nix-grpc-daemon[1560]: time=2026-09-22T15:07:50.768Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 199.173213] nix-grpc-daemon[1560]: time=2026-09-22T15:07:50.768Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 199.227885] niks3-server[1145]: 2026/09/22 15:07:50 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 199.240879] niks3-server[1145]: 2026/09/22 15:07:50 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker1 # [ 199.216622] nix-grpc-daemon[1560]: time=2026-09-22T15:07:50.816Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.249894] niks3-server[1145]: 2026/09/22 15:07:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/73/sign lb # [ 199.257122] niks3-server[1145]: 2026/09/22 15:07:50 INFO Signed narinfos id=73 count=1 lb # [ 199.262073] niks3-server[1145]: 2026/09/22 15:07:50 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 199.268924] niks3-server[1145]: 2026/09/22 15:07:50 INFO Received complete upload request method=POST path=/api/pending_closures/73/complete lb # [ 199.274701] niks3-server[1145]: 2026/09/22 15:07:50 INFO Completed upload id=73 worker1 # [ 199.241462] nix-grpc-daemon[1560]: time=2026-09-22T15:07:50.841Z level=INFO msg="Upload complete. (274ms)" lb # [ 199.277390] niks3-server[1145]: 2026/09/22 15:07:50 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker1 # [ 199.261184] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=1 worker1 # [ 199.276358] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 199.286093] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 199.290525] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 199.295102] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 199.298252] nix-daemon[833]: reaped child process 1952, status = succeeded worker1 # [ 199.301688] nix-grpc-daemon[1560]: time=2026-09-22T15:07:50.900Z level=INFO msg="All 2 paths already cached" worker1 # [ 199.305721] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 199.319016] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 199.445529] nix-daemon[833]: accepted connection from pid 1979, user nix-grpc-daemon (trusted) worker1 # [ 199.464429] nix-daemon[833]: reaped child process 1982, status = succeeded worker1 # [ 199.567500] nix-daemon[833]: accepted connection from pid 1984, user nix-grpc-daemon (trusted) worker1 # [ 199.583788] nix-daemon[833]: reaped child process 1987, status = succeeded lb # [ 199.622597] niks3-server[1145]: 2026/09/22 15:07:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 199.600932] nix-grpc-daemon[1560]: time=2026-09-22T15:07:51.201Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 199.602395] nix-grpc-daemon[1560]: time=2026-09-22T15:07:51.201Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 199.653403] niks3-server[1145]: 2026/09/22 15:07:51 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 199.668791] niks3-server[1145]: 2026/09/22 15:07:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/74/sign worker1 # [ 199.642783] nix-grpc-daemon[1560]: time=2026-09-22T15:07:51.243Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.679475] niks3-server[1145]: 2026/09/22 15:07:51 INFO Signed narinfos id=74 count=1 lb # [ 199.684805] niks3-server[1145]: 2026/09/22 15:07:51 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 199.693409] niks3-server[1145]: 2026/09/22 15:07:51 INFO Received complete upload request method=POST path=/api/pending_closures/74/complete lb # [ 199.697019] niks3-server[1145]: 2026/09/22 15:07:51 INFO Completed upload id=74 worker1 # [ 199.665394] nix-grpc-daemon[1560]: time=2026-09-22T15:07:51.265Z level=INFO msg="Upload complete. (340ms)" lb # [ 199.702231] niks3-server[1145]: 2026/09/22 15:07:51 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 199.674559] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 199.686982] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 199.692390] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 199.696841] nix-daemon[833]: reaped child process 1977, status = succeeded worker1 # [ 199.707976] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 200.549543] nix-daemon[833]: reaped child process 1991, status = succeeded worker1 # [ 200.650076] nix-daemon[833]: accepted connection from pid 2007, user nix-grpc-daemon (trusted) worker1 # [ 200.671173] nix-daemon[833]: reaped child process 2010, status = succeeded lb # [ 200.709329] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 200.687117] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.286Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 200.688761] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.286Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 200.739621] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 200.759662] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst worker1 # [ 200.742977] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.343Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.774383] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/75/sign lb # [ 200.784321] niks3-server[1145]: 2026/09/22 15:07:52 INFO Signed narinfos id=75 count=1 lb # [ 200.790290] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 200.799542] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received complete upload request method=POST path=/api/pending_closures/75/complete lb # [ 200.810004] niks3-server[1145]: 2026/09/22 15:07:52 INFO Completed upload id=75 worker1 # [ 200.777231] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.377Z level=INFO msg="Upload complete. (259ms)" lb # [ 200.812564] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker1 # [ 200.793229] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=1 worker1 # [ 200.810986] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 200.816372] nix-daemon[833]: reaped child process 1989, status = succeeded worker1 # [ 200.833845] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 200.850749] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 200.867586] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.467Z level=INFO msg="All 2 paths already cached" worker1 # [ 200.879200] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 200.894287] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 201.056507] nix-daemon[833]: accepted connection from pid 2014, user nix-grpc-daemon (trusted) worker1 # [ 201.080373] nix-daemon[833]: reaped child process 2017, status = succeeded worker1 # [ 201.193566] nix-daemon[833]: accepted connection from pid 2019, user nix-grpc-daemon (trusted) worker1 # [ 201.216220] nix-daemon[833]: reaped child process 2022, status = succeeded lb # [ 201.251754] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 201.229301] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.829Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 201.230857] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.829Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 201.286287] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/76/sign worker1 # [ 201.261253] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.861Z level=INFO msg="Uploading 1 narinfos" lb # [ 201.300582] niks3-server[1145]: 2026/09/22 15:07:52 INFO Signed narinfos id=76 count=1 lb # [ 201.303608] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst lb # [ 201.322168] niks3-server[1145]: 2026/09/22 15:07:52 INFO Received complete upload request method=POST path=/api/pending_closures/76/complete lb # [ 201.329198] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 201.333252] niks3-server[1145]: 2026/09/22 15:07:52 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 201.301052] nix-grpc-daemon[1560]: time=2026-09-22T15:07:52.901Z level=INFO msg="Upload complete. (390ms)" lb # [ 201.336666] niks3-server[1145]: 2026/09/22 15:07:52 INFO Completed upload id=76 worker1 # [ 201.311439] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 201.326853] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 201.333269] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 201.338618] nix-daemon[833]: reaped child process 2012, status = succeeded worker1 # [ 201.350176] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 202.195230] nix-daemon[833]: reaped child process 2026, status = succeeded worker1 # [ 202.285175] nix-daemon[833]: accepted connection from pid 2042, user nix-grpc-daemon (trusted) worker1 # [ 202.303247] nix-daemon[833]: reaped child process 2045, status = succeeded lb # [ 202.341672] niks3-server[1145]: 2026/09/22 15:07:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 202.320376] nix-grpc-daemon[1560]: time=2026-09-22T15:07:53.919Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 202.321842] nix-grpc-daemon[1560]: time=2026-09-22T15:07:53.919Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 202.382899] niks3-server[1145]: 2026/09/22 15:07:53 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 202.395531] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst worker1 # [ 202.379582] nix-grpc-daemon[1560]: time=2026-09-22T15:07:53.979Z level=INFO msg="Uploading 1 narinfos" lb # [ 202.411718] niks3-server[1145]: 2026/09/22 15:07:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/77/sign lb # [ 202.419462] niks3-server[1145]: 2026/09/22 15:07:54 INFO Signed narinfos id=77 count=1 lb # [ 202.423645] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 202.430549] niks3-server[1145]: 2026/09/22 15:07:54 INFO Received complete upload request method=POST path=/api/pending_closures/77/complete lb # [ 202.437302] niks3-server[1145]: 2026/09/22 15:07:54 INFO Completed upload id=77 worker1 # [ 202.405051] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.005Z level=INFO msg="Upload complete. (243ms)" lb # [ 202.441156] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker1 # [ 202.417983] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=1 worker1 # [ 202.437257] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 202.442076] nix-daemon[833]: reaped child process 2024, status = succeeded worker1 # [ 202.460620] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 202.475611] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 202.490378] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.090Z level=INFO msg="All 2 paths already cached" worker1 # [ 202.500280] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 202.513865] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 202.674075] nix-daemon[833]: accepted connection from pid 2049, user nix-grpc-daemon (trusted) worker1 # [ 202.691683] nix-daemon[833]: reaped child process 2052, status = succeeded worker1 # [ 202.793682] nix-daemon[833]: accepted connection from pid 2054, user nix-grpc-daemon (trusted) worker1 # [ 202.811530] nix-daemon[833]: reaped child process 2057, status = succeeded lb # [ 202.844397] niks3-server[1145]: 2026/09/22 15:07:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 202.821919] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.422Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 202.823371] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.422Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 202.871169] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 202.852094] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.452Z level=INFO msg="Uploading 1 narinfos" lb # [ 202.884947] niks3-server[1145]: 2026/09/22 15:07:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/78/sign lb # [ 202.897243] niks3-server[1145]: 2026/09/22 15:07:54 INFO Signed narinfos id=78 count=1 lb # [ 202.899975] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls worker1 # [ 202.883173] nix-grpc-daemon[1560]: time=2026-09-22T15:07:54.483Z level=INFO msg="Upload complete. (354ms)" lb # [ 202.915635] niks3-server[1145]: 2026/09/22 15:07:54 INFO Received complete upload request method=POST path=/api/pending_closures/78/complete worker1 # [ 202.890769] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 202.924270] niks3-server[1145]: 2026/09/22 15:07:54 INFO Completed upload id=78 lb # [ 202.926920] niks3-server[1145]: 2026/09/22 15:07:54 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 202.902170] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1 # [ 202.907484] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 202.912401] nix-daemon[833]: reaped child process 2047, status = succeeded worker1 # [ 202.923863] nix-daemon[833]: accepted connection from pid 1464, user nix-grpc-daemon (trusted) worker1 # [ 204.197260] nix-daemon[833]: reaped child process 2061, status = succeeded worker1 # [ 204.314176] nix-daemon[833]: accepted connection from pid 2077, user nix-grpc-daemon (trusted) worker1 # [ 204.329438] nix-daemon[833]: reaped child process 2080, status = succeeded lb # [ 204.372201] niks3-server[1145]: 2026/09/22 15:07:55 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 204.350209] nix-grpc-daemon[1560]: time=2026-09-22T15:07:55.948Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 204.352544] nix-grpc-daemon[1560]: time=2026-09-22T15:07:55.948Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 204.409306] niks3-server[1145]: 2026/09/22 15:07:56 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 204.423369] niks3-server[1145]: 2026/09/22 15:07:56 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker1 # [ 204.404746] nix-grpc-daemon[1560]: time=2026-09-22T15:07:56.004Z level=INFO msg="Uploading 1 narinfos" lb # [ 204.436318] niks3-server[1145]: 2026/09/22 15:07:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/79/sign lb # [ 204.444187] niks3-server[1145]: 2026/09/22 15:07:56 INFO Signed narinfos id=79 count=1 lb # [ 204.447212] niks3-server[1145]: 2026/09/22 15:07:56 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 204.462784] niks3-server[1145]: 2026/09/22 15:07:56 INFO Received complete upload request method=POST path=/api/pending_closures/79/complete lb # [ 204.469799] niks3-server[1145]: 2026/09/22 15:07:56 INFO Completed upload id=79 worker1 # [ 204.437245] nix-grpc-daemon[1560]: time=2026-09-22T15:07:56.037Z level=INFO msg="Upload complete. (303ms)" lb # [ 204.473079] niks3-server[1145]: 2026/09/22 15:07:56 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 204.453216] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52036 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=1 worker1 # [ 204.470097] nix-daemon[833]: reaped child process 2059, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.73 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 204.648838] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: e34eb5c3047343ec8dca46b1ba77d9a7 client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics client # [ 204.858862] nix[1592]: don't know how to build these paths: client # [ 204.859982] nix[1592]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker2 # [ 204.948371] nix-grpc-daemon[2124]: ts=2026-09-22T15:07:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52120 worker1 # [ 204.860184] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52036 worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker1 # [ 204.880099] nix-grpc-daemon[1464]: ts=2026-09-22T15:07:56Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 client # [ 204.890236] nix[1592]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}, waiting up to 30s for a worker lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 208.057416] envoy[895]: conn peer=[2001:db8:1::1]:58108 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27127 tx=12427 ms=17460 client # [ 234.895544] nix[1592]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip} client # [ 234.902175] nix[1592]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 234.925342] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 234.927383] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 234.930789] systemd[1]: gpu.service: Consumed 187ms CPU time over 30.276s wall clock time, 35.4M memory peak, 5.2K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.09 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 48.57 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.25 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 237.159688] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:28Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 237.934059] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:52036 worker2 # [ 238.035116] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52120 worker1 # [ 237.969192] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:29Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker1 # [ 237.975025] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:29Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 238.111159] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 lb # [ 238.059340] envoy[895]: conn peer=[2001:db8:1::1]:33902 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=579 ms=30063 worker2 # [ 238.132477] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52120 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 238.148440] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 238.163867] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) worker2 # [ 238.193219] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:29Z level=info event=niks3_push_started pid=2184 worker2 # [ 238.345255] nix-grpc-daemon[2184]: time=2026-09-22T15:08:29.964Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 238.455628] nix-daemon[857]: accepted connection from pid 2197, user nix-grpc-daemon (trusted) worker2 # [ 238.474991] nix-daemon[857]: reaped child process 2200, status = succeeded worker2 # [ 238.582237] nix-daemon[857]: accepted connection from pid 2202, user nix-grpc-daemon (trusted) worker2 # [ 238.603219] nix-daemon[857]: reaped child process 2205, status = succeeded lb # [ 238.541907] niks3-server[1145]: 2026/09/22 15:08:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 238.614572] nix-grpc-daemon[2184]: time=2026-09-22T15:08:30.234Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 238.617808] nix-grpc-daemon[2184]: time=2026-09-22T15:08:30.234Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 238.579088] niks3-server[1145]: 2026/09/22 15:08:30 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst worker2 # [ 238.661995] nix-grpc-daemon[2184]: time=2026-09-22T15:08:30.281Z level=INFO msg="Uploading 1 narinfos" lb # [ 238.592979] niks3-server[1145]: 2026/09/22 15:08:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/80/sign lb # [ 238.606931] niks3-server[1145]: 2026/09/22 15:08:30 INFO Signed narinfos id=80 count=1 lb # [ 238.614531] niks3-server[1145]: 2026/09/22 15:08:30 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 238.628551] niks3-server[1145]: 2026/09/22 15:08:30 INFO Received complete upload request method=POST path=/api/pending_closures/80/complete worker2 # [ 238.700340] nix-grpc-daemon[2184]: time=2026-09-22T15:08:30.319Z level=INFO msg="Upload complete. (351ms)" lb # [ 238.638646] niks3-server[1145]: 2026/09/22 15:08:30 INFO Completed upload id=80 lb # [ 238.641915] niks3-server[1145]: 2026/09/22 15:08:30 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 238.708152] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 238.724367] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 238.731448] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) worker2 # [ 238.736968] nix-daemon[857]: reaped child process 2182, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... worker2 # [ 238.749649] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 239.439607] nix-daemon[857]: reaped child process 2209, status = succeeded worker2 # [ 239.519378] nix-daemon[857]: accepted connection from pid 2225, user nix-grpc-daemon (trusted) worker2 # [ 239.541247] nix-daemon[857]: reaped child process 2228, status = succeeded lb # [ 239.483652] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 239.556426] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.174Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 239.561445] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.175Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 239.528110] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 239.543874] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst worker2 # [ 239.622390] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.240Z level=INFO msg="Uploading 1 narinfos" lb # [ 239.559631] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/81/sign lb # [ 239.571511] niks3-server[1145]: 2026/09/22 15:08:31 INFO Signed narinfos id=81 count=1 lb # [ 239.578808] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 239.586559] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received complete upload request method=POST path=/api/pending_closures/81/complete lb # [ 239.595371] niks3-server[1145]: 2026/09/22 15:08:31 INFO Completed upload id=81 lb # [ 239.599518] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 239.657072] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.275Z level=INFO msg="Upload complete. (296ms)" worker1 # [ 239.583275] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:31Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker1 # [ 239.589501] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:31Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 239.669615] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=0 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=1 worker2 # [ 239.691721] nix-daemon[857]: reaped child process 2207, status = succeeded worker2 # [ 239.722803] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 239.737931] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 239.752147] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.371Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 239.763227] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 239.777419] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) worker2 # [ 239.928213] nix-daemon[857]: accepted connection from pid 2232, user nix-grpc-daemon (trusted) worker2 # [ 239.948894] nix-daemon[857]: reaped child process 2235, status = succeeded worker2 # [ 240.050734] nix-daemon[857]: accepted connection from pid 2237, user nix-grpc-daemon (trusted) worker2 # [ 240.069371] nix-daemon[857]: reaped child process 2240, status = succeeded lb # [ 240.016759] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 240.088222] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.707Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 240.089733] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.707Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 240.061773] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 240.133091] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.752Z level=INFO msg="Uploading 1 narinfos" lb # [ 240.074895] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/82/sign lb # [ 240.082059] niks3-server[1145]: 2026/09/22 15:08:31 INFO Signed narinfos id=82 count=1 lb # [ 240.086501] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 240.095998] niks3-server[1145]: 2026/09/22 15:08:31 INFO Received complete upload request method=POST path=/api/pending_closures/82/complete lb # [ 240.101974] niks3-server[1145]: 2026/09/22 15:08:31 INFO Completed upload id=82 worker2 # [ 240.163020] nix-grpc-daemon[2184]: time=2026-09-22T15:08:31.782Z level=INFO msg="Upload complete. (368ms)" lb # [ 240.104574] niks3-server[1145]: 2026/09/22 15:08:31 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 240.172341] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 240.191540] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 240.198174] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) worker2 # [ 240.204180] nix-daemon[857]: reaped child process 2230, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... worker2 # [ 240.216470] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 241.681142] nix-daemon[857]: reaped child process 2244, status = succeeded worker2 # [ 241.800055] nix-daemon[857]: accepted connection from pid 2260, user nix-grpc-daemon (trusted) worker2 # [ 241.822981] nix-daemon[857]: reaped child process 2263, status = succeeded lb # [ 241.759804] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 241.836404] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.455Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 241.838019] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.455Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 241.805244] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 241.816855] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 241.889051] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.508Z level=INFO msg="Uploading 1 narinfos" lb # [ 241.828956] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/83/sign lb # [ 241.836248] niks3-server[1145]: 2026/09/22 15:08:33 INFO Signed narinfos id=83 count=1 lb # [ 241.841518] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 241.855766] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received complete upload request method=POST path=/api/pending_closures/83/complete lb # [ 241.865533] niks3-server[1145]: 2026/09/22 15:08:33 INFO Completed upload id=83 worker2 # [ 241.927262] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.546Z level=INFO msg="Upload complete. (300ms)" lb # [ 241.870674] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 241.941352] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=1 worker1 # [ 241.855917] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:33Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker1 # [ 241.861984] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:33Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 241.961443] nix-daemon[857]: reaped child process 2242, status = succeeded worker2 # [ 241.994564] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 242.008158] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 242.020853] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.640Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 242.031439] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 242.045569] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) worker2 # [ 242.201747] nix-daemon[857]: accepted connection from pid 2267, user nix-grpc-daemon (trusted) worker2 # [ 242.220145] nix-daemon[857]: reaped child process 2270, status = succeeded worker2 # [ 242.322628] nix-daemon[857]: accepted connection from pid 2272, user nix-grpc-daemon (trusted) worker2 # [ 242.340242] nix-daemon[857]: reaped child process 2275, status = succeeded lb # [ 242.282614] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 242.353787] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.973Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 242.355236] nix-grpc-daemon[2184]: time=2026-09-22T15:08:33.973Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 242.309897] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst lb # [ 242.326019] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/84/sign worker2 # [ 242.394060] nix-grpc-daemon[2184]: time=2026-09-22T15:08:34.013Z level=INFO msg="Uploading 1 narinfos" lb # [ 242.338006] niks3-server[1145]: 2026/09/22 15:08:33 INFO Signed narinfos id=84 count=1 lb # [ 242.345551] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls worker2 # [ 242.420301] nix-grpc-daemon[2184]: time=2026-09-22T15:08:34.040Z level=INFO msg="Upload complete. (358ms)" lb # [ 242.359390] niks3-server[1145]: 2026/09/22 15:08:33 INFO Received complete upload request method=POST path=/api/pending_closures/84/complete lb # [ 242.370241] niks3-server[1145]: 2026/09/22 15:08:33 INFO Completed upload id=84 worker2 # [ 242.428148] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=0 paths=1 nar_bytes_in=760 lb # [ 242.374073] niks3-server[1145]: 2026/09/22 15:08:33 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 242.441032] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 worker2 # [ 242.446843] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) worker2 # [ 242.452496] nix-daemon[857]: reaped child process 2265, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... worker2 # [ 242.464437] nix-daemon[857]: accepted connection from pid 2124, user nix-grpc-daemon (trusted) client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 243.726612] nix-daemon[857]: reaped child process 2279, status = succeeded worker2 # [ 243.850030] nix-daemon[857]: accepted connection from pid 2295, user nix-grpc-daemon (trusted) worker2 # [ 243.870221] nix-daemon[857]: reaped child process 2298, status = succeeded lb # [ 243.815989] niks3-server[1145]: 2026/09/22 15:08:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 243.887806] nix-grpc-daemon[2184]: time=2026-09-22T15:08:35.505Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 243.889935] nix-grpc-daemon[2184]: time=2026-09-22T15:08:35.505Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 243.851090] niks3-server[1145]: 2026/09/22 15:08:35 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst worker2 # [ 243.937611] nix-grpc-daemon[2184]: time=2026-09-22T15:08:35.556Z level=INFO msg="Uploading 1 narinfos" lb # [ 243.868580] niks3-server[1145]: 2026/09/22 15:08:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/85/sign lb # [ 243.882346] niks3-server[1145]: 2026/09/22 15:08:35 INFO Signed narinfos id=85 count=1 lb # [ 243.889963] niks3-server[1145]: 2026/09/22 15:08:35 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 243.901918] niks3-server[1145]: 2026/09/22 15:08:35 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls worker2 # [ 243.969585] nix-grpc-daemon[2184]: time=2026-09-22T15:08:35.589Z level=INFO msg="Upload complete. (295ms)" lb # [ 243.908289] niks3-server[1145]: 2026/09/22 15:08:35 INFO Received complete upload request method=POST path=/api/pending_closures/85/complete lb # [ 243.912464] niks3-server[1145]: 2026/09/22 15:08:35 INFO Completed upload id=85 lb # [ 243.915806] niks3-server[1145]: 2026/09/22 15:08:35 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 243.981168] nix-grpc-daemon[2124]: ts=2026-09-22T15:08:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52120 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=1 worker2 # [ 244.000301] nix-daemon[857]: reaped child process 2277, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2, in 6.22 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath, in 0.18 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 245.163452] nix-grpc-daemon[1464]: ts=2026-09-22T15:08:36Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.10 seconds) (finished: run the VM test script, in 246.40 seconds) test script finished in 246.66s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) client # [2026-09-22T15:08:37Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T15:08:37Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-22T15:08:37Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) lb # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) worker1 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) worker2 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-22T15:08:38Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.45 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh