tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm lb # Disk image does not exist, creating the virtualisation disk image... worker1 # Disk image does not exist, creating the virtualisation disk image... worker1: QEMU running (pid 51) lb: QEMU running (pid 50) client # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 49) lb # Formatting '/build/vm-state-lb/tmp.1GSJkwPrrR', fmt=raw size=1073741824 client # Formatting '/build/vm-state-client/tmp.fiobgkBmEO', fmt=raw size=1073741824 worker2: QEMU running (pid 52) lb # mke2fs 1.47.4 (6-Mar-2025) client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Formatting '/build/vm-state-worker1/tmp.oZ3eC9pqCe', fmt=raw size=1073741824 worker2 # Disk image does not exist, creating the virtualisation disk image... (finished: start all VMs, in 0.51 seconds) worker1 # mke2fs 1.47.4 (6-Mar-2025) worker2 # Formatting '/build/vm-state-worker2/tmp.VozQ3rtJI1', fmt=raw size=1073741824 client: waiting for unit network-addresses-eth1.service worker1 # Discarding device blocks: 0/262144 done worker2 # mke2fs 1.47.4 (6-Mar-2025) client: waiting for the VM to finish booting worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Discarding device blocks: 0/262144 done client # Discarding device blocks: 0/262144 done lb # Discarding device blocks: 0/262144 done worker1 # Filesystem UUID: 63ca42a6-0a78-4a40-aed9-62f78a282947 worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Superblock backups stored on blocks: worker2 # Filesystem UUID: 9e950184-7788-4e15-b451-aa57d7ad5f00 client # Filesystem UUID: 39e36b9e-d9a6-41e9-be3e-c0c8076db105 lb # Filesystem UUID: 0369716f-fabe-48ec-a9df-ad7d213a7498 worker1 # 32768, 98304, 163840, 229376 worker2 # Superblock backups stored on blocks: client # Superblock backups stored on blocks: lb # Superblock backups stored on blocks: worker1 # worker2 # 32768, 98304, 163840, 229376 client # 32768, 98304, 163840, 229376 lb # 32768, 98304, 163840, 229376 worker1 # Allocating group tables: 0/8 done worker2 # client # lb # worker1 # Writing inode tables: 0/8 done worker2 # Allocating group tables: 0/8 done client # Allocating group tables: 0/8 done lb # Allocating group tables: 0/8 done worker1 # Creating journal (8192 blocks): done worker2 # Writing inode tables: 0/8 done client # Writing inode tables: 0/8 done lb # Writing inode tables: 0/8 done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Creating journal (8192 blocks): done client # Creating journal (8192 blocks): done lb # Creating journal (8192 blocks): done worker1 # worker2 # Writing superblocks and filesystem accounting information: 0/8 done client # Writing superblocks and filesystem accounting information: 0/8 done lb # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Virtualisation disk image created. worker2 # client # lb # worker1 # Starting virtiofs daemons... worker2 # Virtualisation disk image created. client # Virtualisation disk image created. lb # Virtualisation disk image created. worker1 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # Starting virtiofs daemons... client # Starting virtiofs daemons... lb # Starting virtiofs daemons... worker1 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T15:59:28Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-09-23T15:59:28Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests worker1 # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests client # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests lb # [2026-09-23T15:59:28Z INFO virtiofsd] Client connected, servicing requests worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] random: crng init done worker1 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] DMA32 empty worker1 # [ 0.000000] Normal empty worker1 # [ 0.000000] Device empty worker1 # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8ywmcs4wqfsykii45m0wrnjpayzliy1j-nixos-system-worker1-test/init regInfo=/nix/store/2xnyxk9qqas7nahgj7fiqv6zy78vllkd-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/2xnyxk9qqas7nahgj7fiqv6zy78vllkd-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000034] arm-pv: using stolen time PV worker1 # [ 0.000650] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.000862] Console: colour dummy device 80x25 worker1 # [ 0.000870] printk: legacy console [tty0] enabled worker1 # [ 0.001060] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.001066] pid_max: default: 32768 minimum: 301 worker1 # [ 0.001144] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.001298] landlock: Up and running. worker1 # [ 0.001300] Yama: becoming mindful. worker1 # [ 0.001925] LSM support for eBPF active worker1 # [ 0.002104] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.002141] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.003927] rcu: Hierarchical SRCU implementation. worker1 # [ 0.003932] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.005189] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.005277] EFI services will not be available. worker1 # [ 0.005342] smp: Bringing up secondary CPUs ... worker1 # [ 0.005350] smp: Brought up 1 node, 1 CPU worker1 # [ 0.005353] SMP: Total of 1 processors activated. worker1 # [ 0.005359] CPU: All CPU(s) started at EL1 worker1 # [ 0.005369] CPU features: detected: Branch Target Identification worker1 # [ 0.005373] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.005377] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.005380] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.005384] CPU features: detected: Common not Private translations worker1 # [ 0.005387] CPU features: detected: CRC32 instructions worker1 # [ 0.005390] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.005393] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.005396] CPU features: detected: Data independent timing control (DIT) lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.005399] CPU features: detected: E0PD worker1 # [ 0.005402] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.005405] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.000000] KASLR enabled lb # [ 0.000000] random: crng init done worker1 # [ 0.005408] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.005412] CPU features: detected: Fine Grained Traps lb # [ 0.000000] efi: UEFI not found. client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.005415] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.005419] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.005422] CPU features: detected: LSE atomic instructions client # [ 0.000000] KASLR enabled lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] random: crng init done worker1 # [ 0.005425] CPU features: detected: Privileged Access Never lb # [ 0.000000] Zone ranges: client # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.005428] CPU features: detected: PMUv3 client # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA32 empty worker1 # [ 0.005431] CPU features: detected: RAS Extension Support lb # [ 0.000000] Normal empty client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] Device empty lb # [ 0.000000] Movable zone start for each node client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.005434] CPU features: detected: RASv1p1 Extension Support lb # [ 0.000000] Early memory node ranges client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] Linux version 6.18.52 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 14 11:36:19 UTC 2026 worker1 # [ 0.005436] CPU features: detected: Random Number Generator client # [ 0.000000] Zone ranges: lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done worker1 # [ 0.005439] CPU features: detected: Speculation barrier (SB) client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.005441] CPU features: detected: Stage-2 Force Write-Back client # [ 0.000000] DMA32 empty worker2 # [ 0.000000] efi: UEFI not found. client # [ 0.000000] Normal empty lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] Device empty worker1 # [ 0.005444] CPU features: detected: TLB range maintenance instructions lb # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] Movable zone start for each node worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.005449] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.005490] alternatives: applying system-wide alternatives client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] Zone ranges: worker1 # [ 0.008410] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] DMA32 empty lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] Normal empty client # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.008593] Memory: 1405840K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124664K reserved, 32768K cma-reserved) worker2 # [ 0.000000] Device empty client # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 worker1 # [ 0.009016] devtmpfs: initialized worker2 # [ 0.000000] Movable zone start for each node lb # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker2 # [ 0.000000] Early memory node ranges worker1 # [ 0.010879] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.010900] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.011086] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.011090] 0 pages in range for non-PLT usage lb # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 worker1 # [ 0.011091] 508272 pages in range for PLT usage worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.011197] pinctrl core: initialized pinctrl subsystem lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.011996] DMI not present or invalid. client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker2 # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.015676] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.017839] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.018010] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.018207] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] alternatives: applying boot alternatives worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.018228] audit: initializing netlink subsys (disabled) lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5hmvppg1fs8xkiccvl0m50n4dxjz92fr-nixos-system-lb-test/init regInfo=/nix/store/4s18yqhkjka9yjskv51fw7r9nw16dgfd-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.018765] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.018767] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.000000] CPU features: detected: Spectre-BHB lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/4s18yqhkjka9yjskv51fw7r9nw16dgfd-closure-info/registration", will be passed to user space. worker1 # [ 0.018771] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.018774] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.018779] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ra6r7v42kn1phhf50aiw8qw3p1s4g3i7-nixos-system-client-test/init regInfo=/nix/store/lgfd5irrpwicr30w9sv4rcyvvpw4p2ws-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.018811] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.018820] cpuidle: using governor ladder lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.018826] cpuidle: using governor menu client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/lgfd5irrpwicr30w9sv4rcyvvpw4p2ws-closure-info/registration", will be passed to user space. lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.019022] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.019038] ASID allocator initialised with 65536 entries lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.020330] Serial: AMBA PL011 UART driver worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/bxvmlpjg1y5fh7n09mwrfkkffnsyixlj-nixos-system-worker2-test/init regInfo=/nix/store/85g4acyh62j9yqhpzlfzw6d69c8rs2px-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.025804] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.025958] printk: console [ttyAMA0] enabled worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/85g4acyh62j9yqhpzlfzw6d69c8rs2px-closure-info/registration", will be passed to user space. lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] Policy zone: DMA client # [ 0.000000] software IO TLB: area num 1. worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] ftrace: allocating 74950 entries in 294 pages worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] Policy zone: DMA lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] ftrace: allocating 74950 entries in 294 pages worker2 # [ 0.000000] Policy zone: DMA lb # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker1 # [ 0.147234] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] ftrace: allocating 74950 entries in 294 pages worker1 # [ 0.147250] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.147255] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.147260] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.147264] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker1 # [ 0.147269] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.147274] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.147278] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.154398] fbcon: Taking over console lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.154411] ACPI: Interpreter disabled. client # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.156239] iommu: Default domain type: Translated client # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.156248] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker1 # [ 0.157826] SCSI subsystem initialized worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker2 # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.163441] usbcore: registered new interface driver usbfs lb # [ 0.000030] arm-pv: using stolen time PV worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.163473] usbcore: registered new interface driver hub worker1 # [ 0.163490] usbcore: registered new device driver usb client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a10000 lb # [ 0.000406] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.163774] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.000586] Console: colour dummy device 80x25 worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000593] printk: legacy console [tty0] enabled client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.163780] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.163797] PTP clock support registered client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.163846] EDAC MC: Ver: 3.0.0 lb # [ 0.000783] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.000030] arm-pv: using stolen time PV worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000790] pid_max: default: 32768 minimum: 301 worker1 # [ 0.168263] scmi_core: SCMI protocol bus registered lb # [ 0.000870] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.000413] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.001046] landlock: Up and running. worker1 # [ 0.169199] FPGA manager framework client # [ 0.000582] Console: colour dummy device 80x25 lb # [ 0.001049] Yama: becoming mindful. worker1 # [ 0.170082] vgaarb: loaded worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000590] printk: legacy console [tty0] enabled lb # [ 0.001503] LSM support for eBPF active worker2 # [ 0.000030] arm-pv: using stolen time PV worker1 # [ 0.170682] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.001651] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000783] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.000389] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000790] pid_max: default: 32768 minimum: 301 lb # [ 0.001684] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000557] Console: colour dummy device 80x25 lb # [ 0.003413] rcu: Hierarchical SRCU implementation. client # [ 0.000870] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.000564] printk: legacy console [tty0] enabled client # [ 0.001033] landlock: Up and running. lb # [ 0.003418] rcu: Max phase no-delay instances is 1000. client # [ 0.001036] Yama: becoming mindful. lb # [ 0.004701] fsl-mc MSI: its@8080000 domain created client # [ 0.001511] LSM support for eBPF active worker2 # [ 0.000756] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.004800] EFI services will not be available. worker1 # [ 0.174224] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.000762] pid_max: default: 32768 minimum: 301 client # [ 0.001651] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.004918] smp: Bringing up secondary CPUs ... worker1 # [ 0.174257] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.004926] smp: Brought up 1 node, 1 CPU worker2 # [ 0.000843] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.001683] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000972] landlock: Up and running. lb # [ 0.004929] SMP: Total of 1 processors activated. worker2 # [ 0.000975] Yama: becoming mindful. client # [ 0.003551] rcu: Hierarchical SRCU implementation. lb # [ 0.004935] CPU: All CPU(s) started at EL1 worker2 # [ 0.001417] LSM support for eBPF active client # [ 0.003556] rcu: Max phase no-delay instances is 1000. lb # [ 0.004945] CPU features: detected: Branch Target Identification client # [ 0.004802] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.001543] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.004949] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.177825] netfs: FS-Cache loaded client # [ 0.004892] EFI services will not be available. worker1 # [ 0.177929] pnp: PnP ACPI: disabled worker2 # [ 0.001576] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.004964] smp: Bringing up secondary CPUs ... lb # [ 0.004953] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.003420] rcu: Hierarchical SRCU implementation. client # [ 0.004972] smp: Brought up 1 node, 1 CPU worker2 # [ 0.003424] rcu: Max phase no-delay instances is 1000. client # [ 0.004975] SMP: Total of 1 processors activated. lb # [ 0.004956] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.004981] CPU: All CPU(s) started at EL1 worker2 # [ 0.004663] fsl-mc MSI: its@8080000 domain created lb # [ 0.004960] CPU features: detected: Common not Private translations worker2 # [ 0.004752] EFI services will not be available. client # [ 0.004991] CPU features: detected: Branch Target Identification worker2 # [ 0.004817] smp: Bringing up secondary CPUs ... lb # [ 0.004964] CPU features: detected: CRC32 instructions client # [ 0.004996] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.004825] smp: Brought up 1 node, 1 CPU lb # [ 0.004967] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.004828] SMP: Total of 1 processors activated. client # [ 0.004999] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.004833] CPU: All CPU(s) started at EL1 worker1 # [ 0.181696] NET: Registered PF_INET protocol family lb # [ 0.004970] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.004844] CPU features: detected: Branch Target Identification lb # [ 0.004973] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.181957] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.005003] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.004849] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.004976] CPU features: detected: E0PD client # [ 0.005006] CPU features: detected: Common not Private translations lb # [ 0.004979] CPU features: detected: Enhanced Counter Virtualization client # [ 0.005010] CPU features: detected: CRC32 instructions worker2 # [ 0.004852] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.004982] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.005012] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.004855] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.004985] CPU features: detected: Enhanced Virtualization Traps client # [ 0.005016] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.004859] CPU features: detected: Common not Private translations lb # [ 0.004989] CPU features: detected: Fine Grained Traps client # [ 0.005019] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.004863] CPU features: detected: CRC32 instructions client # [ 0.005022] CPU features: detected: E0PD lb # [ 0.004992] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.004865] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.005025] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.004997] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.004869] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.005000] CPU features: detected: LSE atomic instructions client # [ 0.005028] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.004872] CPU features: detected: Data independent timing control (DIT) lb # [ 0.005003] CPU features: detected: Privileged Access Never client # [ 0.005031] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.004875] CPU features: detected: E0PD lb # [ 0.005005] CPU features: detected: PMUv3 client # [ 0.005035] CPU features: detected: Fine Grained Traps lb # [ 0.005009] CPU features: detected: RAS Extension Support worker2 # [ 0.004878] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.005011] CPU features: detected: RASv1p1 Extension Support client # [ 0.005038] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker2 # [ 0.004881] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.005014] CPU features: detected: Random Number Generator client # [ 0.005043] CPU features: detected: RCpc load-acquire (LDAPR) worker2 # [ 0.004884] CPU features: detected: Enhanced Virtualization Traps client # [ 0.005046] CPU features: detected: LSE atomic instructions lb # [ 0.005017] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.004887] CPU features: detected: Fine Grained Traps client # [ 0.005049] CPU features: detected: Privileged Access Never client # [ 0.005051] CPU features: detected: PMUv3 worker2 # [ 0.004890] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.005055] CPU features: detected: RAS Extension Support worker2 # [ 0.004896] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.005058] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.004899] CPU features: detected: LSE atomic instructions client # [ 0.005060] CPU features: detected: Random Number Generator worker2 # [ 0.004901] CPU features: detected: Privileged Access Never worker2 # [ 0.004904] CPU features: detected: PMUv3 client # [ 0.005063] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.004907] CPU features: detected: RAS Extension Support client # [ 0.005065] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.004910] CPU features: detected: RASv1p1 Extension Support client # [ 0.005068] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.004912] CPU features: detected: Random Number Generator client # [ 0.005073] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker2 # [ 0.004915] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.004918] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.004921] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.004925] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.005020] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.004963] alternatives: applying system-wide alternatives lb # [ 0.005022] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.007847] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.005027] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.005067] alternatives: applying system-wide alternatives worker2 # [ 0.008069] Memory: 1405708K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124632K reserved, 32768K cma-reserved) lb # [ 0.008058] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.008453] devtmpfs: initialized worker2 # [ 0.010206] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.008249] Memory: 1405692K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124636K reserved, 32768K cma-reserved) lb # [ 0.008621] devtmpfs: initialized worker2 # [ 0.010232] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.005110] alternatives: applying system-wide alternatives worker2 # [ 0.010407] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.010426] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.010411] 0 pages in range for non-PLT usage client # [ 0.008065] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.010448] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.010412] 508272 pages in range for PLT usage worker2 # [ 0.010517] pinctrl core: initialized pinctrl subsystem lb # [ 0.010624] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.011261] DMI not present or invalid. lb # [ 0.010628] 0 pages in range for non-PLT usage client # [ 0.008222] Memory: 1405640K/1572864K available (24448K kernel code, 7094K rwdata, 26372K rodata, 4736K init, 1107K bss, 124660K reserved, 32768K cma-reserved) client # [ 0.008603] devtmpfs: initialized worker2 # [ 0.014394] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.010629] 508272 pages in range for PLT usage lb # [ 0.010744] pinctrl core: initialized pinctrl subsystem client # [ 0.010390] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.016559] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.011503] DMI not present or invalid. worker2 # [ 0.016745] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.010411] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.014678] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.010589] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.016881] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.016938] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.010593] 0 pages in range for non-PLT usage worker2 # [ 0.016959] audit: initializing netlink subsys (disabled) lb # [ 0.017073] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.010594] 508272 pages in range for PLT usage worker2 # [ 0.017516] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.010699] pinctrl core: initialized pinctrl subsystem lb # [ 0.017270] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.011427] DMI not present or invalid. worker2 # [ 0.017518] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.017292] audit: initializing netlink subsys (disabled) client # [ 0.014522] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.017521] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.017861] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.017524] thermal_sys: Registered thermal governor 'user_space' client # [ 0.016683] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.017863] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.017529] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.016856] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.017866] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.017552] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.017869] thermal_sys: Registered thermal governor 'user_space' client # [ 0.017052] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.017562] cpuidle: using governor ladder client # [ 0.017071] audit: initializing netlink subsys (disabled) worker1 # [ 0.209945] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.017874] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.017567] cpuidle: using governor menu client # [ 0.017605] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.209987] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.017744] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.017907] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 client # [ 0.017607] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.017915] cpuidle: using governor ladder worker1 # [ 0.210014] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.017921] cpuidle: using governor menu worker2 # [ 0.017759] ASID allocator initialised with 65536 entries client # [ 0.017610] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.210081] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.018933] Serial: AMBA PL011 UART driver lb # [ 0.018114] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.017613] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.018129] ASID allocator initialised with 65536 entries worker1 # [ 0.210223] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.017618] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.024049] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.019342] Serial: AMBA PL011 UART driver worker2 # [ 0.024218] printk: console [ttyAMA0] enabled worker1 # [ 0.210301] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.017650] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.024634] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.017658] cpuidle: using governor ladder worker1 # [ 0.210335] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.024782] printk: console [ttyAMA0] enabled client # [ 0.017663] cpuidle: using governor menu worker1 # [ 0.210370] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.017851] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.210476] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.144692] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.017866] ASID allocator initialised with 65536 entries worker1 # [ 0.210504] NET: Registered PF_XDP protocol family client # [ 0.019055] Serial: AMBA PL011 UART driver lb # [ 0.144714] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.210519] PCI: CLS 0 bytes, default 64 worker1 # [ 0.210761] Trying to unpack rootfs image as initramfs... lb # [ 0.144719] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.024256] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.024379] printk: console [ttyAMA0] enabled lb # [ 0.144724] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.144728] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.140164] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.144472] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.144732] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.140179] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.144490] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.144736] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.140184] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.144495] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.144741] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.140189] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.144499] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.140193] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.144504] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.140197] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.144508] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.152048] fbcon: Taking over console worker2 # [ 0.140202] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.152062] ACPI: Interpreter disabled. client # [ 0.144512] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker1 # [ 0.228032] kvm [1]: HYP mode not available lb # [ 0.153944] iommu: Default domain type: Translated worker2 # [ 0.140206] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.144516] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.153954] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.155602] SCSI subsystem initialized worker2 # [ 0.147554] fbcon: Taking over console client # [ 0.151921] fbcon: Taking over console worker2 # [ 0.147569] ACPI: Interpreter disabled. client # [ 0.151936] ACPI: Interpreter disabled. worker2 # [ 0.149426] iommu: Default domain type: Translated worker2 # [ 0.149436] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.151102] SCSI subsystem initialized client # [ 0.158205] iommu: Default domain type: Translated client # [ 0.158214] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.159888] SCSI subsystem initialized lb # [ 0.163546] usbcore: registered new interface driver usbfs lb # [ 0.163581] usbcore: registered new interface driver hub client # [ 0.160563] usbcore: registered new interface driver usbfs worker2 # [ 0.156481] usbcore: registered new interface driver usbfs lb # [ 0.163598] usbcore: registered new device driver usb client # [ 0.160596] usbcore: registered new interface driver hub worker2 # [ 0.156514] usbcore: registered new interface driver hub lb # [ 0.163892] pps_core: LinuxPPS API ver. 1 registered client # [ 0.160620] usbcore: registered new device driver usb worker2 # [ 0.156530] usbcore: registered new device driver usb client # [ 0.160883] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.156804] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.163899] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.163916] PTP clock support registered client # [ 0.160889] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.156811] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.163973] EDAC MC: Ver: 3.0.0 client # [ 0.160906] PTP clock support registered worker2 # [ 0.156820] PTP clock support registered client # [ 0.160957] EDAC MC: Ver: 3.0.0 worker2 # [ 0.156877] EDAC MC: Ver: 3.0.0 lb # [ 0.168553] scmi_core: SCMI protocol bus registered client # [ 0.165463] scmi_core: SCMI protocol bus registered worker2 # [ 0.161305] scmi_core: SCMI protocol bus registered lb # [ 0.169531] FPGA manager framework lb # [ 0.170545] vgaarb: loaded client # [ 0.166455] FPGA manager framework worker2 # [ 0.162273] FPGA manager framework client # [ 0.167402] vgaarb: loaded worker2 # [ 0.163230] vgaarb: loaded lb # [ 0.171167] clocksource: Switched to clocksource arch_sys_counter client # [ 0.168036] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.163877] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.171778] VFS: Disk quotas dquot_6.6.0 lb # [ 0.171811] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.174128] netfs: FS-Cache loaded lb # [ 0.174240] pnp: PnP ACPI: disabled client # [ 0.172015] VFS: Disk quotas dquot_6.6.0 client # [ 0.174588] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.170965] VFS: Disk quotas dquot_6.6.0 client # [ 0.175731] netfs: FS-Cache loaded worker2 # [ 0.171001] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.175855] pnp: PnP ACPI: disabled worker2 # [ 0.174679] netfs: FS-Cache loaded worker2 # [ 0.174805] pnp: PnP ACPI: disabled lb # [ 0.180213] NET: Registered PF_INET protocol family client # [ 0.179771] NET: Registered PF_INET protocol family lb # [ 0.180493] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.178566] NET: Registered PF_INET protocol family client # [ 0.180699] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.178841] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.209639] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.207570] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.209678] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.207612] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.209703] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.207638] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.209772] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.207714] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.209916] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.207868] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.209996] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.209097] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.210030] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.209139] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.210065] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.209166] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.210156] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.209236] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.210181] NET: Registered PF_XDP protocol family lb # [ 0.210198] PCI: CLS 0 bytes, default 64 client # [ 0.209379] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.210437] Trying to unpack rootfs image as initramfs... client # [ 0.209461] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.209497] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.209543] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.209652] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.209672] NET: Registered PF_XDP protocol family client # [ 0.209688] PCI: CLS 0 bytes, default 64 worker2 # [ 0.212720] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.209915] Trying to unpack rootfs image as initramfs... worker2 # [ 0.212757] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.212792] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.212883] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.225055] kvm [1]: HYP mode not available worker2 # [ 0.212908] NET: Registered PF_XDP protocol family worker1 # [ 0.311787] Initialise system trusted keyrings worker2 # [ 0.212926] PCI: CLS 0 bytes, default 64 worker1 # [ 0.312514] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.213149] Trying to unpack rootfs image as initramfs... worker1 # [ 0.313774] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.225719] kvm [1]: HYP mode not available worker2 # [ 0.224914] kvm [1]: HYP mode not available worker1 # [ 0.318717] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.338678] Key type asymmetric registered worker1 # [ 0.346725] Asymmetric key parser 'x509' registered worker1 # [ 0.346796] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.348389] io scheduler mq-deadline registered worker1 # [ 0.348400] io scheduler kyber registered worker1 # [ 0.353375] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.358713] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.359172] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.359192] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.359206] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.359215] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.359242] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.359275] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker1 # [ 0.359376] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.359385] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.359391] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.359397] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.359402] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.359478] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.359929] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.360121] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.360139] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.360170] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.360188] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.360660] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.360849] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.360866] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.360897] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.361367] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.361554] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.361572] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.361603] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.362062] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.362251] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.362268] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.362299] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.362319] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.315849] Initialise system trusted keyrings lb # [ 0.316599] workingset: timestamp_bits=42 max_order=19 bucket_order=0 lb # [ 0.317874] squashfs: version 4.0 (2009/01/31) Phillip Lougher lb # [ 0.318652] 9p: Installing v9fs 9p2000 file system support client # [ 0.316547] Initialise system trusted keyrings client # [ 0.317289] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.394862] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint client # [ 0.318536] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.395082] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.395116] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.319311] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.316408] Initialise system trusted keyrings worker1 # [ 0.395664] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.317152] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.395857] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.395888] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.318406] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.396286] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.319210] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.396471] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.396750] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.396944] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.396976] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.397437] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.397632] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.397664] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.398128] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.398323] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.398355] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.398832] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.399108] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.399125] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.399155] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.399604] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.399795] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.399811] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.399841] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.400407] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.339950] Key type asymmetric registered worker1 # [ 0.400418] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.339971] Asymmetric key parser 'x509' registered worker1 # [ 0.400424] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.400470] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.400518] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.347354] Key type asymmetric registered worker1 # [ 0.400566] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.347380] Asymmetric key parser 'x509' registered worker1 # [ 0.400624] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.347445] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.400669] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.349625] io scheduler mq-deadline registered lb # [ 0.349637] io scheduler kyber registered worker1 # [ 0.400715] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.400760] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.348073] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.400805] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.349127] io scheduler mq-deadline registered client # [ 0.349139] io scheduler kyber registered worker1 # [ 0.400850] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.400922] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.400967] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.400989] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.348095] Key type asymmetric registered worker2 # [ 0.348118] Asymmetric key parser 'x509' registered worker1 # [ 0.401010] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.348177] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.401032] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.350310] io scheduler mq-deadline registered worker1 # [ 0.401053] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.350321] io scheduler kyber registered worker1 # [ 0.401074] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.359425] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.401096] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.401120] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.401142] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.401164] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.360833] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.401186] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.361251] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.401208] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.360172] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.401230] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.361268] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.401250] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.361280] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.401271] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned worker1 # [ 0.401292] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned lb # [ 0.361288] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.361544] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.401313] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.361319] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.401335] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.360065] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.361951] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.401360] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.361343] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.361968] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.401370] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.361417] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.361980] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.401374] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.361427] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.402195] pci 0000:00:07.0: enabling device (0000 -> 0002) lb # [ 0.361433] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.361988] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.361450] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.361438] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.361854] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.362008] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.361443] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.361872] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.362034] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.361536] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.362106] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.361885] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.361974] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.362116] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.362160] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.361893] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.362121] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.362176] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.362126] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.361914] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.362206] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.362131] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker2 # [ 0.361937] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.362222] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.362186] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.362019] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.362677] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.362029] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.362630] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.362860] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.458874] pci 0000:00:07.0: quirk_usb_early_handoff+0x0/0xa60 took 55350 usecs worker2 # [ 0.362035] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.362817] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.362876] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.362041] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.362833] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.362905] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.362863] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.362046] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.362879] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.362100] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.382269] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.363333] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.362544] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.382456] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] client # [ 0.363519] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.362734] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.382472] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.363535] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.362752] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.382501] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.363564] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.362782] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.382951] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.364026] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.362799] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.383132] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.363261] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.383710] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.383148] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.363448] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.383729] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.363464] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.383759] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.363494] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.386354] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.382670] pci 0000:00:03.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint client # [ 0.386540] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.382858] pci 0000:00:03.0: BAR 0 [io 0x0000-0x007f] client # [ 0.386556] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.382875] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.386585] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.382906] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.386603] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] worker2 # [ 0.383369] pci 0000:00:04.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.383553] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.387052] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.383570] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.387238] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.383600] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.387267] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.383619] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.387748] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.387934] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.387964] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.480771] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.395227] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.395258] pci 0000:00:04.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.395759] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.395962] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.395992] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.396451] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.400436] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.396637] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.400632] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.396667] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.400885] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.397057] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.401073] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.397237] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.401103] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.396183] pci 0000:00:05.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.397520] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.401550] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.397706] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.396390] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.401738] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.396421] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.397736] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.490995] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.401768] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.396913] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.398185] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.402218] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.397105] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.398370] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.402405] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.397135] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.398400] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.402435] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.397544] pci 0000:00:07.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.398848] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.402888] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.397729] pci 0000:00:07.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.399034] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.403172] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.403190] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.399064] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.397977] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.403219] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.398168] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.399547] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.399812] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.398198] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.403677] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.399839] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.403865] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.398653] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.403881] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.399868] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.398846] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.498721] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.403911] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.400345] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.398877] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.500642] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.400528] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.502529] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) worker2 # [ 0.399335] pci 0000:00:0a.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.400544] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.399527] pci 0000:00:0a.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.400574] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.399557] pci 0000:00:0a.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.401138] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.400048] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.401149] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.400316] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.400334] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.401154] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.400364] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.401198] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.400831] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.401245] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.401027] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.401292] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.401043] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.424575] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.401339] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.401076] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.424595] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.401654] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.401384] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.401666] pci 0000:00:04.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.424600] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.512318] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) lb # [ 0.401429] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.513993] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.401672] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.424647] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.401474] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.401717] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.424696] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.401520] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker2 # [ 0.401764] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.424743] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.401565] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.401816] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.424792] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.401637] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker2 # [ 0.401866] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.424839] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.401682] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.401914] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.401704] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned client # [ 0.424888] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.401725] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.401965] pci 0000:00:08.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.424935] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.401746] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.402017] pci 0000:00:09.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.424982] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.401767] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.402064] pci 0000:00:0a.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.425029] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.401788] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.402112] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.425134] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.401810] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned client # [ 0.425189] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.402188] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.401834] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.425210] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.402238] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.401855] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.425232] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.401877] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.402263] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.524751] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.425253] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.402285] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.401899] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.526516] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.425275] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.402309] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.401921] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.425296] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.402332] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.401943] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.425317] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.401964] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.402354] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.425343] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.401985] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned worker2 # [ 0.402376] pci 0000:00:07.0: BAR 0 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.529811] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.402006] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned client # [ 0.425365] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.402403] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.402027] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.425392] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.402426] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.402048] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.425415] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.402448] pci 0000:00:0a.0: BAR 1 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.402074] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.425437] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.402471] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.402083] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.425460] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.402495] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.402088] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.425481] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.402518] pci 0000:00:03.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.402894] pci 0000:00:07.0: enabling device (0000 -> 0002) client # [ 0.425502] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned worker2 # [ 0.402539] pci 0000:00:0b.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.425525] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned worker2 # [ 0.402563] pci 0000:00:01.0: BAR 0 [io 0x10c0-0x10df]: assigned client # [ 0.425549] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.402585] pci 0000:00:02.0: BAR 0 [io 0x10e0-0x10ff]: assigned client # [ 0.425570] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.402607] pci 0000:00:04.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.425598] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.402630] pci 0000:00:0c.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.538088] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.425607] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.402657] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.425612] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.402666] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.426435] pci 0000:00:07.0: enabling device (0000 -> 0002) worker2 # [ 0.402671] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.459283] pci 0000:00:07.0: quirk_usb_early_handoff+0x0/0xa60 took 55073 usecs worker2 # [ 0.403509] pci 0000:00:07.0: enabling device (0000 -> 0002) worker2 # [ 0.460007] pci 0000:00:07.0: quirk_usb_early_handoff+0x0/0xa60 took 55179 usecs worker1 # [ 0.550581] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.553153] msm_serial: driver initialized worker1 # [ 0.553288] SuperH (H)SCI(F) driver initialized worker1 # [ 0.553342] STM32 USART driver initialized lb # [ 0.480400] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.482481] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.482488] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.480608] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.482744] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.493613] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.492667] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.496199] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.493815] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.498215] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.495770] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.585472] loop: module loaded worker1 # [ 0.585644] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 0.586457] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.503348] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.506880] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) lb # [ 0.509020] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) lb # [ 0.510671] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.505646] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) client # [ 0.508233] virtio-pci 0000:00:05.0: enabling device (0000 -> 0002) client # [ 0.510980] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) worker2 # [ 0.512060] virtio-pci 0000:00:06.0: enabling device (0000 -> 0002) worker2 # [ 0.514005] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.599362] megasas: 07.734.00.00-rc1 worker2 # [ 0.515868] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.600072] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker1 # [ 0.602025] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.602052] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.603606] Using buffer write method worker1 # [ 0.603668] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.528615] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.530592] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.520595] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.605496] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.605545] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.522773] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.524633] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.533978] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.526501] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.529754] virtio-pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.537058] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.531567] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.623545] Using buffer write method worker1 # [ 0.623591] Concatenating MTD devices: worker1 # [ 0.623595] (0): "0.flash" worker1 # [ 0.623605] (1): "0.flash" client # [ 0.536604] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.623608] into device "0.flash" worker2 # [ 0.535519] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) lb # [ 0.550424] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.553596] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.556204] msm_serial: driver initialized lb # [ 0.556406] SuperH (H)SCI(F) driver initialized lb # [ 0.556462] STM32 USART driver initialized client # [ 0.556185] msm_serial: driver initialized client # [ 0.556336] SuperH (H)SCI(F) driver initialized client # [ 0.556387] STM32 USART driver initialized worker2 # [ 0.556208] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.557991] msm_serial: driver initialized worker2 # [ 0.558118] SuperH (H)SCI(F) driver initialized worker2 # [ 0.558171] STM32 USART driver initialized lb # [ 0.588892] loop: module loaded client # [ 0.585825] loop: module loaded lb # [ 0.589071] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 0.586000] virtio_blk virtio2: 1/0/0 default/read/poll queues lb # [ 0.589824] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.586739] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.586594] loop: module loaded worker2 # [ 0.586778] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 0.587536] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.592664] megasas: 07.734.00.00-rc1 lb # [ 0.595800] megasas: 07.734.00.00-rc1 client # [ 0.593365] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.596588] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.595251] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.595276] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.592464] megasas: 07.734.00.00-rc1 worker2 # [ 0.593124] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.608243] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.604876] Using buffer write method lb # [ 0.608276] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.609843] Using buffer write method client # [ 0.604946] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.609925] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.606477] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.606523] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.604906] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.604967] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.606551] Using buffer write method worker2 # [ 0.606621] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.620079] Using buffer write method client # [ 0.620107] Concatenating MTD devices: client # [ 0.620111] (0): "0.flash" client # [ 0.620115] (1): "0.flash" client # [ 0.620122] into device "0.flash" lb # [ 0.623792] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.623865] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.625428] Using buffer write method lb # [ 0.625456] Concatenating MTD devices: lb # [ 0.625460] (0): "0.flash" lb # [ 0.625472] (1): "0.flash" lb # [ 0.625476] into device "0.flash" worker2 # [ 0.621811] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.621844] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.623392] Using buffer write method worker2 # [ 0.623420] Concatenating MTD devices: worker2 # [ 0.623424] (0): "0.flash" worker2 # [ 0.623435] (1): "0.flash" worker2 # [ 0.623439] into device "0.flash" worker1 # [ 0.864288] Freeing initrd memory: 26976K worker1 # [ 0.870570] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.874375] thunder_xcv, ver 1.0 worker1 # [ 0.874427] thunder_bgx, ver 1.0 worker1 # [ 0.874449] nicpf, ver 1.0 worker1 # [ 0.876266] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.876279] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.876304] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.876313] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.876342] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.876348] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 0.876371] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.876377] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.876509] sky2: driver version 1.30 worker1 # [ 0.878105] usbcore: registered new interface driver usb-storage worker1 # [ 0.878240] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.878257] usbserial: USB Serial support registered for generic worker1 # [ 0.879458] ehci-pci 0000:00:07.0: EHCI Host Controller worker1 # [ 0.879490] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.879776] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 worker1 # [ 0.890687] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.891447] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.891760] hub 1-0:1.0: USB hub found worker1 # [ 0.891782] hub 1-0:1.0: 6 ports detected worker1 # [ 0.894659] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.894688] rtc-pl031 9010000.pl031: setting system clock to 2026-09-23T15:59:30 UTC (1790179170) worker1 # [ 0.896737] i2c_dev: i2c /dev entries driver worker1 # [ 0.900368] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.900381] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.900660] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.901022] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.902543] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.906094] usbcore: registered new interface driver usbhid worker1 # [ 0.906104] usbhid: USB HID core driver client # [ 0.859888] Freeing initrd memory: 26972K worker1 # [ 0.941076] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.943414] drop_monitor: Initializing network drop monitor service worker1 # [ 0.943661] NET: Registered PF_INET6 protocol family worker1 # [ 0.946979] Segment Routing with IPv6 worker1 # [ 0.947009] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.947038] NET: Registered PF_PACKET protocol family worker1 # [ 0.948665] 9pnet: Installing 9P2000 support client # [ 0.866005] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.948721] Key type dns_resolver registered lb # [ 0.869833] Freeing initrd memory: 26948K client # [ 0.869894] thunder_xcv, ver 1.0 worker2 # [ 0.865022] Freeing initrd memory: 26944K client # [ 0.869940] thunder_bgx, ver 1.0 lb # [ 0.876088] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.869962] nicpf, ver 1.0 client # [ 0.870504] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.870511] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.955509] registered taskstats version 1 client # [ 0.870535] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.955654] Loading compiled-in X.509 certificates client # [ 0.870543] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.871023] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.870574] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.870580] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.870603] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.870608] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.870739] sky2: driver version 1.30 worker2 # [ 0.874736] thunder_xcv, ver 1.0 lb # [ 0.879683] thunder_xcv, ver 1.0 client # [ 0.879770] ehci-pci 0000:00:07.0: EHCI Host Controller worker2 # [ 0.874779] thunder_bgx, ver 1.0 worker1 # [ 0.964334] Demotion targets for Node 0: null lb # [ 0.879726] thunder_bgx, ver 1.0 worker1 # [ 0.964449] Key type .fscrypt registered worker2 # [ 0.874801] nicpf, ver 1.0 lb # [ 0.879750] nicpf, ver 1.0 client # [ 0.879801] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.875339] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.964456] Key type fscrypt-provisioning registered lb # [ 0.880360] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.880129] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 worker1 # [ 0.964557] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.875346] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.880367] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.964587] ima: Allocated hash algorithm: sha1 worker2 # [ 0.875369] e1000e: Intel(R) PRO/1000 Network Driver lb # [ 0.880391] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.964609] ima: No architecture policies found worker2 # [ 0.875377] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.880399] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.875406] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.880445] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.882707] usbcore: registered new interface driver usb-storage worker1 # [ 0.968549] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.875411] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.880451] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.882860] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.875450] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.880476] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.882874] usbserial: USB Serial support registered for generic worker2 # [ 0.875456] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.880482] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.883461] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.875589] sky2: driver version 1.30 lb # [ 0.880620] sky2: driver version 1.30 lb # [ 0.882230] usbcore: registered new interface driver usb-storage client # [ 0.887089] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.882326] usbcore: registered new interface driver usbserial_generic lb # [ 0.882342] usbserial: USB Serial support registered for generic client # [ 0.887115] rtc-pl031 9010000.pl031: setting system clock to 2026-09-23T15:59:30 UTC (1790179170) worker2 # [ 0.884573] ehci-pci 0000:00:07.0: EHCI Host Controller lb # [ 0.882953] hv_vmbus: registering driver hyperv_keyboard client # [ 0.887419] i2c_dev: i2c /dev entries driver worker2 # [ 0.884603] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 lb # [ 0.883880] ehci-pci 0000:00:07.0: EHCI Host Controller worker2 # [ 0.884877] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 lb # [ 0.883905] ehci-pci 0000:00:07.0: new USB bus registered, assigned bus number 1 lb # [ 0.884105] ehci-pci 0000:00:07.0: irq 16, io mem 0x10086000 worker2 # [ 0.887427] usbcore: registered new interface driver usb-storage worker2 # [ 0.887505] usbcore: registered new interface driver usbserial_generic lb # [ 0.896291] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 lb # [ 0.896605] hub 1-0:1.0: USB hub found worker2 # [ 0.887518] usbserial: USB Serial support registered for generic lb # [ 0.896626] hub 1-0:1.0: 6 ports detected worker2 # [ 0.890394] hv_vmbus: registering driver hyperv_keyboard client # [ 0.892795] sdhci: Secure Digital Host Controller Interface driver client # [ 0.892808] sdhci: Copyright(c) Pierre Ossman lb # [ 0.899395] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.891956] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.893065] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.899421] rtc-pl031 9010000.pl031: setting system clock to 2026-09-23T15:59:30 UTC (1790179170) client # [ 0.893437] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.899728] i2c_dev: i2c /dev entries driver worker2 # [ 0.891981] rtc-pl031 9010000.pl031: setting system clock to 2026-09-23T15:59:30 UTC (1790179170) client # [ 0.894913] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.892280] i2c_dev: i2c /dev entries driver client # [ 0.895153] usbcore: registered new interface driver usbhid client # [ 0.895159] usbhid: USB HID core driver client # [ 0.900503] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 client # [ 0.900807] hub 1-0:1.0: USB hub found worker1 # [ 0.986664] clk: Disabling unused clocks client # [ 0.900827] hub 1-0:1.0: 6 ports detected lb # [ 0.905071] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.905083] sdhci: Copyright(c) Pierre Ossman client # [ 0.903056] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.987258] PM: genpd: Disabling unused power domains lb # [ 0.905358] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.897593] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.905749] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.897606] sdhci: Copyright(c) Pierre Ossman client # [ 0.905680] drop_monitor: Initializing network drop monitor service worker2 # [ 0.897867] Synopsys Designware Multimedia Card Interface Driver client # [ 0.905865] NET: Registered PF_INET6 protocol family worker1 # [ 0.990909] Freeing unused kernel memory: 4736K worker2 # [ 0.898234] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.991124] Run /init as init process lb # [ 0.910011] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.899762] hid: raw HID events driver (C) Jiri Kosina client # [ 0.907762] Segment Routing with IPv6 lb # [ 0.910291] usbcore: registered new interface driver usbhid worker2 # [ 0.899914] ehci-pci 0000:00:07.0: USB 2.0 started, EHCI 1.00 client # [ 0.907780] In-situ OAM (IOAM) with IPv6 lb # [ 0.910298] usbhid: USB HID core driver worker2 # [ 0.900214] hub 1-0:1.0: USB hub found client # [ 0.907808] NET: Registered PF_PACKET protocol family worker2 # [ 0.900237] hub 1-0:1.0: 6 ports detected worker2 # [ 0.905669] usbcore: registered new interface driver usbhid worker2 # [ 0.905680] usbhid: USB HID core driver lb # [ 0.913154] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.909462] 9pnet: Installing 9P2000 support client # [ 0.909513] Key type dns_resolver registered lb # [ 0.914750] drop_monitor: Initializing network drop monitor service lb # [ 0.914925] NET: Registered PF_INET6 protocol family lb # [ 0.918173] Segment Routing with IPv6 worker2 # [ 0.907982] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.918194] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.909494] drop_monitor: Initializing network drop monitor service lb # [ 0.918223] NET: Registered PF_PACKET protocol family worker2 # [ 0.909643] NET: Registered PF_INET6 protocol family worker2 # [ 0.912718] Segment Routing with IPv6 worker2 # [ 0.912736] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.912764] NET: Registered PF_PACKET protocol family lb # [ 0.920091] 9pnet: Installing 9P2000 support lb # [ 0.920138] Key type dns_resolver registered client # [ 0.916096] registered taskstats version 1 worker2 # [ 0.914464] 9pnet: Installing 9P2000 support client # [ 0.916254] Loading compiled-in X.509 certificates worker2 # [ 0.914511] Key type dns_resolver registered lb # [ 0.927011] registered taskstats version 1 lb # [ 0.927153] Loading compiled-in X.509 certificates worker1 # [ 1.009045] systemd[1]: Successfully made /usr/ read-only. client # [ 0.924966] Demotion targets for Node 0: null client # [ 0.925072] Key type .fscrypt registered client # [ 0.925078] Key type fscrypt-provisioning registered client # [ 0.925173] ima: No TPM chip found, activating TPM-bypass! client # [ 0.925192] ima: Allocated hash algorithm: sha1 client # [ 0.925213] ima: No architecture policies found worker2 # [ 0.921129] registered taskstats version 1 worker2 # [ 0.921285] Loading compiled-in X.509 certificates client # [ 0.929453] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.935826] Demotion targets for Node 0: null lb # [ 0.935930] Key type .fscrypt registered lb # [ 0.935937] Key type fscrypt-provisioning registered lb # [ 0.936035] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.936055] ima: Allocated hash algorithm: sha1 worker2 # [ 0.930273] Demotion targets for Node 0: null lb # [ 0.936077] ima: No architecture policies found worker2 # [ 0.930374] Key type .fscrypt registered worker2 # [ 0.930381] Key type fscrypt-provisioning registered worker2 # [ 0.930474] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.940392] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.930493] ima: Allocated hash algorithm: sha1 worker2 # [ 0.930515] ima: No architecture policies found worker2 # [ 0.934599] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.947666] clk: Disabling unused clocks client # [ 0.947697] PM: genpd: Disabling unused power domains client # [ 0.951848] Freeing unused kernel memory: 4736K client # [ 0.952657] Run /init as init process lb # [ 0.958798] clk: Disabling unused clocks lb # [ 0.958830] PM: genpd: Disabling unused power domains worker2 # [ 0.952549] clk: Disabling unused clocks lb # [ 0.963064] Freeing unused kernel memory: 4736K worker2 # [ 0.952581] PM: genpd: Disabling unused power domains lb # [ 0.963879] Run /init as init process worker2 # [ 0.956688] Freeing unused kernel memory: 4736K worker2 # [ 0.956874] Run /init as init process client # [ 0.966279] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.977374] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 0.974079] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.162763] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.143280] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.148114] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.147958] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.315313] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.343935] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.355945] systemd[1]: Detected virtualization qemu. worker1 # [ 1.358002] systemd[1]: Detected architecture arm64. worker1 # [ 1.359950] systemd[1]: Running in initrd. worker1 # [ 1.362478] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.365632] systemd[1]: Hostname set to . lb # [ 1.297854] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.300561] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.301088] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.314036] systemd[1]: Detected virtualization qemu. client # [ 1.316371] systemd[1]: Detected architecture arm64. lb # [ 1.312207] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.324467] systemd[1]: Detected virtualization qemu. worker1 # [ 1.403078] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 lb # [ 1.326539] systemd[1]: Detected architecture arm64. client # [ 1.319281] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.308859] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.328632] systemd[1]: Running in initrd. client # [ 1.325273] systemd[1]: Running in initrd. worker2 # [ 1.321279] systemd[1]: Detected virtualization qemu. worker2 # [ 1.323367] systemd[1]: Detected architecture arm64. lb # [ 1.331162] systemd[1]: Initializing machine ID from random generator. client # [ 1.327884] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.325373] systemd[1]: Running in initrd. lb # [ 1.333995] systemd[1]: Hostname set to . client # [ 1.330989] systemd[1]: Hostname set to . worker2 # [ 1.328055] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.331056] systemd[1]: Hostname set to . lb # [ 1.383488] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 worker2 # [ 1.380156] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 client # [ 1.400318] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:07.0-1/input0 worker1 # [ 1.526767] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.507264] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.503953] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.520104] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.677916] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.695124] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.700774] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 client # [ 1.642243] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.646517] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.665573] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.671431] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.668925] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.679419] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 client # [ 1.678629] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:07.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.669349] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 client # [ 1.684166] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:07.0-2/input0 worker1 # [ 1.791585] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.801067] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.802214] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.803556] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.804578] systemd[1]: Reached target Path Units. worker1 # [ 1.805357] systemd[1]: Reached target Slice Units. worker1 # [ 1.806149] systemd[1]: Reached target Swaps. worker1 # [ 1.806933] systemd[1]: Reached target Timer Units. worker1 # [ 1.807934] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.809118] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.810206] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.811202] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.812188] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.813061] systemd[1]: Reached target Socket Units. worker1 # [ 1.815586] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.816713] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.824087] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.834995] systemd[1]: Starting Journal Service... client # [ 1.752896] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.759830] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.762470] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.763660] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.765089] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.769535] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.766147] systemd[1]: Reached target Path Units. client # [ 1.766959] systemd[1]: Reached target Slice Units. lb # [ 1.770737] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.767798] systemd[1]: Reached target Swaps. lb # [ 1.772211] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.768623] systemd[1]: Reached target Timer Units. lb # [ 1.773286] systemd[1]: Reached target Path Units. client # [ 1.769641] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.774111] systemd[1]: Reached target Slice Units. worker2 # [ 1.766052] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.770872] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.774937] systemd[1]: Reached target Swaps. lb # [ 1.775753] systemd[1]: Reached target Timer Units. client # [ 1.772015] systemd[1]: Listening on Journal Sockets. lb # [ 1.776784] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.778110] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.859082] systemd[1]: Starting Load Kernel Modules... client # [ 1.773098] systemd[1]: Listening on udev Control Socket. client # [ 1.773233] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.779274] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.860032] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.773257] systemd[1]: Reached target Socket Units. lb # [ 1.780287] systemd[1]: Listening on udev Control Socket. lb # [ 1.781329] systemd[1]: Listening on udev Kernel Socket. client # [ 1.777459] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.782244] systemd[1]: Reached target Socket Units. worker2 # [ 1.774323] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.778604] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.775494] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.784740] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.776906] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.777928] systemd[1]: Reached target Path Units. worker2 # [ 1.778728] systemd[1]: Reached target Slice Units. lb # [ 1.785916] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.779545] systemd[1]: Reached target Swaps. worker2 # [ 1.780324] systemd[1]: Reached target Timer Units. worker2 # [ 1.781317] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.782619] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.783707] systemd[1]: Listening on Journal Sockets. client # [ 1.788221] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.784753] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.785745] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.786620] systemd[1]: Reached target Socket Units. worker2 # [ 1.789080] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.795379] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.790227] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.796350] systemd[1]: Starting Journal Service... lb # [ 1.803455] systemd[1]: Starting Journal Service... worker1 # [ 1.883095] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.800093] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.893972] systemd-journald[72]: Collecting audit messages is disabled. worker2 # [ 1.808192] systemd[1]: Starting Journal Service... client # [ 1.820424] systemd[1]: Starting Load Kernel Modules... lb # [ 1.828531] systemd[1]: Starting Load Kernel Modules... client # [ 1.824316] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.906810] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.829489] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.911950] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.912224] systemd[1]: Mounted Kernel Configuration File System. client # [ 1.836230] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.832296] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.833243] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.847261] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.845854] systemd-journald[72]: Collecting audit messages is disabled. client # [ 1.852217] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.853255] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.861700] systemd-journald[72]: Collecting audit messages is disabled. worker2 # [ 1.855436] systemd-journald[72]: Collecting audit messages is disabled. worker1 # [ 1.944883] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.856597] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.864310] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.875422] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.876116] systemd[1]: Mounted Kernel Configuration File System. lb # [ 1.878903] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.959374] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.961648] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.872040] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.872742] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.964160] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.972046] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 worker1 # [ 1.972285] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.972295] [drm] features: -context_init worker1 # [ 1.973008] [drm] number of scanouts: 1 worker1 # [ 1.973026] [drm] number of cap sets: 0 worker2 # [ 1.884270] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.904685] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.910016] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.908427] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.923226] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.999092] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.999111] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 client # [ 1.922957] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.932718] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 worker2 # [ 1.924591] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.932956] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.927107] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.932966] [drm] features: -context_init lb # [ 1.933690] [drm] number of scanouts: 1 lb # [ 1.933708] [drm] number of cap sets: 0 worker1 # [ 2.023316] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.935027] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.940098] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 2.023513] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 2.023539] systemd[1]: Reached target Local File Systems. lb # [ 1.947839] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 2.027474] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.950340] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.953538] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 worker1 # [ 2.031974] Console: switching to colour frame buffer device 160x50 client # [ 1.953779] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 2.038602] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 1.953789] [drm] features: -context_init client # [ 1.954503] [drm] number of scanouts: 1 client # [ 1.954521] [drm] number of cap sets: 0 lb # [ 1.959659] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic lb # [ 1.959677] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 worker2 # [ 1.951999] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker2 # [ 1.958141] [drm] pci: virtio-gpu-pci detected at 0000:00:05.0 worker2 # [ 1.958373] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.958383] [drm] features: -context_init worker2 # [ 1.959070] [drm] number of scanouts: 1 worker2 # [ 1.959088] [drm] number of cap sets: 0 client # [ 1.972679] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.972877] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.972902] systemd[1]: Reached target Local File Systems. client # [ 1.976791] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.976489] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.976822] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.976851] systemd[1]: Reached target Local File Systems. client # [ 1.981429] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic worker1 # [ 2.066971] systemd[1]: Finished Load Kernel Modules. client # [ 1.981447] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 worker1 # [ 2.070228] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.984260] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 2.077538] systemd[1]: Started Journal Service. worker2 # [ 1.989308] virtio-pci 0000:00:05.0: [drm] Registered 1 planes with drm panic worker2 # [ 1.989327] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:05.0 on minor 0 lb # [ 1.996176] Console: switching to colour frame buffer device 160x50 lb # [ 2.002967] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 2.072329] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.073639] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.006523] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 2.006891] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.006926] systemd[1]: Reached target Local File Systems. worker1 # [ 2.084316] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.019919] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 2.008338] Console: switching to colour frame buffer device 160x50 client # [ 2.011382] Console: switching to colour frame buffer device 160x50 client # [ 2.017864] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.020936] systemd[1]: Started Journal Service. worker1 # [ 2.093098] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.007984] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.094196] systemd-modules-load[74]: Module 'virtio_rng' is built in client # [ 2.009355] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.010757] systemd-modules-load[74]: Module 'virtio_console' is built in worker1 # [ 2.100298] systemd[1]: Starting Create System Files and Directories... client # [ 2.024131] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.035930] virtio-pci 0000:00:05.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker2 # [ 2.040070] systemd[1]: Started Journal Service. lb # [ 2.047417] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.117389] systemd[1]: Finished Apply Kernel Variables. client # [ 2.032337] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.033302] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.050818] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.044445] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.045725] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.041334] systemd[1]: Finished Load Kernel Modules. lb # [ 2.046792] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.037935] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.047850] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.129987] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker2 # [ 2.040715] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker2 # [ 2.041846] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.042877] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker2 # [ 2.043830] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.075455] systemd[1]: Started Journal Service. worker1 # [ 2.144981] systemd[1]: Finished Create System Files and Directories. lb # [ 2.064375] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.057283] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.058347] systemd[1]: Finished Load Kernel Modules. client # [ 2.064193] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.067442] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 2.076383] systemd[1]: Starting Create System Files and Directories... client # [ 2.075230] systemd-udevd[79]: Using default interface naming scheme 'v261'. client # [ 2.077364] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.164773] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.089859] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.093188] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.105634] systemd-udevd[78]: Using default interface naming scheme 'v261'. client # [ 2.101265] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.105030] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.110030] systemd[1]: Finished Apply Kernel Variables. lb # [ 2.120837] systemd[1]: Finished Create System Files and Directories. client # [ 2.117759] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.126128] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.140317] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.224174] systemd[1]: Starting Virtual Console Setup... client # [ 2.172081] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.176271] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.272434] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.275816] systemd[1]: Finished Virtual Console Setup. lb # [ 2.196165] systemd[1]: Starting Virtual Console Setup... client # [ 2.220415] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.223748] systemd[1]: Finished Virtual Console Setup. worker2 # [ 2.232449] systemd-vconsole-setup[101]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.235805] systemd[1]: Finished Virtual Console Setup. lb # [ 2.244457] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.247821] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.883598] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.884640] systemd[1]: Reached target System Initialization. worker1 # [ 2.888105] systemd[1]: Reached target Basic System. client # [ 2.833892] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.830219] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.831191] systemd[1]: Reached target System Initialization. worker2 # [ 2.836102] systemd[1]: Reached target Basic System. client # [ 2.840125] systemd[1]: Reached target System Initialization. client # [ 2.841021] systemd[1]: Reached target Basic System. lb # [ 2.858052] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.858986] systemd[1]: Reached target System Initialization. lb # [ 2.864169] systemd[1]: Reached target Basic System. worker1 # [ 3.041689] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.060934] (udev-worker)[100]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.068715] (udev-worker)[100]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.996091] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.992372] (udev-worker)[94]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.008078] (udev-worker)[98]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 3.006033] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.009748] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.017469] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.021520] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.042815] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.045998] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.063527] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.154194] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.155858] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.066645] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.160801] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.075431] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.096312] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.102838] systemd[1]: Reached target Initrd Root Device. client # [ 3.108169] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.113380] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.200458] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.119422] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.115902] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.126103] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.209387] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.211435] systemd[1]: Mounting /sysroot... worker2 # [ 3.122397] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.128898] systemd[1]: Mounting /sysroot... client # [ 3.152233] systemd-fsck[110]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.158991] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 3.160456] systemd[1]: Mounting /sysroot... lb # [ 3.167915] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 3.263848] EXT4-fs (vda): mounted filesystem 63ca42a6-0a78-4a40-aed9-62f78a282947 r/w with ordered data mode. Quota mode: none. worker1 # [ 3.254442] systemd[1]: Mounted /sysroot. worker1 # [ 3.256093] systemd[1]: Reached target Initrd Root File System. lb # [ 3.175124] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker1 # [ 3.257685] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.180847] systemd[1]: Mounting /sysroot... worker2 # [ 3.187665] EXT4-fs (vda): mounted filesystem 9e950184-7788-4e15-b451-aa57d7ad5f00 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.179984] systemd[1]: Mounted /sysroot. worker2 # [ 3.181748] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.188112] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.283616] systemd-sysroot-fstab-check[118]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.214849] EXT4-fs (vda): mounted filesystem 39e36b9e-d9a6-41e9-be3e-c0c8076db105 r/w with ordered data mode. Quota mode: none. client # [ 3.204907] systemd[1]: Mounted /sysroot. worker1 # [ 3.291029] systemd[1]: Reload requested from client PID 118 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.206753] systemd[1]: Reached target Initrd Root File System. worker1 # [ 3.294424] systemd[1]: Reloading... client # [ 3.211010] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.233350] EXT4-fs (vda): mounted filesystem 0369716f-fabe-48ec-a9df-ad7d213a7498 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.211565] systemd-sysroot-fstab-check[118]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.224375] systemd[1]: Mounted /sysroot. lb # [ 3.226291] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.220204] systemd[1]: Reload requested from client PID 118 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.230954] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.224953] systemd[1]: Reloading... client # [ 3.236492] systemd-sysroot-fstab-check[118]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.239851] systemd[1]: Reload requested from client PID 118 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.245108] systemd[1]: Reloading... lb # [ 3.255072] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.263692] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.266544] systemd[1]: Reloading... worker1 # [ 3.500097] systemd[1]: Reloading finished in 206 ms. worker2 # [ 3.423915] systemd[1]: Reloading finished in 205 ms. worker1 # [ 3.526357] systemd-sysroot-fstab-check[118]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.531032] systemd-sysroot-fstab-check[118]: Requesting swap.target/start/replace... worker2 # [ 3.442367] systemd-sysroot-fstab-check[118]: Requesting initrd-fs.target/start/replace... client # [ 3.448562] systemd[1]: Reloading finished in 204 ms. worker1 # [ 3.536272] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.447061] systemd-sysroot-fstab-check[118]: Requesting swap.target/start/replace... worker1 # [ 3.538395] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.541149] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.464792] systemd[1]: Reloading finished in 203 ms. worker2 # [ 3.457359] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.458548] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.459486] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.480157] systemd-sysroot-fstab-check[118]: Requesting initrd-fs.target/start/replace... client # [ 3.485144] systemd-sysroot-fstab-check[118]: Requesting swap.target/start/replace... client # [ 3.491265] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.496089] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... client # [ 3.494237] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.499190] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... client # [ 3.495800] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.506506] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.509379] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.511542] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.874553] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.891248] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.896193] systemd[1]: Mounting /sysroot/run... client # [ 3.825851] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.918373] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.837670] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.855938] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.852208] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.939647] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.852676] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.868343] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.859600] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.866273] systemd[1]: Mounting /sysroot/tmp/shared... lb # [ 3.875286] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.872752] systemd[1]: Mounting /sysroot/run... lb # [ 3.890058] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.886527] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.893473] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.983216] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 4.003963] fuse: init (API version 7.45) worker1 # [ 4.010023] virtiofs virtio6: discovered new tag: nix-store lb # [ 3.919085] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.910401] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 4.018988] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 4.009290] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.929022] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 4.036677] virtiofs virtio7: discovered new tag: shared worker1 # [ 4.037504] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker1 # [ 4.044225] virtiofs virtio8: discovered new tag: xchg worker1 # [ 4.044987] virtiofs virtio8: virtio_fs_setup_dax: No cache capability client # [ 3.965520] fuse: init (API version 7.45) client # [ 3.953806] systemd[1]: Mounted /sysroot/run. client # [ 3.974013] virtiofs virtio6: discovered new tag: nix-store worker2 # [ 3.971861] fuse: init (API version 7.45) client # [ 3.974804] virtiofs virtio6: virtio_fs_setup_dax: No cache capability worker1 # [ 4.050021] systemd[1]: Mounted /sysroot/run. worker1 # [ 4.051837] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.971371] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 4.054239] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 4.055342] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.994019] fuse: init (API version 7.45) client # [ 3.989664] virtiofs virtio7: discovered new tag: shared client # [ 3.990405] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 3.993338] virtiofs virtio6: discovered new tag: nix-store worker2 # [ 3.994114] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 4.002954] virtiofs virtio6: discovered new tag: nix-store worker1 # [ 4.072836] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.002299] virtiofs virtio8: discovered new tag: xchg worker1 # [ 4.074642] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 4.003053] virtiofs virtio8: virtio_fs_setup_dax: No cache capability lb # [ 3.994026] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.987785] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.989029] systemd[1]: Mounted /sysroot/run. lb # [ 4.012317] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 3.995577] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.009756] virtiofs virtio7: discovered new tag: shared worker2 # [ 4.010522] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 4.003841] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 4.006227] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 4.016376] virtiofs virtio8: discovered new tag: xchg worker2 # [ 4.017159] virtiofs virtio8: virtio_fs_setup_dax: No cache capability client # [ 4.008282] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.028858] virtiofs virtio7: discovered new tag: shared lb # [ 4.029594] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 4.036330] virtiofs virtio8: discovered new tag: xchg lb # [ 4.037035] virtiofs virtio8: virtio_fs_setup_dax: No cache capability lb # [ 4.026380] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.022819] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.025626] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 4.035710] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 4.031859] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.030189] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 4.034394] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.039981] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 4.033176] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 4.047203] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 4.057927] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.060936] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.056142] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.057715] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.410972] (udev-worker)[90]: mtd0ro: Failed to find and pin callout binary "/nix/store/gnadg5slifq2r638xvz4pv6vrsdl9xkj-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.418208] (udev-worker)[90]: mtd0ro: /etc/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.349458] (udev-worker)[98]: mtd0ro: Failed to find and pin callout binary "/nix/store/gnadg5slifq2r638xvz4pv6vrsdl9xkj-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.356184] (udev-worker)[98]: mtd0ro: /etc/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.353213] (udev-worker)[94]: mtd0ro: Failed to find and pin callout binary "/nix/store/gnadg5slifq2r638xvz4pv6vrsdl9xkj-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.448356] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.357973] (udev-worker)[94]: mtd0ro: /etc/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.451531] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.452695] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.456269] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.470012] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.471084] systemd[1]: Stopped Virtual Console Setup. client # [ 4.387133] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.475620] systemd[1]: Starting Virtual Console Setup... client # [ 4.392178] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.395590] (udev-worker)[96]: mtd0ro: Failed to find and pin callout binary "/nix/store/gnadg5slifq2r638xvz4pv6vrsdl9xkj-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker2 # [ 4.388355] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.393430] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 4.389627] systemd[1]: Stopped Virtual Console Setup. client # [ 4.394226] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.391235] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 4.394941] systemd[1]: Starting Virtual Console Setup... lb # [ 4.402855] (udev-worker)[96]: mtd0ro: /etc/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory client # [ 4.405030] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.401866] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.406506] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.403551] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.493261] systemd-vconsole-setup[153]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.408731] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.496660] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.406708] systemd[1]: Starting Virtual Console Setup... lb # [ 4.434217] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.430396] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.436961] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.438043] systemd[1]: Stopping Virtual Console Setup... client # [ 4.433684] systemd[1]: Finished Virtual Console Setup. lb # [ 4.440167] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.437773] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 4.439375] systemd[1]: Finished Virtual Console Setup. lb # [ 4.464556] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.467850] systemd[1]: Finished Virtual Console Setup. worker1 # [ 4.876588] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.828558] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.858665] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.942175] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.945283] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.855244] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.949592] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.957517] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.898758] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.903727] systemd[1]: Reached target Initrd File Systems. client # [ 4.908483] systemd[1]: Starting Find NixOS closure... worker1 # [ 5.000643] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.916392] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.921746] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 5.004226] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 4.924989] systemd[1]: Reached target Initrd File Systems. lb # [ 4.929392] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.926479] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 5.019107] systemd[1]: Finished Find NixOS closure. lb # [ 4.937568] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.929507] systemd[1]: Reached target Initrd File Systems. worker1 # [ 5.022863] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.934536] systemd[1]: Starting Find NixOS closure... worker1 # [ 5.028483] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.948866] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.944378] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.951971] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.965418] systemd[1]: Finished Find NixOS closure. client # [ 4.968226] systemd[1]: Reached target Initrd Default Target. client # [ 4.970732] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 5.058853] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.980991] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.064731] systemd[1]: Stopped target Basic System. worker1 # [ 5.065829] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 5.066941] systemd[1]: Stopped target Path Units. worker1 # [ 5.067918] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.987339] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 5.072232] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.074854] systemd[1]: Stopped target Slice Units. worker1 # [ 5.077405] systemd[1]: Stopped target Socket Units. worker1 # [ 5.079228] systemd[1]: Stopped target System Initialization. lb # [ 4.999523] systemd[1]: Finished Find NixOS closure. worker1 # [ 5.082923] systemd[1]: Stopped target Swaps. lb # [ 5.001682] systemd[1]: Reached target Initrd Default Target. worker1 # [ 5.083722] systemd[1]: Stopped target Timer Units. worker2 # [ 4.993052] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 5.085211] systemd[1]: dbus.socket: Deactivated successfully. client # [ 4.999823] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.005279] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.001668] systemd[1]: Stopped target Basic System. worker1 # [ 5.088524] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.004358] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.999663] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 5.005662] systemd[1]: Stopped target Path Units. client # [ 5.008306] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 5.004944] systemd[1]: Finished Find NixOS closure. client # [ 5.010926] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.007514] systemd[1]: Reached target Initrd Default Target. worker1 # [ 5.098078] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.100140] systemd[1]: Stopped Find NixOS closure. client # [ 5.015878] systemd[1]: Stopped target Slice Units. worker2 # [ 5.012327] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 5.103163] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.020247] systemd[1]: Stopped target Socket Units. client # [ 5.021124] systemd[1]: Stopped target System Initialization. client # [ 5.022078] systemd[1]: Stopped target Swaps. client # [ 5.022879] systemd[1]: Stopped target Timer Units. client # [ 5.023703] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.111540] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.114120] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.114881] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.115863] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.037860] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 5.120201] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.035700] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 5.040651] systemd[1]: Stopped target Basic System. worker1 # [ 5.123641] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.038642] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 5.125256] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.039809] systemd[1]: Stopped Find NixOS closure. worker2 # [ 5.035534] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.044467] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.045647] systemd[1]: Stopped target Path Units. worker1 # [ 5.128319] systemd[1]: Stopped Create System Files and Directories. client # [ 5.042905] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.047641] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.043859] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.040357] systemd[1]: Stopped target Basic System. client # [ 5.044962] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.041344] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 5.131507] systemd[1]: Stopped target Local File Systems. client # [ 5.045724] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 5.042372] systemd[1]: Stopped target Path Units. client # [ 5.046725] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 5.132691] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.047435] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.133618] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 5.043302] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.134610] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.052907] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.135383] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.136630] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.137642] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.056676] systemd[1]: Stopped target Slice Units. worker1 # [ 5.138403] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 5.048212] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 5.139319] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.140282] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 5.050319] systemd[1]: Stopped target Slice Units. worker1 # [ 5.141273] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.142089] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.061108] systemd[1]: Stopped target Socket Units. client # [ 5.056253] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.142989] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 5.053499] systemd[1]: Stopped target Socket Units. lb # [ 5.062813] systemd[1]: Stopped target System Initialization. worker1 # [ 5.143970] systemd[1]: systemd-udevd.service: Consumed 1.399s CPU time over 3.109s wall clock time, 22.2M memory peak. client # [ 5.059027] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 5.056229] systemd[1]: Stopped target System Initialization. client # [ 5.061905] systemd[1]: Stopped Create System Files and Directories. lb # [ 5.067655] systemd[1]: Stopped target Swaps. client # [ 5.064445] systemd[1]: Stopped target Local File Systems. client # [ 5.065264] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 5.061376] systemd[1]: Stopped target Swaps. worker1 # [ 5.152327] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.153362] systemd[1]: Closed udev Control Socket. worker2 # [ 5.063108] systemd[1]: Stopped target Timer Units. lb # [ 5.072245] systemd[1]: Stopped target Timer Units. worker1 # [ 5.154341] systemd[1]: Starting Cleanup udev Database... client # [ 5.068173] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.073056] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.069194] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.073930] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 5.065422] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.156183] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.075030] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.070799] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.073702] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.160146] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.074836] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.161234] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 5.075582] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.076635] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.077520] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 5.073845] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.164172] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.078641] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.165158] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.079626] systemd[1]: systemd-udevd.service: Consumed 1.383s CPU time over 3.092s wall clock time, 22.3M memory peak. lb # [ 5.086758] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.168326] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.078642] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.088893] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.085184] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 5.082129] systemd[1]: Stopped Find NixOS closure. lb # [ 5.092327] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.088183] systemd[1]: Closed udev Control Socket. client # [ 5.089193] systemd[1]: Starting Cleanup udev Database... worker2 # [ 5.086443] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 5.095359] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.092156] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.097347] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.093274] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 5.090126] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 5.100313] systemd[1]: Stopped Load Kernel Modules. client # [ 5.096178] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 5.092751] systemd[1]: Stopped Apply Kernel Variables. lb # [ 5.101161] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.097292] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 5.094514] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 5.103555] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.100132] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.101093] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.098974] systemd[1]: Stopped Load Kernel Modules. lb # [ 5.108297] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 5.099797] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.104270] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.109508] systemd[1]: Stopped Create System Files and Directories. client # [ 5.105260] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 5.101119] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 5.111048] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.192451] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.111987] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.194542] systemd[1]: Finished Cleanup udev Database. lb # [ 5.113159] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 5.104487] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 5.114175] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 5.105581] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.196485] systemd[1]: Reached target Switch Root. lb # [ 5.114976] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.108147] systemd[1]: Stopped target Local File Systems. worker2 # [ 5.110298] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.200546] systemd[1]: Starting NixOS Activation... lb # [ 5.119929] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.111389] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 5.112569] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 5.113332] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.114333] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.115322] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.124237] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.125284] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.128209] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 5.120559] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.129248] systemd[1]: systemd-udevd.service: Consumed 1.400s CPU time over 3.085s wall clock time, 22.3M memory peak. lb # [ 5.132148] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.127526] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 5.124352] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.129585] systemd[1]: Finished Cleanup udev Database. worker2 # [ 5.125569] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.136229] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 5.128236] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.137176] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.132753] systemd[1]: Reached target Switch Root. worker2 # [ 5.129200] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.138155] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.134214] systemd[1]: Starting NixOS Activation... lb # [ 5.138978] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 5.132115] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 5.133106] systemd[1]: systemd-udevd.service: Consumed 1.386s CPU time over 3.125s wall clock time, 22.4M memory peak. lb # [ 5.144423] systemd[1]: Closed udev Control Socket. lb # [ 5.145162] systemd[1]: Starting Cleanup udev Database... worker2 # [ 5.136227] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 5.145934] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.146999] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 5.140257] systemd[1]: Closed udev Control Socket. worker2 # [ 5.141001] systemd[1]: Starting Cleanup udev Database... worker2 # [ 5.141754] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.152112] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 5.144228] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.153257] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 5.145130] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.154231] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 5.155188] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.148319] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 5.149320] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 5.152181] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.171356] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.174574] systemd[1]: Finished Cleanup udev Database. lb # [ 5.175337] systemd[1]: Reached target Switch Root. worker2 # [ 5.170686] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.180146] systemd[1]: Starting NixOS Activation... worker2 # [ 5.176147] systemd[1]: Finished Cleanup udev Database. worker2 # [ 5.176945] systemd[1]: Reached target Switch Root. worker2 # [ 5.177629] systemd[1]: Starting NixOS Activation... worker1 # [ 5.278985] initrd-nixos-activation-start[176]: booting system configuration /nix/store/8ywmcs4wqfsykii45m0wrnjpayzliy1j-nixos-system-worker1-test client # [ 5.212367] initrd-nixos-activation-start[180]: booting system configuration /nix/store/ra6r7v42kn1phhf50aiw8qw3p1s4g3i7-nixos-system-client-test worker1 # [ 5.311953] initrd-nixos-activation-start[176]: running activation script... client # [ 5.243074] initrd-nixos-activation-start[180]: running activation script... lb # [ 5.259046] initrd-nixos-activation-start[178]: booting system configuration /nix/store/5hmvppg1fs8xkiccvl0m50n4dxjz92fr-nixos-system-lb-test worker2 # [ 5.253245] initrd-nixos-activation-start[179]: booting system configuration /nix/store/bxvmlpjg1y5fh7n09mwrfkkffnsyixlj-nixos-system-worker2-test lb # [ 5.291113] initrd-nixos-activation-start[178]: running activation script... worker2 # [ 5.284437] initrd-nixos-activation-start[179]: running activation script... client # [ 5.459511] initrd-nixos-activation-start[203]: setting up /etc... worker1 # [ 5.550190] initrd-nixos-activation-start[199]: setting up /etc... lb # [ 5.531129] initrd-nixos-activation-start[201]: setting up /etc... worker2 # [ 5.528476] initrd-nixos-activation-start[202]: setting up /etc... client # [ 5.573733] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 5.576188] systemd[1]: Finished NixOS Activation. client # [ 5.577625] systemd[1]: Starting Switch Root... worker1 # [ 5.667580] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 5.670530] systemd[1]: Finished NixOS Activation. worker1 # [ 5.671692] systemd[1]: Starting Switch Root... client # [ 5.598862] systemd[1]: Switching root. worker1 # [ 5.695349] systemd[1]: Switching root. lb # [ 5.648234] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.650984] systemd[1]: Finished NixOS Activation. worker2 # [ 5.645037] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.656156] systemd[1]: Starting Switch Root... worker2 # [ 5.647675] systemd[1]: Finished NixOS Activation. worker2 # [ 5.652255] systemd[1]: Starting Switch Root... lb # [ 5.675035] systemd[1]: Switching root. worker2 # [ 5.671108] systemd[1]: Switching root. client # [ 5.789813] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). worker1 # [ 5.880343] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). lb # [ 5.861239] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.853555] systemd-journald[72]: Received SIGTERM from PID 1 (systemd). lb # [ 6.384923] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.397923] systemd[1]: Detected virtualization qemu. worker2 # [ 6.381751] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.471493] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.393890] systemd[1]: Detected virtualization qemu. lb # [ 6.401137] systemd[1]: Detected architecture arm64. worker2 # [ 6.395952] systemd[1]: Detected architecture arm64. worker1 # [ 6.484266] systemd[1]: Detected virtualization qemu. lb # [ 6.405109] systemd[1]: Detected first boot. worker2 # [ 6.398169] systemd[1]: Detected first boot. client # [ 6.392895] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.487328] systemd[1]: Detected architecture arm64. client # [ 6.405615] systemd[1]: Detected virtualization qemu. worker1 # [ 6.491345] systemd[1]: Detected first boot. lb # [ 6.410926] systemd[1]: Initializing machine ID from random generator. worker2 # [ 6.403749] systemd[1]: Initializing machine ID from random generator. client # [ 6.408778] systemd[1]: Detected architecture arm64. worker1 # [ 6.497103] systemd[1]: Initializing machine ID from random generator. client # [ 6.412735] systemd[1]: Detected first boot. client # [ 6.418384] systemd[1]: Initializing machine ID from random generator. lb # [ 6.731431] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.728869] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 6.819318] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 6.740146] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.918277] systemd[1]: Applying preset policy. lb # [ 6.927377] systemd[1]: Applying preset policy. client # [ 6.940408] systemd[1]: Applying preset policy. worker1 # [ 7.029141] systemd[1]: Applying preset policy. client # [ 7.162724] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.162097] systemd[1]: Populated /etc with preset unit settings. lb # [ 7.174519] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.260450] systemd[1]: Populated /etc with preset unit settings. client # [ 7.378368] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 7.379639] systemd[1]: Stopped initrd-switch-root.service. client # [ 7.384026] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 7.387129] systemd[1]: Created slice Slice /system/getty. client # [ 7.389287] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.386443] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 7.390576] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.387761] systemd[1]: Stopped initrd-switch-root.service. client # [ 7.392567] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 7.395220] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 7.481717] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 7.396344] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.392472] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 7.398718] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 7.483082] systemd[1]: Stopped initrd-switch-root.service. client # [ 7.399829] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 7.396180] systemd[1]: Created slice Slice /system/getty. client # [ 7.401401] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.398165] systemd[1]: Created slice User and Session Slice. worker1 # [ 7.487431] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 7.402977] systemd[1]: Stopped target initrd-switch-root.target. client # [ 7.405581] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.400379] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 7.409651] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 7.491344] systemd[1]: Created slice Slice /system/getty. client # [ 7.406770] systemd[1]: Reached target Path Units. worker2 # [ 7.402648] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 7.411379] systemd[1]: Stopped initrd-switch-root.service. client # [ 7.408283] systemd[1]: Reached target Remote File Systems. worker1 # [ 7.493362] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.404913] systemd[1]: Expecting device /dev/hvc0... client # [ 7.410656] systemd[1]: Reached target Slice Units. worker1 # [ 7.495688] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.406699] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 7.411636] systemd[1]: Reached target Swaps. worker2 # [ 7.408677] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 7.415911] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 7.497139] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 7.414645] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.409802] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 7.499882] systemd[1]: Expecting device /dev/hvc0... lb # [ 7.419742] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.412064] systemd[1]: Stopped target initrd-root-fs.target. client # [ 7.417606] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 7.500887] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.413147] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 7.503321] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 7.421645] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.415511] systemd[1]: Reached target Virtual Machines and Containers. client # [ 7.419830] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 7.504428] systemd[1]: Stopped target initrd-fs.target. lb # [ 7.424002] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 7.505956] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.416818] systemd[1]: Reached target Path Units. client # [ 7.422201] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.418987] systemd[1]: Reached target Remote File Systems. lb # [ 7.425437] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 7.423411] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 7.507633] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 7.428173] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 7.420112] systemd[1]: Reached target Slice Units. worker1 # [ 7.510075] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 7.422319] systemd[1]: Reached target Swaps. lb # [ 7.430042] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 7.427578] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 7.511344] systemd[1]: Reached target Path Units. worker1 # [ 7.513624] systemd[1]: Reached target Remote File Systems. lb # [ 7.432075] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.424815] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 7.429863] systemd[1]: Listening on Journal Audit Socket. lb # [ 7.434086] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 7.514671] systemd[1]: Reached target Slice Units. worker2 # [ 7.427782] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 7.516979] systemd[1]: Reached target Swaps. client # [ 7.432854] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 7.436098] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 7.430021] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 7.434424] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 7.519385] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 7.438053] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.432432] systemd[1]: Listening on Factory Reset Management. client # [ 7.436092] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.440202] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 7.522508] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.433670] systemd[1]: Listening on Hostname Service Socket. lb # [ 7.442288] systemd[1]: Reached target Path Units. client # [ 7.438505] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.524768] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 7.444243] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.437849] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 7.527130] systemd[1]: Listening on Factory Reset Management. lb # [ 7.446159] systemd[1]: Reached target Slice Units. worker1 # [ 7.528332] systemd[1]: Listening on Hostname Service Socket. lb # [ 7.448097] systemd[1]: Reached target Swaps. worker2 # [ 7.440021] systemd[1]: Listening on Journal Audit Socket. client # [ 7.445592] systemd[1]: Listening on Disk Repartitioning Service Socket. client # [ 7.446975] systemd[1]: Listening on udev Control Socket. lb # [ 7.451441] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.443737] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 7.532715] systemd[1]: Starting Journal Log Access Socket... client # [ 7.448731] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.445850] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 7.454463] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 7.535061] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.447746] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.456743] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 7.453372] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.450092] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.539136] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 7.459106] systemd[1]: Listening on Factory Reset Management. lb # [ 7.460322] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 7.541469] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 7.542931] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.454786] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 7.464462] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 7.456204] systemd[1]: Listening on udev Control Socket. client # [ 7.460898] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.544818] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.457791] systemd[1]: Listening on udev Varlink Socket. lb # [ 7.466567] systemd[1]: Listening on Journal Audit Socket. client # [ 7.464372] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 7.550496] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.462211] systemd[1]: Mounting Huge Pages File System... lb # [ 7.470321] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 7.551856] systemd[1]: Listening on udev Control Socket. lb # [ 7.471931] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 7.553466] systemd[1]: Listening on udev Varlink Socket. lb # [ 7.475156] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.468038] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.557942] systemd[1]: Mounting Huge Pages File System... lb # [ 7.476827] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.561554] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 7.482574] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 7.484011] systemd[1]: Listening on udev Control Socket. lb # [ 7.485610] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.479102] systemd[1]: Mounting Kernel Debug File System... client # [ 7.483549] systemd[1]: Mounting Kernel Trace File System... lb # [ 7.489176] systemd[1]: Mounting Huge Pages File System... worker1 # [ 7.570861] systemd[1]: Mounting Kernel Debug File System... client # [ 7.490036] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 7.496471] systemd[1]: Mounting POSIX Message Queue File System... client # [ 7.491285] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 7.491055] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 7.584403] systemd[1]: Mounting Kernel Trace File System... lb # [ 7.507057] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 7.504187] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 7.504558] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 7.517614] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 7.600645] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 7.602002] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 7.516168] systemd[1]: Mounting Kernel Configuration File System... client # [ 7.522235] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.516552] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 7.522635] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.516817] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 7.529919] systemd[1]: Starting Create List of Static Device Nodes... client # [ 7.522909] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.517079] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.523175] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.531382] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 7.619029] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.532234] systemd[1]: Mounting FUSE Control File System... worker1 # [ 7.619416] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.532618] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.619677] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.619937] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 7.544808] systemd[1]: Mounting Kernel Configuration File System... lb # [ 7.547028] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 7.550512] systemd[1]: Mounting FUSE Control File System... worker1 # [ 7.636927] systemd[1]: Mounting FUSE Control File System... lb # [ 7.556213] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.637300] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 7.559006] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 7.554329] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.561525] systemd[1]: Starting Journal Service... lb # [ 7.582760] systemd[1]: Mounting FUSE Control File System... lb # [ 7.586285] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.583058] systemd[1]: Starting Journal Service... worker1 # [ 7.674978] systemd[1]: Starting Journal Service... client # [ 7.595781] systemd[1]: Starting Load Kernel Modules... worker2 # [ 7.595642] systemd[1]: Starting Load Kernel Modules... worker1 # [ 7.691716] systemd[1]: Starting Load Kernel Modules... lb # [ 7.612686] systemd[1]: Starting Journal Service... client # [ 7.610573] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.608376] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 7.616427] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 7.617961] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.708775] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 7.624320] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 7.627877] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.713952] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 7.633374] systemd[1]: Starting Load Kernel Modules... worker1 # [ 7.715720] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.629905] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 7.722953] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 7.634284] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 7.726340] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 7.638587] systemd[1]: Mounted Huge Pages File System. worker2 # [ 7.640917] systemd[1]: Mounted POSIX Message Queue File System. client # [ 7.645277] systemd[1]: Starting Coldplug All udev Devices... lb # [ 7.650905] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... client # [ 7.647954] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 7.731132] systemd[1]: Mounted Huge Pages File System. worker2 # [ 7.644996] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 7.731615] systemd[1]: Mounted POSIX Message Queue File System. client # [ 7.650438] systemd[1]: Mounted Huge Pages File System. worker1 # [ 7.731999] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 7.732381] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.732769] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 7.733138] systemd[1]: Mounted FUSE Control File System. worker2 # [ 7.647840] systemd[1]: Mounted Kernel Trace File System. client # [ 7.654228] systemd[1]: Mounted POSIX Message Queue File System. client # [ 7.655697] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 7.650749] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 7.651197] systemd[1]: Mounted FUSE Control File System. lb # [ 7.663562] systemd[1]: Starting Remount Root and Kernel File Systems... lb # [ 7.663947] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.666078] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.758928] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 7.668392] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 7.674020] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 7.679890] systemd[1]: Starting Coldplug All udev Devices... lb # [ 7.682513] systemd[1]: Listening on Journal Log Access Socket. lb # [ 7.682920] systemd[1]: Mounted Huge Pages File System. worker1 # [ 7.765465] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 7.684902] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 7.689313] systemd[1]: Mounted POSIX Message Queue File System. client # [ 7.687444] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.692690] systemd[1]: Mounted Kernel Debug File System. lb # [ 7.696940] systemd[1]: Mounted Kernel Trace File System. client # [ 7.699555] systemd-journald[273]: Collecting audit messages is enabled. lb # [ 7.716596] systemd-journald[271]: Collecting audit messages is enabled. client # [ 7.712772] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 7.713676] systemd[1]: Finished Load Kernel Modules. client # [ 7.718713] systemd[1]: Starting Apply Kernel Variables... lb # [ 7.724334] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 7.728464] systemd[1]: Mounted Kernel Configuration File System. lb # [ 7.743233] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 7.724363] systemd[1]: Queued start job for default target Multi-User System. client # [ 7.725667] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 7.726884] systemd-modules-load[274]: Module 'atkbd' is built in client # [ 7.727909] systemd-modules-load[274]: Module 'loop' is built in lb # [ 7.732517] systemd[1]: Queued start job for default target Multi-User System. lb # [ 7.749157] systemd[1]: Finished Load Kernel Modules. client # [ 7.745192] systemd[1]: Started Journal Service. lb # [ 7.735195] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 7.744272] systemd[1]: Finished Load Kernel Modules. lb # [ 7.755913] systemd[1]: Started Journal Service. client # [ 7.738977] systemd[1]: Mounted FUSE Control File System. lb # [ 7.743646] systemd-modules-load[272]: Module 'atkbd' is built in worker1 # [ 7.840020] systemd-journald[269]: Collecting audit messages is enabled. worker2 # [ 7.753603] systemd[1]: Starting Firewall... lb # [ 7.748849] systemd-modules-load[272]: Module 'loop' is built in worker2 # [ 7.758506] systemd-journald[272]: Collecting audit messages is enabled. worker1 # [ 7.850932] systemd[1]: Finished Load Kernel Modules. client # [ 7.768204] EXT4-fs (vda): re-mounted 39e36b9e-d9a6-41e9-be3e-c0c8076db105. worker2 # [ 7.766161] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 7.854822] EXT4-fs (vda): re-mounted 63ca42a6-0a78-4a40-aed9-62f78a282947. worker2 # [ 7.772748] EXT4-fs (vda): re-mounted 9e950184-7788-4e15-b451-aa57d7ad5f00. worker1 # [ 7.861515] systemd[1]: Starting Firewall... lb # [ 7.768152] systemd[1]: Starting Firewall... worker1 # [ 7.871358] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 7.781586] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 7.782177] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 7.774347] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 7.782478] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.878210] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 7.783876] systemd[1]: Starting Apply Kernel Variables... client # [ 7.782771] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.880798] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.881235] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 7.789452] systemd[1]: Mounted FUSE Control File System. worker2 # [ 7.796564] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 7.798829] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.788454] systemd-oomd[275]: No swap; memory pressure usage will be degraded worker1 # [ 7.898804] systemd[1]: Starting Load/Save OS Random Seed... client # [ 7.802158] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 7.901257] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.803174] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.906281] systemd[1]: Started Journal Service. worker2 # [ 7.821145] systemd[1]: Started Journal Service. worker2 # [ 7.807414] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 7.810488] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 7.816283] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 7.902032] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 7.903206] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 7.817139] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 7.818327] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 7.821535] systemd-modules-load[273]: Module 'atkbd' is built in lb # [ 7.833712] systemd-oomd[273]: No swap; memory pressure usage will be degraded worker1 # [ 7.918046] systemd-modules-load[270]: Module 'atkbd' is built in lb # [ 7.841814] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 7.925391] systemd-modules-load[270]: Module 'loop' is built in worker2 # [ 7.837380] systemd-modules-load[273]: Module 'loop' is built in lb # [ 7.864381] EXT4-fs (vda): re-mounted 0369716f-fabe-48ec-a9df-ad7d213a7498. worker2 # [ 7.845964] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 7.937721] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 7.866166] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 7.867159] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 7.875959] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 7.876999] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.893166] systemd-journald[273]: Received client request to flush runtime journal. lb # [ 7.891589] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 7.894070] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.999748] systemd-oomd[271]: No swap; memory pressure usage will be degraded worker2 # [ 7.922199] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 7.929246] systemd[1]: Reached target First Boot Complete. client # [ 7.933665] systemd[1]: Finished Load/Save OS Random Seed. client # [ 7.934604] systemd[1]: Reached target First Boot Complete. client # [ 7.935406] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 8.038270] systemd-journald[269]: Received client request to flush runtime journal. client # [ 7.941647] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 7.964427] systemd-journald[271]: Received client request to flush runtime journal. worker2 # [ 7.941444] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 7.963862] systemd-journald[272]: Received client request to flush runtime journal. worker2 # [ 7.997193] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 8.088327] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 7.998607] systemd-oomd[274]: No swap; memory pressure usage will be degraded worker1 # [ 8.089537] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 8.093785] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 8.095098] systemd[1]: Reached target First Boot Complete. worker2 # [ 8.005170] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 8.006010] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 8.095915] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 8.006926] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 8.017506] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 8.018519] systemd[1]: Reached target First Boot Complete. worker1 # [ 8.104823] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.019320] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 8.105642] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 8.024950] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 8.025916] systemd[1]: Finished Apply Kernel Variables. lb # [ 8.029205] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 8.074235] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 8.076379] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 8.143395] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 8.144516] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 8.147349] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.287493] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 8.290172] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 8.300539] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 8.257021] systemd-udevd[311]: Using default interface naming scheme 'v261'. lb # [ 8.297029] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 8.298633] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 8.307264] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.397759] systemd-udevd[307]: Using default interface naming scheme 'v261'. worker2 # [ 8.356615] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 8.375715] systemd[1]: Mounting /run/wrappers... worker1 # [ 8.470693] systemd[1]: Mounting /run/wrappers... lb # [ 8.405155] systemd[1]: Mounting /run/wrappers... worker1 # [ 8.529758] systemd[1]: Mounted /run/wrappers. worker1 # [ 8.530581] systemd[1]: Reached target Local File Systems. lb # [ 8.456630] systemd[1]: Mounted /run/wrappers. lb # [ 8.457417] systemd[1]: Reached target Local File Systems. worker1 # [ 8.540221] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 8.464106] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 8.545213] systemd[1]: Starting register-nix-paths.service... lb # [ 8.467633] systemd[1]: Starting register-nix-paths.service... lb # [ 8.474419] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 8.475316] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.560329] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 8.561219] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 8.562466] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 8.484190] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 8.486944] systemd[1]: Finished Coldplug All udev Devices. lb # [ 8.496976] systemd[1]: Starting Create System Files and Directories... client # [ 8.492656] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 8.498311] systemd-udevd[307]: Using default interface naming scheme 'v261'. client # [ 8.495021] systemd[1]: Reached target Preparation for Local File Systems. client # [ 8.498585] systemd[1]: Mounting /run/wrappers... client # [ 8.501621] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.589540] systemd[1]: Starting Create System Files and Directories... worker1 # [ 8.590544] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 8.501439] systemd[1]: Mounted /run/wrappers. worker2 # [ 8.504199] systemd[1]: Reached target Local File Systems. worker2 # [ 8.512389] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 8.524172] systemd[1]: Starting register-nix-paths.service... worker2 # [ 8.535312] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 8.539381] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 8.546097] systemd[1]: Mounted /run/wrappers. client # [ 8.546842] systemd[1]: Reached target Local File Systems. worker2 # [ 8.544546] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 8.550648] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 8.554085] systemd[1]: Starting register-nix-paths.service... worker2 # [ 8.549976] systemd[1]: Starting Create System Files and Directories... client # [ 8.561581] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 8.562746] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 8.579792] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 8.587599] systemd[1]: Starting Create System Files and Directories... client # [ 8.592739] systemd-udevd[304]: Using default interface naming scheme 'v261'. worker1 # [ 8.686462] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 8.697091] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 8.615962] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 8.628662] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 8.622332] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 8.629477] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 8.665972] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 8.674548] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 8.785368] systemd[1]: Finished Create System Files and Directories. worker1 # [ 8.793043] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 8.713954] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 8.802641] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.724127] systemd[1]: Finished Create System Files and Directories. lb # [ 8.739583] systemd[1]: Finished Create System Files and Directories. client # [ 8.736394] systemd[1]: Starting Rebuild Journal Catalog... client # [ 8.742312] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 8.748717] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 8.743315] systemd[1]: Finished Create System Files and Directories. worker2 # [ 8.749589] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 8.760179] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.757162] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 8.765821] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 8.900985] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 8.848129] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 8.863044] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 8.878743] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 8.964817] systemd[1]: Finished Rebuild Journal Catalog. client # [ 8.880552] systemd[1]: Starting Update is Completed... worker1 # [ 8.968621] systemd[1]: Starting Update is Completed... lb # [ 8.916769] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 8.924784] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 8.928451] systemd[1]: Starting Update is Completed... client # [ 8.952875] systemd[1]: Finished Update is Completed. lb # [ 8.957753] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 8.974272] systemd[1]: Starting Update is Completed... worker1 # [ 9.065531] systemd[1]: Finished Update is Completed. worker2 # [ 9.026233] systemd[1]: Finished Update is Completed. lb # [ 9.081336] systemd[1]: Finished Update is Completed. client # [ 9.153732] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 9.193146] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 9.325160] systemd[1]: Finished Coldplug All udev Devices. client # [ 9.365078] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 9.462285] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 9.373669] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 9.464410] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 9.376598] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 9.392298] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 9.395492] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 9.423561] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 9.424926] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 9.486835] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 9.626917] (udev-worker)[363]: Network interface NamePolicy= disabled on kernel command line. client # [ 9.631144] (udev-worker)[351]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 9.631092] systemd[1]: Finished Firewall. client # [ 9.636946] (udev-worker)[351]: Network interface NamePolicy= disabled on kernel command line. lb # [ 9.675332] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 9.705780] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 9.795176] systemd[1]: Finished Firewall. worker2 # [ 9.721743] systemd[1]: Finished Coldplug All udev Devices. lb # [ 9.752920] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 9.757316] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 9.841925] systemd[1]: Finished Coldplug All udev Devices. lb # [ 9.806803] systemd[1]: Finished register-nix-paths.service. lb # [ 9.807754] systemd[1]: Reached target System Initialization. lb # [ 9.813056] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 9.814080] systemd[1]: Started niks3 garbage collection timer. lb # [ 9.814912] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 9.815831] systemd[1]: Reached target Timer Units. worker2 # [ 9.806705] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 9.822060] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 9.826522] systemd[1]: Listening on niks3 server socket. worker1 # [ 9.907502] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 9.827426] systemd[1]: Listening on Nix Daemon Socket. lb # [ 9.831657] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 9.836291] systemd[1]: Reached target Socket Units. worker2 # [ 9.826915] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 9.837113] systemd[1]: Reached target Basic System. lb # [ 9.837825] systemd[1]: Started backdoor.service. lb # [ 9.843816] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 9.848917] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 9.933234] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse lb # [ 9.862831] systemd[1]: Starting Post-Boot Actions... client # [ 9.880496] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 9.881732] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 9.893030] systemd[1]: Started Reset console on configuration changes. client # [ 9.889523] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.890442] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.891689] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 9.898967] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 9.904265] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 9.910089] systemd[1]: Starting resolvconf update... client # [ 9.905555] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 9.919221] systemd[1]: Finished register-nix-paths.service. client # [ 9.938240] mousedev: PS/2 mouse device common for all mice lb # [ 9.942785] systemd[1]: Started rustfs.service. lb # [ 9.962994] systemd[1]: Starting rustfs-bucket.service... lb # connecting to host... worker2 # [ 10.005476] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 10.108556] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 10.031360] systemd[1]: Starting D-Bus System Message Bus... lb # [ 10.054210] systemd[1]: Finished Post-Boot Actions. lb # [ 10.060734] nsncd[448]: Sep 23 15:59:39.675 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.056434] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 10.147478] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 10.078447] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.164105] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.168248] systemd[1]: Reached target System Initialization. worker2 # [ 10.088262] systemd[1]: Finished register-nix-paths.service. worker2 # [ 10.090097] systemd[1]: Reached target System Initialization. worker1 # [ 10.180101] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 10.181198] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 10.182141] systemd[1]: Reached target Timer Units. worker1 # [ 10.182840] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 10.183710] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 10.093734] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 10.107987] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 10.104735] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 10.116907] (udev-worker)[349]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 10.112665] systemd[1]: Reached target Timer Units. worker2 # [ 10.116205] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 10.126324] (udev-worker)[343]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 10.120689] systemd[1]: Listening on Nix Daemon Socket. lb # [ 10.137081] (udev-worker)[343]: Network interface NamePolicy= disabled on kernel command line. lb # [ 10.138226] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 10.130103] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 10.141503] systemd[1]: Reached target Socket Units. worker2 # [ 10.148561] systemd[1]: Reached target Basic System. worker1 # [ 10.239693] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 10.161284] systemd[1]: Starting User Login Management... worker2 # [ 10.153836] systemd[1]: Started backdoor.service. worker1 # [ 10.252241] systemd[1]: Reached target Socket Units. worker2 # [ 10.163891] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 10.264510] systemd[1]: Reached target Basic System. worker2 # [ 10.176347] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.277556] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 10.188806] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.196717] systemd[1]: Started Reset console on configuration changes. worker2 # [ 10.205621] systemd[1]: Starting resolvconf update... worker1 # [ 10.301916] systemd[1]: Started backdoor.service. worker2 # [ 10.214962] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 10.315105] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 10.330554] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 10.263586] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 10.257467] systemd[1]: Finished Post-Boot Actions. worker1 # [ 10.354703] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.278893] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.373163] systemd[1]: Started Reset console on configuration changes. worker2 # [ 10.288104] systemd[1]: Reached target Host and Network Name Lookups. worker2 # connecting to host... worker2 # [ 10.301709] nsncd[490]: Sep 23 15:59:39.903 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 10.303763] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.400791] systemd[1]: Starting resolvconf update... worker2 # [ 10.321663] systemd[1]: Starting User Login Management... worker1 # [ 10.416925] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 10.432659] systemd[1]: Finished Post-Boot Actions. worker2 # [ 10.348749] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 10.449956] nix-grpc-daemon[485]: ts=2026-09-23T15:59:40Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" client # [ 10.372247] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.375517] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.373527] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... client # [ 10.379513] systemd[1]: Reached target System Initialization. client # [ 10.381725] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 10.382729] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 10.383622] systemd[1]: Reached target Timer Units. client # [ 10.390089] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 10.392656] systemd[1]: Listening on Nix Daemon Socket. client # [ 10.395838] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 10.391431] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' client # [ 10.400813] systemd[1]: Reached target Socket Units. lb # [ 10.407480] dbus-broker-launch[462]: Looking up NSS user entry for 'systemd-timesync'... client # [ 10.404146] systemd[1]: Reached target Basic System. client # [ 10.405489] systemd[1]: Started backdoor.service. client # [ 10.406741] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 10.494269] nix-grpc-daemon[485]: ts=2026-09-23T15:59:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc client # [ 10.412819] systemd[1]: Starting nftables firewall... worker2 # [ 10.395084] dbus-broker-launch[494]: Invalid user-name in /nix/store/flsxa7d757b7zpdiv9wsbs42iawcisak-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 10.410887] systemd[1]: Started D-Bus System Message Bus. lb # [ 10.420791] dbus-broker-launch[462]: NSS returned no entry for 'systemd-timesync' lb # [ 10.421864] dbus-broker-launch[462]: Invalid user-name in /nix/store/4yiprls1sll47jid3xzq0m9nmi1qz2ww-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 10.424142] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # connecting to host... worker1 # [ 10.524237] nix-grpc-daemon[485]: ts=2026-09-23T15:59:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 client # [ 10.443628] systemd[1]: Starting Post-Boot Actions... worker2 # [ 10.452718] dbus-broker-launch[494]: Ready client # [ 10.459621] systemd[1]: Started Reset console on configuration changes. client # [ 10.479190] systemd[1]: Starting resolvconf update... lb # [ 10.478299] systemd[1]: Started D-Bus System Message Bus. lb # [ 10.487645] systemd-logind[482]: New seat seat0. worker1 # [ 10.568439] nix-grpc-daemon[485]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 10.569947] nix-grpc-daemon[485]: E0000 00:00:1790179180.113400 485 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 10.496758] systemd[1]: Started User Login Management. worker2 # [ 10.488473] (udev-worker)[339]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 10.508420] systemd[1]: Starting linger-users.service... worker2 # [ 10.500815] systemd-logind[513]: New seat seat0. worker2 # [ 10.501581] systemd[1]: Started User Login Management. worker2 # [ 10.502297] (udev-worker)[339]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 10.503398] systemd[1]: Starting linger-users.service... worker2 # [ 10.516758] (udev-worker)[338]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 10.607445] nix-grpc-daemon[485]: E0000 00:00:1790179180.129052 485 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 10.528554] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 10.529507] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 10.530316] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 10.531182] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 10.620681] nix-grpc-daemon[485]: ts=2026-09-23T15:59:40Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 10.622902] nsncd[488]: Sep 23 15:59:40.125 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 10.543211] dbus-broker-launch[462]: Ready worker2 # [ 10.555028] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 10.646395] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.647338] nix-grpc-daemon[485]: ts=2026-09-23T15:59:40Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Could not connect to server" worker2 # [ 10.560405] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 10.563921] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 10.571022] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 10.568519] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.665398] nix-grpc-daemon[485]: E0000 00:00:1790179180.151169 540 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 10.587403] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 10.583450] nsncd[456]: Sep 23 15:59:40.211 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 10.591695] systemd[1]: Stopping Host and Network Name Lookups... client # connecting to host... lb # [ 10.596944] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 10.677094] nix-grpc-daemon[485]: E0000 00:00:1790179180.178775 540 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 10.597887] systemd[1]: Stopping User and Group Name Lookups... lb # [ 10.598678] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 10.596076] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.594642] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 10.598292] systemd[1]: Finished linger-users.service. lb # [ 10.606958] systemd[1]: nscd.service: Deactivated successfully. client # [ 10.602595] systemd[1]: Finished Post-Boot Actions. worker1 # [ 10.689510] nix-grpc-daemon[485]: E0000 00:00:1790179180.180522 540 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. lb # [ 10.611204] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 10.691856] nix-grpc-daemon[485]: E0000 00:00:1790179180.209736 540 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb # [ 10.636476] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 10.636234] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.720143] nix-grpc-daemon[485]: ts=2026-09-23T15:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" lb # [ 10.641164] systemd[1]: linger-users.service: Deactivated successfully. client # [ 10.637184] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 10.633669] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 10.634614] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 10.635481] systemd[1]: Reached target User and Group Name Lookups. lb # [ 10.647156] systemd[1]: Finished linger-users.service. worker1 # [ 10.733388] systemd[1]: Reached target Host and Network Name Lookups. client: Guest shell says: b'Spawning backdoor root shell...\n' worker2 # [ 10.643582] nsncd[564]: Sep 23 15:59:40.260 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 10.734683] dbus-broker-launch[492]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 10.735750] dbus-broker-launch[492]: NSS returned no entry for 'systemd-timesync' client # [ 10.675044] systemd[1]: Starting User Login Management... worker2 # [ 10.670947] systemd[1]: Finished resolvconf update. worker1 # [ 10.749815] dbus-broker-launch[492]: Invalid user-name in /nix/store/flsxa7d757b7zpdiv9wsbs42iawcisak-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client: connected to guest root shell worker2 # [ 10.675235] systemd[1]: Reached target Preparation for Network. client # [ 10.679632] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 10.760140] systemd[1]: Reached target User and Group Name Lookups. client: (connecting took 11.11 seconds) worker1 # [ 10.760997] systemd[1]: Starting User Login Management... client: (finished: waiting for the VM to finish booting, in 11.11 seconds) worker1 # [ 10.761729] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 10.680362] systemd[1]: Starting DHCP Client... worker1 # [ 10.762499] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 10.685037] systemd[1]: Starting Extra networking commands.... worker1 # [ 10.763365] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 10.778647] dbus-broker-launch[492]: Ready worker1 # [ 10.794663] nix-grpc-daemon[485]: ts=2026-09-23T15:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker1 # [ 10.809709] systemd-logind[546]: New seat seat0. worker1 # [ 10.810506] systemd[1]: Started User Login Management. worker1 # [ 10.811227] systemd[1]: Starting linger-users.service... lb # [ 10.734606] systemd-logind[482]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 10.825770] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 10.826811] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 10.827631] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 10.754460] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.843329] systemd[1]: Stopping User and Group Name Lookups... lb # [ 10.761569] nsncd[560]: Sep 23 15:59:40.369 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 10.768344] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.849793] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 10.850721] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 10.851504] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 10.771693] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.860143] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.874714] (udev-worker)[436]: Network interface NamePolicy= disabled on kernel command line. lb # [ 10.800475] systemd[1]: Finished resolvconf update. lb # [ 10.813103] systemd[1]: Starting DHCP Client... worker1 # [ 10.895007] (udev-worker)[336]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 10.905306] (udev-worker)[336]: Network interface NamePolicy= disabled on kernel command line. client # [ 10.821755] dbus-broker-launch[466]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 10.914218] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 10.915152] systemd[1]: Finished linger-users.service. worker1 # [ 10.938905] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.939856] systemd[1]: Reached target Host and Network Name Lookups. client # [ 10.854079] dbus-broker-launch[466]: NSS returned no entry for 'systemd-timesync' client # [ 10.855173] dbus-broker-launch[466]: Invalid user-name in /nix/store/6wvgzhp3xj1v1xybf1ixpbqi5gif5fbv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 10.945849] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.947096] nsncd[609]: Sep 23 15:59:40.561 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 10.970083] systemd[1]: Finished resolvconf update. worker1 # [ 10.970857] systemd[1]: Reached target Preparation for Network. worker1 # [ 10.971681] systemd[1]: Starting DHCP Client... worker2 # [ 10.890494] dhcpcd[599]: dhcpcd-10.3.2 starting worker1 # [ 10.985843] systemd[1]: Starting Extra networking commands.... worker2 # [ 10.901187] dhcpcd[637]: dev: loaded udev lb # [ 10.913068] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 10.910108] systemd-logind[486]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 10.911667] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 10.924500] systemd-logind[486]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 10.925681] systemd-logind[486]: New seat seat0. worker2 # [ 10.921964] systemd[1]: Starting Address configuration of eth1... client # [ 10.926607] systemd[1]: Started User Login Management. client # [ 10.937625] systemd[1]: Starting linger-users.service... worker2 # [ 10.956288] 8021q: 802.1Q VLAN Support v1.8 client # [ 10.959056] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 10.975651] systemd-logind[513]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 10.981753] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 10.982754] systemd[1]: Stopping Host and Network Name Lookups... client # [ 10.983570] systemd[1]: Stopped target User and Group Name Lookups. client # [ 10.994471] systemd[1]: Stopping User and Group Name Lookups... client # [ 10.995352] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.003763] systemd[1]: nscd.service: Deactivated successfully. client # [ 11.010161] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 11.011342] dbus-broker-launch[466]: Ready worker2 # [ 11.017897] systemd[1]: Finished Extra networking commands.. worker2 # [ 11.018765] systemd[1]: Reached target Network. client # [ 11.036934] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.036667] systemd[1]: Starting Permit User Sessions... worker2 # [ 11.058000] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 11.065897] systemd[1]: linger-users.service: Deactivated successfully. client # [ 11.070417] systemd[1]: Finished linger-users.service. worker2 # [ 11.091384] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 11.092690] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 11.095172] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 11.095503] cfg80211: failed to load regulatory.db lb # [ 11.099572] dhcpcd[612]: dhcpcd-10.3.2 starting lb # [ 11.109453] dhcpcd[627]: dev: loaded udev worker2 # [ 11.122363] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 11.195140] nix-grpc-daemon[485]: ts=2026-09-23T15:59:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker2 # [ 11.113337] systemd[1]: Finished Permit User Sessions. client # [ 11.119583] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.207029] dhcpcd[645]: dhcpcd-10.3.2 starting worker2 # [ 11.120391] systemd[1]: Started Getty on tty1. client # [ 11.124347] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.121146] systemd[1]: Reached target Login Prompts. worker1 # [ 11.212399] dhcpcd[688]: dev: loaded udev client # [ 11.125717] nsncd[546]: Sep 23 15:59:40.750 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.127621] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.141156] network-addresses-eth1-start[643]: adding address 192.168.1.4/24... done lb # [ 11.177983] mousedev: PS/2 mouse device common for all mice client # [ 11.160226] systemd[1]: Finished resolvconf update. worker1 # [ 11.261827] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 11.157398] network-addresses-eth1-start[643]: adding address 2001:db8:1::4/64... done lb # [ 11.182039] 8021q: 802.1Q VLAN Support v1.8 client # [ 11.168995] systemd[1]: Starting DHCP Client... worker2 # [ 11.176497] systemd[1]: Finished Address configuration of eth1. worker2 # [ 11.204844] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 11.200536] systemd[1]: Finished Firewall. lb # [ 11.204979] systemd[1]: Reached target Preparation for Network. worker2 # [ 11.197226] dhcpcd[637]: eth0: waiting for carrier worker2 # [ 11.197951] dhcpcd[637]: eth0: carrier acquired lb # [ 11.212347] systemd[1]: Starting Address configuration of eth1... worker2 # [ 11.204869] dhcpcd[637]: DUID 00:01:00:01:32:46:b3:ec:52:54:00:12:34:56 worker2 # [ 11.206021] dhcpcd[637]: eth0: IAID 00:12:34:56 worker2 # [ 11.207588] dhcpcd[637]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 11.300085] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 11.301244] systemd[1]: Finished Extra networking commands.. worker1 # [ 11.302016] systemd[1]: Reached target Network. lb # [ 11.222481] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.317817] systemd[1]: Starting Address configuration of eth1... worker1 # [ 11.328211] systemd[1]: Starting Permit User Sessions... worker2 # [ 11.254486] mousedev: PS/2 mouse device common for all mice worker1 # [ 11.341967] systemd-logind[546]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 11.361159] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 11.391565] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 11.392054] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 11.394782] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 11.395090] cfg80211: failed to load regulatory.db worker1 # [ 11.415036] systemd[1]: Finished Permit User Sessions. worker1 # [ 11.418626] systemd[1]: Started Getty on tty1. worker1 # [ 11.419378] systemd[1]: Reached target Login Prompts. lb # [ 11.366616] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 11.356268] systemd-logind[482]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 11.349901] dhcpcd[637]: eth0: soliciting a DHCP lease worker2 # [ 11.356530] dhcpcd[637]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 11.363853] dhcpcd[582]: dhcpcd-10.3.2 starting worker1 # [ 11.462878] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 11.364215] dhcpcd[637]: eth0: probing address 10.0.2.15/24 client # [ 11.372624] dhcpcd[589]: dev: loaded udev worker1 # [ 11.470185] network-addresses-eth1-start[699]: adding address 192.168.1.3/24... done worker1 # [ 11.497307] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 11.486811] dhcpcd[688]: eth0: waiting for carrier worker1 # [ 11.491135] network-addresses-eth1-start[699]: adding address 2001:db8:1::3/64... done worker1 # [ 11.494352] dhcpcd[688]: eth0: waiting for carrier client # [ 11.426372] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 11.498186] dhcpcd[688]: eth0: carrier acquired lb # [ 11.435921] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 11.436425] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 11.439648] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 11.440000] cfg80211: failed to load regulatory.db worker2 # [ 11.420205] systemd-logind[513]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 11.511507] systemd[1]: Finished Address configuration of eth1. worker1 # [ 11.513844] dhcpcd[688]: DUID 00:01:00:01:32:46:b3:ed:52:54:00:12:34:56 worker1 # [ 11.515102] dhcpcd[688]: eth0: IAID 00:12:34:56 worker1 # [ 11.515759] dhcpcd[688]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 11.456020] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 11.486818] network-addresses-eth1-start[636]: adding address 192.168.1.2/24... done worker1 # [ 11.602438] mousedev: PS/2 mouse device common for all mice worker1 # [ 11.599214] dhcpcd[688]: eth0: soliciting a DHCP lease client # [ 11.531330] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 11.605273] dhcpcd[688]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 11.530214] network-addresses-eth1-start[636]: adding address 2001:db8:1::2/64... done worker1 # [ 11.612197] dhcpcd[688]: eth0: probing address 10.0.2.15/24 client # [ 11.573316] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 11.573799] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 11.554829] dhcpcd[662]: /nix/store/1ki7bgdr0niilkg9jbkpcdaggbv0kb8a-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (641) - Operation not permitted client # [ 11.577437] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 11.567898] dhcpcd[662]: .resolvconf-wrapped: clearing stale lock pid 641 client # [ 11.577762] cfg80211: failed to load regulatory.db lb # [ 11.573918] systemd[1]: Finished Address configuration of eth1. worker1 # [ 11.668147] systemd-logind[546]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 11.624398] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 11.612537] dhcpcd[627]: eth0: waiting for carrier lb # [ 11.617712] dhcpcd[627]: libudev: received NULL device lb # [ 11.621995] dhcpcd[627]: libudev: received NULL device lb # [ 11.622877] dhcpcd[627]: eth0: carrier acquired lb # [ 11.632205] dhcpcd[627]: DUID 00:01:00:01:32:46:b3:ed:52:54:00:12:34:56 lb # [ 11.633168] dhcpcd[627]: eth0: IAID 00:12:34:56 lb # [ 11.633799] dhcpcd[627]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 11.668010] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 11.654971] dhcpcd[589]: eth0: waiting for carrier client # [ 11.656763] dhcpcd[589]: libudev: received NULL device client # [ 11.658310] dhcpcd[589]: libudev: received NULL device client # [ 11.659509] dhcpcd[589]: eth0: carrier acquired client # [ 11.669707] systemd[1]: Finished nftables firewall. client # [ 11.674273] systemd[1]: Reached target Preparation for Network. client # [ 11.677687] dhcpcd[589]: DUID 00:01:00:01:32:46:b3:ed:52:54:00:12:34:56 client # [ 11.678634] dhcpcd[589]: eth0: IAID 00:12:34:56 client # [ 11.679248] dhcpcd[589]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 11.684214] systemd[1]: Starting Address configuration of eth1... client # [ 11.685083] systemd[1]: Starting Extra networking commands.... lb # [ 11.696274] systemd[1]: Finished Extra networking commands.. lb # [ 11.697160] systemd[1]: Reached target Network. lb # [ 11.705710] systemd[1]: Starting PostgreSQL Server... lb # [ 11.707656] systemd[1]: Starting Permit User Sessions... client # [ 11.801118] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 11.791339] systemd[1]: Finished Permit User Sessions. lb # [ 11.804694] systemd[1]: Started Getty on tty1. lb # [ 11.805411] systemd[1]: Reached target Login Prompts. client # [ 11.815933] network-addresses-eth1-start[613]: adding address 192.168.1.1/24... done client # [ 11.845042] network-addresses-eth1-start[613]: adding address 2001:db8:1::1/64... done client # [ 11.884214] systemd[1]: Finished Address configuration of eth1. client # [ 11.905071] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 worker1 # [ 11.995912] nix-grpc-daemon[485]: ts=2026-09-23T15:59:41Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" client # [ 11.956483] systemd[1]: Finished Extra networking commands.. client # [ 11.962101] systemd[1]: Reached target Network. client # [ 11.964497] systemd[1]: Starting Permit User Sessions... lb # [ 11.979069] postgresql-pre-start[729]: The files belonging to this database system will be owned by user "postgres". lb # [ 11.982923] postgresql-pre-start[729]: This user must also own the server process. lb # [ 11.995118] postgresql-pre-start[729]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 11.998091] postgresql-pre-start[729]: The default database encoding has accordingly been set to "UTF8". lb # [ 11.999329] postgresql-pre-start[729]: The default text search configuration will be set to "english". lb # [ 12.003536] postgresql-pre-start[729]: Data page checksums are enabled. lb # [ 12.005545] postgresql-pre-start[729]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.006826] postgresql-pre-start[729]: creating subdirectories ... ok lb # [ 12.007666] postgresql-pre-start[729]: selecting dynamic shared memory implementation ... posix worker2 # [ 12.015930] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 client # [ 12.062450] systemd[1]: Finished Permit User Sessions. client # [ 12.070518] systemd[1]: Started Getty on tty1. client # [ 12.072662] systemd[1]: Reached target Login Prompts. lb # [ 12.119812] postgresql-pre-start[729]: selecting default "max_connections" ... 100 client: (finished: waiting for unit network-addresses-eth1.service, in 12.58 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.04 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 12.333344] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 lb # [ 12.239869] postgresql-pre-start[729]: selecting default "shared_buffers" ... 128MB lb: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } worker2 # [ 12.313372] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 12.322068] systemd[1]: Starting Virtual Console Setup... worker2 # [ 12.328948] systemd[1]: Starting Virtual Console Setup... client # [ 12.335208] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 12.340668] systemd[1]: Stopped Virtual Console Setup. client # [ 12.343749] systemd[1]: Starting Virtual Console Setup... lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2 # [ 12.352743] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 12.353829] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 12.354530] systemd[1]: Starting Virtual Console Setup... client # [ 12.370572] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 12.410560] systemd-logind[513]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) client # [ 12.418654] systemd-logind[486]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker2 # [ 12.495336] systemd-vconsole-setup[693]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 12.502673] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 12.500138] systemd[1]: Finished Virtual Console Setup. client # [ 12.505916] systemd[1]: Finished Virtual Console Setup. worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.04 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 12.518780] dhcpcd[627]: eth0: soliciting a DHCP lease lb # [ 12.524646] dhcpcd[627]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 12.532250] dhcpcd[627]: eth0: probing address 10.0.2.15/24 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.03 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service worker1 # [ 12.714649] systemd[1]: Starting Virtual Console Setup... worker1 # [ 12.748796] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 12.749956] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 12.756450] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 12.763241] systemd[1]: Starting Virtual Console Setup... worker2 # [ 12.707082] dhcpcd[637]: eth0: soliciting an IPv6 router worker2 # [ 12.711362] dhcpcd[637]: eth0: Router Advertisement from fe80::2 worker2 # [ 12.714315] dhcpcd[637]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 12.717236] dhcpcd[637]: eth0: adding route to fec0::/64 worker2 # [ 12.719536] dhcpcd[637]: eth0: adding default route via fe80::2 worker1 # [ 12.882906] systemd-logind[546]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 12.826629] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:06.0/virtio5/input/input3 worker1 # [ 12.957473] systemd-vconsole-setup[752]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 12.962760] systemd[1]: Finished Virtual Console Setup. client # [ 12.998724] dhcpcd[589]: eth0: soliciting an IPv6 router client # [ 13.002864] dhcpcd[589]: eth0: Router Advertisement from fe80::2 client # [ 13.005650] dhcpcd[589]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 13.008619] dhcpcd[589]: eth0: adding route to fec0::/64 client # [ 13.010967] dhcpcd[589]: eth0: adding default route via fe80::2 client # [ 13.037966] dhcpcd[589]: eth0: soliciting a DHCP lease client # [ 13.045200] dhcpcd[589]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 13.052788] dhcpcd[589]: eth0: probing address 10.0.2.15/24 lb # [ 13.234263] systemd[1]: Starting Virtual Console Setup... lb # [ 13.275888] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 13.291247] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 13.295327] systemd[1]: Stopped Virtual Console Setup. lb # [ 13.305545] systemd[1]: Starting Virtual Console Setup... lb # [ 13.362900] systemd-logind[482]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 13.598426] nix-grpc-daemon[485]: ts=2026-09-23T15:59:43Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 13.598333] systemd-vconsole-setup[760]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 13.604301] systemd[1]: Finished Virtual Console Setup. lb # [ 13.747114] dhcpcd[627]: eth0: soliciting an IPv6 router lb # [ 13.747997] dhcpcd[627]: eth0: Router Advertisement from fe80::2 lb # [ 13.753202] dhcpcd[627]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 13.754098] dhcpcd[627]: eth0: adding route to fec0::/64 lb # [ 13.754821] dhcpcd[627]: eth0: adding default route via fe80::2 lb # [ 14.079661] postgresql-pre-start[729]: selecting default time zone ... UTC lb # [ 14.082816] postgresql-pre-start[729]: creating configuration files ... ok worker1 # [ 14.186463] dhcpcd[688]: eth0: soliciting an IPv6 router worker1 # [ 14.190818] dhcpcd[688]: eth0: Router Advertisement from fe80::2 worker1 # [ 14.193544] dhcpcd[688]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 14.196621] dhcpcd[688]: eth0: adding route to fec0::/64 worker1 # [ 14.198981] dhcpcd[688]: eth0: adding default route via fe80::2 lb # [ 14.355187] postgresql-pre-start[729]: running bootstrap script ... ok lb # [ 15.070419] postgresql-pre-start[729]: performing post-bootstrap initialization ... ok lb # [ 15.256196] postgresql-pre-start[729]: syncing data to disk ... ok lb # [ 15.258652] postgresql-pre-start[729]: initdb: warning: enabling "trust" authentication for local connections lb # [ 15.260094] postgresql-pre-start[729]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 15.262389] postgresql-pre-start[729]: Success. You can now start the database server using: lb # [ 15.263689] postgresql-pre-start[729]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 15.405313] postgres[792]: [792] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 15.408899] postgres[792]: [792] LOG: listening on IPv6 address "::1", port 5432 lb # [ 15.410178] postgres[792]: [792] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 15.412354] postgres[792]: [792] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 15.426874] postgres[803]: [803] LOG: database system was shut down at 2026-09-23 15:59:44 GMT lb # [ 15.431844] postgres[792]: [792] LOG: database system is ready to accept connections lb # [ 15.436355] systemd[1]: Started PostgreSQL Server. lb # [ 15.447465] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 15.637039] postgresql-setup-start[814]: CREATE DATABASE lb # [ 15.682733] postgresql-setup-start[819]: CREATE ROLE lb # [ 15.699892] postgresql-setup-start[821]: ALTER DATABASE lb # [ 15.705865] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 15.707872] systemd[1]: Reached target PostgreSQL. worker2 # [ 15.978404] dhcpcd[637]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 15.983886] dhcpcd[637]: eth0: adding route to 10.0.2.0/24 worker2 # [ 15.986913] dhcpcd[637]: eth0: adding default route via 10.0.2.2 worker2 # [ 16.182083] systemd[1]: Started DHCP Client. worker2 # [ 16.184990] systemd[1]: Reached target Network is Online. worker2 # [ 16.190810] systemd[1]: Starting scheduler-token.service... worker2 # [ 16.253673] systemd[1]: scheduler-token.service: Main process exited, code=exited, status=7/NOTRUNNING worker2 # [ 16.258044] systemd[1]: scheduler-token.service: Failed with result 'exit-code'. worker2 # [ 16.259400] systemd[1]: Failed to start scheduler-token.service. worker2 # [ 16.261394] systemd[1]: Dependency failed for Nix worker-protocol over gRPC. worker2 # [ 16.262712] systemd[1]: nix-grpc-daemon.service: Job nix-grpc-daemon.service/start failed with result 'dependency'. worker2 # [ 16.264550] systemd[1]: scheduler-token.service: Consumed 32ms CPU time over 65ms wall clock time, 3M memory peak, 40B incoming IP traffic, 60B outgoing IP traffic. worker2 # [ 16.266489] systemd[1]: Reached target Multi-User System. worker2 # [ 16.267258] systemd[1]: Startup finished in 945ms (kernel) + 4.994s (initrd) + 10.320s (userspace) = 16.260s. worker1 # [ 16.802122] nix-grpc-daemon[485]: ts=2026-09-23T15:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker1 # [ 16.859316] dhcpcd[688]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 16.866914] dhcpcd[688]: eth0: adding route to 10.0.2.0/24 worker1 # [ 16.872374] dhcpcd[688]: eth0: adding default route via 10.0.2.2 worker1 # [ 17.039253] systemd[1]: Started DHCP Client. worker1 # [ 17.042463] systemd[1]: Reached target Multi-User System. worker1 # [ 17.043759] systemd[1]: Startup finished in 981ms (kernel) + 5.050s (initrd) + 11.011s (userspace) = 17.043s. lb # [ 17.221903] dhcpcd[627]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 17.222354] dhcpcd[627]: eth0: adding route to 10.0.2.0/24 lb # [ 17.222497] dhcpcd[627]: eth0: adding default route via 10.0.2.2 lb # [ 17.397867] systemd[1]: Started DHCP Client. lb # [ 17.400559] systemd[1]: Reached target Network is Online. lb # [ 17.404589] systemd[1]: Started Envoy reverse proxy. lb # [ 17.416703] systemd[1]: Started mock-oidc.service. worker2 # [ 17.510008] systemd[1]: scheduler-token.service: Scheduled restart job, restart counter is at 1. worker2 # [ 17.521355] systemd[1]: Starting scheduler-token.service... lb # [ 17.597017] mock-oidc-server[898]: Mock OIDC Server running lb # [ 17.598735] mock-oidc-server[898]: OIDC Address: 192.168.1.2:8080 lb # [ 17.600470] mock-oidc-server[898]: Issue Address: 0.0.0.0:8081 lb # [ 17.601486] mock-oidc-server[898]: Issuer: http://192.168.1.2:8080/oidc lb # [ 17.603926] mock-oidc-server[898]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 17.607486] mock-oidc-server[898]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 17.609427] mock-oidc-server[898]: Issue tokens: http://0.0.0.0:8081/issue?sub=... worker2 # [ 17.607307] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 17.612920] systemd[1]: Finished scheduler-token.service. worker2 # [ 17.614850] systemd[1]: scheduler-token.service: Consumed 61ms CPU time over 1.353s wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb # [ 17.821684] envoy[897]: [2026-09-23 15:59:47.436][897][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 17.824588] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 17.826464] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 17.829087] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 17.857221] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 17.863258] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 17.867653] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 17.872103] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 17.874455] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 17.876699] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 17.879607] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 17.914699] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 17.918246] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 17.926395] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 17.929280] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 17.931343] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 17.933357] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 17.936530] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 17.938786] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 17.941880] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 17.949918] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 17.952579] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 17.954389] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 17.962175] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 17.964321] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 17.966759] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 17.969794] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 17.972719] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 17.974404] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 17.976190] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 17.978666] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 17.981714] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche client # [ 17.978744] dhcpcd[589]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 17.983276] dhcpcd[589]: eth0: adding route to 10.0.2.0/24 lb # [ 17.983580] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 17.990865] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector client # [ 17.991001] dhcpcd[589]: eth0: adding default route via 10.0.2.2 lb # [ 17.997521] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 17.999331] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 18.004795] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 18.006978] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 18.010381] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 18.012111] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 18.019384] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 18.022573] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 18.025263] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 18.027228] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 18.030442] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 18.033492] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 18.035312] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 18.040194] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 18.048539] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 18.051174] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 18.053614] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 18.056609] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 18.058970] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 18.065213] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 18.067285] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 18.069292] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 18.073375] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 18.077032] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 18.079451] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 18.081789] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 18.084430] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 18.090282] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 18.094898] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 18.097286] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 18.102089] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 18.106568] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 18.108384] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 18.111706] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 18.114399] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 18.116467] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 18.118333] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 18.121641] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr lb # [ 18.123413] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 18.125753] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 18.127445] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder client # [ 18.128262] systemd[1]: Started DHCP Client. lb # [ 18.129793] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 18.135025] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso client # [ 18.131553] systemd[1]: Reached target Multi-User System. lb # [ 18.137074] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based client # [ 18.133518] systemd[1]: Startup finished in 940ms (kernel) + 5.004s (initrd) + 12.187s (userspace) = 18.132s. lb # [ 18.138673] envoy[897]: [2026-09-23 15:59:47.439][897][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 18.141964] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 18.148783] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 18.150765] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 18.153030] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 18.166550] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 18.168363] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 18.170891] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 18.172845] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 18.174507] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 18.176914] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 18.178986] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 18.180839] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 18.183724] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 18.187063] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 18.189818] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 18.192244] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 18.196706] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 18.198249] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 18.203891] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 18.207913] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 18.211993] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 18.214164] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 18.225269] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 18.226922] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 18.229872] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 18.231512] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 18.233437] envoy[897]: [2026-09-23 15:59:47.440][897][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 18.235330] envoy[897]: [2026-09-23 15:59:47.455][897][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 18.236853] envoy[897]: [2026-09-23 15:59:47.456][897][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 18.252592] envoy[897]: [2026-09-23 15:59:47.456][897][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 18.254025] envoy[897]: [2026-09-23 15:59:47.456][897][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 18.266359] envoy[897]: [2026-09-23 15:59:47.456][897][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 18.269291] envoy[897]: [2026-09-23 15:59:47.492][897][info][main] [source/server/server.cc:968] runtime: {} lb # [ 18.270550] envoy[897]: [2026-09-23 15:59:47.496][897][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 18.273747] envoy[897]: [2026-09-23 15:59:47.496][897][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 18.276555] envoy[897]: [2026-09-23 15:59:47.496][897][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 18.278032] envoy[897]: [2026-09-23 15:59:47.519][897][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 18.279567] envoy[897]: [2026-09-23 15:59:47.520][897][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 18.281456] envoy[897]: [2026-09-23 15:59:47.520][897][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 18.283154] envoy[897]: [2026-09-23 15:59:47.691][897][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 18.284831] envoy[897]: [2026-09-23 15:59:47.708][897][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 18.286400] envoy[897]: [2026-09-23 15:59:47.709][897][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 18.289698] envoy[897]: [2026-09-23 15:59:47.709][897][info][main] [source/server/server.cc:1077] starting main dispatch loop lb # [ 18.291103] envoy[897]: [2026-09-23 15:59:47.709][897][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 18.292941] envoy[897]: [2026-09-23 15:59:47.709][897][info][upstream] [source/common/upstream/cluster_manager_impl.cc:227] cm init: initializing secondary clusters lb # [ 21.658690] rustfs-bucket-start[940]: mb s3://farm lb # [ 21.668589] systemd[1]: Finished rustfs-bucket.service. lb # [ 21.676774] systemd[1]: Starting niks3 server... worker1 # [ 21.801121] nix-grpc-daemon[485]: ts=2026-09-23T15:59:51Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 21.811984] postgres[958]: [958] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 21.816211] postgres[958]: [958] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 21.838667] niks3-server[953]: 2026/09/23 15:59:51 OK 20241026095416_initial_model.sql (15.43ms) lb # [ 21.842042] niks3-server[953]: 2026/09/23 15:59:51 OK 20251210153512_drop_unused_gin_index.sql (3.63ms) lb # [ 21.847329] niks3-server[953]: 2026/09/23 15:59:51 OK 20251218171726_add_pins.sql (5.23ms) lb # [ 21.851903] niks3-server[953]: 2026/09/23 15:59:51 OK 20260628120000_add_object_size_and_stats.sql (4.53ms) lb # [ 21.857192] niks3-server[953]: 2026/09/23 15:59:51 OK 20260905000000_add_claims.sql (5.25ms) lb # [ 21.860923] niks3-server[953]: 2026/09/23 15:59:51 OK 20260920000000_drop_claims.sql (3.7ms) lb # [ 21.863483] niks3-server[953]: 2026/09/23 15:59:51 OK 20260923120000_add_pushes.sql (2.46ms) lb # [ 21.865432] niks3-server[953]: 2026/09/23 15:59:51 goose: successfully migrated database to version: 20260923120000 lb # [ 21.868991] niks3-server[953]: 2026/09/23 15:59:51 OK 1_commit_pending_closure.sql (5.42ms) lb # [ 21.871496] niks3-server[953]: 2026/09/23 15:59:51 OK 2_object_stats_trigger.sql (2.48ms) lb # [ 21.874308] niks3-server[953]: 2026/09/23 15:59:51 OK 3_commit_push.sql (2.42ms) lb # [ 21.875326] niks3-server[953]: 2026/09/23 15:59:51 goose: up to current file version: 3 lb # [ 21.877046] niks3-server[953]: 2026/09/23 15:59:51 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key lb # [ 21.898477] niks3-server[953]: 2026/09/23 15:59:51 INFO Read proxy enabled — serving cache objects from S3 lb # [ 21.899795] niks3-server[953]: 2026/09/23 15:59:51 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 21.907569] niks3-server[953]: 2026/09/23 15:59:51 INFO systemd watchdog enabled interval=15s lb # [ 21.910189] niks3-server[953]: 2026/09/23 15:59:51 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 21.911747] systemd[1]: Started niks3 server. lb # [ 21.912538] systemd[1]: Reached target Multi-User System. lb # [ 21.913377] systemd[1]: Startup finished in 952ms (kernel) + 4.996s (initrd) + 15.960s (userspace) = 21.909s. lb: (finished: waiting for unit niks3.service, in 10.24 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.03 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.03 seconds) lb: waiting for TCP port 50051 on localhost worker1 # [ 26.801824] nix-grpc-daemon[485]: ts=2026-09-23T15:59:56Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker1 # [ 31.802508] nix-grpc-daemon[485]: ts=2026-09-23T16:00:01Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" worker1 # [ 31.989958] nix-grpc-daemon[485]: ts=2026-09-23T16:00:01Z level=info event=scheduler_take_over lb # [ 31.909364] niks3-server[953]: 2026/09/23 16:00:01 INFO lead: acquired remote=192.168.1.3:55244 lb # [ 33.092940] envoy[897]: [2026-09-23 16:00:02.707][897][warning][config] [source/extensions/config_subscription/grpc/grpc_subscription_impl.cc:130] gRPC config: initial fetch timed out for type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment lb # [ 33.101990] envoy[897]: [2026-09-23 16:00:02.709][897][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 33.108180] envoy[897]: [2026-09-23 16:00:02.723][897][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager lb # [ 33.118980] envoy[897]: [2026-09-23 16:00:02.733][897][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 33.439726] envoy[897]: conn peer=[::1]:48970 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=10 lb: (finished: waiting for TCP port 50051 on localhost, in 10.58 seconds) worker2 # [ 33.595338] systemd[1]: Starting scheduler-token.service... worker2 # [ 33.661992] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 33.668317] systemd[1]: Finished scheduler-token.service. worker2 # [ 33.669895] systemd[1]: scheduler-token.service: Consumed 38ms CPU time over 70ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 33.687888] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 33.858691] nix-grpc-daemon[485]: ts=2026-09-23T16:00:03Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:59636 worker2 # [ 33.816689] nix-grpc-daemon[785]: ts=2026-09-23T16:00:03Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 33.826051] nix-grpc-daemon[785]: ts=2026-09-23T16:00:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 33.828172] nix-grpc-daemon[785]: ts=2026-09-23T16:00:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 33.842950] nix-grpc-daemon[785]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 33.845934] nix-grpc-daemon[785]: E0000 00:00:1790179203.466276 785 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 33.851269] nix-grpc-daemon[785]: E0000 00:00:1790179203.474848 785 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 33.854426] nix-grpc-daemon[785]: ts=2026-09-23T16:00:03Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 33.865232] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly ['worker1', 'worker2'] are healthy members of aarch64-linux lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 33.869610] nix-grpc-daemon[785]: E0000 00:00:1790179203.492095 827 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 33.887346] nix-grpc-daemon[785]: E0000 00:00:1790179203.510987 827 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 33.900195] nix-grpc-daemon[785]: E0000 00:00:1790179203.513724 827 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 33.908980] nix-grpc-daemon[785]: E0000 00:00:1790179203.531967 827 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 33.926343] nix-grpc-daemon[785]: ts=2026-09-23T16:00:03Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 34.036155] nix-grpc-daemon[485]: ts=2026-09-23T16:00:03Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 34.042343] nix-grpc-daemon[485]: ts=2026-09-23T16:00:03Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:59646 worker1 # [ 34.051225] nix-grpc-daemon[485]: ts=2026-09-23T16:00:03Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1 # [ 36.805863] nix-grpc-daemon[485]: ts=2026-09-23T16:00:06Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.806239] nix-grpc-daemon[485]: ts=2026-09-23T16:00:06Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:59646 worker1 # [ 36.806453] nix-grpc-daemon[485]: ts=2026-09-23T16:00:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of aarch64-linux, in 3.31 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.03 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.73 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 38.228862] nix-grpc-daemon[785]: ts=2026-09-23T16:00:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 38.246193] systemd[1]: Started Nix Daemon. worker2 # [ 38.430791] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 38.453716] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5) worker2 # [ 38.507659] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 2/5) worker2 # [ 38.674695] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 333 ms (attempt 3/5) worker2 # [ 39.009770] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 204 ms (attempt 4/5) worker2 # [ 39.216198] nix-grpc-daemon[785]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 39.221847] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 39.349296] nix-grpc-daemon[485]: ts=2026-09-23T16:00:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 39.360847] systemd[1]: Started Nix Daemon. worker1 # [ 39.554850] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 39.580178] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 1/5) worker1 # [ 39.625886] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 72 ms (attempt 2/5) worker1 # [ 39.699607] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 68 ms (attempt 3/5) worker1 # [ 39.769405] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 101 ms (attempt 4/5) worker1 # [ 39.873169] nix-grpc-daemon[485]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 39.878880] nix-grpc-daemon[485]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 39.888330] nix-grpc-daemon[485]: ts=2026-09-23T16:00:09Z level=debug event=path_info_miss path=ra6r7v42kn1phhf50aiw8qw3p1s4g3i7-nixos-system-client-test error="error: path '/nix/store/ra6r7v42kn1phhf50aiw8qw3p1s4g3i7-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 39.813552] nix-grpc-daemon[785]: ts=2026-09-23T16:00:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 39.825432] nix-grpc-daemon[785]: ts=2026-09-23T16:00:09Z level=debug event=path_info_miss path=ra6r7v42kn1phhf50aiw8qw3p1s4g3i7-nixos-system-client-test error="error: path '/nix/store/ra6r7v42kn1phhf50aiw8qw3p1s4g3i7-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds) client: must succeed: install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds) worker1 # [ 40.255326] nix-grpc-daemon[485]: ts=2026-09-23T16:00:09Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:59660 worker1 # [ 40.271246] nix-grpc-daemon[485]: ts=2026-09-23T16:00:09Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:59660 worker1 # [ 40.282875] nix-grpc-daemon[485]: ts=2026-09-23T16:00:09Z level=debug event=path_info_miss path=ra6r7v42kn1phhf50aiw8qw3p1s4g3i7-nixos-system-client-test error="error: path '/nix/store/ra6r7v42kn1phhf50aiw8qw3p1s4g3i7-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 40.297330] nix-grpc-daemon[485]: ts=2026-09-23T16:00:09Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:59660 worker1 # [ 40.305188] nix-grpc-daemon[485]: ts=2026-09-23T16:00:09Z level=debug event=path_info_miss path=ra6r7v42kn1phhf50aiw8qw3p1s4g3i7-nixos-system-client-test error="error: path '/nix/store/ra6r7v42kn1phhf50aiw8qw3p1s4g3i7-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds) worker1 # [ 40.537423] nix-grpc-daemon[485]: E0000 00:00:1790179210.154780 540 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 40.618051] nix-grpc-daemon[485]: ts=2026-09-23T16:00:10Z level=info event=denied method=QueryMissing cn=- role=none worker1 # [ 40.620087] nix-grpc-daemon[485]: E0000 00:00:1790179210.209448 540 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 40.623323] nix-grpc-daemon[485]: E0000 00:00:1790179210.211172 540 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 40.626738] nix-grpc-daemon[485]: E0000 00:00:1790179210.236359 540 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 40.711948] nix-grpc-daemon[485]: ts=2026-09-23T16:00:10Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 2.73 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2 worker1 # [ 40.883782] nix-grpc-daemon[485]: ts=2026-09-23T16:00:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59660 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 40.895994] nix-grpc-daemon[485]: ts=2026-09-23T16:00:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 40.931875] nix-grpc-daemon[485]: ts=2026-09-23T16:00:10Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker1 # [ 40.938404] nix-grpc-daemon[485]: ts=2026-09-23T16:00:10Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 40.858353] nix-grpc-daemon[785]: ts=2026-09-23T16:00:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 40.874643] nix-grpc-daemon[785]: ts=2026-09-23T16:00:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 client # copying 1 paths to 'lb:50051'... worker2 # [ 40.890725] nix-grpc-daemon[785]: ts=2026-09-23T16:00:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker2 # [ 40.911917] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 40.968410] nix-grpc-daemon[785]: ts=2026-09-23T16:00:10Z level=info event=niks3_push_started pid=854 worker2 # [ 41.177708] nix-grpc-daemon[854]: time=2026-09-23T16:00:10.801Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 41.288079] nix-daemon[842]: accepted connection from pid 868, user nix-grpc-daemon (trusted) worker2 # [ 41.307264] nix-daemon[842]: reaped child process 871, status = succeeded lb # [ 41.324695] niks3-server[953]: 2026/09/23 16:00:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 41.336074] nix-grpc-daemon[854]: time=2026-09-23T16:00:10.958Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 41.337555] nix-grpc-daemon[854]: time=2026-09-23T16:00:10.958Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 41.396040] niks3-server[953]: 2026/09/23 16:00:11 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign lb # [ 41.415952] niks3-server[953]: 2026/09/23 16:00:11 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 41.446085] niks3-server[953]: 2026/09/23 16:00:11 INFO Signed narinfos id=1 count=1 worker2 # [ 41.440132] nix-grpc-daemon[854]: time=2026-09-23T16:00:11.061Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.467232] niks3-server[953]: 2026/09/23 16:00:11 INFO Received complete push request method=POST path=/api/pushes/1/complete lb # [ 41.479733] niks3-server[953]: 2026/09/23 16:00:11 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 41.488987] niks3-server[953]: 2026/09/23 16:00:11 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo worker2 # [ 41.497858] nix-grpc-daemon[854]: time=2026-09-23T16:00:11.121Z level=INFO msg="Upload complete. (316ms)" worker2 # [ 41.509300] nix-grpc-daemon[785]: ts=2026-09-23T16:00:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_in=504 worker2 # [ 41.528683] nix-grpc-daemon[785]: ts=2026-09-23T16:00:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 41.537957] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 41.544905] nix-daemon[842]: reaped child process 852, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> worker2: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker2 # [ 41.559612] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker2 # [ 42.627875] nix-daemon[842]: reaped child process 875, status = succeeded worker2 # [ 42.748964] nix-daemon[842]: accepted connection from pid 891, user nix-grpc-daemon (trusted) worker2 # [ 42.767988] nix-daemon[842]: reaped child process 894, status = succeeded lb # [ 42.782685] niks3-server[953]: 2026/09/23 16:00:12 INFO Received push request method=POST path=/api/pushes worker2 # [ 42.788460] nix-grpc-daemon[854]: time=2026-09-23T16:00:12.410Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 42.790372] nix-grpc-daemon[854]: time=2026-09-23T16:00:12.410Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 42.825237] niks3-server[953]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker2 # [ 42.840707] nix-grpc-daemon[854]: time=2026-09-23T16:00:12.463Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.842666] niks3-server[953]: 2026/09/23 16:00:12 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign lb # [ 42.854217] niks3-server[953]: 2026/09/23 16:00:12 INFO Signed narinfos id=2 count=1 lb # [ 42.859247] niks3-server[953]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst lb # [ 42.866159] niks3-server[953]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 42.872090] niks3-server[953]: 2026/09/23 16:00:12 INFO Received complete push request method=POST path=/api/pushes/2/complete worker2 # [ 42.876109] nix-grpc-daemon[854]: time=2026-09-23T16:00:12.499Z level=INFO msg="Upload complete. (299ms)" lb # [ 42.886462] niks3-server[953]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 42.985704] nix-grpc-daemon[485]: ts=2026-09-23T16:00:12Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker1 # [ 42.991469] nix-grpc-daemon[485]: ts=2026-09-23T16:00:12Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 42.889173] nix-grpc-daemon[785]: ts=2026-09-23T16:00:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 42.911930] nix-grpc-daemon[785]: ts=2026-09-23T16:00:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 42.918898] nix-daemon[842]: reaped child process 873, status = succeeded worker2 # [ 42.923487] nix-grpc-daemon[785]: ts=2026-09-23T16:00:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 42.932726] nix-grpc-daemon[854]: time=2026-09-23T16:00:12.556Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 42.942959] nix-grpc-daemon[785]: ts=2026-09-23T16:00:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker2 # [ 42.964299] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 43.117948] nix-daemon[842]: accepted connection from pid 898, user nix-grpc-daemon (trusted) worker2 # [ 43.138584] nix-daemon[842]: reaped child process 901, status = succeeded lb # [ 43.151512] niks3-server[953]: 2026/09/23 16:00:12 INFO Received push request method=POST path=/api/pushes worker2 # [ 43.152145] nix-grpc-daemon[854]: time=2026-09-23T16:00:12.775Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 43.154720] nix-grpc-daemon[854]: time=2026-09-23T16:00:12.777Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 43.185942] niks3-server[953]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst worker2 # [ 43.189439] nix-grpc-daemon[854]: time=2026-09-23T16:00:12.812Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.201497] niks3-server[953]: 2026/09/23 16:00:12 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign lb # [ 43.211482] niks3-server[953]: 2026/09/23 16:00:12 INFO Signed narinfos id=3 count=1 lb # [ 43.216977] niks3-server[953]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 43.231044] niks3-server[953]: 2026/09/23 16:00:12 INFO Received complete push request method=POST path=/api/pushes/3/complete worker2 # [ 43.228159] nix-grpc-daemon[854]: time=2026-09-23T16:00:12.851Z level=INFO msg="Upload complete. (247ms)" lb # [ 43.240221] niks3-server[953]: 2026/09/23 16:00:12 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker2 # [ 43.240082] nix-grpc-daemon[785]: ts=2026-09-23T16:00:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 43.249170] nix-grpc-daemon[785]: ts=2026-09-23T16:00:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 43.261904] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 43.266858] nix-daemon[842]: reaped child process 896, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... worker2 # [ 43.280183] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) client # farm-b> worker2: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker2 # [ 44.510670] nix-daemon[842]: reaped child process 905, status = succeeded worker2 # [ 44.626125] nix-daemon[842]: accepted connection from pid 922, user nix-grpc-daemon (trusted) worker2 # [ 44.648623] nix-daemon[842]: reaped child process 925, status = succeeded lb # [ 44.660874] niks3-server[953]: 2026/09/23 16:00:14 INFO Received push request method=POST path=/api/pushes worker2 # [ 44.663216] nix-grpc-daemon[854]: time=2026-09-23T16:00:14.285Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 44.664862] nix-grpc-daemon[854]: time=2026-09-23T16:00:14.286Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" worker2 # [ 44.699505] nix-grpc-daemon[854]: time=2026-09-23T16:00:14.323Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.700889] niks3-server[953]: 2026/09/23 16:00:14 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign lb # [ 44.721955] niks3-server[953]: 2026/09/23 16:00:14 INFO Signed narinfos id=4 count=1 lb # [ 44.729761] niks3-server[953]: 2026/09/23 16:00:14 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 44.740759] niks3-server[953]: 2026/09/23 16:00:14 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 44.749948] niks3-server[953]: 2026/09/23 16:00:14 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 44.755945] niks3-server[953]: 2026/09/23 16:00:14 INFO Received complete push request method=POST path=/api/pushes/4/complete lb # [ 44.758754] niks3-server[953]: 2026/09/23 16:00:14 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker2 # [ 44.753325] nix-grpc-daemon[854]: time=2026-09-23T16:00:14.377Z level=INFO msg="Upload complete. (263ms)" worker2 # [ 44.765306] nix-grpc-daemon[785]: ts=2026-09-23T16:00:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker1 # [ 44.861305] nix-grpc-daemon[485]: ts=2026-09-23T16:00:14Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker1 # [ 44.867676] nix-grpc-daemon[485]: ts=2026-09-23T16:00:14Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 44.785510] nix-grpc-daemon[785]: ts=2026-09-23T16:00:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 44.794063] nix-daemon[842]: reaped child process 903, status = succeeded worker2 # [ 44.802632] nix-grpc-daemon[785]: ts=2026-09-23T16:00:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 44.815996] nix-grpc-daemon[854]: time=2026-09-23T16:00:14.439Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 44.826102] nix-grpc-daemon[785]: ts=2026-09-23T16:00:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker2 # [ 44.855749] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 45.013116] nix-daemon[842]: accepted connection from pid 929, user nix-grpc-daemon (trusted) worker2 # [ 45.033618] nix-daemon[842]: reaped child process 932, status = succeeded lb # [ 45.040515] niks3-server[953]: 2026/09/23 16:00:14 INFO Received push request method=POST path=/api/pushes worker2 # [ 45.041180] nix-grpc-daemon[854]: time=2026-09-23T16:00:14.664Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 45.042940] nix-grpc-daemon[854]: time=2026-09-23T16:00:14.664Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 45.071886] niks3-server[953]: 2026/09/23 16:00:14 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst worker2 # [ 45.073860] nix-grpc-daemon[854]: time=2026-09-23T16:00:14.697Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.087943] niks3-server[953]: 2026/09/23 16:00:14 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign lb # [ 45.091960] niks3-server[953]: 2026/09/23 16:00:14 INFO Signed narinfos id=5 count=1 lb # [ 45.105221] niks3-server[953]: 2026/09/23 16:00:14 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 45.113746] niks3-server[953]: 2026/09/23 16:00:14 INFO Received complete push request method=POST path=/api/pushes/5/complete worker2 # [ 45.108601] nix-grpc-daemon[854]: time=2026-09-23T16:00:14.732Z level=INFO msg="Upload complete. (235ms)" lb # [ 45.118189] niks3-server[953]: 2026/09/23 16:00:14 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker2 # [ 45.118279] nix-grpc-daemon[785]: ts=2026-09-23T16:00:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 45.134242] nix-grpc-daemon[785]: ts=2026-09-23T16:00:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 45.144216] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 45.146517] nix-daemon[842]: reaped child process 927, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... worker2 # [ 45.160111] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) client # farm-top> worker2: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker2 # [ 46.048899] nix-daemon[842]: reaped child process 936, status = succeeded worker2 # [ 46.148897] nix-daemon[842]: accepted connection from pid 952, user nix-grpc-daemon (trusted) worker2 # [ 46.171736] nix-daemon[842]: reaped child process 955, status = succeeded lb # [ 46.180684] niks3-server[953]: 2026/09/23 16:00:15 INFO Received push request method=POST path=/api/pushes worker2 # [ 46.183456] nix-grpc-daemon[854]: time=2026-09-23T16:00:15.805Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 46.185301] nix-grpc-daemon[854]: time=2026-09-23T16:00:15.805Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 46.223205] niks3-server[953]: 2026/09/23 16:00:15 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls worker2 # [ 46.227434] nix-grpc-daemon[854]: time=2026-09-23T16:00:15.850Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.238156] niks3-server[953]: 2026/09/23 16:00:15 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign lb # [ 46.250059] niks3-server[953]: 2026/09/23 16:00:15 INFO Signed narinfos id=6 count=1 lb # [ 46.256319] niks3-server[953]: 2026/09/23 16:00:15 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 46.271708] niks3-server[953]: 2026/09/23 16:00:15 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst lb # [ 46.276440] niks3-server[953]: 2026/09/23 16:00:15 INFO Received complete push request method=POST path=/api/pushes/6/complete lb # [ 46.281925] niks3-server[953]: 2026/09/23 16:00:15 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker2 # [ 46.278125] nix-grpc-daemon[854]: time=2026-09-23T16:00:15.901Z level=INFO msg="Upload complete. (300ms)" worker2 # [ 46.292312] nix-grpc-daemon[785]: ts=2026-09-23T16:00:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker2 # [ 46.309423] nix-daemon[842]: reaped child process 934, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2, in 5.70 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath, in 0.18 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.02 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.22 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.21 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.24 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.22 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 47.543333] nix-grpc-daemon[485]: ts=2026-09-23T16:00:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59660 worker2 # [ 47.458974] nix-grpc-daemon[785]: ts=2026-09-23T16:00:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 47.470483] nix-grpc-daemon[854]: time=2026-09-23T16:00:17.093Z level=INFO msg="All 2 paths already cached" worker1 # [ 47.579408] nix-grpc-daemon[485]: ts=2026-09-23T16:00:17Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 >&2, in 0.22 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 outPath, in 0.14 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.08 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true lb # [ 48.082454] envoy[897]: conn peer=[2001:db8:1::1]:51398 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=1648 lb # [ 48.087514] envoy[897]: conn peer=[2001:db8:1::1]:51400 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=64 lb # [ 48.093140] envoy[897]: conn peer=[2001:db8:1::1]:51406 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=199 ms=19 lb # [ 48.097880] envoy[897]: conn peer=[2001:db8:1::1]:51408 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=12 lb # [ 48.103349] envoy[897]: conn peer=[2001:db8:1::1]:51412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9545 tx=4351 ms=5517 worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&2 lb # [ 48.107835] envoy[897]: conn peer=[2001:db8:1::1]:53552 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=62 worker2 # [ 48.318198] nix-grpc-daemon[785]: ts=2026-09-23T16:00:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56394 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 48.418724] nix-grpc-daemon[485]: ts=2026-09-23T16:00:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 48.445600] nix-grpc-daemon[485]: ts=2026-09-23T16:00:18Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 48.358933] nix-grpc-daemon[785]: ts=2026-09-23T16:00:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker1 # [ 48.451751] nix-grpc-daemon[485]: ts=2026-09-23T16:00:18Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 48.373906] nix-grpc-daemon[785]: ts=2026-09-23T16:00:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 48.390131] nix-grpc-daemon[854]: time=2026-09-23T16:00:18.013Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker2 # [ 48.401253] nix-grpc-daemon[785]: ts=2026-09-23T16:00:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 48.416315] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 48.583741] nix-daemon[842]: accepted connection from pid 972, user nix-grpc-daemon (trusted) worker2 # [ 48.601538] nix-daemon[842]: reaped child process 975, status = succeeded lb # [ 48.617187] niks3-server[953]: 2026/09/23 16:00:18 INFO Received push request method=POST path=/api/pushes worker2 # [ 48.618765] nix-grpc-daemon[854]: time=2026-09-23T16:00:18.241Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 48.620522] nix-grpc-daemon[854]: time=2026-09-23T16:00:18.241Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 48.655723] niks3-server[953]: 2026/09/23 16:00:18 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign worker2 # [ 48.653924] nix-grpc-daemon[854]: time=2026-09-23T16:00:18.277Z level=INFO msg="Uploading 1 narinfos" lb # [ 48.669764] niks3-server[953]: 2026/09/23 16:00:18 INFO Signed narinfos id=7 count=1 lb # [ 48.677466] niks3-server[953]: 2026/09/23 16:00:18 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 48.688069] niks3-server[953]: 2026/09/23 16:00:18 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 48.691277] niks3-server[953]: 2026/09/23 16:00:18 INFO Received complete push request method=POST path=/api/pushes/7/complete worker2 # [ 48.691114] nix-grpc-daemon[854]: time=2026-09-23T16:00:18.314Z level=INFO msg="Upload complete. (257ms)" lb # [ 48.702134] niks3-server[953]: 2026/09/23 16:00:18 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker2 # [ 48.703517] nix-grpc-daemon[785]: ts=2026-09-23T16:00:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 48.720958] nix-grpc-daemon[785]: ts=2026-09-23T16:00:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 48.730702] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 48.735200] nix-daemon[842]: reaped child process 970, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... worker2 # [ 48.748498] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) client # farm-top> worker2: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker2 # [ 50.218401] nix-daemon[842]: reaped child process 979, status = succeeded worker2 # [ 50.380142] nix-daemon[842]: accepted connection from pid 995, user nix-grpc-daemon (trusted) worker2 # [ 50.404684] nix-daemon[842]: reaped child process 998, status = succeeded lb # [ 50.413884] niks3-server[953]: 2026/09/23 16:00:20 INFO Received push request method=POST path=/api/pushes worker2 # [ 50.420433] nix-grpc-daemon[854]: time=2026-09-23T16:00:20.042Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 50.421901] nix-grpc-daemon[854]: time=2026-09-23T16:00:20.042Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 50.488512] niks3-server[953]: 2026/09/23 16:00:20 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign lb # [ 50.498641] niks3-server[953]: 2026/09/23 16:00:20 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 50.490577] nix-grpc-daemon[854]: time=2026-09-23T16:00:20.113Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.507027] niks3-server[953]: 2026/09/23 16:00:20 INFO Signed narinfos id=8 count=1 lb # [ 50.511573] niks3-server[953]: 2026/09/23 16:00:20 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 50.518666] niks3-server[953]: 2026/09/23 16:00:20 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 50.530011] niks3-server[953]: 2026/09/23 16:00:20 INFO Received complete push request method=POST path=/api/pushes/8/complete lb # [ 50.535944] niks3-server[953]: 2026/09/23 16:00:20 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker2 # [ 50.535286] nix-grpc-daemon[854]: time=2026-09-23T16:00:20.158Z level=INFO msg="Upload complete. (371ms)" worker2 # [ 50.549894] nix-grpc-daemon[785]: ts=2026-09-23T16:00:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker2 # [ 50.582589] nix-daemon[842]: reaped child process 977, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.50 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.20 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.06 seconds) subtest: outputs read back through any worker carry the cache signature client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&2 worker1 # [ 51.306835] nix-grpc-daemon[485]: ts=2026-09-23T16:00:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59660 client # don't know how to build these paths: client # /nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker1 # [ 51.317426] nix-grpc-daemon[485]: ts=2026-09-23T16:00:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 51.343283] nix-grpc-daemon[485]: ts=2026-09-23T16:00:20Z level=debug event=want client=4 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv cached=0 worker1 # [ 51.350357] nix-grpc-daemon[485]: ts=2026-09-23T16:00:20Z level=debug event=assigned drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 51.360256] nix-grpc-daemon[485]: ts=2026-09-23T16:00:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 51.371315] nix-grpc-daemon[485]: ts=2026-09-23T16:00:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59660 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' to 'lb:50051'... worker1 # [ 51.386992] nix-grpc-daemon[485]: ts=2026-09-23T16:00:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 51.401152] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 51.442508] nix-grpc-daemon[485]: ts=2026-09-23T16:00:21Z level=info event=niks3_push_started pid=901 worker1 # [ 51.609349] nix-grpc-daemon[901]: time=2026-09-23T16:00:21.228Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca="" worker1 # [ 51.730252] nix-daemon[849]: accepted connection from pid 914, user nix-grpc-daemon (trusted) worker1 # [ 51.754818] nix-daemon[849]: reaped child process 917, status = succeeded lb # [ 51.681140] niks3-server[953]: 2026/09/23 16:00:21 INFO Received push request method=POST path=/api/pushes worker1 # [ 51.773923] nix-grpc-daemon[901]: time=2026-09-23T16:00:21.392Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 51.775540] nix-grpc-daemon[901]: time=2026-09-23T16:00:21.392Z level=INFO msg="Uploading 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv (512B)" lb # [ 51.731400] niks3-server[953]: 2026/09/23 16:00:21 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign worker1 # [ 51.824073] nix-grpc-daemon[901]: time=2026-09-23T16:00:21.442Z level=INFO msg="Uploading 1 narinfos" lb # [ 51.743897] niks3-server[953]: 2026/09/23 16:00:21 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.ls lb # [ 51.751733] niks3-server[953]: 2026/09/23 16:00:21 INFO Signed narinfos id=9 count=1 lb # [ 51.757186] niks3-server[953]: 2026/09/23 16:00:21 INFO Registered completed upload object_key=nar/13mhmmy2qay13imbbdi287vhryz1hwnyg0w6agd9s0ph37wnsqll.nar.zst lb # [ 51.768347] niks3-server[953]: 2026/09/23 16:00:21 INFO Received complete push request method=POST path=/api/pushes/9/complete lb # [ 51.782605] niks3-server[953]: 2026/09/23 16:00:21 INFO Registered completed upload object_key=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y.narinfo worker1 # [ 51.870698] nix-grpc-daemon[901]: time=2026-09-23T16:00:21.490Z level=INFO msg="Upload complete. (255ms)" worker1 # [ 51.883774] nix-grpc-daemon[485]: ts=2026-09-23T16:00:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 51.896721] nix-grpc-daemon[485]: ts=2026-09-23T16:00:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 51.911670] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 51.924441] nix-daemon[849]: reaped child process 899, status = succeeded client # building '/nix/store/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv' on lb:50051... client # farm-a> node-a: building 3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv worker1 # [ 51.935579] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-sig worker1 # [ 52.564653] nix-daemon[849]: reaped child process 921, status = succeeded worker1 # [ 52.662367] nix-daemon[849]: accepted connection from pid 937, user nix-grpc-daemon (trusted) worker1 # [ 52.678337] nix-daemon[849]: reaped child process 940, status = succeeded lb # [ 52.605062] niks3-server[953]: 2026/09/23 16:00:22 INFO Received push request method=POST path=/api/pushes worker1 # [ 52.698557] nix-grpc-daemon[901]: time=2026-09-23T16:00:22.316Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.700575] nix-grpc-daemon[901]: time=2026-09-23T16:00:22.316Z level=INFO msg="Uploading 2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a (128B)" lb # [ 52.647580] niks3-server[953]: 2026/09/23 16:00:22 INFO Registered completed upload object_key=log/3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv worker1 # [ 52.744752] nix-grpc-daemon[901]: time=2026-09-23T16:00:22.364Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.664631] niks3-server[953]: 2026/09/23 16:00:22 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign lb # [ 52.675465] niks3-server[953]: 2026/09/23 16:00:22 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 52.689645] niks3-server[953]: 2026/09/23 16:00:22 INFO Signed narinfos id=10 count=1 worker1 # [ 52.774515] nix-grpc-daemon[901]: time=2026-09-23T16:00:22.394Z level=INFO msg="Upload complete. (228ms)" lb # [ 52.695862] niks3-server[953]: 2026/09/23 16:00:22 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.ls lb # [ 52.701149] niks3-server[953]: 2026/09/23 16:00:22 INFO Received complete push request method=POST path=/api/pushes/10/complete lb # [ 52.707894] niks3-server[953]: 2026/09/23 16:00:22 INFO Registered completed upload object_key=2ykckkv44ccpw95ad66fm21ggp6krwj9.narinfo worker1 # [ 52.790529] nix-grpc-daemon[485]: ts=2026-09-23T16:00:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 drv=3m2hhq3bz9jazpcvgg4g03aa5wnlj12y-farm-a.drv assign_id=5 outputs=1 worker1 # [ 52.805269] nix-grpc-daemon[485]: ts=2026-09-23T16:00:22Z level=debug event=want client=4 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv cached=0 worker1 # [ 52.813825] nix-grpc-daemon[485]: ts=2026-09-23T16:00:22Z level=debug event=assigned drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 52.819456] nix-grpc-daemon[485]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 52.824932] nix-daemon[849]: reaped child process 919, status = succeeded worker1 # [ 52.828245] nix-grpc-daemon[485]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 52.840467] nix-grpc-daemon[901]: time=2026-09-23T16:00:22.460Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 52.849637] nix-grpc-daemon[485]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 client # copying path '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' to 'lb:50051'... worker1 # [ 52.862891] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 53.007388] nix-daemon[849]: accepted connection from pid 946, user nix-grpc-daemon (trusted) worker1 # [ 53.026531] nix-daemon[849]: reaped child process 949, status = succeeded lb # [ 52.949820] niks3-server[953]: 2026/09/23 16:00:22 INFO Received push request method=POST path=/api/pushes worker1 # [ 53.039929] nix-grpc-daemon[901]: time=2026-09-23T16:00:22.659Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 53.041725] nix-grpc-daemon[901]: time=2026-09-23T16:00:22.659Z level=INFO msg="Uploading z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv (624B)" lb # [ 52.978841] niks3-server[953]: 2026/09/23 16:00:22 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign worker1 # [ 53.069038] nix-grpc-daemon[901]: time=2026-09-23T16:00:22.688Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.993788] niks3-server[953]: 2026/09/23 16:00:22 INFO Signed narinfos id=11 count=1 lb # [ 53.001489] niks3-server[953]: 2026/09/23 16:00:22 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.ls lb # [ 53.017000] niks3-server[953]: 2026/09/23 16:00:22 INFO Registered completed upload object_key=nar/0cnhkgsbmxv5hj7zw3fa59qfxikw6251mlhz2gz1v6pgn8c8shwp.nar.zst worker1 # [ 53.109616] nix-grpc-daemon[901]: time=2026-09-23T16:00:22.729Z level=INFO msg="Upload complete. (233ms)" lb # [ 53.028162] niks3-server[953]: 2026/09/23 16:00:22 INFO Received complete push request method=POST path=/api/pushes/11/complete lb # [ 53.032056] niks3-server[953]: 2026/09/23 16:00:22 INFO Registered completed upload object_key=z8kadp39h0myij9ln0hpxb61ldn71h4i.narinfo worker1 # [ 53.121192] nix-grpc-daemon[485]: ts=2026-09-23T16:00:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 53.132360] nix-grpc-daemon[485]: ts=2026-09-23T16:00:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 53.140186] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 53.145365] nix-daemon[849]: reaped child process 944, status = succeeded client # building '/nix/store/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv' on lb:50051... worker1 # [ 53.157054] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) client # farm-b> node-a: building z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-sig worker1 # [ 53.810444] nix-daemon[849]: reaped child process 953, status = succeeded worker1 # [ 53.927855] nix-daemon[849]: accepted connection from pid 969, user nix-grpc-daemon (trusted) worker1 # [ 53.947348] nix-daemon[849]: reaped child process 972, status = succeeded lb # [ 53.870099] niks3-server[953]: 2026/09/23 16:00:23 INFO Received push request method=POST path=/api/pushes worker1 # [ 53.963451] nix-grpc-daemon[901]: time=2026-09-23T16:00:23.582Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 53.965598] nix-grpc-daemon[901]: time=2026-09-23T16:00:23.582Z level=INFO msg="Uploading h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b (176B)" lb # [ 53.916993] niks3-server[953]: 2026/09/23 16:00:23 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign worker1 # [ 54.006074] nix-grpc-daemon[901]: time=2026-09-23T16:00:23.625Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.926174] niks3-server[953]: 2026/09/23 16:00:23 INFO Registered completed upload object_key=log/z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv lb # [ 53.933992] niks3-server[953]: 2026/09/23 16:00:23 INFO Signed narinfos id=12 count=1 lb # [ 53.939206] niks3-server[953]: 2026/09/23 16:00:23 INFO Registered completed upload object_key=nar/0f75gpfkjj0g9xi2113yvvpdw0l16spc2f1xik1ifnzfbrvx4pfk.nar.zst lb # [ 53.949170] niks3-server[953]: 2026/09/23 16:00:23 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.ls lb # [ 53.954561] niks3-server[953]: 2026/09/23 16:00:23 INFO Received complete push request method=POST path=/api/pushes/12/complete worker1 # [ 54.034929] nix-grpc-daemon[901]: time=2026-09-23T16:00:23.654Z level=INFO msg="Upload complete. (265ms)" lb # [ 53.957920] niks3-server[953]: 2026/09/23 16:00:23 INFO Registered completed upload object_key=h1r17djqpb9gp4y7v8nzx65ns9vdr50c.narinfo worker1 # [ 54.053558] nix-grpc-daemon[485]: ts=2026-09-23T16:00:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 drv=z8kadp39h0myij9ln0hpxb61ldn71h4i-farm-b.drv assign_id=6 outputs=1 worker1 # [ 54.068364] nix-grpc-daemon[485]: ts=2026-09-23T16:00:23Z level=debug event=want client=4 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv cached=0 worker1 # [ 54.071696] nix-grpc-daemon[485]: ts=2026-09-23T16:00:23Z level=debug event=assigned drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 54.078097] nix-grpc-daemon[485]: ts=2026-09-23T16:00:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 54.082695] nix-daemon[849]: reaped child process 951, status = succeeded worker1 # [ 54.086049] nix-grpc-daemon[485]: ts=2026-09-23T16:00:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 54.096659] nix-grpc-daemon[901]: time=2026-09-23T16:00:23.716Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' to 'lb:50051'... worker1 # [ 54.106805] nix-grpc-daemon[485]: ts=2026-09-23T16:00:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 54.120182] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 54.258897] nix-daemon[849]: accepted connection from pid 978, user nix-grpc-daemon (trusted) worker1 # [ 54.280244] nix-daemon[849]: reaped child process 981, status = succeeded lb # [ 54.196509] niks3-server[953]: 2026/09/23 16:00:23 INFO Received push request method=POST path=/api/pushes worker1 # [ 54.286570] nix-grpc-daemon[901]: time=2026-09-23T16:00:23.906Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 54.288393] nix-grpc-daemon[901]: time=2026-09-23T16:00:23.906Z level=INFO msg="Uploading knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv (752B)" lb # [ 54.229252] niks3-server[953]: 2026/09/23 16:00:23 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign worker1 # [ 54.318850] nix-grpc-daemon[901]: time=2026-09-23T16:00:23.938Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.242264] niks3-server[953]: 2026/09/23 16:00:23 INFO Registered completed upload object_key=nar/0lpagyrngav67x80d1hq0njjlkmqdkvqawraz8dsp36ag50v6iwf.nar.zst worker1 # [ 54.345549] nix-grpc-daemon[901]: time=2026-09-23T16:00:23.965Z level=INFO msg="Upload complete. (214ms)" lb # [ 54.257725] niks3-server[953]: 2026/09/23 16:00:23 INFO Signed narinfos id=13 count=1 lb # [ 54.269780] niks3-server[953]: 2026/09/23 16:00:23 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.ls worker1 # [ 54.352270] nix-grpc-daemon[485]: ts=2026-09-23T16:00:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 54.274823] niks3-server[953]: 2026/09/23 16:00:23 INFO Received complete push request method=POST path=/api/pushes/13/complete worker1 # [ 54.364786] nix-grpc-daemon[485]: ts=2026-09-23T16:00:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 lb # [ 54.286707] niks3-server[953]: 2026/09/23 16:00:23 INFO Registered completed upload object_key=knvx2sz45j0sdqm3fnbdrv7m887k7a6x.narinfo worker1 # [ 54.372366] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 54.377501] nix-daemon[849]: reaped child process 976, status = succeeded client # building '/nix/store/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv' on lb:50051... client # farm-top> node-a: building knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv worker1 # [ 54.391392] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-sig worker1 # [ 55.289031] nix-daemon[849]: reaped child process 985, status = succeeded worker1 # [ 55.372619] nix-daemon[849]: accepted connection from pid 1001, user nix-grpc-daemon (trusted) worker1 # [ 55.394027] nix-daemon[849]: reaped child process 1004, status = succeeded lb # [ 55.317191] niks3-server[953]: 2026/09/23 16:00:24 INFO Received push request method=POST path=/api/pushes worker1 # [ 55.409584] nix-grpc-daemon[901]: time=2026-09-23T16:00:25.028Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 55.411252] nix-grpc-daemon[901]: time=2026-09-23T16:00:25.028Z level=INFO msg="Uploading 4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top (232B)" lb # [ 55.358541] niks3-server[953]: 2026/09/23 16:00:24 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign worker1 # [ 55.449007] nix-grpc-daemon[901]: time=2026-09-23T16:00:25.068Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.372069] niks3-server[953]: 2026/09/23 16:00:24 INFO Signed narinfos id=14 count=1 lb # [ 55.374887] niks3-server[953]: 2026/09/23 16:00:24 INFO Registered completed upload object_key=log/knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv lb # [ 55.389099] niks3-server[953]: 2026/09/23 16:00:25 INFO Registered completed upload object_key=nar/07ar364rwqqniwi2nkdpqlgv7ws7702n5lqz703ackfmssrh40v8.nar.zst lb # [ 55.400954] niks3-server[953]: 2026/09/23 16:00:25 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.ls lb # [ 55.403844] niks3-server[953]: 2026/09/23 16:00:25 INFO Received complete push request method=POST path=/api/pushes/14/complete worker1 # [ 55.491186] nix-grpc-daemon[901]: time=2026-09-23T16:00:25.111Z level=INFO msg="Upload complete. (289ms)" lb # [ 55.410522] niks3-server[953]: 2026/09/23 16:00:25 INFO Registered completed upload object_key=4s2wbz2hg55lpb7s5vn3ynd342bs09lw.narinfo worker1 # [ 55.505170] nix-grpc-daemon[485]: ts=2026-09-23T16:00:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=1 drv=knvx2sz45j0sdqm3fnbdrv7m887k7a6x-farm-top.drv assign_id=7 outputs=1 worker1 # [ 55.523715] nix-daemon[849]: reaped child process 983, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig >&2, in 4.47 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag sig outPath, in 0.18 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top worker1 # [ 55.856994] nix-grpc-daemon[485]: ts=2026-09-23T16:00:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:48342 worker1 # [ 55.865350] nix-grpc-daemon[485]: ts=2026-09-23T16:00:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:48342 client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker1:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.15 seconds) client: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top worker2 # [ 55.919210] nix-grpc-daemon[785]: ts=2026-09-23T16:00:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:37144 client # these 3 paths will be fetched (0.0 KiB download, 0.5 KiB unpacked): client # /nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a client # /nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b client # /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top worker2 # [ 55.949941] nix-grpc-daemon[785]: ts=2026-09-23T16:00:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:37144 worker2 # [ 55.958975] nix-grpc-daemon[785]: copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'http://lb:5751'... worker2 # [ 55.981052] nix-grpc-daemon[785]: copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'http://lb:5751'... worker2 # [ 55.995339] nix-grpc-daemon[785]: copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix path-info --sigs --store 'grpc://worker2:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&ca-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ca.pem' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.25 seconds) client: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top client # finding garbage collector roots... client # removing stale temporary roots file "/nix/var/nix/temproots/927" client # removing stale temporary roots file "/nix/var/nix/temproots/898" client # removing stale temporary roots file "/nix/var/nix/temproots/886" client # removing stale temporary roots file "/nix/var/nix/temproots/848" client # removing stale temporary roots file "/nix/var/nix/temproots/942" client # removing stale temporary roots file "/nix/var/nix/temproots/865" client # removing stale temporary roots file "/nix/var/nix/temproots/919" client # removing stale temporary roots file "/nix/var/nix/temproots/906" client # deleting specified paths... client # deleting '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' client # deleting unused links... client # note: hard linking is currently saving 0.0 KiB worker2 # [ 56.370107] nix-grpc-daemon[785]: ts=2026-09-23T16:00:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 56.380079] nix-grpc-daemon[785]: ts=2026-09-23T16:00:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 56.387836] nix-grpc-daemon[854]: time=2026-09-23T16:00:26.009Z level=INFO msg="All 1 paths already cached" worker2 # [ 56.393884] nix-grpc-daemon[785]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56394 client # copying 3 paths... worker1 # [ 56.489622] nix-grpc-daemon[485]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 56.497184] nix-grpc-daemon[485]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59660 client # copying path '/nix/store/2ykckkv44ccpw95ad66fm21ggp6krwj9-farm-a' from 'grpc://lb:50051'... worker1 # [ 56.522422] nix-grpc-daemon[485]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 56.530293] nix-grpc-daemon[485]: ts=2026-09-23T16:00:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=1 nar_bytes_out=232 worker2 # [ 56.445841] nix-grpc-daemon[785]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 56.453792] nix-grpc-daemon[785]: ts=2026-09-23T16:00:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 56.551541] nix-grpc-daemon[485]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 56.558405] nix-grpc-daemon[485]: ts=2026-09-23T16:00:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=1 nar_bytes_out=128 client # copying path '/nix/store/h1r17djqpb9gp4y7v8nzx65ns9vdr50c-farm-b' from 'grpc://lb:50051'... client # copying path '/nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top' from 'grpc://lb:50051'... client: (finished: must succeed: nix-store --delete /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top && nix copy --from 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --option trusted-public-keys 'farm-test-1:RkClDwvfixdOwourBI4UD9hudE3xfU5EBQcMFUVuRV8=' /nix/store/4s2wbz2hg55lpb7s5vn3ynd342bs09lw-farm-top, in 0.47 seconds) (finished: subtest: outputs read back through any worker carry the cache signature, in 5.52 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup client # [ 56.553762] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: 2894a8ddfe8545e0bca386f107e6f8db client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 0.05 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup worker1 # [ 56.813290] nix-grpc-daemon[485]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59660 client # [ 56.734506] nix[995]: don't know how to build these paths: client # [ 56.736056] nix[995]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 56.833230] nix-grpc-daemon[485]: ts=2026-09-23T16:00:26Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker1 # [ 56.839415] nix-grpc-daemon[485]: ts=2026-09-23T16:00:26Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 56.753106] nix-grpc-daemon[785]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 56.769722] nix-grpc-daemon[785]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 client # [ 56.788102] nix[995]: copying 1 paths to 'lb:50051'... client # [ 56.789445] nix[995]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 56.785098] nix-grpc-daemon[785]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 56.801056] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 56.977830] nix-daemon[842]: accepted connection from pid 1005, user nix-grpc-daemon (trusted) worker2 # [ 56.997594] nix-daemon[842]: reaped child process 1008, status = succeeded lb # [ 57.014578] niks3-server[953]: 2026/09/23 16:00:26 INFO Received push request method=POST path=/api/pushes worker2 # [ 57.013973] nix-grpc-daemon[854]: time=2026-09-23T16:00:26.636Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 57.015988] nix-grpc-daemon[854]: time=2026-09-23T16:00:26.636Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 57.048547] niks3-server[953]: 2026/09/23 16:00:26 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls worker2 # [ 57.055164] nix-grpc-daemon[854]: time=2026-09-23T16:00:26.678Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.063164] niks3-server[953]: 2026/09/23 16:00:26 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign lb # [ 57.075067] niks3-server[953]: 2026/09/23 16:00:26 INFO Signed narinfos id=15 count=1 lb # [ 57.086119] niks3-server[953]: 2026/09/23 16:00:26 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst lb # [ 57.096504] niks3-server[953]: 2026/09/23 16:00:26 INFO Received complete push request method=POST path=/api/pushes/15/complete lb # [ 57.104142] niks3-server[953]: 2026/09/23 16:00:26 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 57.095174] nix-grpc-daemon[854]: time=2026-09-23T16:00:26.718Z level=INFO msg="Upload complete. (274ms)" worker2 # [ 57.109123] nix-grpc-daemon[785]: ts=2026-09-23T16:00:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 57.124764] nix-grpc-daemon[785]: ts=2026-09-23T16:00:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 57.133790] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 57.137838] nix-daemon[842]: reaped child process 1003, status = succeeded worker2 # [ 57.149307] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) client # [ 57.151860] nix[995]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client # [ 57.636943] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup. client # Running as unit: dedup2.service; invocation ID: 45a0a226402c4af4954d175656f6b2bd client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag dedup, in 1.10 seconds) client: must succeed: sleep 2 worker2 # [ 57.880934] nix-grpc-daemon[785]: ts=2026-09-23T16:00:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56394 client # [ 57.893407] nix[1011]: this derivation will be built: worker2 # [ 57.891991] nix-grpc-daemon[785]: ts=2026-09-23T16:00:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56394 client # [ 57.900073] nix[1011]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 57.909899] nix-grpc-daemon[785]: ts=2026-09-23T16:00:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker1 # [ 57.996304] nix-grpc-daemon[485]: ts=2026-09-23T16:00:27Z level=debug event=want client=6 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 client # [ 57.916983] nix[1011]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... lb # [ 58.081246] envoy[897]: conn peer=[2001:db8:1::1]:53558 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4185 tx=1920 ms=2246 lb # [ 58.086189] envoy[897]: conn peer=[2001:db8:1::1]:39240 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9498 tx=4352 ms=4211 lb # [ 58.091354] envoy[897]: conn peer=[2001:db8:1::1]:39254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2891 ms=129 lb # [ 58.098410] envoy[897]: conn peer=[2001:db8:1::1]:39276 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=329 ms=41 lb # [ 58.103198] envoy[897]: conn peer=[2001:db8:1::1]:39258 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=384 tx=410 ms=68 lb # [ 58.107921] envoy[897]: conn peer=[2001:db8:1::1]:39262 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=375 ms=56 client: (finished: must succeed: sleep 2, in 2.07 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 60.236656] nix-daemon[842]: reaped child process 1012, status = succeeded worker2 # [ 60.338196] nix-daemon[842]: accepted connection from pid 1038, user nix-grpc-daemon (trusted) worker2 # [ 60.358577] nix-daemon[842]: reaped child process 1041, status = succeeded lb # [ 60.366301] niks3-server[953]: 2026/09/23 16:00:29 INFO Received push request method=POST path=/api/pushes worker2 # [ 60.368477] nix-grpc-daemon[854]: time=2026-09-23T16:00:29.990Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 60.369940] nix-grpc-daemon[854]: time=2026-09-23T16:00:29.990Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 60.406289] niks3-server[953]: 2026/09/23 16:00:30 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 60.430196] niks3-server[953]: 2026/09/23 16:00:30 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign worker2 # [ 60.427227] nix-grpc-daemon[854]: time=2026-09-23T16:00:30.050Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.438353] niks3-server[953]: 2026/09/23 16:00:30 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst lb # [ 60.451168] niks3-server[953]: 2026/09/23 16:00:30 INFO Signed narinfos id=16 count=1 lb # [ 60.456824] niks3-server[953]: 2026/09/23 16:00:30 INFO Received complete push request method=POST path=/api/pushes/16/complete lb # [ 60.459351] niks3-server[953]: 2026/09/23 16:00:30 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls worker2 # [ 60.455124] nix-grpc-daemon[854]: time=2026-09-23T16:00:30.078Z level=INFO msg="Upload complete. (288ms)" lb # [ 60.466373] niks3-server[953]: 2026/09/23 16:00:30 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 60.469203] nix-grpc-daemon[785]: ts=2026-09-23T16:00:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 60.488312] nix-grpc-daemon[785]: ts=2026-09-23T16:00:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=2 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=8 outputs=1 worker2 # [ 60.495488] nix-daemon[842]: reaped child process 1010, status = succeeded client # [ 60.529338] systemd[1]: dedup1.service: Deactivated successfully. client # [ 60.532897] systemd[1]: dedup1.service: Consumed 162ms CPU time over 3.978s wall clock time, 41.5M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic. client # [ 60.541567] systemd[1]: dedup2.service: Deactivated successfully. client # [ 60.546074] systemd[1]: dedup2.service: Consumed 211ms CPU time over 2.904s wall clock time, 33.2M memory peak, 6.5K incoming IP traffic, 5.8K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.13 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: two clients wanting the same drv build it once, in 4.96 seconds) subtest: --timeout and --max-silent-time reach the builder worker2 # [ 61.692675] nix-grpc-daemon[785]: ts=2026-09-23T16:00:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56394 worker1 # [ 61.801442] nix-grpc-daemon[485]: ts=2026-09-23T16:00:31Z level=debug event=want client=7 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv cached=0 worker1 # [ 61.810959] nix-grpc-daemon[485]: ts=2026-09-23T16:00:31Z level=debug event=assigned drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 61.811225] nix-grpc-daemon[485]: ts=2026-09-23T16:00:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 61.817198] nix-grpc-daemon[485]: ts=2026-09-23T16:00:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 61.843589] nix-grpc-daemon[485]: ts=2026-09-23T16:00:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 61.858881] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 62.014883] nix-daemon[849]: accepted connection from pid 1031, user nix-grpc-daemon (trusted) worker1 # [ 62.037032] nix-daemon[849]: reaped child process 1034, status = succeeded lb # [ 61.961095] niks3-server[953]: 2026/09/23 16:00:31 INFO Received push request method=POST path=/api/pushes worker1 # [ 62.051652] nix-grpc-daemon[901]: time=2026-09-23T16:00:31.670Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 62.053663] nix-grpc-daemon[901]: time=2026-09-23T16:00:31.670Z level=INFO msg="Uploading sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv (424B)" lb # [ 61.992822] niks3-server[953]: 2026/09/23 16:00:31 INFO Registered completed upload object_key=nar/1m12xmj6yzmb9y2j8ly0yvh5fyzy1nqk7ajhqwr4wn3b5h0bsch5.nar.zst worker1 # [ 62.085332] nix-grpc-daemon[901]: time=2026-09-23T16:00:31.705Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.009331] niks3-server[953]: 2026/09/23 16:00:31 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign lb # [ 62.018536] niks3-server[953]: 2026/09/23 16:00:31 INFO Signed narinfos id=17 count=1 lb # [ 62.023769] niks3-server[953]: 2026/09/23 16:00:31 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.ls lb # [ 62.034676] niks3-server[953]: 2026/09/23 16:00:31 INFO Received complete push request method=POST path=/api/pushes/17/complete lb # [ 62.038749] niks3-server[953]: 2026/09/23 16:00:31 INFO Registered completed upload object_key=sfkglm39i7dsf4k91pn9ij8xz5mkgirx.narinfo worker1 # [ 62.124377] nix-grpc-daemon[901]: time=2026-09-23T16:00:31.744Z level=INFO msg="Upload complete. (249ms)" worker1 # [ 62.136300] nix-grpc-daemon[485]: ts=2026-09-23T16:00:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 62.152784] nix-grpc-daemon[485]: ts=2026-09-23T16:00:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 62.159640] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 62.171192] nix-daemon[849]: reaped child process 1029, status = succeeded worker1 # [ 62.177794] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) lb # [ 68.080499] envoy[897]: conn peer=[2001:db8:1::1]:39300 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1579 tx=1597 ms=2603 lb # [ 68.080862] envoy[897]: conn peer=[2001:db8:1::1]:39284 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3005 tx=1541 ms=3761 worker1 # [ 68.196174] nix-grpc-daemon[485]: ts=2026-09-23T16:00:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=6 drv=sfkglm39i7dsf4k91pn9ij8xz5mkgirx-slow-tmot.drv assign_id=9 outputs=0 worker1 # [ 68.220158] nix-daemon[849]: reaped child process 1036, status = succeeded worker1 # [ 68.221726] nix-daemon[849]: reaped child process 1038, status = succeeded worker2 # [ 68.341123] nix-grpc-daemon[785]: ts=2026-09-23T16:00:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56394 worker1 # [ 68.440143] nix-grpc-daemon[485]: ts=2026-09-23T16:00:38Z level=debug event=want client=8 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv cached=0 worker1 # [ 68.446930] nix-grpc-daemon[485]: ts=2026-09-23T16:00:38Z level=debug event=assigned drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 68.359486] nix-grpc-daemon[785]: ts=2026-09-23T16:00:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 68.373883] nix-grpc-daemon[785]: ts=2026-09-23T16:00:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 68.388515] nix-grpc-daemon[785]: ts=2026-09-23T16:00:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 68.403685] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 68.565142] nix-daemon[842]: accepted connection from pid 1054, user nix-grpc-daemon (trusted) worker2 # [ 68.585239] nix-daemon[842]: reaped child process 1057, status = succeeded lb # [ 68.602584] niks3-server[953]: 2026/09/23 16:00:38 INFO Received push request method=POST path=/api/pushes worker2 # [ 68.603040] nix-grpc-daemon[854]: time=2026-09-23T16:00:38.226Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 68.604788] nix-grpc-daemon[854]: time=2026-09-23T16:00:38.226Z level=INFO msg="Uploading pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv (424B)" lb # [ 68.640263] niks3-server[953]: 2026/09/23 16:00:38 INFO Registered completed upload object_key=nar/14f5yrnllfav3svmw4v4svw15r4zlf5yv1p972jy14mmq6gdw943.nar.zst worker2 # [ 68.644801] nix-grpc-daemon[854]: time=2026-09-23T16:00:38.268Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.657513] niks3-server[953]: 2026/09/23 16:00:38 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign lb # [ 68.666906] niks3-server[953]: 2026/09/23 16:00:38 INFO Signed narinfos id=18 count=1 lb # [ 68.680540] niks3-server[953]: 2026/09/23 16:00:38 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.ls worker2 # [ 68.681137] nix-grpc-daemon[854]: time=2026-09-23T16:00:38.304Z level=INFO msg="Upload complete. (259ms)" lb # [ 68.690387] niks3-server[953]: 2026/09/23 16:00:38 INFO Received complete push request method=POST path=/api/pushes/18/complete lb # [ 68.698748] niks3-server[953]: 2026/09/23 16:00:38 INFO Registered completed upload object_key=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s.narinfo worker2 # [ 68.691212] nix-grpc-daemon[785]: ts=2026-09-23T16:00:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 68.708727] nix-grpc-daemon[785]: ts=2026-09-23T16:00:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 68.716519] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 68.722064] nix-daemon[842]: reaped child process 1052, status = succeeded worker2 # [ 68.733434] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 74.550781] nix-grpc-daemon[785]: ts=2026-09-23T16:00:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=5 drv=pqqkii3gblyblsbkdbaa4hlzm7wlfq9s-slow-tmom.drv assign_id=10 outputs=0 worker2 # [ 74.578541] nix-daemon[842]: reaped child process 1059, status = succeeded worker2 # [ 74.580728] nix-daemon[842]: reaped child process 1061, status = succeeded (finished: subtest: --timeout and --max-silent-time reach the builder, in 13.27 seconds) subtest: the first client leaving does not fail the second client: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share client # [ 74.805140] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share. client # Running as unit: share1.service; invocation ID: 7671abb398144c5aa89e8f72df244e20 client: (finished: must succeed: systemd-run --unit share1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 0.09 seconds) client: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share worker1 # [ 75.099524] nix-grpc-daemon[485]: ts=2026-09-23T16:00:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59660 client # [ 75.021778] nix[1084]: don't know how to build these paths: client # [ 75.022978] nix[1084]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker1 # [ 75.119762] nix-grpc-daemon[485]: ts=2026-09-23T16:00:44Z level=debug event=want client=9 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=0 worker1 # [ 75.129435] nix-grpc-daemon[485]: ts=2026-09-23T16:00:44Z level=debug event=assigned drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 75.138930] nix-grpc-daemon[485]: ts=2026-09-23T16:00:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 75.146492] nix-grpc-daemon[485]: ts=2026-09-23T16:00:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59660 client # [ 75.068618] nix[1084]: copying 1 paths to 'lb:50051'... client # [ 75.071931] nix[1084]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' to 'lb:50051'... worker1 # [ 75.159214] nix-grpc-daemon[485]: ts=2026-09-23T16:00:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 75.174577] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 75.330553] nix-daemon[849]: accepted connection from pid 1065, user nix-grpc-daemon (trusted) worker1 # [ 75.351179] nix-daemon[849]: reaped child process 1068, status = succeeded lb # [ 75.275115] niks3-server[953]: 2026/09/23 16:00:44 INFO Received push request method=POST path=/api/pushes worker1 # [ 75.366453] nix-grpc-daemon[901]: time=2026-09-23T16:00:44.985Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 75.368561] nix-grpc-daemon[901]: time=2026-09-23T16:00:44.985Z level=INFO msg="Uploading rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv (432B)" lb # [ 75.310650] niks3-server[953]: 2026/09/23 16:00:44 INFO Registered completed upload object_key=nar/0chdjpc9an2ckdblh08lnyrmzvw3h8qs76cn5ydwjwvgwkrm731l.nar.zst worker1 # [ 75.404871] nix-grpc-daemon[901]: time=2026-09-23T16:00:45.024Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.325220] niks3-server[953]: 2026/09/23 16:00:44 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign lb # [ 75.334607] niks3-server[953]: 2026/09/23 16:00:44 INFO Signed narinfos id=19 count=1 lb # [ 75.340326] niks3-server[953]: 2026/09/23 16:00:44 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.ls lb # [ 75.352765] niks3-server[953]: 2026/09/23 16:00:44 INFO Received complete push request method=POST path=/api/pushes/19/complete lb # [ 75.359871] niks3-server[953]: 2026/09/23 16:00:44 INFO Registered completed upload object_key=rxafkggp1xca5h7p0r6gwpq3qqp2kn63.narinfo worker1 # [ 75.441027] nix-grpc-daemon[901]: time=2026-09-23T16:00:45.060Z level=INFO msg="Upload complete. (251ms)" worker1 # [ 75.451296] nix-grpc-daemon[485]: ts=2026-09-23T16:00:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=1 nar_bytes_in=432 worker1 # [ 75.468674] nix-grpc-daemon[485]: ts=2026-09-23T16:00:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 75.477550] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 75.483276] nix-daemon[849]: reaped child process 1063, status = succeeded worker1 # [ 75.496560] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) client # [ 75.409376] nix[1084]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051... client # [ 75.918245] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share. client # Running as unit: share2.service; invocation ID: 1a7d02e87daa4edbbd11c65f48557166 client: (finished: must succeed: sleep 1; systemd-run --unit share2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag share, in 1.12 seconds) worker1 # [ 76.226750] nix-grpc-daemon[485]: ts=2026-09-23T16:00:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59660 client # [ 76.149393] nix[1100]: this derivation will be built: worker2 # [ 76.150601] nix-grpc-daemon[785]: ts=2026-09-23T16:00:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 76.164639] nix-grpc-daemon[785]: copying path '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' from 'http://lb:5751'... client # [ 76.186731] nix[1100]: /nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker1 # [ 76.284447] nix-grpc-daemon[485]: ts=2026-09-23T16:00:45Z level=debug event=want client=10 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv cached=0 worker1 # [ 76.287678] nix-grpc-daemon[485]: ts=2026-09-23T16:00:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 client # [ 76.205218] nix[1100]: building '/nix/store/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv' on lb:50051... client: must succeed: sleep 2; systemctl kill -s INT share1 lb # [ 78.085262] envoy[897]: conn peer=[2001:db8:1::1]:40074 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3001 tx=952 ms=6435 lb # [ 78.085651] envoy[897]: conn peer=[2001:db8:1::1]:40090 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2989 tx=977 ms=6235 client # [ 79.281394] systemd[1]: share1.service: Sent signal SIGINT to main process 1084 (nix) on client request. client # [ 79.290907] nix[1084]: shutting downrxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 79.303962] nix[1084]: error: interrupted by the user client: (finished: must succeed: sleep 2; systemctl kill -s INT share1, in 2.09 seconds) client: waiting for success: ! systemctl is-active share1 client # [ 79.360930] systemd[1]: share1.service: Main process exited, code=exited, status=1/FAILURE client # [ 79.364630] systemd[1]: share1.service: Failed with result 'exit-code'. client # [ 79.366269] systemd[1]: share1.service: Consumed 176ms CPU time over 4.558s wall clock time, 43.5M memory peak, 6.2K incoming IP traffic, 8.2K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share1, in 1.11 seconds) worker1 # [ 80.729899] nix-daemon[849]: reaped child process 1072, status = succeeded client: waiting for success: ! systemctl is-active share2 worker1 # [ 80.821146] nix-daemon[849]: accepted connection from pid 1108, user nix-grpc-daemon (trusted) worker1 # [ 80.841842] nix-daemon[849]: reaped child process 1111, status = succeeded lb # [ 80.765987] niks3-server[953]: 2026/09/23 16:00:50 INFO Received push request method=POST path=/api/pushes worker1 # [ 80.860382] nix-grpc-daemon[901]: time=2026-09-23T16:00:50.477Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 80.861910] nix-grpc-daemon[901]: time=2026-09-23T16:00:50.477Z level=INFO msg="Uploading fjww0fd4rwk1s35jav3cyal62l24n356-slow-share (120B)" lb # [ 80.816596] niks3-server[953]: 2026/09/23 16:00:50 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.ls worker1 # [ 80.906874] nix-grpc-daemon[901]: time=2026-09-23T16:00:50.526Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.826476] niks3-server[953]: 2026/09/23 16:00:50 INFO Registered completed upload object_key=nar/172qq270pqbv9ipsik19pmld0m7fj8r5nyyxq3slfx9n7zcaa9s0.nar.zst lb # [ 80.835861] niks3-server[953]: 2026/09/23 16:00:50 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign lb # [ 80.845313] niks3-server[953]: 2026/09/23 16:00:50 INFO Signed narinfos id=20 count=1 lb # [ 80.847162] niks3-server[953]: 2026/09/23 16:00:50 INFO Registered completed upload object_key=log/rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv worker1 # [ 80.935663] nix-grpc-daemon[901]: time=2026-09-23T16:00:50.555Z level=INFO msg="Upload complete. (223ms)" lb # [ 80.854671] niks3-server[953]: 2026/09/23 16:00:50 INFO Received complete push request method=POST path=/api/pushes/20/complete lb # [ 80.858646] niks3-server[953]: 2026/09/23 16:00:50 INFO Registered completed upload object_key=fjww0fd4rwk1s35jav3cyal62l24n356.narinfo worker1 # [ 80.948865] nix-grpc-daemon[485]: ts=2026-09-23T16:00:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=5 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=1 worker1 # [ 80.965317] nix-grpc-daemon[485]: ts=2026-09-23T16:00:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=4 drv=rxafkggp1xca5h7p0r6gwpq3qqp2kn63-slow-share.drv assign_id=11 outputs=1 worker1 # [ 80.971344] nix-daemon[849]: reaped child process 1070, status = succeeded client # [ 80.903082] systemd[1]: share2.service: Deactivated successfully. client # [ 80.907449] systemd[1]: share2.service: Consumed 199ms CPU time over 4.989s wall clock time, 35.3M memory peak, 6.5K incoming IP traffic, 5.9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active share2, in 1.12 seconds) client: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; } client: (finished: must succeed: systemctl show -p Result share2 | grep -q success || { journalctl -u share2 >&2; false; }, in 0.05 seconds) (finished: subtest: the first client leaving does not fail the second, in 7.10 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 81.975386] systemd[1]: Started Nix Daemon. client # [ 82.092415] nix-daemon[1152]: accepted connection from pid 1149, user root (trusted) worker1 # [ 82.329596] nix-grpc-daemon[485]: ts=2026-09-23T16:00:51Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:59660 worker2 # [ 82.243852] nix-grpc-daemon[785]: ts=2026-09-23T16:00:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker1 # [ 82.345512] nix-grpc-daemon[485]: ts=2026-09-23T16:00:51Z level=debug event=want client=11 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker1 # [ 82.352172] nix-grpc-daemon[485]: ts=2026-09-23T16:00:51Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 82.264894] nix-grpc-daemon[785]: ts=2026-09-23T16:00:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 82.281077] nix-grpc-daemon[785]: ts=2026-09-23T16:00:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 82.296899] nix-grpc-daemon[785]: ts=2026-09-23T16:00:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 82.311409] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 82.475927] nix-daemon[842]: accepted connection from pid 1101, user nix-grpc-daemon (trusted) worker2 # [ 82.495918] nix-daemon[842]: reaped child process 1104, status = succeeded lb # [ 82.511704] niks3-server[953]: 2026/09/23 16:00:52 INFO Received push request method=POST path=/api/pushes worker2 # [ 82.513104] nix-grpc-daemon[854]: time=2026-09-23T16:00:52.136Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 82.515004] nix-grpc-daemon[854]: time=2026-09-23T16:00:52.136Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 82.540538] niks3-server[953]: 2026/09/23 16:00:52 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign worker2 # [ 82.539214] nix-grpc-daemon[854]: time=2026-09-23T16:00:52.162Z level=INFO msg="Uploading 1 narinfos" lb # [ 82.552226] niks3-server[953]: 2026/09/23 16:00:52 INFO Signed narinfos id=21 count=1 lb # [ 82.561552] niks3-server[953]: 2026/09/23 16:00:52 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 82.577752] niks3-server[953]: 2026/09/23 16:00:52 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 82.585574] niks3-server[953]: 2026/09/23 16:00:52 INFO Received complete push request method=POST path=/api/pushes/21/complete worker2 # [ 82.582898] nix-grpc-daemon[854]: time=2026-09-23T16:00:52.206Z level=INFO msg="Upload complete. (253ms)" lb # [ 82.591909] niks3-server[953]: 2026/09/23 16:00:52 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker2 # [ 82.592600] nix-grpc-daemon[785]: ts=2026-09-23T16:00:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 82.607334] nix-grpc-daemon[785]: ts=2026-09-23T16:00:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 82.613836] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 82.618605] nix-daemon[842]: reaped child process 1099, status = succeeded worker2 # [ 82.629334] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 84.268748] nix-daemon[842]: reaped child process 1108, status = succeeded worker2 # [ 84.400070] nix-daemon[842]: accepted connection from pid 1124, user nix-grpc-daemon (trusted) worker2 # [ 84.422436] nix-daemon[842]: reaped child process 1127, status = succeeded lb # [ 84.430261] niks3-server[953]: 2026/09/23 16:00:54 INFO Received push request method=POST path=/api/pushes worker2 # [ 84.432408] nix-grpc-daemon[854]: time=2026-09-23T16:00:54.055Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 84.433910] nix-grpc-daemon[854]: time=2026-09-23T16:00:54.055Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 84.482308] niks3-server[953]: 2026/09/23 16:00:54 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker2 # [ 84.485007] nix-grpc-daemon[854]: time=2026-09-23T16:00:54.108Z level=INFO msg="Uploading 1 narinfos" lb # [ 84.497207] niks3-server[953]: 2026/09/23 16:00:54 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign lb # [ 84.505339] niks3-server[953]: 2026/09/23 16:00:54 INFO Signed narinfos id=22 count=1 lb # [ 84.509692] niks3-server[953]: 2026/09/23 16:00:54 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 84.522822] niks3-server[953]: 2026/09/23 16:00:54 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 84.526333] niks3-server[953]: 2026/09/23 16:00:54 INFO Received complete push request method=POST path=/api/pushes/22/complete lb # [ 84.531454] niks3-server[953]: 2026/09/23 16:00:54 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker2 # [ 84.521695] nix-grpc-daemon[854]: time=2026-09-23T16:00:54.145Z level=INFO msg="Upload complete. (280ms)" worker2 # [ 84.538681] nix-grpc-daemon[785]: ts=2026-09-23T16:00:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=12 outputs=1 worker2 # [ 84.554828] nix-grpc-daemon[785]: ts=2026-09-23T16:00:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 84.558986] nix-daemon[842]: reaped child process 1106, status = succeeded worker2 # [ 84.579478] nix-grpc-daemon[785]: ts=2026-09-23T16:00:54Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 84.586778] nix-grpc-daemon[785]: ts=2026-09-23T16:00:54Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 84.935178] nix-grpc-daemon[485]: ts=2026-09-23T16:00:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:59660 worker2 # [ 84.849171] nix-grpc-daemon[785]: ts=2026-09-23T16:00:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 84.860465] nix-grpc-daemon[854]: time=2026-09-23T16:00:54.484Z level=INFO msg="All 1 paths already cached" worker1 # [ 84.971024] nix-grpc-daemon[485]: ts=2026-09-23T16:00:54Z level=debug event=want client=12 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker1 # [ 84.978260] nix-grpc-daemon[485]: ts=2026-09-23T16:00:54Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 84.891941] nix-grpc-daemon[785]: ts=2026-09-23T16:00:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 84.903998] nix-grpc-daemon[785]: ts=2026-09-23T16:00:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 84.917042] nix-grpc-daemon[854]: time=2026-09-23T16:00:54.540Z level=INFO msg="All 1 paths already cached" worker2 # [ 84.928136] nix-grpc-daemon[785]: ts=2026-09-23T16:00:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 84.942885] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 85.107194] nix-daemon[842]: accepted connection from pid 1131, user nix-grpc-daemon (trusted) worker2 # [ 85.131059] nix-daemon[842]: reaped child process 1134, status = succeeded lb # [ 85.145117] niks3-server[953]: 2026/09/23 16:00:54 INFO Received push request method=POST path=/api/pushes worker2 # [ 85.147573] nix-grpc-daemon[854]: time=2026-09-23T16:00:54.770Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 85.149294] nix-grpc-daemon[854]: time=2026-09-23T16:00:54.771Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 85.182254] niks3-server[953]: 2026/09/23 16:00:54 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker2 # [ 85.186887] nix-grpc-daemon[854]: time=2026-09-23T16:00:54.810Z level=INFO msg="Uploading 1 narinfos" lb # [ 85.198720] niks3-server[953]: 2026/09/23 16:00:54 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign lb # [ 85.207640] niks3-server[953]: 2026/09/23 16:00:54 INFO Signed narinfos id=23 count=1 lb # [ 85.213496] niks3-server[953]: 2026/09/23 16:00:54 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 85.227957] niks3-server[953]: 2026/09/23 16:00:54 INFO Received complete push request method=POST path=/api/pushes/23/complete lb # [ 85.240468] niks3-server[953]: 2026/09/23 16:00:54 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker2 # [ 85.237825] nix-grpc-daemon[854]: time=2026-09-23T16:00:54.861Z level=INFO msg="Upload complete. (277ms)" worker2 # [ 85.249620] nix-grpc-daemon[785]: ts=2026-09-23T16:00:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_in=624 worker2 # [ 85.268848] nix-grpc-daemon[785]: ts=2026-09-23T16:00:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 85.279936] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 85.287916] nix-daemon[842]: reaped child process 1129, status = succeeded worker2 # [ 85.302974] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 86.542230] nix-daemon[842]: reaped child process 1138, status = succeeded worker2 # [ 86.651061] nix-daemon[842]: accepted connection from pid 1154, user nix-grpc-daemon (trusted) worker2 # [ 86.670953] nix-daemon[842]: reaped child process 1157, status = succeeded lb # [ 86.681925] niks3-server[953]: 2026/09/23 16:00:56 INFO Received push request method=POST path=/api/pushes worker2 # [ 86.684610] nix-grpc-daemon[854]: time=2026-09-23T16:00:56.307Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 86.686078] nix-grpc-daemon[854]: time=2026-09-23T16:00:56.307Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 86.730387] niks3-server[953]: 2026/09/23 16:00:56 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign worker2 # [ 86.732480] nix-grpc-daemon[854]: time=2026-09-23T16:00:56.355Z level=INFO msg="Uploading 1 narinfos" lb # [ 86.744322] niks3-server[953]: 2026/09/23 16:00:56 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 86.755321] niks3-server[953]: 2026/09/23 16:00:56 INFO Signed narinfos id=24 count=1 lb # [ 86.765354] niks3-server[953]: 2026/09/23 16:00:56 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv lb # [ 86.770953] niks3-server[953]: 2026/09/23 16:00:56 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 86.774013] niks3-server[953]: 2026/09/23 16:00:56 INFO Received complete push request method=POST path=/api/pushes/24/complete lb # [ 86.777411] niks3-server[953]: 2026/09/23 16:00:56 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker2 # [ 86.768539] nix-grpc-daemon[854]: time=2026-09-23T16:00:56.392Z level=INFO msg="Upload complete. (251ms)" worker2 # [ 86.781205] nix-grpc-daemon[785]: ts=2026-09-23T16:00:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=13 outputs=1 worker2 # [ 86.802620] nix-grpc-daemon[785]: ts=2026-09-23T16:00:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 86.807361] nix-daemon[842]: reaped child process 1136, status = succeeded worker2 # [ 86.822146] nix-grpc-daemon[785]: ts=2026-09-23T16:00:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 86.828953] nix-grpc-daemon[785]: ts=2026-09-23T16:00:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 87.063108] nix-grpc-daemon[785]: ts=2026-09-23T16:00:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 87.071287] nix-grpc-daemon[785]: ts=2026-09-23T16:00:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 87.079643] nix-grpc-daemon[854]: time=2026-09-23T16:00:56.701Z level=INFO msg="All 2 paths already cached" worker1 # [ 87.185317] nix-grpc-daemon[485]: ts=2026-09-23T16:00:56Z level=debug event=want client=13 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker1 # [ 87.191694] nix-grpc-daemon[485]: ts=2026-09-23T16:00:56Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 87.104790] nix-grpc-daemon[785]: ts=2026-09-23T16:00:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 87.120263] nix-grpc-daemon[785]: ts=2026-09-23T16:00:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 87.134383] nix-grpc-daemon[854]: time=2026-09-23T16:00:56.758Z level=INFO msg="All 2 paths already cached" worker2 # [ 87.144615] nix-grpc-daemon[785]: ts=2026-09-23T16:00:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 87.158477] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 87.318364] nix-daemon[842]: accepted connection from pid 1161, user nix-grpc-daemon (trusted) worker2 # [ 87.339842] nix-daemon[842]: reaped child process 1164, status = succeeded lb # [ 87.351962] niks3-server[953]: 2026/09/23 16:00:56 INFO Received push request method=POST path=/api/pushes worker2 # [ 87.352776] nix-grpc-daemon[854]: time=2026-09-23T16:00:56.976Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 87.354791] nix-grpc-daemon[854]: time=2026-09-23T16:00:56.976Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 87.382558] niks3-server[953]: 2026/09/23 16:00:56 INFO Received sign narinfos request method=POST path=/api/pushes/25/sign worker2 # [ 87.382493] nix-grpc-daemon[854]: time=2026-09-23T16:00:57.006Z level=INFO msg="Uploading 1 narinfos" lb # [ 87.398040] niks3-server[953]: 2026/09/23 16:00:57 INFO Signed narinfos id=25 count=1 lb # [ 87.405483] niks3-server[953]: 2026/09/23 16:00:57 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst lb # [ 87.421107] niks3-server[953]: 2026/09/23 16:00:57 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls worker2 # [ 87.420409] nix-grpc-daemon[854]: time=2026-09-23T16:00:57.044Z level=INFO msg="Upload complete. (244ms)" lb # [ 87.429438] niks3-server[953]: 2026/09/23 16:00:57 INFO Received complete push request method=POST path=/api/pushes/25/complete lb # [ 87.434615] niks3-server[953]: 2026/09/23 16:00:57 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker2 # [ 87.432998] nix-grpc-daemon[785]: ts=2026-09-23T16:00:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_in=752 worker2 # [ 87.448554] nix-grpc-daemon[785]: ts=2026-09-23T16:00:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 87.455676] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 87.462161] nix-daemon[842]: reaped child process 1159, status = succeeded worker2 # [ 87.474744] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) lb # [ 88.086675] envoy[897]: conn peer=[2001:db8:1::1]:36386 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3003 tx=788 ms=4299 lb # [ 88.091706] envoy[897]: conn peer=[2001:db8:1::1]:36400 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1592 tx=1598 ms=4735 lb # [ 88.096810] envoy[897]: conn peer=[2001:db8:1::1]:42766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=42 lb # [ 88.102581] envoy[897]: conn peer=[2001:db8:1::1]:42754 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3445 tx=1940 ms=2375 lb # [ 88.108813] envoy[897]: conn peer=[2001:db8:1::1]:42782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3887 tx=2157 ms=2004 lb # [ 88.114507] envoy[897]: conn peer=[2001:db8:1::1]:42784 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=30 worker2 # [ 88.736892] nix-daemon[842]: reaped child process 1168, status = succeeded worker2 # [ 88.827158] nix-daemon[842]: accepted connection from pid 1184, user nix-grpc-daemon (trusted) worker2 # [ 88.846333] nix-daemon[842]: reaped child process 1187, status = succeeded lb # [ 88.861992] niks3-server[953]: 2026/09/23 16:00:58 INFO Received push request method=POST path=/api/pushes worker2 # [ 88.864402] nix-grpc-daemon[854]: time=2026-09-23T16:00:58.486Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 88.865936] nix-grpc-daemon[854]: time=2026-09-23T16:00:58.486Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" worker2 # [ 88.907485] nix-grpc-daemon[854]: time=2026-09-23T16:00:58.531Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.906679] niks3-server[953]: 2026/09/23 16:00:58 INFO Received sign narinfos request method=POST path=/api/pushes/26/sign lb # [ 88.920569] niks3-server[953]: 2026/09/23 16:00:58 INFO Signed narinfos id=26 count=1 lb # [ 88.931578] niks3-server[953]: 2026/09/23 16:00:58 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 88.941085] niks3-server[953]: 2026/09/23 16:00:58 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 88.956524] niks3-server[953]: 2026/09/23 16:00:58 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 88.965231] niks3-server[953]: 2026/09/23 16:00:58 INFO Received complete push request method=POST path=/api/pushes/26/complete worker2 # [ 88.956836] nix-grpc-daemon[854]: time=2026-09-23T16:00:58.580Z level=INFO msg="Upload complete. (267ms)" lb # [ 88.968719] niks3-server[953]: 2026/09/23 16:00:58 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker2 # [ 88.969297] nix-grpc-daemon[785]: ts=2026-09-23T16:00:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=14 outputs=1 worker1 # [ 89.063414] nix-grpc-daemon[485]: ts=2026-09-23T16:00:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59660 worker2 # [ 88.988890] nix-daemon[842]: reaped child process 1166, status = succeeded worker1 # [ 89.084207] nix-grpc-daemon[485]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker1 # [ 89.101190] nix-grpc-daemon[485]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker1 # [ 89.115829] nix-grpc-daemon[485]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker2 # [ 89.064299] nix-grpc-daemon[785]: ts=2026-09-23T16:00:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 89.071233] nix-grpc-daemon[785]: ts=2026-09-23T16:00:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_out=232 client # [ 89.160673] nix-daemon[1152]: reaped child process 1154, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.34 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.45 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag w1only, in 0.30 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.12 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.03 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 90.127009] nix-daemon[1152]: accepted connection from pid 1234, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 90.271697] nix-grpc-daemon[785]: ts=2026-09-23T16:00:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 90.279526] nix-grpc-daemon[785]: ts=2026-09-23T16:00:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker1 # [ 90.381829] nix-grpc-daemon[485]: ts=2026-09-23T16:01:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 90.397084] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 90.574449] nix-daemon[849]: accepted connection from pid 1129, user nix-grpc-daemon (trusted) worker1 # [ 90.593922] nix-daemon[849]: reaped child process 1132, status = succeeded lb # [ 90.523354] niks3-server[953]: 2026/09/23 16:01:00 INFO Received push request method=POST path=/api/pushes worker1 # [ 90.612561] nix-grpc-daemon[901]: time=2026-09-23T16:01:00.231Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 90.614246] nix-grpc-daemon[901]: time=2026-09-23T16:01:00.231Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 90.554978] niks3-server[953]: 2026/09/23 16:01:00 INFO Received sign narinfos request method=POST path=/api/pushes/27/sign worker1 # [ 90.646766] nix-grpc-daemon[901]: time=2026-09-23T16:01:00.265Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.569619] niks3-server[953]: 2026/09/23 16:01:00 INFO Signed narinfos id=27 count=1 lb # [ 90.576562] niks3-server[953]: 2026/09/23 16:01:00 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 90.587159] niks3-server[953]: 2026/09/23 16:01:00 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 90.600951] niks3-server[953]: 2026/09/23 16:01:00 INFO Received complete push request method=POST path=/api/pushes/27/complete worker1 # [ 90.687597] nix-grpc-daemon[901]: time=2026-09-23T16:01:00.307Z level=INFO msg="Upload complete. (275ms)" lb # [ 90.607757] niks3-server[953]: 2026/09/23 16:01:00 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker1 # [ 90.701204] nix-grpc-daemon[485]: ts=2026-09-23T16:01:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=1 nar_bytes_in=120 worker1 # [ 90.724384] nix-grpc-daemon[485]: ts=2026-09-23T16:01:00Z level=debug event=want client=14 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker1 # [ 90.729485] nix-grpc-daemon[485]: ts=2026-09-23T16:01:00Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 90.736657] nix-grpc-daemon[485]: ts=2026-09-23T16:01:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 90.742751] nix-daemon[849]: reaped child process 1127, status = succeeded worker1 # [ 90.746298] nix-grpc-daemon[485]: ts=2026-09-23T16:01:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59660 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker1 # [ 90.762911] nix-grpc-daemon[485]: ts=2026-09-23T16:01:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker1 # [ 90.776191] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 90.920438] nix-daemon[849]: accepted connection from pid 1138, user nix-grpc-daemon (trusted) worker1 # [ 90.943273] nix-daemon[849]: reaped child process 1141, status = succeeded lb # [ 90.860963] niks3-server[953]: 2026/09/23 16:01:00 INFO Received push request method=POST path=/api/pushes worker1 # [ 90.952184] nix-grpc-daemon[901]: time=2026-09-23T16:01:00.571Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker1 # [ 90.953681] nix-grpc-daemon[901]: time=2026-09-23T16:01:00.571Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker1 # [ 90.955449] nix-grpc-daemon[901]: time=2026-09-23T16:01:00.571Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 90.902878] niks3-server[953]: 2026/09/23 16:01:00 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 90.917875] niks3-server[953]: 2026/09/23 16:01:00 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst worker1 # [ 91.013077] nix-grpc-daemon[901]: time=2026-09-23T16:01:00.632Z level=INFO msg="Uploading 2 narinfos" lb # [ 90.931567] niks3-server[953]: 2026/09/23 16:01:00 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 90.939819] niks3-server[953]: 2026/09/23 16:01:00 INFO Received sign narinfos request method=POST path=/api/pushes/28/sign lb # [ 90.946396] niks3-server[953]: 2026/09/23 16:01:00 INFO Signed narinfos id=28 count=2 lb # [ 90.951126] niks3-server[953]: 2026/09/23 16:01:00 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 90.964809] niks3-server[953]: 2026/09/23 16:01:00 INFO Received complete push request method=POST path=/api/pushes/28/complete worker1 # [ 91.054120] nix-grpc-daemon[901]: time=2026-09-23T16:01:00.673Z level=INFO msg="Upload complete. (262ms)" lb # [ 90.973917] niks3-server[953]: 2026/09/23 16:01:00 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 90.980385] niks3-server[953]: 2026/09/23 16:01:00 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo worker1 # [ 91.064390] nix-grpc-daemon[485]: ts=2026-09-23T16:01:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=2 nar_bytes_in=984 worker1 # [ 91.084845] nix-grpc-daemon[485]: ts=2026-09-23T16:01:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 91.093358] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 91.100367] nix-daemon[849]: reaped child process 1136, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker1 # [ 91.114595] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> node-a: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 92.188612] nix-daemon[849]: reaped child process 1145, status = succeeded worker1 # [ 92.271861] nix-daemon[849]: accepted connection from pid 1161, user nix-grpc-daemon (trusted) worker1 # [ 92.288996] nix-daemon[849]: reaped child process 1164, status = succeeded lb # [ 92.214286] niks3-server[953]: 2026/09/23 16:01:01 INFO Received push request method=POST path=/api/pushes worker1 # [ 92.306640] nix-grpc-daemon[901]: time=2026-09-23T16:01:01.924Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 92.245024] niks3-server[953]: 2026/09/23 16:01:01 INFO Received sign narinfos request method=POST path=/api/pushes/29/sign worker1 # [ 92.335158] nix-grpc-daemon[901]: time=2026-09-23T16:01:01.954Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.257472] niks3-server[953]: 2026/09/23 16:01:01 INFO Signed narinfos id=29 count=1 lb # [ 92.268279] niks3-server[953]: 2026/09/23 16:01:01 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 92.280479] niks3-server[953]: 2026/09/23 16:01:01 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 92.292171] niks3-server[953]: 2026/09/23 16:01:01 INFO Received complete push request method=POST path=/api/pushes/29/complete worker1 # [ 92.377812] nix-grpc-daemon[901]: time=2026-09-23T16:01:01.997Z level=INFO msg="Upload complete. (251ms)" lb # [ 92.299316] niks3-server[953]: 2026/09/23 16:01:01 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo client # copying 1 paths... worker1 # [ 92.393172] nix-grpc-daemon[485]: ts=2026-09-23T16:01:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=15 outputs=1 worker1 # [ 92.411189] nix-grpc-daemon[485]: ts=2026-09-23T16:01:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 92.417033] nix-daemon[849]: reaped child process 1143, status = succeeded client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 92.354573] nix-grpc-daemon[785]: ts=2026-09-23T16:01:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 92.367671] nix-grpc-daemon[785]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... worker2 # [ 92.385377] nix-grpc-daemon[785]: ts=2026-09-23T16:01:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=0 paths=1 nar_bytes_out=120 client # [ 92.472940] nix-daemon[1152]: reaped child process 1237, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.54 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 92.642794] nix-daemon[1152]: accepted connection from pid 1256, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 92.875725] nix-grpc-daemon[485]: ts=2026-09-23T16:01:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:59660 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 92.789319] nix-grpc-daemon[785]: ts=2026-09-23T16:01:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker1 # [ 92.904878] nix-grpc-daemon[485]: ts=2026-09-23T16:01:02Z level=debug event=want client=15 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker1 # [ 92.911463] nix-grpc-daemon[485]: ts=2026-09-23T16:01:02Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 92.824739] nix-grpc-daemon[785]: ts=2026-09-23T16:01:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 92.839687] nix-grpc-daemon[785]: ts=2026-09-23T16:01:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker2 # [ 92.858816] nix-grpc-daemon[785]: ts=2026-09-23T16:01:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 92.874225] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 92.896954] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 1/5) worker2 # [ 92.961921] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 2/5) worker2 # [ 93.103995] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 3/5) worker2 # [ 93.261998] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 775 ms (attempt 4/5) worker2 # [ 94.040786] nix-grpc-daemon[785]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 94.045783] nix-grpc-daemon[785]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 94.055520] nix-grpc-daemon[785]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker2 # [ 94.238088] nix-daemon[842]: accepted connection from pid 1200, user nix-grpc-daemon (trusted) worker2 # [ 94.260328] nix-daemon[842]: reaped child process 1203, status = succeeded lb # [ 94.273448] niks3-server[953]: 2026/09/23 16:01:03 INFO Received push request method=POST path=/api/pushes worker2 # [ 94.276715] nix-grpc-daemon[854]: time=2026-09-23T16:01:03.899Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 94.278428] nix-grpc-daemon[854]: time=2026-09-23T16:01:03.899Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 94.306451] niks3-server[953]: 2026/09/23 16:01:03 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst worker2 # [ 94.309402] nix-grpc-daemon[854]: time=2026-09-23T16:01:03.932Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.318814] niks3-server[953]: 2026/09/23 16:01:03 INFO Received sign narinfos request method=POST path=/api/pushes/30/sign lb # [ 94.331229] niks3-server[953]: 2026/09/23 16:01:03 INFO Signed narinfos id=30 count=1 lb # [ 94.337189] niks3-server[953]: 2026/09/23 16:01:03 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls lb # [ 94.349528] niks3-server[953]: 2026/09/23 16:01:03 INFO Received complete push request method=POST path=/api/pushes/30/complete worker2 # [ 94.345767] nix-grpc-daemon[854]: time=2026-09-23T16:01:03.969Z level=INFO msg="Upload complete. (270ms)" lb # [ 94.356254] niks3-server[953]: 2026/09/23 16:01:03 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker2 # [ 94.357043] nix-grpc-daemon[785]: ts=2026-09-23T16:01:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=1 paths=1 nar_bytes_in=568 worker2 # [ 94.369949] nix-grpc-daemon[785]: ts=2026-09-23T16:01:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 94.382509] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) worker2 # [ 94.392326] nix-daemon[842]: reaped child process 1193, status = succeeded worker2 # [ 94.397410] nix-grpc-daemon[785]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... worker2 # [ 94.411512] nix-daemon[842]: accepted connection from pid 785, user nix-grpc-daemon (trusted) client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... client # uses-input-w1onlyb> worker2: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 95.276378] nix-daemon[842]: reaped child process 1208, status = succeeded worker2 # [ 95.366472] nix-daemon[842]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) worker2 # [ 95.386674] nix-daemon[842]: reaped child process 1227, status = succeeded lb # [ 95.394562] niks3-server[953]: 2026/09/23 16:01:05 INFO Received push request method=POST path=/api/pushes worker2 # [ 95.396476] nix-grpc-daemon[854]: time=2026-09-23T16:01:05.018Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 95.425400] niks3-server[953]: 2026/09/23 16:01:05 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls worker2 # [ 95.429361] nix-grpc-daemon[854]: time=2026-09-23T16:01:05.052Z level=INFO msg="Uploading 1 narinfos" lb # [ 95.438590] niks3-server[953]: 2026/09/23 16:01:05 INFO Received sign narinfos request method=POST path=/api/pushes/31/sign lb # [ 95.449556] niks3-server[953]: 2026/09/23 16:01:05 INFO Signed narinfos id=31 count=1 lb # [ 95.460158] niks3-server[953]: 2026/09/23 16:01:05 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 95.459183] nix-grpc-daemon[854]: time=2026-09-23T16:01:05.082Z level=INFO msg="Upload complete. (234ms)" lb # [ 95.468735] niks3-server[953]: 2026/09/23 16:01:05 INFO Received complete push request method=POST path=/api/pushes/31/complete lb # [ 95.472141] niks3-server[953]: 2026/09/23 16:01:05 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo client # copying 1 paths... worker2 # [ 95.468860] nix-grpc-daemon[785]: ts=2026-09-23T16:01:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56394 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=16 outputs=1 worker1 # [ 95.567855] nix-grpc-daemon[485]: ts=2026-09-23T16:01:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59660 worker2 # [ 95.483372] nix-daemon[842]: reaped child process 1205, status = succeeded worker1 # [ 95.580970] nix-grpc-daemon[485]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 95.627634] nix-grpc-daemon[485]: ts=2026-09-23T16:01:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 95.634888] nix-grpc-daemon[485]: ts=2026-09-23T16:01:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=1 nar_bytes_out=120 client # [ 95.632299] nix-daemon[1152]: reaped child process 1259, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.16 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 95.808124] nix-daemon[1152]: accepted connection from pid 1278, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 96.041783] nix-grpc-daemon[485]: ts=2026-09-23T16:01:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:59660 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 95.955435] nix-grpc-daemon[785]: ts=2026-09-23T16:01:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 95.967608] nix-grpc-daemon[854]: time=2026-09-23T16:01:05.591Z level=INFO msg="All 1 paths already cached" worker1 # [ 96.074407] nix-grpc-daemon[485]: ts=2026-09-23T16:01:05Z level=debug event=want client=16 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker1 # [ 96.082178] nix-grpc-daemon[485]: ts=2026-09-23T16:01:05Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 96.091518] nix-grpc-daemon[485]: ts=2026-09-23T16:01:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 96.103026] nix-grpc-daemon[485]: ts=2026-09-23T16:01:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:59660 client # copying 1 paths to 'lb:50051'... worker1 # [ 96.119514] nix-grpc-daemon[901]: time=2026-09-23T16:01:05.736Z level=INFO msg="All 1 paths already cached" client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker1 # [ 96.125221] nix-grpc-daemon[485]: ts=2026-09-23T16:01:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 96.140647] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 96.294336] nix-daemon[849]: accepted connection from pid 1173, user nix-grpc-daemon (trusted) worker1 # [ 96.315430] nix-daemon[849]: reaped child process 1176, status = succeeded lb # [ 96.232447] niks3-server[953]: 2026/09/23 16:01:05 INFO Received push request method=POST path=/api/pushes worker1 # [ 96.325074] nix-grpc-daemon[901]: time=2026-09-23T16:01:05.944Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 96.326559] nix-grpc-daemon[901]: time=2026-09-23T16:01:05.944Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" worker1 # [ 96.363476] nix-grpc-daemon[901]: time=2026-09-23T16:01:05.982Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.271924] niks3-server[953]: 2026/09/23 16:01:05 INFO Received sign narinfos request method=POST path=/api/pushes/32/sign lb # [ 96.288657] niks3-server[953]: 2026/09/23 16:01:05 INFO Signed narinfos id=32 count=1 lb # [ 96.294803] niks3-server[953]: 2026/09/23 16:01:05 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 96.306186] niks3-server[953]: 2026/09/23 16:01:05 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 96.316275] niks3-server[953]: 2026/09/23 16:01:05 INFO Received complete push request method=POST path=/api/pushes/32/complete worker1 # [ 96.401938] nix-grpc-daemon[901]: time=2026-09-23T16:01:06.021Z level=INFO msg="Upload complete. (244ms)" lb # [ 96.322809] niks3-server[953]: 2026/09/23 16:01:05 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker1 # [ 96.412874] nix-grpc-daemon[485]: ts=2026-09-23T16:01:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=1 nar_bytes_in=568 worker1 # [ 96.428538] nix-grpc-daemon[485]: ts=2026-09-23T16:01:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 96.437481] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) worker1 # [ 96.447466] nix-daemon[849]: reaped child process 1171, status = succeeded worker1 # [ 96.454137] nix-daemon[849]: accepted connection from pid 485, user nix-grpc-daemon (trusted) client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... client # uses-input-w1onlyc> node-a: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 97.320255] nix-daemon[849]: reaped child process 1180, status = succeeded worker1 # [ 97.425733] nix-daemon[849]: accepted connection from pid 1196, user nix-grpc-daemon (trusted) worker1 # [ 97.443474] nix-daemon[849]: reaped child process 1199, status = succeeded lb # [ 97.370045] niks3-server[953]: 2026/09/23 16:01:06 INFO Received push request method=POST path=/api/pushes worker1 # [ 97.462330] nix-grpc-daemon[901]: time=2026-09-23T16:01:07.080Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 97.403185] niks3-server[953]: 2026/09/23 16:01:07 INFO Received sign narinfos request method=POST path=/api/pushes/33/sign worker1 # [ 97.493292] nix-grpc-daemon[901]: time=2026-09-23T16:01:07.112Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.417209] niks3-server[953]: 2026/09/23 16:01:07 INFO Signed narinfos id=33 count=1 lb # [ 97.424058] niks3-server[953]: 2026/09/23 16:01:07 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls lb # [ 97.427894] niks3-server[953]: 2026/09/23 16:01:07 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 97.442909] niks3-server[953]: 2026/09/23 16:01:07 INFO Received complete push request method=POST path=/api/pushes/33/complete lb # [ 97.451576] niks3-server[953]: 2026/09/23 16:01:07 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker1 # [ 97.538630] nix-grpc-daemon[901]: time=2026-09-23T16:01:07.158Z level=INFO msg="Upload complete. (272ms)" client # copying 1 paths... worker1 # [ 97.553174] nix-grpc-daemon[485]: ts=2026-09-23T16:01:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=17 outputs=1 worker2 # [ 97.466079] nix-grpc-daemon[785]: ts=2026-09-23T16:01:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:56394 worker2 # [ 97.480630] nix-grpc-daemon[785]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... worker1 # [ 97.573772] nix-daemon[849]: reaped child process 1178, status = succeeded client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 97.614301] nix-grpc-daemon[485]: ts=2026-09-23T16:01:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 97.621423] nix-grpc-daemon[485]: ts=2026-09-23T16:01:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59660 duration_s=0 paths=1 nar_bytes_out=120 client # [ 97.621315] nix-daemon[1152]: reaped child process 1281, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix job --argstr tag w1only --argstr salt c >&2, in 1.99 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 8.34 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A input --argstr tag viacache, in 0.33 seconds) client: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache lb # [ 98.087692] envoy[897]: conn peer=[2001:db8:1::1]:42802 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=406 ms=27 client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv lb # [ 98.092606] envoy[897]: conn peer=[2001:db8:1::1]:42792 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4378 tx=2392 ms=2026 lb # [ 98.097701] envoy[897]: conn peer=[2001:db8:1::1]:42818 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4250 tx=2073 ms=2131 lb # [ 98.104144] envoy[897]: conn peer=[2001:db8:1::1]:39070 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=329 ms=54 lb # [ 98.109610] envoy[897]: conn peer=[2001:db8:1::1]:39076 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3757 tx=2127 ms=2775 lb # [ 98.114513] envoy[897]: conn peer=[2001:db8:1::1]:39082 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=422 tx=328 ms=31 lb # [ 98.119256] envoy[897]: conn peer=[2001:db8:1::1]:39088 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3743 tx=2099 ms=1594 lb # [ 98.124144] envoy[897]: conn peer=[2001:db8:1::1]:39094 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=422 tx=328 ms=31 client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/xwnww2wldfcdimh1fkyvzhwrccjdhpmk-dep.nix -A referrer --argstr tag viacache, in 0.29 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.12 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.20 seconds) worker2 # [ 98.632935] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 98.897867] nix-grpc-daemon[785]: ts=2026-09-23T16:01:08Z level=info event=signal_exit worker2 # [ 100.870588] nix-grpc-daemon[785]: ts=2026-09-23T16:01:10Z level=info event=scheduler_restarting worker1 # [ 100.972686] nix-grpc-daemon[485]: ts=2026-09-23T16:01:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:59646 worker1 # [ 100.981080] nix-grpc-daemon[485]: ts=2026-09-23T16:01:10Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 100.908653] nix-grpc-daemon[785]: ts=2026-09-23T16:01:10Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 100.938396] nix-daemon[842]: reaped child process 844, status = succeeded worker2 # [ 101.543374] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 101.551297] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 101.556809] systemd[1]: nix-grpc-daemon.service: Consumed 3.417s CPU time over 1min 7.869s wall clock time, 62.4M memory peak, 178.5K incoming IP traffic, 239.9K outgoing IP traffic. lb: waiting until exactly ['worker1'] are healthy members of aarch64-linux lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly ['worker1'] are healthy members of aarch64-linux, in 0.08 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 101.959421] nix-grpc-daemon[485]: ts=2026-09-23T16:01:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:59660 worker1 # [ 101.968957] nix-grpc-daemon[485]: ts=2026-09-23T16:01:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:59660 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.25 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.03 seconds) worker2 # [ 101.996247] systemd[1]: Starting scheduler-token.service... worker2 # [ 102.063112] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 102.067211] systemd[1]: Finished scheduler-token.service. worker2 # [ 102.082471] systemd[1]: scheduler-token.service: Consumed 36ms CPU time over 69ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 102.088997] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 102.202457] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:11Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 102.204824] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 102.208687] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 102.215176] nix-grpc-daemon[1252]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 102.236140] nix-grpc-daemon[1252]: E0000 00:00:1790179271.836836 1252 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 102.238587] nix-grpc-daemon[1252]: E0000 00:00:1790179271.838849 1252 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 102.264352] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:11Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 102.266601] nix-grpc-daemon[1252]: E0000 00:00:1790179271.848913 1292 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 102.269312] nix-grpc-daemon[1252]: E0000 00:00:1790179271.871304 1292 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 102.274675] nix-grpc-daemon[1252]: E0000 00:00:1790179271.871496 1292 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 102.281589] nix-grpc-daemon[1252]: E0000 00:00:1790179271.887082 1292 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 102.284342] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 102.285197] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 102.373478] nix-grpc-daemon[485]: ts=2026-09-23T16:01:11Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:59646 worker1 # [ 102.391776] nix-grpc-daemon[485]: ts=2026-09-23T16:01:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 102.427992] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 102.567762] nix-grpc-daemon[485]: ts=2026-09-23T16:01:12Z level=info event=signal_exit lb # [ 102.912826] niks3-server[953]: 2026/09/23 16:01:12 INFO lead: released remote=192.168.1.3:55244 worker1 # [ 103.996692] nix-grpc-daemon[485]: ts=2026-09-23T16:01:13Z level=info event=scheduler_restarting worker2 # [ 103.907516] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:13Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 103.914680] envoy[897]: [2026-09-23 16:01:13.526][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker1 # [ 104.001609] nix-grpc-daemon[485]: ts=2026-09-23T16:01:13Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 104.001769] nix-grpc-daemon[485]: ts=2026-09-23T16:01:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:59646 worker1 # [ 104.001881] nix-grpc-daemon[485]: ts=2026-09-23T16:01:13Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 104.006069] nix-grpc-daemon[485]: ts=2026-09-23T16:01:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:59646 worker1 # [ 104.027060] nix-grpc-daemon[485]: ts=2026-09-23T16:01:13Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 104.057871] nix-daemon[849]: reaped child process 851, status = succeeded worker2 # [ 104.107974] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.113641] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 104.222246] nix-grpc-daemon[485]: ts=2026-09-23T16:01:13Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 104.314534] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.320159] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.521269] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.526718] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.727947] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.733323] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 104.936593] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 104.940749] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.137341] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.142712] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.343919] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.349156] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.566450] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 105.571417] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 105.580742] systemd[1]: nix-grpc-daemon.service: Consumed 2.902s CPU time over 1min 35.402s wall clock time, 67M memory peak, 539.6K incoming IP traffic, 262.1K outgoing IP traffic. lb: waiting until exactly ['worker2'] are healthy members of aarch64-linux lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 105.550287] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.555682] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly ['worker2'] are healthy members of aarch64-linux, in 0.08 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 105.756834] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.762068] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.815268] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 105.830496] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 105.856932] nix-grpc-daemon[1252]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 1/5) worker2 # [ 105.954015] nix-grpc-daemon[1252]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 2/5) worker2 # [ 105.963318] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.971838] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.976979] nix-grpc-daemon[1252]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 63 ms (attempt 3/5) worker2 # [ 106.036853] nix-grpc-daemon[1252]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 224 ms (attempt 4/5) worker2 # [ 106.170303] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.175494] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.263370] nix-grpc-daemon[1252]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 106.269665] nix-grpc-daemon[1252]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 106.294260] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48748 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 106.312814] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 106.340865] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:15Z level=info event=niks3_push_started pid=1312 worker2 # [ 106.376660] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.381642] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.510668] nix-grpc-daemon[1312]: time=2026-09-23T16:01:16.132Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 106.584502] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.604197] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.622682] nix-daemon[842]: accepted connection from pid 1325, user nix-grpc-daemon (trusted) worker2 # [ 106.638539] nix-daemon[842]: reaped child process 1328, status = succeeded lb # [ 106.656915] niks3-server[953]: 2026/09/23 16:01:16 INFO Received push request method=POST path=/api/pushes worker2 # [ 106.663251] nix-grpc-daemon[1312]: time=2026-09-23T16:01:16.285Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 106.666820] nix-grpc-daemon[1312]: time=2026-09-23T16:01:16.285Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 106.669313] nix-grpc-daemon[1312]: time=2026-09-23T16:01:16.285Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 106.720186] niks3-server[953]: 2026/09/23 16:01:16 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls worker2 # [ 106.723063] nix-grpc-daemon[1312]: time=2026-09-23T16:01:16.345Z level=INFO msg="Uploading 2 narinfos" lb # [ 106.733413] niks3-server[953]: 2026/09/23 16:01:16 INFO Received sign narinfos request method=POST path=/api/pushes/34/sign lb # [ 106.741642] niks3-server[953]: 2026/09/23 16:01:16 INFO Signed narinfos id=34 count=2 lb # [ 106.746363] niks3-server[953]: 2026/09/23 16:01:16 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 106.752614] niks3-server[953]: 2026/09/23 16:01:16 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 106.755518] niks3-server[953]: 2026/09/23 16:01:16 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 106.769266] niks3-server[953]: 2026/09/23 16:01:16 INFO Received complete push request method=POST path=/api/pushes/34/complete worker2 # [ 106.760000] nix-grpc-daemon[1312]: time=2026-09-23T16:01:16.383Z level=INFO msg="Upload complete. (250ms)" lb # [ 106.771600] niks3-server[953]: 2026/09/23 16:01:16 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 106.774632] niks3-server[953]: 2026/09/23 16:01:16 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo worker2 # [ 106.772139] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48748 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 106.786247] nix-daemon[842]: reaped child process 1310, status = succeeded worker2 # [ 106.789875] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.793819] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.22 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds) worker1 # [ 107.000808] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 106.996871] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.000954] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.143135] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:16Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 107.145597] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 107.149517] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 107.156075] nix-grpc-daemon[1222]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 107.157564] nix-grpc-daemon[1222]: E0000 00:00:1790179276.774042 1222 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 107.160680] nix-grpc-daemon[1222]: E0000 00:00:1790179276.780467 1222 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 107.164061] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:16Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 107.165810] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 107.090354] niks3-server[953]: 2026/09/23 16:01:16 INFO lead: acquired remote=192.168.1.3:43830 lb: waiting until exactly ['worker1', 'worker2'] are healthy members of aarch64-linux lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 107.196177] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:16Z level=info event=scheduler_take_over worker1 # [ 107.201650] nix-grpc-daemon[1222]: E0000 00:00:1790179276.793508 1262 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 107.203958] nix-grpc-daemon[1222]: E0000 00:00:1790179276.810013 1262 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 107.213733] nix-grpc-daemon[1222]: E0000 00:00:1790179276.810236 1262 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 107.216666] nix-grpc-daemon[1222]: E0000 00:00:1790179276.832796 1262 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 107.232292] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.234395] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2 # [ 107.197873] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.203023] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.435606] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.445116] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:59236 worker1 # [ 107.451185] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 107.403889] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.504167] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:17Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 107.508604] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:59236 worker1 # [ 107.514118] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 107.917702] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:17Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:59238 lb # [ 108.088711] envoy[897]: conn peer=[2001:db8:1::4]:47366 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=3074 tx=1089 ms=66968 lb # [ 108.093889] envoy[897]: conn peer=[2001:db8:1::1]:43578 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=29 lb # [ 108.099588] envoy[897]: conn peer=[2001:db8:1::3]:35908 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2003 tx=969 ms=70009 lb # [ 108.105716] envoy[897]: conn peer=[2001:db8:1::1]:43590 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1010 tx=282 ms=974 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of aarch64-linux, in 1.14 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.62 seconds) subtest: a niks3 restart does not cost the leader its role lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb # [ 108.381300] niks3-server[953]: 2026/09/23 16:01:17 INFO Shutdown signal received, draining in-flight requests timeout=10s worker2 # [ 108.377259] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:17Z level=info event=scheduler_lock_lost status=200 worker1 # [ 108.467239] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:18Z level=info event=scheduler_lock_lost status=200 lb # [ 108.389539] systemd[1]: Stopping niks3 server... lb # [ 108.390485] niks3-server[953]: 2026/09/23 16:01:17 INFO lead: released remote=192.168.1.3:43830 lb # [ 112.129991] systemd[1]: niks3.service: Deactivated successfully. lb # [ 112.134856] systemd[1]: Stopped niks3 server. lb # [ 112.138971] systemd[1]: niks3.service: Consumed 659ms CPU time over 1min 30.456s wall clock time, 27.8M memory peak, 100.7K incoming IP traffic, 144K outgoing IP traffic. lb # [ 112.162121] systemd[1]: Starting niks3 server... lb # [ 112.268431] niks3-server[1114]: 2026/09/23 16:01:21 goose: no migrations to run. current version: 20260923120000 lb # [ 112.275432] niks3-server[1114]: 2026/09/23 16:01:21 OK 1_commit_pending_closure.sql (7.23ms) lb # [ 112.279471] niks3-server[1114]: 2026/09/23 16:01:21 OK 2_object_stats_trigger.sql (3.98ms) lb # [ 112.283213] niks3-server[1114]: 2026/09/23 16:01:21 OK 3_commit_push.sql (3.34ms) lb # [ 112.285371] niks3-server[1114]: 2026/09/23 16:01:21 goose: up to current file version: 3 lb # [ 112.286575] niks3-server[1114]: 2026/09/23 16:01:21 INFO Loaded signing key name=farm-test-1 path=/nix/store/3qiyvklx8qgcqqsb1swilx6drs1cdj8m-key lb # [ 112.298014] niks3-server[1114]: 2026/09/23 16:01:21 INFO Read proxy enabled — serving cache objects from S3 lb # [ 112.299510] niks3-server[1114]: 2026/09/23 16:01:21 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 112.308469] niks3-server[1114]: 2026/09/23 16:01:21 INFO systemd watchdog enabled interval=15s lb # [ 112.312682] niks3-server[1114]: 2026/09/23 16:01:21 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 112.314069] systemd[1]: Started niks3 server. lb: waiting for unit niks3.service lb # [ 112.318846] niks3-server[1114]: 2026/09/23 16:01:21 INFO lead: acquired remote=192.168.1.3:43840 lb: (finished: waiting for unit niks3.service, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield worker1: (finished: must fail: journalctl -u nix-grpc-daemon | grep -q event=scheduler_yield, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2 worker1 # [ 112.903191] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:22Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 112.918427] nix-daemon[849]: accepted connection from pid 1222, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker1 # [ 112.940638] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 112.956451] nix-grpc-daemon[1222]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 1/5) worker1 # [ 112.971723] nix-grpc-daemon[1222]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 2/5) worker1 # [ 113.006926] nix-grpc-daemon[1222]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 109 ms (attempt 3/5) worker1 # [ 113.117835] nix-grpc-daemon[1222]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 699 ms (attempt 4/5) worker1 # [ 113.820596] nix-grpc-daemon[1222]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 113.825114] nix-grpc-daemon[1222]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 113.873195] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:23Z level=debug event=want client=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv cached=0 worker1 # [ 113.880673] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:23Z level=debug event=assigned drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 113.890640] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 113.903200] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43202 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' to 'lb:50051'... worker1 # [ 113.917408] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 113.933101] nix-daemon[849]: accepted connection from pid 1222, user nix-grpc-daemon (trusted) worker1 # [ 113.965384] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:23Z level=info event=niks3_push_started pid=1294 worker1 # [ 114.101365] nix-grpc-daemon[1294]: time=2026-09-23T16:01:23.720Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca="" worker1 # [ 114.212114] nix-daemon[849]: accepted connection from pid 1307, user nix-grpc-daemon (trusted) worker1 # [ 114.233173] nix-daemon[849]: reaped child process 1310, status = succeeded lb # [ 114.153071] niks3-server[1114]: 2026/09/23 16:01:23 INFO Received push request method=POST path=/api/pushes worker1 # [ 114.249711] nix-grpc-daemon[1294]: time=2026-09-23T16:01:23.868Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 114.251206] nix-grpc-daemon[1294]: time=2026-09-23T16:01:23.868Z level=INFO msg="Uploading mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv (544B)" lb # [ 114.213294] niks3-server[1114]: 2026/09/23 16:01:23 INFO Received sign narinfos request method=POST path=/api/pushes/35/sign lb # [ 114.225462] niks3-server[1114]: 2026/09/23 16:01:23 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.ls lb # [ 114.255173] niks3-server[1114]: 2026/09/23 16:01:23 INFO Signed narinfos id=35 count=1 worker1 # [ 114.340116] nix-grpc-daemon[1294]: time=2026-09-23T16:01:23.959Z level=INFO msg="Uploading 1 narinfos" lb # [ 114.266211] niks3-server[1114]: 2026/09/23 16:01:23 INFO Registered completed upload object_key=nar/0hn539w6achi7azzyhpihsi61g85x9f535dxv438yq5y50ksrp1d.nar.zst lb # [ 114.272799] niks3-server[1114]: 2026/09/23 16:01:23 INFO Received complete push request method=POST path=/api/pushes/35/complete lb # [ 114.289319] niks3-server[1114]: 2026/09/23 16:01:23 INFO Registered completed upload object_key=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z.narinfo worker1 # [ 114.375842] nix-grpc-daemon[1294]: time=2026-09-23T16:01:23.995Z level=INFO msg="Upload complete. (270ms)" worker1 # [ 114.387346] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43202 duration_s=0 paths=1 nar_bytes_in=544 worker1 # [ 114.404945] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 114.416512] nix-daemon[849]: accepted connection from pid 1222, user nix-grpc-daemon (trusted) worker1 # [ 114.422513] nix-daemon[849]: reaped child process 1292, status = succeeded client # building '/nix/store/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv' on lb:50051... worker1 # [ 114.434662] nix-daemon[849]: accepted connection from pid 1222, user nix-grpc-daemon (trusted) client # farm-a> node-a: building mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-after-niks3-restart worker1 # [ 115.701710] nix-daemon[849]: reaped child process 1314, status = succeeded worker1 # [ 115.826429] nix-daemon[849]: accepted connection from pid 1330, user nix-grpc-daemon (trusted) worker1 # [ 115.845512] nix-daemon[849]: reaped child process 1333, status = succeeded lb # [ 115.769708] niks3-server[1114]: 2026/09/23 16:01:25 INFO Received push request method=POST path=/api/pushes worker1 # [ 115.864453] nix-grpc-daemon[1294]: time=2026-09-23T16:01:25.482Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 115.866238] nix-grpc-daemon[1294]: time=2026-09-23T16:01:25.482Z level=INFO msg="Uploading j3iswx3ynilvcycpyw0z667966c9kpzx-farm-a (144B)" lb # [ 115.820214] niks3-server[1114]: 2026/09/23 16:01:25 INFO Registered completed upload object_key=log/mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv worker1 # [ 115.911674] nix-grpc-daemon[1294]: time=2026-09-23T16:01:25.530Z level=INFO msg="Uploading 1 narinfos" lb # [ 115.834493] niks3-server[1114]: 2026/09/23 16:01:25 INFO Received sign narinfos request method=POST path=/api/pushes/36/sign lb # [ 115.841302] niks3-server[1114]: 2026/09/23 16:01:25 INFO Signed narinfos id=36 count=1 lb # [ 115.843910] niks3-server[1114]: 2026/09/23 16:01:25 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.ls lb # [ 115.854884] niks3-server[1114]: 2026/09/23 16:01:25 INFO Registered completed upload object_key=nar/1diw08qzlsh0zkrx4kvj1mvbc57g7r65j1f459ankpg9yc5rgcpx.nar.zst lb # [ 115.857923] niks3-server[1114]: 2026/09/23 16:01:25 INFO Received complete push request method=POST path=/api/pushes/36/complete lb # [ 115.861384] niks3-server[1114]: 2026/09/23 16:01:25 INFO Registered completed upload object_key=j3iswx3ynilvcycpyw0z667966c9kpzx.narinfo worker1 # [ 115.946228] nix-grpc-daemon[1294]: time=2026-09-23T16:01:25.565Z level=INFO msg="Upload complete. (297ms)" worker1 # [ 115.968959] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43202 duration_s=1 drv=mxnzwd2qgmj6r8zhjk6jlcxv8j46h04z-farm-a.drv assign_id=1 outputs=1 worker1 # [ 115.983877] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:25Z level=debug event=want client=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv cached=0 worker1 # [ 115.996990] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:25Z level=debug event=assigned drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 116.003964] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 116.010266] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 116.016168] nix-daemon[849]: reaped child process 1312, status = succeeded client # copying 1 paths to 'lb:50051'... worker1 # [ 116.018582] nix-grpc-daemon[1294]: time=2026-09-23T16:01:25.634Z level=INFO msg="All 1 paths already cached" client # copying path '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' to 'lb:50051'... worker1 # [ 116.022766] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 116.040343] nix-daemon[849]: accepted connection from pid 1222, user nix-grpc-daemon (trusted) worker1 # [ 116.173745] nix-daemon[849]: accepted connection from pid 1339, user nix-grpc-daemon (trusted) worker1 # [ 116.194408] nix-daemon[849]: reaped child process 1342, status = succeeded lb # [ 116.110630] niks3-server[1114]: 2026/09/23 16:01:25 INFO Received push request method=POST path=/api/pushes worker1 # [ 116.201019] nix-grpc-daemon[1294]: time=2026-09-23T16:01:25.820Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 116.202484] nix-grpc-daemon[1294]: time=2026-09-23T16:01:25.820Z level=INFO msg="Uploading 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv (656B)" worker1 # [ 116.232449] nix-grpc-daemon[1294]: time=2026-09-23T16:01:25.852Z level=INFO msg="Uploading 1 narinfos" lb # [ 116.140192] niks3-server[1114]: 2026/09/23 16:01:25 INFO Registered completed upload object_key=nar/1xpcisa10g5by3yknnrs1xwhxhf4s243h7gwzjii0799pwbhfjfa.nar.zst lb # [ 116.156498] niks3-server[1114]: 2026/09/23 16:01:25 INFO Received sign narinfos request method=POST path=/api/pushes/37/sign lb # [ 116.165742] niks3-server[1114]: 2026/09/23 16:01:25 INFO Signed narinfos id=37 count=1 lb # [ 116.177039] niks3-server[1114]: 2026/09/23 16:01:25 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.ls lb # [ 116.187387] niks3-server[1114]: 2026/09/23 16:01:25 INFO Received complete push request method=POST path=/api/pushes/37/complete lb # [ 116.192266] niks3-server[1114]: 2026/09/23 16:01:25 INFO Registered completed upload object_key=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch.narinfo worker1 # [ 116.277550] nix-grpc-daemon[1294]: time=2026-09-23T16:01:25.897Z level=INFO msg="Upload complete. (231ms)" worker1 # [ 116.288288] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43202 duration_s=0 paths=1 nar_bytes_in=656 worker1 # [ 116.304807] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 116.315761] nix-daemon[849]: accepted connection from pid 1222, user nix-grpc-daemon (trusted) worker1 # [ 116.318723] nix-daemon[849]: reaped child process 1337, status = succeeded client # building '/nix/store/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv' on lb:50051... worker1 # [ 116.332316] nix-daemon[849]: accepted connection from pid 1222, user nix-grpc-daemon (trusted) client # farm-b> node-a: building 5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-after-niks3-restart worker1 # [ 117.593502] nix-daemon[849]: reaped child process 1346, status = succeeded worker1 # [ 117.727492] nix-daemon[849]: accepted connection from pid 1362, user nix-grpc-daemon (trusted) worker1 # [ 117.746133] nix-daemon[849]: reaped child process 1365, status = succeeded lb # [ 117.670900] niks3-server[1114]: 2026/09/23 16:01:27 INFO Received push request method=POST path=/api/pushes worker1 # [ 117.764504] nix-grpc-daemon[1294]: time=2026-09-23T16:01:27.383Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 117.766395] nix-grpc-daemon[1294]: time=2026-09-23T16:01:27.383Z level=INFO msg="Uploading myar0ljvsqm9h7fxyh6qrqkg0175r3xn-farm-b (192B)" lb # [ 117.711081] niks3-server[1114]: 2026/09/23 16:01:27 INFO Registered completed upload object_key=nar/0zvv5rxmyk9afay83j52m7ipyhrqivhg6h6a0ksjd658pxzwi78w.nar.zst lb # [ 117.728113] niks3-server[1114]: 2026/09/23 16:01:27 INFO Received sign narinfos request method=POST path=/api/pushes/38/sign worker1 # [ 117.815061] nix-grpc-daemon[1294]: time=2026-09-23T16:01:27.434Z level=INFO msg="Uploading 1 narinfos" lb # [ 117.736791] niks3-server[1114]: 2026/09/23 16:01:27 INFO Signed narinfos id=38 count=1 lb # [ 117.744342] niks3-server[1114]: 2026/09/23 16:01:27 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.ls lb # [ 117.751686] niks3-server[1114]: 2026/09/23 16:01:27 INFO Registered completed upload object_key=log/5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv lb # [ 117.761075] niks3-server[1114]: 2026/09/23 16:01:27 INFO Received complete push request method=POST path=/api/pushes/38/complete lb # [ 117.771482] niks3-server[1114]: 2026/09/23 16:01:27 INFO Registered completed upload object_key=myar0ljvsqm9h7fxyh6qrqkg0175r3xn.narinfo worker1 # [ 117.862890] nix-grpc-daemon[1294]: time=2026-09-23T16:01:27.482Z level=INFO msg="Upload complete. (316ms)" worker1 # [ 117.882722] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43202 duration_s=1 drv=5ml8wmsr73y0fh0dflaimhsh2xbcd3ch-farm-b.drv assign_id=2 outputs=1 worker1 # [ 117.900287] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:27Z level=debug event=want client=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv cached=0 worker1 # [ 117.911678] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:27Z level=debug event=assigned drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 117.918508] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 117.924940] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 117.931366] nix-daemon[849]: reaped child process 1344, status = succeeded client # copying 1 paths to 'lb:50051'... worker1 # [ 117.934011] nix-grpc-daemon[1294]: time=2026-09-23T16:01:27.549Z level=INFO msg="All 2 paths already cached" client # copying path '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' to 'lb:50051'... worker1 # [ 117.938488] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 117.951814] nix-daemon[849]: accepted connection from pid 1222, user nix-grpc-daemon (trusted) worker1 # [ 118.090196] nix-daemon[849]: accepted connection from pid 1371, user nix-grpc-daemon (trusted) worker1 # [ 118.113309] nix-daemon[849]: reaped child process 1374, status = succeeded lb # [ 118.035260] niks3-server[1114]: 2026/09/23 16:01:27 INFO Received push request method=POST path=/api/pushes worker1 # [ 118.125527] nix-grpc-daemon[1294]: time=2026-09-23T16:01:27.745Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 118.127040] nix-grpc-daemon[1294]: time=2026-09-23T16:01:27.745Z level=INFO msg="Uploading 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv (784B)" lb # [ 118.065212] niks3-server[1114]: 2026/09/23 16:01:27 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.ls lb # [ 118.076325] niks3-server[1114]: 2026/09/23 16:01:27 INFO Received sign narinfos request method=POST path=/api/pushes/39/sign worker1 # [ 118.164653] nix-grpc-daemon[1294]: time=2026-09-23T16:01:27.784Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.088742] niks3-server[1114]: 2026/09/23 16:01:27 INFO Signed narinfos id=39 count=1 lb # [ 118.095059] niks3-server[1114]: 2026/09/23 16:01:27 INFO Registered completed upload object_key=nar/1fnvw3c0v6n1j60nd5iagl3bggzcvixsw103w98mwhnpmnmgb248.nar.zst lb # [ 118.108903] niks3-server[1114]: 2026/09/23 16:01:27 INFO Received complete push request method=POST path=/api/pushes/39/complete worker1 # [ 118.194262] nix-grpc-daemon[1294]: time=2026-09-23T16:01:27.814Z level=INFO msg="Upload complete. (230ms)" lb # [ 118.114603] niks3-server[1114]: 2026/09/23 16:01:27 INFO Registered completed upload object_key=6j7gr603xfslr5lxcbh72430f5q1r4b0.narinfo worker1 # [ 118.204775] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43202 duration_s=0 paths=1 nar_bytes_in=784 worker1 # [ 118.220625] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43202 worker1 # [ 118.231088] nix-daemon[849]: accepted connection from pid 1222, user nix-grpc-daemon (trusted) worker1 # [ 118.233349] nix-daemon[849]: reaped child process 1369, status = succeeded client # building '/nix/store/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv' on lb:50051... worker1 # [ 118.246884] nix-daemon[849]: accepted connection from pid 1222, user nix-grpc-daemon (trusted) client # farm-top> node-a: building 6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-after-niks3-restart worker1 # [ 119.502146] nix-daemon[849]: reaped child process 1378, status = succeeded worker1 # [ 119.620557] nix-daemon[849]: accepted connection from pid 1394, user nix-grpc-daemon (trusted) worker1 # [ 119.642780] nix-daemon[849]: reaped child process 1397, status = succeeded lb # [ 119.566974] niks3-server[1114]: 2026/09/23 16:01:29 INFO Received push request method=POST path=/api/pushes worker1 # [ 119.660442] nix-grpc-daemon[1294]: time=2026-09-23T16:01:29.278Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 119.662070] nix-grpc-daemon[1294]: time=2026-09-23T16:01:29.278Z level=INFO msg="Uploading z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc-farm-top (248B)" lb # [ 119.607590] niks3-server[1114]: 2026/09/23 16:01:29 INFO Registered completed upload object_key=log/6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv lb # [ 119.621544] niks3-server[1114]: 2026/09/23 16:01:29 INFO Received sign narinfos request method=POST path=/api/pushes/40/sign worker1 # [ 119.708745] nix-grpc-daemon[1294]: time=2026-09-23T16:01:29.328Z level=INFO msg="Uploading 1 narinfos" lb # [ 119.635125] niks3-server[1114]: 2026/09/23 16:01:29 INFO Signed narinfos id=40 count=1 lb # [ 119.640273] niks3-server[1114]: 2026/09/23 16:01:29 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.ls lb # [ 119.643063] niks3-server[1114]: 2026/09/23 16:01:29 INFO Registered completed upload object_key=nar/0cypkbh15calmx90jgh2waxpq661jalf4c99dgb7j606z61xh0ld.nar.zst lb # [ 119.656512] niks3-server[1114]: 2026/09/23 16:01:29 INFO Received complete push request method=POST path=/api/pushes/40/complete worker1 # [ 119.743448] nix-grpc-daemon[1294]: time=2026-09-23T16:01:29.363Z level=INFO msg="Upload complete. (286ms)" lb # [ 119.664251] niks3-server[1114]: 2026/09/23 16:01:29 INFO Registered completed upload object_key=z8mx9hni3m7cymmz0ddfhg3jhqvi9mlc.narinfo worker1 # [ 119.757345] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43202 duration_s=1 drv=6j7gr603xfslr5lxcbh72430f5q1r4b0-farm-top.drv assign_id=3 outputs=1 worker1 # [ 119.778814] nix-daemon[849]: reaped child process 1376, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart >&2, in 7.12 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag after-niks3-restart outPath, in 0.19 seconds) (finished: subtest: a niks3 restart does not cost the leader its role, in 11.65 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1 # [ 120.265245] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 121.178420] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:30Z level=info event=signal_exit lb # [ 121.316579] niks3-server[1114]: 2026/09/23 16:01:30 INFO lead: released remote=192.168.1.3:43840 lb # [ 122.303929] niks3-server[1114]: 2026/09/23 16:01:31 INFO lead: acquired remote=192.168.1.4:43072 worker2 # [ 122.297209] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:31Z level=info event=scheduler_take_over worker1 # [ 122.393871] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:32Z level=info event=scheduler_restarting lb # [ 122.311210] envoy[897]: [2026-09-23 16:01:31.925][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker2 # [ 122.313269] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:31Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 122.403304] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:32Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 122.414679] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:59236 worker1 # [ 122.420601] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:32Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 122.425299] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:32Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:59236 worker1 # [ 122.430377] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:32Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 122.453908] nix-daemon[849]: reaped child process 1284, status = succeeded worker2 # [ 122.514376] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:32Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 122.616982] nix-grpc-daemon[1222]: ts=2026-09-23T16:01:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 122.535654] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:32Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 122.540620] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:32Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:40396 worker2 # [ 122.546085] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:32Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 122.560865] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:32Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:40400 worker1 # [ 124.563452] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 124.568863] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 124.577456] systemd[1]: nix-grpc-daemon.service: Consumed 1.271s CPU time over 17.566s wall clock time, 38.3M memory peak, 187.5K incoming IP traffic, 88.2K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2 client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 124.851715] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 124.859821] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 124.886484] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:34Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker2 # [ 124.893651] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:34Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 124.903000] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 124.914376] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48748 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker2 # [ 124.930098] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 124.945190] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 125.095761] nix-daemon[842]: accepted connection from pid 1348, user nix-grpc-daemon (trusted) worker2 # [ 125.115625] nix-daemon[842]: reaped child process 1351, status = succeeded lb # [ 125.131370] niks3-server[1114]: 2026/09/23 16:01:34 INFO Received push request method=POST path=/api/pushes worker2 # [ 125.132464] nix-grpc-daemon[1312]: time=2026-09-23T16:01:34.755Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 125.134617] nix-grpc-daemon[1312]: time=2026-09-23T16:01:34.755Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 125.169873] niks3-server[1114]: 2026/09/23 16:01:34 INFO Received sign narinfos request method=POST path=/api/pushes/41/sign worker2 # [ 125.171050] nix-grpc-daemon[1312]: time=2026-09-23T16:01:34.794Z level=INFO msg="Uploading 1 narinfos" lb # [ 125.181006] niks3-server[1114]: 2026/09/23 16:01:34 INFO Signed narinfos id=41 count=1 lb # [ 125.190821] niks3-server[1114]: 2026/09/23 16:01:34 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 125.203333] niks3-server[1114]: 2026/09/23 16:01:34 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 125.216868] niks3-server[1114]: 2026/09/23 16:01:34 INFO Received complete push request method=POST path=/api/pushes/41/complete worker2 # [ 125.217205] nix-grpc-daemon[1312]: time=2026-09-23T16:01:34.840Z level=INFO msg="Upload complete. (256ms)" lb # [ 125.227203] niks3-server[1114]: 2026/09/23 16:01:34 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker2 # [ 125.230166] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48748 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 125.244333] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 125.253970] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 125.260385] nix-daemon[842]: reaped child process 1346, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker2 # [ 125.273396] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker2 # [ 126.115689] nix-daemon[842]: reaped child process 1355, status = succeeded worker2 # [ 126.242031] nix-daemon[842]: accepted connection from pid 1371, user nix-grpc-daemon (trusted) worker2 # [ 126.259221] nix-daemon[842]: reaped child process 1374, status = succeeded lb # [ 126.278121] niks3-server[1114]: 2026/09/23 16:01:35 INFO Received push request method=POST path=/api/pushes worker2 # [ 126.278958] nix-grpc-daemon[1312]: time=2026-09-23T16:01:35.900Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 126.280602] nix-grpc-daemon[1312]: time=2026-09-23T16:01:35.900Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" worker2 # [ 126.319181] nix-grpc-daemon[1312]: time=2026-09-23T16:01:35.942Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.318789] niks3-server[1114]: 2026/09/23 16:01:35 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 126.331853] niks3-server[1114]: 2026/09/23 16:01:35 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 126.342376] niks3-server[1114]: 2026/09/23 16:01:35 INFO Received sign narinfos request method=POST path=/api/pushes/42/sign lb # [ 126.356151] niks3-server[1114]: 2026/09/23 16:01:35 INFO Signed narinfos id=42 count=1 worker2 # [ 126.353053] nix-grpc-daemon[1312]: time=2026-09-23T16:01:35.976Z level=INFO msg="Upload complete. (269ms)" lb # [ 126.361578] niks3-server[1114]: 2026/09/23 16:01:35 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 126.366078] niks3-server[1114]: 2026/09/23 16:01:35 INFO Received complete push request method=POST path=/api/pushes/42/complete lb # [ 126.370406] niks3-server[1114]: 2026/09/23 16:01:35 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker2 # [ 126.377099] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker2 # [ 126.391433] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:35Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker2 # [ 126.396793] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:35Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 126.401161] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 126.405180] nix-daemon[842]: reaped child process 1353, status = succeeded worker2 # [ 126.408731] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 126.420296] nix-grpc-daemon[1312]: time=2026-09-23T16:01:36.044Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker2 # [ 126.429901] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 126.440761] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 126.578653] nix-daemon[842]: accepted connection from pid 1380, user nix-grpc-daemon (trusted) worker2 # [ 126.596414] nix-daemon[842]: reaped child process 1383, status = succeeded lb # [ 126.610700] niks3-server[1114]: 2026/09/23 16:01:36 INFO Received push request method=POST path=/api/pushes worker2 # [ 126.610591] nix-grpc-daemon[1312]: time=2026-09-23T16:01:36.234Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 126.612115] nix-grpc-daemon[1312]: time=2026-09-23T16:01:36.234Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 126.641388] niks3-server[1114]: 2026/09/23 16:01:36 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls worker2 # [ 126.641885] nix-grpc-daemon[1312]: time=2026-09-23T16:01:36.265Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.654571] niks3-server[1114]: 2026/09/23 16:01:36 INFO Received sign narinfos request method=POST path=/api/pushes/43/sign lb # [ 126.664715] niks3-server[1114]: 2026/09/23 16:01:36 INFO Signed narinfos id=43 count=1 lb # [ 126.675925] niks3-server[1114]: 2026/09/23 16:01:36 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst worker2 # [ 126.675806] nix-grpc-daemon[1312]: time=2026-09-23T16:01:36.299Z level=INFO msg="Upload complete. (221ms)" lb # [ 126.686384] niks3-server[1114]: 2026/09/23 16:01:36 INFO Received complete push request method=POST path=/api/pushes/43/complete lb # [ 126.692442] niks3-server[1114]: 2026/09/23 16:01:36 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo worker2 # [ 126.684293] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48748 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 126.699890] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 126.710464] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 126.713818] nix-daemon[842]: reaped child process 1378, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker2 # [ 126.728198] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby lb # [ 128.086815] envoy[897]: conn peer=[2001:db8:1::1]:38230 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9779 tx=4465 ms=6873 lb # [ 128.091873] envoy[897]: conn peer=[2001:db8:1::3]:38820 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1217 tx=530 ms=15388 worker2 # [ 128.194372] nix-daemon[842]: reaped child process 1387, status = succeeded worker2 # [ 128.321893] nix-daemon[842]: accepted connection from pid 1403, user nix-grpc-daemon (trusted) worker2 # [ 128.341234] nix-daemon[842]: reaped child process 1406, status = succeeded lb # [ 128.357574] niks3-server[1114]: 2026/09/23 16:01:37 INFO Received push request method=POST path=/api/pushes worker2 # [ 128.359074] nix-grpc-daemon[1312]: time=2026-09-23T16:01:37.981Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 128.360850] nix-grpc-daemon[1312]: time=2026-09-23T16:01:37.981Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 128.398689] niks3-server[1114]: 2026/09/23 16:01:38 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker2 # [ 128.402323] nix-grpc-daemon[1312]: time=2026-09-23T16:01:38.025Z level=INFO msg="Uploading 1 narinfos" lb # [ 128.413936] niks3-server[1114]: 2026/09/23 16:01:38 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 128.423584] niks3-server[1114]: 2026/09/23 16:01:38 INFO Received sign narinfos request method=POST path=/api/pushes/44/sign lb # [ 128.433715] niks3-server[1114]: 2026/09/23 16:01:38 INFO Signed narinfos id=44 count=1 lb # [ 128.435635] niks3-server[1114]: 2026/09/23 16:01:38 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 128.441676] niks3-server[1114]: 2026/09/23 16:01:38 INFO Received complete push request method=POST path=/api/pushes/44/complete worker2 # [ 128.432340] nix-grpc-daemon[1312]: time=2026-09-23T16:01:38.056Z level=INFO msg="Upload complete. (292ms)" lb # [ 128.444464] niks3-server[1114]: 2026/09/23 16:01:38 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker2 # [ 128.452347] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker2 # [ 128.466563] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:38Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker2 # [ 128.476208] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:38Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 128.484390] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 client # copying 1 paths to 'lb:50051'... worker2 # [ 128.489960] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48748 client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker2 # [ 128.494283] nix-daemon[842]: reaped child process 1385, status = succeeded worker2 # [ 128.498454] nix-grpc-daemon[1312]: time=2026-09-23T16:01:38.112Z level=INFO msg="All 2 paths already cached" worker2 # [ 128.513954] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 128.520239] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 128.641340] nix-daemon[842]: accepted connection from pid 1412, user nix-grpc-daemon (trusted) worker2 # [ 128.658981] nix-daemon[842]: reaped child process 1415, status = succeeded lb # [ 128.674008] niks3-server[1114]: 2026/09/23 16:01:38 INFO Received push request method=POST path=/api/pushes worker2 # [ 128.673982] nix-grpc-daemon[1312]: time=2026-09-23T16:01:38.297Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 128.675500] nix-grpc-daemon[1312]: time=2026-09-23T16:01:38.297Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 128.708285] niks3-server[1114]: 2026/09/23 16:01:38 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker2 # [ 128.706835] nix-grpc-daemon[1312]: time=2026-09-23T16:01:38.330Z level=INFO msg="Uploading 1 narinfos" lb # [ 128.723057] niks3-server[1114]: 2026/09/23 16:01:38 INFO Received sign narinfos request method=POST path=/api/pushes/45/sign lb # [ 128.733018] niks3-server[1114]: 2026/09/23 16:01:38 INFO Signed narinfos id=45 count=1 lb # [ 128.738878] niks3-server[1114]: 2026/09/23 16:01:38 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls worker2 # [ 128.740145] nix-grpc-daemon[1312]: time=2026-09-23T16:01:38.363Z level=INFO msg="Upload complete. (217ms)" lb # [ 128.749279] niks3-server[1114]: 2026/09/23 16:01:38 INFO Received complete push request method=POST path=/api/pushes/45/complete lb # [ 128.753381] niks3-server[1114]: 2026/09/23 16:01:38 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker2 # [ 128.751153] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48748 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 128.762611] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 128.771970] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 128.774885] nix-daemon[842]: reaped child process 1410, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... worker2 # [ 128.786493] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker2 # [ 130.291517] nix-daemon[842]: reaped child process 1419, status = succeeded worker2 # [ 130.377384] nix-daemon[842]: accepted connection from pid 1435, user nix-grpc-daemon (trusted) worker2 # [ 130.396856] nix-daemon[842]: reaped child process 1438, status = succeeded lb # [ 130.410700] niks3-server[1114]: 2026/09/23 16:01:40 INFO Received push request method=POST path=/api/pushes worker2 # [ 130.413948] nix-grpc-daemon[1312]: time=2026-09-23T16:01:40.036Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 130.415753] nix-grpc-daemon[1312]: time=2026-09-23T16:01:40.036Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 130.451575] niks3-server[1114]: 2026/09/23 16:01:40 INFO Received sign narinfos request method=POST path=/api/pushes/46/sign worker2 # [ 130.452544] nix-grpc-daemon[1312]: time=2026-09-23T16:01:40.076Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.469676] niks3-server[1114]: 2026/09/23 16:01:40 INFO Signed narinfos id=46 count=1 lb # [ 130.485311] niks3-server[1114]: 2026/09/23 16:01:40 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 130.499047] niks3-server[1114]: 2026/09/23 16:01:40 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 130.506591] nix-grpc-daemon[1312]: time=2026-09-23T16:01:40.130Z level=INFO msg="Upload complete. (305ms)" lb # [ 130.514457] niks3-server[1114]: 2026/09/23 16:01:40 INFO Received complete push request method=POST path=/api/pushes/46/complete lb # [ 130.526099] niks3-server[1114]: 2026/09/23 16:01:40 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker2 # [ 130.521241] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 lb # [ 130.536738] niks3-server[1114]: 2026/09/23 16:01:40 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls worker2 # [ 130.542365] nix-daemon[842]: reaped child process 1417, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby >&2, in 5.93 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag on-standby outPath, in 0.18 seconds) worker1 # [ 130.899608] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 131.031200] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:40Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 131.033522] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 131.037380] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 131.043822] nix-grpc-daemon[1415]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 131.064138] nix-grpc-daemon[1415]: E0000 00:00:1790179300.661596 1415 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 131.066528] nix-grpc-daemon[1415]: E0000 00:00:1790179300.663616 1415 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 131.092117] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:40Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 131.094335] nix-grpc-daemon[1415]: E0000 00:00:1790179300.672188 1455 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 131.096984] nix-grpc-daemon[1415]: E0000 00:00:1790179300.694414 1455 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 131.099286] nix-grpc-daemon[1415]: E0000 00:00:1790179300.694636 1455 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 131.101747] nix-grpc-daemon[1415]: E0000 00:00:1790179300.711145 1455 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 131.107230] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 131.110016] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:40Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 131.021706] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:40Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:40396 worker2 # [ 131.030119] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 11.43 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs client # [ 131.402200] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 6ce73a8ea224422cbe3a294aba45d94a client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag rs, in 0.09 seconds) worker1 # [ 131.716196] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38440 worker1 # [ 131.732937] nix-daemon[849]: accepted connection from pid 1415, user nix-grpc-daemon (trusted) client # [ 131.664399] nix[1405]: don't know how to build these paths: client # [ 131.666051] nix[1405]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 131.677903] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:41Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker2 # [ 131.685850] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:41Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 131.692845] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 131.703822] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:48748 client # [ 131.720158] nix[1405]: copying 1 paths to 'lb:50051'... worker2 # [ 131.717919] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48748 client # [ 131.725328] nix[1405]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker2 # [ 131.741299] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 131.894358] nix-daemon[842]: accepted connection from pid 1451, user nix-grpc-daemon (trusted) worker2 # [ 131.912570] nix-daemon[842]: reaped child process 1454, status = succeeded lb # [ 131.929983] niks3-server[1114]: 2026/09/23 16:01:41 INFO Received push request method=POST path=/api/pushes worker2 # [ 131.934573] nix-grpc-daemon[1312]: time=2026-09-23T16:01:41.557Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 131.936318] nix-grpc-daemon[1312]: time=2026-09-23T16:01:41.557Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 131.965759] niks3-server[1114]: 2026/09/23 16:01:41 INFO Received sign narinfos request method=POST path=/api/pushes/47/sign worker2 # [ 131.965252] nix-grpc-daemon[1312]: time=2026-09-23T16:01:41.588Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.980189] niks3-server[1114]: 2026/09/23 16:01:41 INFO Signed narinfos id=47 count=1 lb # [ 131.987635] niks3-server[1114]: 2026/09/23 16:01:41 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 132.001106] niks3-server[1114]: 2026/09/23 16:01:41 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 132.015375] niks3-server[1114]: 2026/09/23 16:01:41 INFO Received complete push request method=POST path=/api/pushes/47/complete lb # [ 132.019474] niks3-server[1114]: 2026/09/23 16:01:41 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker2 # [ 132.016208] nix-grpc-daemon[1312]: time=2026-09-23T16:01:41.639Z level=INFO msg="Upload complete. (267ms)" worker2 # [ 132.026354] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:48748 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 132.040401] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 worker2 # [ 132.059015] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) worker2 # [ 132.063409] nix-daemon[842]: reaped child process 1449, status = succeeded client # [ 132.080729] nix[1405]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker2 # [ 132.079073] nix-daemon[842]: accepted connection from pid 1252, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 134.253303] systemd-journald[269]: Received client request to rotate journal, rotating. worker1 # [ 134.273490] systemd-journald[269]: Vacuuming done, freed 0B of archived journals from /var/log/journal/db72aa263333491a82503ede879c4344. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.09 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 134.234016] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds) client: must succeed: sleep 5.0 worker2 # [ 134.237747] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:43Z level=info event=draining lb # [ 138.091393] envoy[897]: conn peer=[2001:db8:1::1]:39410 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9619 tx=4373 ms=5684 client: (finished: must succeed: sleep 5.0, in 5.05 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 139.795839] nix-daemon[842]: reaped child process 1458, status = succeeded worker2 # [ 139.872289] nix-daemon[842]: accepted connection from pid 1499, user nix-grpc-daemon (trusted) worker2 # [ 139.890887] nix-daemon[842]: reaped child process 1502, status = succeeded lb # [ 139.904706] niks3-server[1114]: 2026/09/23 16:01:49 INFO Received push request method=POST path=/api/pushes worker2 # [ 139.907803] nix-grpc-daemon[1312]: time=2026-09-23T16:01:49.529Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 139.909671] nix-grpc-daemon[1312]: time=2026-09-23T16:01:49.529Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 139.945564] niks3-server[1114]: 2026/09/23 16:01:49 INFO Received sign narinfos request method=POST path=/api/pushes/48/sign worker2 # [ 139.946410] nix-grpc-daemon[1312]: time=2026-09-23T16:01:49.569Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.962750] niks3-server[1114]: 2026/09/23 16:01:49 INFO Signed narinfos id=48 count=1 lb # [ 139.970865] niks3-server[1114]: 2026/09/23 16:01:49 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 139.977886] niks3-server[1114]: 2026/09/23 16:01:49 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 139.988534] niks3-server[1114]: 2026/09/23 16:01:49 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 139.991413] niks3-server[1114]: 2026/09/23 16:01:49 INFO Received complete push request method=POST path=/api/pushes/48/complete lb # [ 139.995701] niks3-server[1114]: 2026/09/23 16:01:49 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker2 # [ 139.987653] nix-grpc-daemon[1312]: time=2026-09-23T16:01:49.611Z level=INFO msg="Upload complete. (288ms)" worker2 # [ 140.001197] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:48748 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 140.019835] nix-daemon[842]: reaped child process 1456, status = succeeded client # [ 140.036296] systemd[1]: rs.service: Deactivated successfully. client # [ 140.041830] systemd[1]: rs.service: Consumed 212ms CPU time over 8.635s wall clock time, 41.2M memory peak, 7.4K incoming IP traffic, 8.4K outgoing IP traffic. worker2 # [ 140.239145] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:49Z level=info event=signal_exit lb # [ 140.308197] niks3-server[1114]: 2026/09/23 16:01:49 INFO lead: released remote=192.168.1.4:43072 lb # [ 140.973749] niks3-server[1114]: 2026/09/23 16:01:50 INFO lead: acquired remote=192.168.1.3:51650 worker1 # [ 141.055518] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:50Z level=info event=scheduler_take_over worker2 # [ 141.303237] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:50Z level=info event=scheduler_restarting lb # [ 141.310541] envoy[897]: [2026-09-23 16:01:50.924][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker1 # [ 141.402879] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:51Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 141.313962] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:50Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 141.323853] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:40396 worker2 # [ 141.329604] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:50Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 141.334046] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:50Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:40396 worker2 # [ 141.339513] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:50Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 141.366233] nix-daemon[842]: reaped child process 1304, status = succeeded worker1 # [ 141.603897] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:51Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 141.613399] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:51Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:45676 worker1 # [ 141.619605] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:51Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 141.541711] nix-grpc-daemon[1252]: ts=2026-09-23T16:01:51Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.20 seconds) client: waiting for success: ! systemctl is-active rs worker1 # [ 141.872716] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:51Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:45678 client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2 # [ 143.188227] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 143.194577] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 143.200561] systemd[1]: nix-grpc-daemon.service: Consumed 1.786s CPU time over 41.114s wall clock time, 39.7M memory peak, 345.9K incoming IP traffic, 172K outgoing IP traffic. worker2 # [ 143.217693] systemd[1]: Starting scheduler-token.service... worker2 # [ 143.293290] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 143.300518] systemd[1]: Finished scheduler-token.service. worker2 # [ 143.302307] systemd[1]: scheduler-token.service: Consumed 44ms CPU time over 78ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 143.309869] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 143.443904] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:53Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 143.446390] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:53Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 143.450194] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:53Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 143.456119] nix-grpc-daemon[1513]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 143.457590] nix-grpc-daemon[1513]: E0000 00:00:1790179313.078365 1513 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 143.460978] nix-grpc-daemon[1513]: E0000 00:00:1790179313.084676 1513 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 143.465353] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:53Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 143.467123] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 143.474479] nix-grpc-daemon[1513]: E0000 00:00:1790179313.096159 1554 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 143.500210] nix-grpc-daemon[1513]: E0000 00:00:1790179313.113916 1554 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 143.502451] nix-grpc-daemon[1513]: E0000 00:00:1790179313.114075 1554 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 143.510363] nix-grpc-daemon[1513]: E0000 00:00:1790179313.133287 1554 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 143.522124] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:53Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 143.623249] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:53Z level=info event=oidc_jwks provider=mock keys=1 lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 143.631298] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:53Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:45676 worker1 # [ 143.631495] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.95 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid client # [ 144.346401] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 12483d6c775f454b8b3bd61fb8079eb8 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag mid, in 0.09 seconds) worker2 # [ 144.551419] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:41638 worker2 # [ 144.565886] nix-daemon[842]: accepted connection from pid 1513, user nix-grpc-daemon (trusted) client # [ 144.586535] nix[1441]: don't know how to build these paths: client # [ 144.587894] nix[1441]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 144.688564] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:54Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker1 # [ 144.698214] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:54Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 144.709079] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38440 worker1 # [ 144.717407] nix-grpc-daemon[1415]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 1/5) worker1 # [ 144.752965] nix-grpc-daemon[1415]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 2/5) worker1 # [ 144.770911] nix-grpc-daemon[1415]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 352 ms (attempt 3/5) worker1 # [ 145.132538] nix-grpc-daemon[1415]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 4/5) worker1 # [ 145.184811] nix-grpc-daemon[1415]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 145.191470] nix-grpc-daemon[1415]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 145.210042] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38440 client # [ 145.137636] nix[1441]: copying 1 paths to 'lb:50051'... client # [ 145.143013] nix[1441]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker1 # [ 145.229747] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38440 worker1 # [ 145.245749] nix-daemon[849]: accepted connection from pid 1415, user nix-grpc-daemon (trusted) worker1 # [ 145.281587] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:54Z level=info event=niks3_push_started pid=1540 worker1 # [ 145.429486] nix-grpc-daemon[1540]: time=2026-09-23T16:01:55.048Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca="" worker1 # [ 145.538594] nix-daemon[849]: accepted connection from pid 1553, user nix-grpc-daemon (trusted) worker1 # [ 145.557050] nix-daemon[849]: reaped child process 1556, status = succeeded lb # [ 145.482388] niks3-server[1114]: 2026/09/23 16:01:55 INFO Received push request method=POST path=/api/pushes worker1 # [ 145.574442] nix-grpc-daemon[1540]: time=2026-09-23T16:01:55.193Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 145.575994] nix-grpc-daemon[1540]: time=2026-09-23T16:01:55.193Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 145.523075] niks3-server[1114]: 2026/09/23 16:01:55 INFO Received sign narinfos request method=POST path=/api/pushes/49/sign worker1 # [ 145.617884] nix-grpc-daemon[1540]: time=2026-09-23T16:01:55.235Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.537188] niks3-server[1114]: 2026/09/23 16:01:55 INFO Signed narinfos id=49 count=1 lb # [ 145.545058] niks3-server[1114]: 2026/09/23 16:01:55 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 145.553190] niks3-server[1114]: 2026/09/23 16:01:55 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst lb # [ 145.568474] niks3-server[1114]: 2026/09/23 16:01:55 INFO Received complete push request method=POST path=/api/pushes/49/complete worker1 # [ 145.657099] nix-grpc-daemon[1540]: time=2026-09-23T16:01:55.276Z level=INFO msg="Upload complete. (223ms)" worker1 # [ 145.662071] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38440 duration_s=0 paths=1 nar_bytes_in=424 lb # [ 145.580774] niks3-server[1114]: 2026/09/23 16:01:55 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo worker1 # [ 145.668330] nix-grpc-daemon[1415]: ts=2026-09-23T16:01:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38440 worker1 # [ 145.679269] nix-daemon[849]: accepted connection from pid 1415, user nix-grpc-daemon (trusted) worker1 # [ 145.680883] nix-daemon[849]: reaped child process 1538, status = succeeded worker1 # [ 145.689042] nix-daemon[849]: accepted connection from pid 1415, user nix-grpc-daemon (trusted) client # [ 145.603711] nix[1441]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... lb: must succeed: curl -sf localhost:9901/clusters lb # [ 148.090760] envoy[897]: conn peer=[2001:db8:1::1]:32890 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1542 ms=8389 lb # [ 148.095772] envoy[897]: conn peer=[2001:db8:1::4]:35754 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=15816 tx=1257 ms=39255 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker1 # [ 148.277663] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1415 (nix-grpc-daemon) on client request. worker1 # [ 148.279268] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 148.205805] niks3-server[1114]: 2026/09/23 16:01:57 INFO lead: released remote=192.168.1.3:51650 worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds) client: must succeed: sleep 5.0 client # [ 148.209003] nix[1441]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker1 # [ 148.300396] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 148.205080] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:57Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" worker1 # [ 148.301986] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker1 # [ 148.303205] systemd[1]: nix-grpc-daemon.service: Consumed 524ms CPU time over 17.400s wall clock time, 35M memory peak, 217.4K incoming IP traffic, 53.3K outgoing IP traffic. client # [ 148.214363] nix[1441]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again lb # [ 148.217649] envoy[897]: [2026-09-23 16:01:57.826][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 13, upstream_reset_after_response_started{connection_termination} worker1 # [ 148.333307] nix-daemon[849]: reaped child process 1562, status = succeeded worker1 # [ 148.335057] nix-daemon[849]: reaped child process 1474, status = succeeded worker1 # [ 148.344415] nix-daemon[1564]: unexpected Nix daemon error: error: interrupted by the user worker1 # [ 148.348968] nix-daemon[849]: reaped child process 1564, status = failed with exit code 1 worker1 # [ 148.478421] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker1 # [ 148.490789] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 148.405309] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.442328] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:58Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. retried and the latest reset reason: remote connection failure" lb # [ 148.482865] niks3-server[1114]: 2026/09/23 16:01:58 INFO lead: acquired remote=192.168.1.4:40904 worker2 # [ 148.478802] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:58Z level=info event=scheduler_take_over worker1 # [ 148.642350] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 148.644631] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 148.648345] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 148.654906] nix-grpc-daemon[1601]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 148.668170] nix-grpc-daemon[1601]: E0000 00:00:1790179318.272682 1601 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 148.670517] nix-grpc-daemon[1601]: E0000 00:00:1790179318.274703 1601 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.698144] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 148.700344] nix-grpc-daemon[1601]: E0000 00:00:1790179318.282549 1641 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 148.702880] nix-grpc-daemon[1601]: E0000 00:00:1790179318.302664 1641 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.708357] nix-grpc-daemon[1601]: E0000 00:00:1790179318.302810 1641 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker1 # [ 148.712548] nix-grpc-daemon[1601]: E0000 00:00:1790179318.317192 1641 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker1 # [ 148.715052] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 148.718447] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 148.725768] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 148.643685] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.649598] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" client # [ 148.712698] nix[1441]: scheduler at lb:50051: scheduler passive, another node serves, reconnecting worker1 # [ 148.926881] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 148.933385] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 148.850644] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 148.856265] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 149.134202] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 149.140981] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 149.057338] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 149.062779] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 149.341891] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 149.348691] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 149.265494] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:58Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 149.270850] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:58Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 149.549582] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 149.559091] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 149.472365] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 149.499731] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:59Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 149.505000] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:59Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:41642 worker2 # [ 149.511130] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 149.762040] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 149.767367] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 149.719602] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:59Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 149.727349] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:59Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 149.740443] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41638 worker2 # [ 149.751049] nix-grpc-daemon[1513]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 1/5) worker2 # [ 149.792194] nix-grpc-daemon[1513]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 63 ms (attempt 2/5) worker2 # [ 149.856830] nix-grpc-daemon[1513]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 233 ms (attempt 3/5) worker1 # [ 149.968088] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 149.974705] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:59Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 150.175576] nix-grpc-daemon[1601]: ts=2026-09-23T16:01:59Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 150.087566] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:59Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:41642 worker2 # [ 150.095062] nix-grpc-daemon[1513]: ts=2026-09-23T16:01:59Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 150.100732] nix-grpc-daemon[1513]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 21 ms (attempt 4/5) worker2 # [ 150.118750] nix-grpc-daemon[1513]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 150.123968] nix-grpc-daemon[1513]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 150.142475] nix-grpc-daemon[1513]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'... worker2 # [ 150.171246] nix-daemon[842]: accepted connection from pid 1513, user nix-grpc-daemon (trusted) worker2 # [ 150.189231] nix-daemon[842]: accepted connection from pid 1513, user nix-grpc-daemon (trusted) client # [ 150.192743] nix[1441]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker2 # [ 150.505892] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:00Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:41646 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker2 # [ 153.614277] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:03Z level=info event=niks3_push_started pid=1621 worker2 # [ 153.650203] nix-daemon[842]: reaped child process 1596, status = succeeded worker2 # [ 153.774302] nix-grpc-daemon[1621]: time=2026-09-23T16:02:03.396Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" worker2 # [ 153.884698] nix-daemon[842]: accepted connection from pid 1634, user nix-grpc-daemon (trusted) worker2 # [ 153.906067] nix-daemon[842]: reaped child process 1637, status = succeeded lb # [ 153.915273] niks3-server[1114]: 2026/09/23 16:02:03 INFO Received push request method=POST path=/api/pushes worker2 # [ 153.918575] nix-grpc-daemon[1621]: time=2026-09-23T16:02:03.540Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 153.922332] nix-grpc-daemon[1621]: time=2026-09-23T16:02:03.540Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 153.978499] niks3-server[1114]: 2026/09/23 16:02:03 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 153.997998] niks3-server[1114]: 2026/09/23 16:02:03 INFO Received sign narinfos request method=POST path=/api/pushes/50/sign worker2 # [ 153.995666] nix-grpc-daemon[1621]: time=2026-09-23T16:02:03.617Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.007901] niks3-server[1114]: 2026/09/23 16:02:03 INFO Signed narinfos id=50 count=1 lb # [ 154.020654] niks3-server[1114]: 2026/09/23 16:02:03 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 154.029182] niks3-server[1114]: 2026/09/23 16:02:03 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 154.038783] niks3-server[1114]: 2026/09/23 16:02:03 INFO Received complete push request method=POST path=/api/pushes/50/complete lb # [ 154.045865] niks3-server[1114]: 2026/09/23 16:02:03 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo worker2 # [ 154.043603] nix-grpc-daemon[1621]: time=2026-09-23T16:02:03.667Z level=INFO msg="Upload complete. (266ms)" worker2 # [ 154.060471] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41638 duration_s=4 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker2 # [ 154.078585] nix-daemon[842]: reaped child process 1594, status = succeeded client # [ 154.095282] systemd[1]: mid.service: Deactivated successfully. client # [ 154.099750] systemd[1]: mid.service: Consumed 212ms CPU time over 9.753s wall clock time, 39.5M memory peak, 8.9K incoming IP traffic, 10.9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.12 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.41 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr client # [ 154.732422] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: c9b52d8587f14a4d9596b9cc5e6153fc client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag intr, in 0.05 seconds) worker1 # [ 155.001452] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 155.017206] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) client # [ 154.950024] nix[1477]: don't know how to build these paths: client # [ 154.952155] nix[1477]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 154.961246] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:04Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker2 # [ 154.967182] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:04Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 155.061348] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 155.076710] nix-grpc-daemon[1601]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 1/5) worker1 # [ 155.112505] nix-grpc-daemon[1601]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5) worker1 # [ 155.206549] nix-grpc-daemon[1601]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 185 ms (attempt 3/5) worker1 # [ 155.401138] nix-grpc-daemon[1601]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 605 ms (attempt 4/5) worker1 # [ 156.014296] nix-grpc-daemon[1601]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 156.026247] nix-grpc-daemon[1601]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 156.043323] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 client # [ 155.969392] nix[1477]: copying 1 paths to 'lb:50051'... worker1 # [ 156.058499] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 client # [ 155.974481] nix[1477]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker1 # [ 156.076377] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 156.106282] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:05Z level=info event=niks3_push_started pid=1677 worker1 # [ 156.227721] nix-grpc-daemon[1677]: time=2026-09-23T16:02:05.847Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker1.key ca="" worker1 # [ 156.341267] nix-daemon[849]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 156.358572] nix-daemon[849]: reaped child process 1693, status = succeeded lb # [ 156.286024] niks3-server[1114]: 2026/09/23 16:02:05 INFO Received push request method=POST path=/api/pushes worker1 # [ 156.380974] nix-grpc-daemon[1677]: time=2026-09-23T16:02:05.999Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 156.382425] nix-grpc-daemon[1677]: time=2026-09-23T16:02:05.999Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 156.329840] niks3-server[1114]: 2026/09/23 16:02:05 INFO Received sign narinfos request method=POST path=/api/pushes/51/sign worker1 # [ 156.423463] nix-grpc-daemon[1677]: time=2026-09-23T16:02:06.042Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.345957] niks3-server[1114]: 2026/09/23 16:02:05 INFO Signed narinfos id=51 count=1 lb # [ 156.353938] niks3-server[1114]: 2026/09/23 16:02:05 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 156.370517] niks3-server[1114]: 2026/09/23 16:02:05 INFO Received complete push request method=POST path=/api/pushes/51/complete worker1 # [ 156.460676] nix-grpc-daemon[1677]: time=2026-09-23T16:02:06.080Z level=INFO msg="Upload complete. (229ms)" lb # [ 156.380367] niks3-server[1114]: 2026/09/23 16:02:05 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo lb # [ 156.388422] niks3-server[1114]: 2026/09/23 16:02:06 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst worker1 # [ 156.468272] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=424 worker1 # [ 156.484947] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 156.491087] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 156.497377] nix-daemon[849]: reaped child process 1675, status = succeeded worker1 # [ 156.508538] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) client # [ 156.421328] nix[1477]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... lb # [ 158.089487] envoy[897]: conn peer=[2001:db8:1::3]:49090 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=709 tx=328 ms=17197 lb # [ 158.094707] envoy[897]: conn peer=[2001:db8:1::1]:44274 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4127 tx=2025 ms=9524 client: must succeed: systemctl kill -s INT intr worker1 # [ 158.520311] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:08Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 158.432251] systemd[1]: intr.service: Sent signal SIGINT to main process 1477 (nix) on client request. client # [ 158.441270] nix[1477]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) worker1 # [ 158.540919] nix-daemon[1697]: unexpected Nix daemon error: error: interrupted by the user client # [ 158.454782] nix[1477]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) worker1 # [ 158.550998] nix-daemon[849]: reaped child process 1695, status = succeeded worker1 # [ 158.554148] nix-daemon[849]: reaped child process 1697, status = failed with exit code 1 client # [ 158.479791] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 158.485583] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 158.488648] systemd[1]: intr.service: Consumed 171ms CPU time over 3.750s wall clock time, 41.5M memory peak, 6.5K incoming IP traffic, 8.3K outgoing IP traffic. (finished: subtest: interrupting the client stops the build on the worker, in 3.87 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw client # [ 158.627163] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 6aa403cdcaa14f69b8c7324a9cd47635 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix --argstr tag sw, in 0.08 seconds) client # [ 158.818308] nix[1498]: don't know how to build these paths: client # [ 158.819926] nix[1498]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker1 # [ 158.903060] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56332 worker2 # [ 158.830301] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:08Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 158.838378] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:08Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 158.838728] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41638 worker2 # [ 158.849923] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:41638 client # [ 158.878925] nix[1498]: copying 1 paths to 'lb:50051'... client # [ 158.880870] nix[1498]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker2 # [ 158.875510] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41638 worker2 # [ 158.890684] nix-daemon[842]: accepted connection from pid 1513, user nix-grpc-daemon (trusted) worker2 # [ 159.046592] nix-daemon[842]: accepted connection from pid 1669, user nix-grpc-daemon (trusted) worker2 # [ 159.067945] nix-daemon[842]: reaped child process 1672, status = succeeded lb # [ 159.080187] niks3-server[1114]: 2026/09/23 16:02:08 INFO Received push request method=POST path=/api/pushes worker2 # [ 159.080572] nix-grpc-daemon[1621]: time=2026-09-23T16:02:08.703Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 159.082560] nix-grpc-daemon[1621]: time=2026-09-23T16:02:08.703Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 159.120186] niks3-server[1114]: 2026/09/23 16:02:08 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker2 # [ 159.120611] nix-grpc-daemon[1621]: time=2026-09-23T16:02:08.743Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.131244] niks3-server[1114]: 2026/09/23 16:02:08 INFO Received sign narinfos request method=POST path=/api/pushes/52/sign lb # [ 159.141721] niks3-server[1114]: 2026/09/23 16:02:08 INFO Signed narinfos id=52 count=1 lb # [ 159.148343] niks3-server[1114]: 2026/09/23 16:02:08 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 159.161865] niks3-server[1114]: 2026/09/23 16:02:08 INFO Received complete push request method=POST path=/api/pushes/52/complete lb # [ 159.172573] niks3-server[1114]: 2026/09/23 16:02:08 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker2 # [ 159.168593] nix-grpc-daemon[1621]: time=2026-09-23T16:02:08.792Z level=INFO msg="Upload complete. (262ms)" worker2 # [ 159.178994] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41638 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 159.192382] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41638 worker2 # [ 159.207333] nix-daemon[842]: accepted connection from pid 1513, user nix-grpc-daemon (trusted) worker2 # [ 159.213854] nix-daemon[842]: reaped child process 1667, status = succeeded worker2 # [ 159.226057] nix-daemon[842]: accepted connection from pid 1513, user nix-grpc-daemon (trusted) client # [ 159.228949] nix[1498]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2 worker2 # Checking switch inhibitors... done worker2 # [ 161.605554] nixos[1708]: switching to system configuration /nix/store/2s5bc50462smm7jcgcka8hp4k9ri5jih-nixos-system-worker2-test worker2 # activating the configuration... worker2 # [ 161.612385] systemd[1]: Stopped target Remote File Systems. worker2 # [ 161.613243] systemd[1]: Stopped target Local File Systems. worker2 # setting up /etc... worker2 # [ 162.160929] systemd[1]: Reload requested from client PID 1708 ('.switch-to-conf') (unit backdoor.service)... worker2 # [ 162.162486] systemd[1]: Reloading... worker2 # [ 167.089426] systemd[1]: Reloading finished in 4913 ms. worker2 # restarting sysinit-reactivation.target worker2 # [ 167.220752] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 167.339443] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 167.344353] systemd[1]: Reached target Reactivate sysinit units. worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service worker2 # [ 167.348954] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 167.350097] dbus-broker-launch[494]: Caught SIGHUP, trigger reload. worker2 # [ 167.361010] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 167.370100] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 167.373786] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' worker2 # [ 167.385120] dbus-broker-launch[494]: Invalid user-name in /nix/store/ng2ydfkv03gvmdws4f4mjf9wj6qj3kq6-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 167.396489] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 167.413726] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 167.420370] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 167.430070] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 167.431373] systemd[1]: Reached target Remote File Systems. worker2 # [ 167.440227] systemd[1]: Starting linger-users.service... worker2 # [ 167.441016] systemd[1]: Reached target Local File Systems. worker2 # [ 167.441755] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 167.455978] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 167.459811] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 167.465064] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 167.474745] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 167.485329] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:17Z level=info event=draining worker2 # [ 167.492379] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 167.493987] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 167.505851] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 167.509390] systemd[1]: Finished linger-users.service. worker2 # [ 167.806913] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 167.808070] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service worker2 # [ 168.064935] nixos[1708]: finished switching to system configuration /nix/store/2s5bc50462smm7jcgcka8hp4k9ri5jih-nixos-system-worker2-test worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 6.89 seconds) worker2: must succeed: pgrep -f 'read -t [9]0 x' lb # [ 168.092556] envoy[897]: conn peer=[2001:db8:1::1]:40470 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3013 tx=850 ms=3559 worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 168.453111] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 168.461714] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker2 # [ 168.393519] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:18Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 168.395672] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:18Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 168.489668] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 168.505017] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker1 # [ 168.521740] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 168.541942] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 168.716057] nix-daemon[849]: accepted connection from pid 1744, user nix-grpc-daemon (trusted) worker1 # [ 168.733325] nix-daemon[849]: reaped child process 1747, status = succeeded lb # [ 168.660693] niks3-server[1114]: 2026/09/23 16:02:18 INFO Received push request method=POST path=/api/pushes worker1 # [ 168.752290] nix-grpc-daemon[1677]: time=2026-09-23T16:02:18.371Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 168.753821] nix-grpc-daemon[1677]: time=2026-09-23T16:02:18.371Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 168.702608] niks3-server[1114]: 2026/09/23 16:02:18 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls worker1 # [ 168.797090] nix-grpc-daemon[1677]: time=2026-09-23T16:02:18.416Z level=INFO msg="Uploading 1 narinfos" lb # [ 168.716672] niks3-server[1114]: 2026/09/23 16:02:18 INFO Received sign narinfos request method=POST path=/api/pushes/53/sign lb # [ 168.723703] niks3-server[1114]: 2026/09/23 16:02:18 INFO Signed narinfos id=53 count=1 lb # [ 168.731811] niks3-server[1114]: 2026/09/23 16:02:18 INFO Received complete push request method=POST path=/api/pushes/53/complete worker1 # [ 168.826247] nix-grpc-daemon[1677]: time=2026-09-23T16:02:18.446Z level=INFO msg="Upload complete. (267ms)" lb # [ 168.747347] niks3-server[1114]: 2026/09/23 16:02:18 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo lb # [ 168.755042] niks3-server[1114]: 2026/09/23 16:02:18 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker1 # [ 168.837456] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=528 worker1 # [ 168.855261] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 168.861788] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 168.867051] nix-daemon[849]: reaped child process 1742, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... client # farm-a> node-a: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker1 # [ 168.880819] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker1 # [ 169.747825] nix-daemon[849]: reaped child process 1751, status = succeeded worker1 # [ 169.863534] nix-daemon[849]: accepted connection from pid 1767, user nix-grpc-daemon (trusted) worker1 # [ 169.883931] nix-daemon[849]: reaped child process 1770, status = succeeded lb # [ 169.808815] niks3-server[1114]: 2026/09/23 16:02:19 INFO Received push request method=POST path=/api/pushes worker1 # [ 169.904500] nix-grpc-daemon[1677]: time=2026-09-23T16:02:19.523Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 169.906392] nix-grpc-daemon[1677]: time=2026-09-23T16:02:19.523Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 169.857467] niks3-server[1114]: 2026/09/23 16:02:19 INFO Received sign narinfos request method=POST path=/api/pushes/54/sign worker1 # [ 169.947397] nix-grpc-daemon[1677]: time=2026-09-23T16:02:19.566Z level=INFO msg="Uploading 1 narinfos" lb # [ 169.871026] niks3-server[1114]: 2026/09/23 16:02:19 INFO Signed narinfos id=54 count=1 lb # [ 169.879525] niks3-server[1114]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 169.888907] niks3-server[1114]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 169.902006] niks3-server[1114]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 169.908259] niks3-server[1114]: 2026/09/23 16:02:19 INFO Received complete push request method=POST path=/api/pushes/54/complete worker1 # [ 169.988276] nix-grpc-daemon[1677]: time=2026-09-23T16:02:19.608Z level=INFO msg="Upload complete. (297ms)" lb # [ 169.912157] niks3-server[1114]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker2 # [ 169.913577] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:19Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker2 # [ 169.915451] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:19Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 170.001253] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker1 # [ 170.024365] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 170.030168] nix-daemon[849]: reaped child process 1749, status = succeeded worker1 # [ 170.040595] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 170.054091] nix-grpc-daemon[1677]: time=2026-09-23T16:02:19.673Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 170.065444] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker1 # [ 170.087837] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 170.245158] nix-daemon[849]: accepted connection from pid 1774, user nix-grpc-daemon (trusted) worker1 # [ 170.261875] nix-daemon[849]: reaped child process 1777, status = succeeded lb # [ 170.187485] niks3-server[1114]: 2026/09/23 16:02:19 INFO Received push request method=POST path=/api/pushes worker1 # [ 170.277644] nix-grpc-daemon[1677]: time=2026-09-23T16:02:19.897Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 170.279126] nix-grpc-daemon[1677]: time=2026-09-23T16:02:19.897Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 170.217240] niks3-server[1114]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst worker1 # [ 170.310152] nix-grpc-daemon[1677]: time=2026-09-23T16:02:19.929Z level=INFO msg="Uploading 1 narinfos" lb # [ 170.231367] niks3-server[1114]: 2026/09/23 16:02:19 INFO Received sign narinfos request method=POST path=/api/pushes/55/sign lb # [ 170.241951] niks3-server[1114]: 2026/09/23 16:02:19 INFO Signed narinfos id=55 count=1 lb # [ 170.247520] niks3-server[1114]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 170.256708] niks3-server[1114]: 2026/09/23 16:02:19 INFO Received complete push request method=POST path=/api/pushes/55/complete lb # [ 170.263328] niks3-server[1114]: 2026/09/23 16:02:19 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker1 # [ 170.350053] nix-grpc-daemon[1677]: time=2026-09-23T16:02:19.969Z level=INFO msg="Upload complete. (245ms)" worker1 # [ 170.360345] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 170.376577] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 170.384793] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 170.390228] nix-daemon[849]: reaped child process 1772, status = succeeded worker1 # [ 170.401074] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> node-a: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker1 # [ 172.069615] nix-daemon[849]: reaped child process 1781, status = succeeded worker1 # [ 172.201718] nix-daemon[849]: accepted connection from pid 1797, user nix-grpc-daemon (trusted) worker1 # [ 172.219425] nix-daemon[849]: reaped child process 1800, status = succeeded lb # [ 172.145621] niks3-server[1114]: 2026/09/23 16:02:21 INFO Received push request method=POST path=/api/pushes worker1 # [ 172.237497] nix-grpc-daemon[1677]: time=2026-09-23T16:02:21.856Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 172.239240] nix-grpc-daemon[1677]: time=2026-09-23T16:02:21.856Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 172.187243] niks3-server[1114]: 2026/09/23 16:02:21 INFO Received sign narinfos request method=POST path=/api/pushes/56/sign worker1 # [ 172.278349] nix-grpc-daemon[1677]: time=2026-09-23T16:02:21.897Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.201412] niks3-server[1114]: 2026/09/23 16:02:21 INFO Signed narinfos id=56 count=1 lb # [ 172.208255] niks3-server[1114]: 2026/09/23 16:02:21 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 172.216452] niks3-server[1114]: 2026/09/23 16:02:21 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls worker1 # [ 172.310996] nix-grpc-daemon[1677]: time=2026-09-23T16:02:21.930Z level=INFO msg="Upload complete. (294ms)" lb # [ 172.231460] niks3-server[1114]: 2026/09/23 16:02:21 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 172.238030] niks3-server[1114]: 2026/09/23 16:02:21 INFO Received complete push request method=POST path=/api/pushes/56/complete lb # [ 172.243173] niks3-server[1114]: 2026/09/23 16:02:21 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 172.241562] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:21Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker1 # [ 172.325319] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker2 # [ 172.244213] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:21Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 172.348230] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 172.355215] nix-daemon[849]: reaped child process 1779, status = succeeded worker1 # [ 172.358882] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 172.371973] nix-grpc-daemon[1677]: time=2026-09-23T16:02:21.991Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 172.383278] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker1 # [ 172.411483] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 172.567580] nix-daemon[849]: accepted connection from pid 1804, user nix-grpc-daemon (trusted) worker1 # [ 172.588517] nix-daemon[849]: reaped child process 1807, status = succeeded lb # [ 172.512205] niks3-server[1114]: 2026/09/23 16:02:22 INFO Received push request method=POST path=/api/pushes worker1 # [ 172.602315] nix-grpc-daemon[1677]: time=2026-09-23T16:02:22.221Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 172.604162] nix-grpc-daemon[1677]: time=2026-09-23T16:02:22.221Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 172.541673] niks3-server[1114]: 2026/09/23 16:02:22 INFO Received sign narinfos request method=POST path=/api/pushes/57/sign worker1 # [ 172.629328] nix-grpc-daemon[1677]: time=2026-09-23T16:02:22.248Z level=INFO msg="Uploading 1 narinfos" lb # [ 172.554503] niks3-server[1114]: 2026/09/23 16:02:22 INFO Signed narinfos id=57 count=1 lb # [ 172.564895] niks3-server[1114]: 2026/09/23 16:02:22 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 172.580870] niks3-server[1114]: 2026/09/23 16:02:22 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst worker1 # [ 172.670008] nix-grpc-daemon[1677]: time=2026-09-23T16:02:22.289Z level=INFO msg="Upload complete. (240ms)" lb # [ 172.591230] niks3-server[1114]: 2026/09/23 16:02:22 INFO Received complete push request method=POST path=/api/pushes/57/complete worker1 # [ 172.678195] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=768 lb # [ 172.599743] niks3-server[1114]: 2026/09/23 16:02:22 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker1 # [ 172.696581] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 172.703080] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 172.708879] nix-daemon[849]: reaped child process 1802, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker1 # [ 172.720167] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) client # farm-top> node-a: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker1 # [ 173.773388] nix-daemon[849]: reaped child process 1811, status = succeeded worker1 # [ 173.885158] nix-daemon[849]: accepted connection from pid 1827, user nix-grpc-daemon (trusted) worker1 # [ 173.906515] nix-daemon[849]: reaped child process 1830, status = succeeded lb # [ 173.829950] niks3-server[1114]: 2026/09/23 16:02:23 INFO Received push request method=POST path=/api/pushes worker1 # [ 173.922174] nix-grpc-daemon[1677]: time=2026-09-23T16:02:23.540Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 173.923716] nix-grpc-daemon[1677]: time=2026-09-23T16:02:23.540Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 173.873595] niks3-server[1114]: 2026/09/23 16:02:23 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls worker1 # [ 173.965506] nix-grpc-daemon[1677]: time=2026-09-23T16:02:23.585Z level=INFO msg="Uploading 1 narinfos" lb # [ 173.886050] niks3-server[1114]: 2026/09/23 16:02:23 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 173.897561] niks3-server[1114]: 2026/09/23 16:02:23 INFO Received sign narinfos request method=POST path=/api/pushes/58/sign lb # [ 173.908252] niks3-server[1114]: 2026/09/23 16:02:23 INFO Signed narinfos id=58 count=1 lb # [ 173.912768] niks3-server[1114]: 2026/09/23 16:02:23 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 173.917326] niks3-server[1114]: 2026/09/23 16:02:23 INFO Received complete push request method=POST path=/api/pushes/58/complete worker1 # [ 173.998032] nix-grpc-daemon[1677]: time=2026-09-23T16:02:23.617Z level=INFO msg="Upload complete. (264ms)" lb # [ 173.920947] niks3-server[1114]: 2026/09/23 16:02:23 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker1 # [ 174.009109] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker1 # [ 174.028557] nix-daemon[849]: reaped child process 1809, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain >&2, in 5.83 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag during-drain outPath, in 0.18 seconds) worker2: must succeed: pkill -f 'read -t [9]0 x' worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds) client: waiting for success: ! systemctl is-active sw worker2 # [ 174.289379] nix-daemon[842]: reaped child process 1676, status = succeeded worker2 # [ 174.397375] nix-daemon[842]: accepted connection from pid 1854, user nix-grpc-daemon (trusted) worker2 # [ 174.417429] nix-daemon[842]: reaped child process 1857, status = succeeded lb # [ 174.423884] niks3-server[1114]: 2026/09/23 16:02:24 INFO Received push request method=POST path=/api/pushes worker2 # [ 174.425793] nix-grpc-daemon[1621]: time=2026-09-23T16:02:24.048Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 174.427281] nix-grpc-daemon[1621]: time=2026-09-23T16:02:24.048Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 174.469170] niks3-server[1114]: 2026/09/23 16:02:24 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 174.471014] nix-grpc-daemon[1621]: time=2026-09-23T16:02:24.094Z level=INFO msg="Uploading 1 narinfos" lb # [ 174.481876] niks3-server[1114]: 2026/09/23 16:02:24 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 174.493843] niks3-server[1114]: 2026/09/23 16:02:24 INFO Received sign narinfos request method=POST path=/api/pushes/59/sign lb # [ 174.502972] niks3-server[1114]: 2026/09/23 16:02:24 INFO Signed narinfos id=59 count=1 lb # [ 174.514070] niks3-server[1114]: 2026/09/23 16:02:24 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 174.523694] niks3-server[1114]: 2026/09/23 16:02:24 INFO Received complete push request method=POST path=/api/pushes/59/complete worker2 # [ 174.520113] nix-grpc-daemon[1621]: time=2026-09-23T16:02:24.143Z level=INFO msg="Upload complete. (254ms)" lb # [ 174.530586] niks3-server[1114]: 2026/09/23 16:02:24 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker2 # [ 174.533036] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41638 duration_s=15 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker2 # [ 174.552840] nix-daemon[842]: reaped child process 1674, status = succeeded client # [ 174.570117] systemd[1]: sw.service: Deactivated successfully. client # [ 174.574302] systemd[1]: sw.service: Consumed 190ms CPU time over 15.941s wall clock time, 41.2M memory peak, 7.5K incoming IP traffic, 8.7K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.10 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds) worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.06 seconds) lb: waiting until exactly ['worker1', 'worker2'] are healthy members of aarch64-linux lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2 # [ 175.480582] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:25Z level=info event=signal_exit lb: must succeed: curl -sf localhost:9901/clusters lb # [ 176.489312] niks3-server[1114]: 2026/09/23 16:02:26 INFO lead: released remote=192.168.1.4:40904 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2 # [ 177.482078] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:27Z level=info event=scheduler_restarting worker1 # [ 177.573041] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:27Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 177.488867] envoy[897]: [2026-09-23 16:02:27.102][897][warning][config] [./source/extensions/config_subscription/grpc/grpc_stream.h:189] StreamEndpoints gRPC config stream to sched closed: 1, Cancelled on the server side{via_upstream} worker2 # [ 177.486614] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:27Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 177.492228] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:41642 worker2 # [ 177.505442] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:27Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 177.509991] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:27Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:41642 worker2 # [ 177.514723] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:27Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 177.538310] nix-daemon[842]: reaped child process 1569, status = succeeded lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 177.773356] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 177.779027] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 177.702948] nix-grpc-daemon[1513]: ts=2026-09-23T16:02:27Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 177.979849] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 177.986087] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 178.091187] envoy[897]: conn peer=[2001:db8:1::1]:58634 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9677 tx=4441 ms=5574 lb # [ 178.097672] envoy[897]: conn peer=[2001:db8:1::1]:40472 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3008 tx=1536 ms=15731 lb # [ 178.102495] envoy[897]: conn peer=[2001:db8:1::4]:44484 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=6137 tx=811 ms=34171 worker1 # [ 178.186151] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 178.191341] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:27Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 178.392307] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 178.397600] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 178.600124] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 178.604231] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 178.664955] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:28Z level=info event=scheduler_take_over lb # [ 178.584293] niks3-server[1114]: 2026/09/23 16:02:28 INFO lead: acquired remote=192.168.1.3:51918 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 178.800778] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 178.805948] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 179.006704] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 179.011861] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 179.212660] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:28Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 179.217737] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:28Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 179.418601] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 179.423771] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:29Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 179.511684] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 179.517085] systemd[1]: nix-grpc-daemon.service: Consumed 909ms CPU time over 36.206s wall clock time, 37.7M memory peak, 242.2K incoming IP traffic, 81.2K outgoing IP traffic. worker1 # [ 179.627108] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 179.631500] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:45790 worker1 # [ 179.636369] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker2 # [ 179.785882] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker2 # [ 179.798510] systemd[1]: Starting scheduler-token.service... worker2 # [ 179.892076] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 179.900665] systemd[1]: Finished scheduler-token.service. worker2 # [ 179.902870] systemd[1]: scheduler-token.service: Consumed 59ms CPU time over 98ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 179.911683] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 180.046516] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:29Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 180.048819] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:29Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 180.052573] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:29Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 180.057956] nix-grpc-daemon[1873]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 180.059433] nix-grpc-daemon[1873]: E0000 00:00:1790179349.680894 1873 tls_security_connector.cc:771] TlsServerCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 180.063336] nix-grpc-daemon[1873]: E0000 00:00:1790179349.686911 1873 tls_security_connector.cc:767] TlsServerCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 180.100054] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:29Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 180.101806] nix-grpc-daemon[1873]: E0000 00:00:1790179349.695833 1914 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 180.106582] nix-grpc-daemon[1873]: E0000 00:00:1790179349.710886 1914 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 180.109450] nix-grpc-daemon[1873]: E0000 00:00:1790179349.711024 1914 tls_security_connector.cc:493] TlsChannelCertificateWatcher getting identity_cert_error: UNKNOWN:Unable to get latest identity certificates. worker2 # [ 180.112155] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 180.117146] nix-grpc-daemon[1873]: E0000 00:00:1790179349.729536 1914 tls_security_connector.cc:489] TlsChannelCertificateWatcher getting root_cert_error: UNKNOWN:Unable to get latest root certificates. worker2 # [ 180.121420] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:29Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 180.221961] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:29Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 180.227969] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:29Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:45790 worker1 # [ 180.233437] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:29Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) worker1 # [ 181.573540] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:31Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:58278 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: (finished: waiting until exactly ['worker1', 'worker2'] are healthy members of aarch64-linux, in 6.50 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 23.45 seconds) subtest: queue gauges show a burst while every build blocks lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) client: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]' client # [ 182.257021] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key" --eval-store auto --impure --expr "map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ \"q0\" \"q1\" \"q2\" \"q3\" ]". client # Running as unit: burst.service; invocation ID: 459f0bb1a5d84d04ac706a3aa1955b8f client: (finished: must succeed: systemd-run --unit burst nix build --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --impure --expr 'map (tag: import /nix/store/bzzab28rfcdvvdzhgyw7sy9agp2z9pdd-slow.nix { inherit tag; }) [ "q0" "q1" "q2" "q3" ]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1 # [ 182.537630] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56332 client # [ 182.459741] nix[1554]: don't know how to build these paths: client # [ 182.461071] nix[1554]: /nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv client # [ 182.462116] nix[1554]: /nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv client # [ 182.463080] nix[1554]: /nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv client # [ 182.464176] nix[1554]: /nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv worker1 # [ 182.554186] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=debug event=want client=1 drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv cached=0 worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker1 # [ 182.561786] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=debug event=assigned drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 182.475296] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 worker1 # [ 182.567624] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=debug event=want client=1 drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv cached=0 worker1 # [ 182.573737] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=debug event=assigned drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv worker=192.168.1.4:50051 clients=1 client # [ 182.496049] nix[1554]: copying 1 paths to 'lb:50051'... worker1 # [ 182.579165] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=debug event=want client=1 drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv cached=0 worker2 # [ 182.490961] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) client # [ 182.497452] nix[1554]: copying path '/nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv' to 'lb:50051'... worker1 # [ 182.587054] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=debug event=want client=1 drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv cached=0 worker1 # [ 182.595177] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 182.604502] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 182.607377] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 worker2 # [ 182.517825] nix-grpc-daemon[1873]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5) worker1 # [ 182.613814] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker2 # [ 182.578791] nix-grpc-daemon[1873]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 2/5) worker2 # [ 182.605483] nix-grpc-daemon[1873]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 3/5) worker2 # [ 182.629261] nix-grpc-daemon[1873]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 618 ms (attempt 4/5) worker1 # [ 182.739238] nix-daemon[849]: accepted connection from pid 1845, user nix-grpc-daemon (trusted) worker1 # [ 182.758075] nix-daemon[849]: reaped child process 1848, status = succeeded lb # [ 182.682724] niks3-server[1114]: 2026/09/23 16:02:32 INFO Received push request method=POST path=/api/pushes worker1 # [ 182.774025] nix-grpc-daemon[1677]: time=2026-09-23T16:02:32.393Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 182.775673] nix-grpc-daemon[1677]: time=2026-09-23T16:02:32.393Z level=INFO msg="Uploading d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv (416B)" worker1 # [ 182.805005] nix-grpc-daemon[1677]: time=2026-09-23T16:02:32.424Z level=INFO msg="Uploading 1 narinfos" lb # [ 182.714548] niks3-server[1114]: 2026/09/23 16:02:32 INFO Received sign narinfos request method=POST path=/api/pushes/60/sign lb # [ 182.727277] niks3-server[1114]: 2026/09/23 16:02:32 INFO Signed narinfos id=60 count=1 lb # [ 182.738433] niks3-server[1114]: 2026/09/23 16:02:32 INFO Registered completed upload object_key=nar/06ismykzsix0w29371dm1hbzzf3ljf9jn7dyh8skp5wqfkkw0vlk.nar.zst lb # [ 182.750292] niks3-server[1114]: 2026/09/23 16:02:32 INFO Registered completed upload object_key=d4rrlfallgfbcpmjnsn604l2mgff4hgx.ls lb # [ 182.768783] niks3-server[1114]: 2026/09/23 16:02:32 INFO Received complete push request method=POST path=/api/pushes/60/complete worker1 # [ 182.856275] nix-grpc-daemon[1677]: time=2026-09-23T16:02:32.476Z level=INFO msg="Upload complete. (243ms)" lb # [ 182.778085] niks3-server[1114]: 2026/09/23 16:02:32 INFO Registered completed upload object_key=d4rrlfallgfbcpmjnsn604l2mgff4hgx.narinfo worker1 # [ 182.867775] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 182.880584] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 182.893340] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 182.903219] nix-daemon[849]: reaped child process 1843, status = succeeded client # [ 182.821767] nix[1554]: building '/nix/store/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv' on lb:50051... worker1 # [ 182.910819] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker2 # [ 183.249775] nix-grpc-daemon[1873]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 183.256727] nix-grpc-daemon[1873]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 183.274488] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42964 client # [ 183.292131] nix[1554]: copying 1 paths to 'lb:50051'... worker2 # [ 183.289606] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42964 client # [ 183.296181] nix[1554]: copying path '/nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv' to 'lb:50051'... worker2 # [ 183.304288] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker2 # [ 183.337414] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:32Z level=info event=niks3_push_started pid=1933 lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 183.489640] nix-grpc-daemon[1933]: time=2026-09-23T16:02:33.113Z level=INFO msg="Configuring client TLS" cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.pem key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/worker2.key ca="" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 183.603109] nix-daemon[842]: accepted connection from pid 1945, user nix-grpc-daemon (trusted) lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 183.623972] nix-daemon[842]: reaped child process 1948, status = succeeded lb # [ 183.633251] niks3-server[1114]: 2026/09/23 16:02:33 INFO Received push request method=POST path=/api/pushes worker2 # [ 183.632198] nix-grpc-daemon[1933]: time=2026-09-23T16:02:33.255Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 183.633708] nix-grpc-daemon[1933]: time=2026-09-23T16:02:33.255Z level=INFO msg="Uploading dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv (416B)" worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) lb # [ 183.667007] niks3-server[1114]: 2026/09/23 16:02:33 INFO Received sign narinfos request method=POST path=/api/pushes/61/sign worker2 # [ 183.663838] nix-grpc-daemon[1933]: time=2026-09-23T16:02:33.286Z level=INFO msg="Uploading 1 narinfos" lb # [ 183.672598] niks3-server[1114]: 2026/09/23 16:02:33 INFO Registered completed upload object_key=dspy0axfmddglppg9zj9blmxlzhfs40x.ls lb # [ 183.677163] niks3-server[1114]: 2026/09/23 16:02:33 INFO Signed narinfos id=61 count=1 lb # [ 183.681159] niks3-server[1114]: 2026/09/23 16:02:33 INFO Registered completed upload object_key=nar/06mdwsnf16qmfi86y8r33asi4vcrp5z7kdxqki87psgfpgvvpdki.nar.zst lb # [ 183.690032] niks3-server[1114]: 2026/09/23 16:02:33 INFO Received complete push request method=POST path=/api/pushes/61/complete worker2 # [ 183.686894] nix-grpc-daemon[1933]: time=2026-09-23T16:02:33.310Z level=INFO msg="Upload complete. (193ms)" lb # [ 183.696738] niks3-server[1114]: 2026/09/23 16:02:33 INFO Registered completed upload object_key=dspy0axfmddglppg9zj9blmxlzhfs40x.narinfo worker2 # [ 183.694386] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42964 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 183.705397] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 183.713075] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker2 # [ 183.717948] nix-daemon[842]: reaped child process 1931, status = succeeded client # [ 183.735628] nix[1554]: building '/nix/store/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv' on lb:50051... worker2 # [ 183.734435] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker1 # [ 184.017404] nix-daemon[849]: reaped child process 1852, status = succeeded worker1 # [ 184.087096] nix-daemon[849]: accepted connection from pid 1876, user nix-grpc-daemon (trusted) worker1 # [ 184.104980] nix-daemon[849]: reaped child process 1879, status = succeeded lb # [ 184.029738] niks3-server[1114]: 2026/09/23 16:02:33 INFO Received push request method=POST path=/api/pushes worker1 # [ 184.120401] nix-grpc-daemon[1677]: time=2026-09-23T16:02:33.739Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 184.121962] nix-grpc-daemon[1677]: time=2026-09-23T16:02:33.739Z level=INFO msg="Uploading k6zivhvzgmlyxfmy64fzd759bxlhf9b5-slow-q0 (120B)" lb # [ 184.071970] niks3-server[1114]: 2026/09/23 16:02:33 INFO Registered completed upload object_key=k6zivhvzgmlyxfmy64fzd759bxlhf9b5.ls lb # [ 184.083568] niks3-server[1114]: 2026/09/23 16:02:33 INFO Registered completed upload object_key=nar/0xr809jj32p5n6mnc6i7lqsz48wrm5f9jp14m77k724041711iq7.nar.zst worker1 # [ 184.176869] nix-grpc-daemon[1677]: time=2026-09-23T16:02:33.796Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.097782] niks3-server[1114]: 2026/09/23 16:02:33 INFO Received sign narinfos request method=POST path=/api/pushes/62/sign lb # [ 184.105634] niks3-server[1114]: 2026/09/23 16:02:33 INFO Signed narinfos id=62 count=1 lb # [ 184.111560] niks3-server[1114]: 2026/09/23 16:02:33 INFO Registered completed upload object_key=log/d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv lb # [ 184.120429] niks3-server[1114]: 2026/09/23 16:02:33 INFO Received complete push request method=POST path=/api/pushes/62/complete lb # [ 184.130500] niks3-server[1114]: 2026/09/23 16:02:33 INFO Registered completed upload object_key=k6zivhvzgmlyxfmy64fzd759bxlhf9b5.narinfo worker1 # [ 184.211544] nix-grpc-daemon[1677]: time=2026-09-23T16:02:33.831Z level=INFO msg="Upload complete. (290ms)" worker1 # [ 184.230786] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=d4rrlfallgfbcpmjnsn604l2mgff4hgx-slow-q0.drv assign_id=1 outputs=1 worker1 # [ 184.252310] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:33Z level=debug event=assigned drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 184.256634] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 184.261448] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 184.266199] nix-daemon[849]: reaped child process 1850, status = succeeded client # [ 184.184182] nix[1554]: copying 1 paths to 'lb:50051'... worker1 # [ 184.269795] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 client # [ 184.186538] nix[1554]: copying path '/nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv' to 'lb:50051'... worker1 # [ 184.284633] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 184.436320] nix-daemon[849]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker1 # [ 184.455730] nix-daemon[849]: reaped child process 1886, status = succeeded lb # [ 184.377895] niks3-server[1114]: 2026/09/23 16:02:33 INFO Received push request method=POST path=/api/pushes worker1 # [ 184.467964] nix-grpc-daemon[1677]: time=2026-09-23T16:02:34.087Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 184.469619] nix-grpc-daemon[1677]: time=2026-09-23T16:02:34.087Z level=INFO msg="Uploading jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv (416B)" lb # [ 184.408349] niks3-server[1114]: 2026/09/23 16:02:34 INFO Received sign narinfos request method=POST path=/api/pushes/63/sign worker1 # [ 184.494960] nix-grpc-daemon[1677]: time=2026-09-23T16:02:34.114Z level=INFO msg="Uploading 1 narinfos" lb # [ 184.421500] niks3-server[1114]: 2026/09/23 16:02:34 INFO Signed narinfos id=63 count=1 lb # [ 184.427398] niks3-server[1114]: 2026/09/23 16:02:34 INFO Registered completed upload object_key=nar/1fyfjzlx8vymsfmdv5cv8ymgjkr18fwm737qvys29plwwiwmyvwr.nar.zst lb # [ 184.446126] niks3-server[1114]: 2026/09/23 16:02:34 INFO Received complete push request method=POST path=/api/pushes/63/complete lb # [ 184.457205] niks3-server[1114]: 2026/09/23 16:02:34 INFO Registered completed upload object_key=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.ls lb # [ 184.466435] niks3-server[1114]: 2026/09/23 16:02:34 INFO Registered completed upload object_key=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy.narinfo worker1 # [ 184.569054] nix-grpc-daemon[1677]: time=2026-09-23T16:02:34.188Z level=INFO msg="Upload complete. (271ms)" worker1 # [ 184.579749] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 184.600296] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 184.613108] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 184.616617] nix-daemon[849]: reaped child process 1881, status = succeeded client # [ 184.542975] nix[1554]: building '/nix/store/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv' on lb:50051... worker1 # [ 184.630940] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 186.264467] nix-daemon[849]: reaped child process 1890, status = succeeded worker1 # [ 186.363505] nix-daemon[849]: accepted connection from pid 1915, user nix-grpc-daemon (trusted) worker1 # [ 186.385552] nix-daemon[849]: reaped child process 1918, status = succeeded lb # [ 186.303102] niks3-server[1114]: 2026/09/23 16:02:35 INFO Received push request method=POST path=/api/pushes worker1 # [ 186.400425] nix-grpc-daemon[1677]: time=2026-09-23T16:02:36.017Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 186.401879] nix-grpc-daemon[1677]: time=2026-09-23T16:02:36.017Z level=INFO msg="Uploading gjyi8j90pk5flrsqqdhj6h132pcb7n33-slow-q2 (120B)" lb # [ 186.351412] niks3-server[1114]: 2026/09/23 16:02:35 INFO Received sign narinfos request method=POST path=/api/pushes/64/sign worker1 # [ 186.440857] nix-grpc-daemon[1677]: time=2026-09-23T16:02:36.060Z level=INFO msg="Uploading 1 narinfos" lb # [ 186.367045] niks3-server[1114]: 2026/09/23 16:02:35 INFO Signed narinfos id=64 count=1 lb # [ 186.376670] niks3-server[1114]: 2026/09/23 16:02:35 INFO Registered completed upload object_key=gjyi8j90pk5flrsqqdhj6h132pcb7n33.ls lb # [ 186.384440] niks3-server[1114]: 2026/09/23 16:02:35 INFO Registered completed upload object_key=log/jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv lb # [ 186.387524] niks3-server[1114]: 2026/09/23 16:02:35 INFO Registered completed upload object_key=nar/15imdx7zyy6mzjjv6qvdzywh0d9w1n6ikc0rq4rq95aw9x6swfzj.nar.zst lb # [ 186.401847] niks3-server[1114]: 2026/09/23 16:02:36 INFO Received complete push request method=POST path=/api/pushes/64/complete lb # [ 186.404551] niks3-server[1114]: 2026/09/23 16:02:36 INFO Registered completed upload object_key=gjyi8j90pk5flrsqqdhj6h132pcb7n33.narinfo worker1 # [ 186.488894] nix-grpc-daemon[1677]: time=2026-09-23T16:02:36.108Z level=INFO msg="Upload complete. (242ms)" worker2 # [ 186.403086] nix-daemon[842]: reaped child process 1955, status = succeeded worker1 # [ 186.505193] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=jgwqjvc2sfm39r12g67n9dhiqhi4z7xy-slow-q2.drv assign_id=3 outputs=1 worker1 # [ 186.524629] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:36Z level=debug event=assigned drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 186.528573] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 186.531750] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 186.536350] nix-daemon[849]: reaped child process 1888, status = succeeded client # [ 186.457375] nix[1554]: copying 1 paths to 'lb:50051'... worker1 # [ 186.544437] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 client # [ 186.461736] nix[1554]: copying path '/nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv' to 'lb:50051'... worker1 # [ 186.554125] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker2 # [ 186.534288] nix-daemon[842]: accepted connection from pid 1981, user nix-grpc-daemon (trusted) worker2 # [ 186.553538] nix-daemon[842]: reaped child process 1984, status = succeeded lb # [ 186.568795] niks3-server[1114]: 2026/09/23 16:02:36 INFO Received push request method=POST path=/api/pushes worker2 # [ 186.570565] nix-grpc-daemon[1933]: time=2026-09-23T16:02:36.192Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 186.573252] nix-grpc-daemon[1933]: time=2026-09-23T16:02:36.192Z level=INFO msg="Uploading y3qkgrgq2zzpgvi2rf5chq94i627wkdb-slow-q3 (120B)" lb # [ 186.604813] niks3-server[1114]: 2026/09/23 16:02:36 INFO Received sign narinfos request method=POST path=/api/pushes/65/sign worker1 # [ 186.693349] nix-daemon[849]: accepted connection from pid 1922, user nix-grpc-daemon (trusted) worker2 # [ 186.606888] nix-grpc-daemon[1933]: time=2026-09-23T16:02:36.230Z level=INFO msg="Uploading 1 narinfos" lb # [ 186.622579] niks3-server[1114]: 2026/09/23 16:02:36 INFO Signed narinfos id=65 count=1 worker1 # [ 186.713056] nix-daemon[849]: reaped child process 1925, status = succeeded lb # [ 186.632297] niks3-server[1114]: 2026/09/23 16:02:36 INFO Registered completed upload object_key=nar/1v1grzkvw3yj09x0dkdm2avihvqvnri156qzp768hk85zbw7lkn9.nar.zst worker1 # [ 186.731516] nix-grpc-daemon[1677]: time=2026-09-23T16:02:36.351Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 186.733289] nix-grpc-daemon[1677]: time=2026-09-23T16:02:36.351Z level=INFO msg="Uploading pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv (416B)" lb # [ 186.651358] niks3-server[1114]: 2026/09/23 16:02:36 INFO Registered completed upload object_key=log/dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv worker2 # [ 186.651095] nix-grpc-daemon[1933]: time=2026-09-23T16:02:36.274Z level=INFO msg="Upload complete. (301ms)" lb # [ 186.661137] niks3-server[1114]: 2026/09/23 16:02:36 INFO Registered completed upload object_key=y3qkgrgq2zzpgvi2rf5chq94i627wkdb.ls lb # [ 186.669413] niks3-server[1114]: 2026/09/23 16:02:36 INFO Received push request method=POST path=/api/pushes lb # [ 186.674668] niks3-server[1114]: 2026/09/23 16:02:36 INFO Received complete push request method=POST path=/api/pushes/65/complete worker2 # [ 186.665189] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 duration_s=2 drv=dspy0axfmddglppg9zj9blmxlzhfs40x-slow-q3.drv assign_id=2 outputs=1 worker1 # [ 186.764910] nix-grpc-daemon[1677]: time=2026-09-23T16:02:36.384Z level=INFO msg="Uploading 1 narinfos" lb # [ 186.684252] niks3-server[1114]: 2026/09/23 16:02:36 INFO Registered completed upload object_key=y3qkgrgq2zzpgvi2rf5chq94i627wkdb.narinfo lb # [ 186.687682] niks3-server[1114]: 2026/09/23 16:02:36 INFO Received sign narinfos request method=POST path=/api/pushes/66/sign worker2 # [ 186.683796] nix-daemon[842]: reaped child process 1952, status = succeeded lb # [ 186.699997] niks3-server[1114]: 2026/09/23 16:02:36 INFO Signed narinfos id=66 count=1 lb # [ 186.707950] niks3-server[1114]: 2026/09/23 16:02:36 INFO Registered completed upload object_key=nar/1k21jrz411xc9gkca2pnr9mrjq1s3bg3zhsam3nnv4j066dgzgm7.nar.zst lb # [ 186.712164] niks3-server[1114]: 2026/09/23 16:02:36 INFO Registered completed upload object_key=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.ls worker1 # [ 186.797505] nix-grpc-daemon[1677]: time=2026-09-23T16:02:36.417Z level=INFO msg="Upload complete. (231ms)" lb # [ 186.718615] niks3-server[1114]: 2026/09/23 16:02:36 INFO Received complete push request method=POST path=/api/pushes/66/complete lb # [ 186.721603] niks3-server[1114]: 2026/09/23 16:02:36 INFO Registered completed upload object_key=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd.narinfo worker1 # [ 186.808330] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 186.824688] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 186.831607] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 186.840611] nix-daemon[849]: reaped child process 1920, status = succeeded client # [ 186.763099] nix[1554]: building '/nix/store/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv' on lb:50051... worker1 # [ 186.852619] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 188.732557] nix-daemon[849]: reaped child process 1929, status = succeeded worker1 # [ 188.809913] nix-daemon[849]: accepted connection from pid 1954, user nix-grpc-daemon (trusted) worker1 # [ 188.828888] nix-daemon[849]: reaped child process 1957, status = succeeded lb # [ 188.754178] niks3-server[1114]: 2026/09/23 16:02:38 INFO Received push request method=POST path=/api/pushes worker1 # [ 188.848148] nix-grpc-daemon[1677]: time=2026-09-23T16:02:38.464Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 188.849775] nix-grpc-daemon[1677]: time=2026-09-23T16:02:38.464Z level=INFO msg="Uploading l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx-slow-q1 (120B)" lb # [ 188.798460] niks3-server[1114]: 2026/09/23 16:02:38 INFO Registered completed upload object_key=l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.ls worker1 # [ 188.890181] nix-grpc-daemon[1677]: time=2026-09-23T16:02:38.509Z level=INFO msg="Uploading 1 narinfos" lb # [ 188.811702] niks3-server[1114]: 2026/09/23 16:02:38 INFO Received sign narinfos request method=POST path=/api/pushes/67/sign lb # [ 188.821145] niks3-server[1114]: 2026/09/23 16:02:38 INFO Signed narinfos id=67 count=1 lb # [ 188.826430] niks3-server[1114]: 2026/09/23 16:02:38 INFO Registered completed upload object_key=nar/0c1c367r3msa4fz6imwp70zxi4fxvrkb86v3hv921wsrf13yd8v3.nar.zst lb # [ 188.838588] niks3-server[1114]: 2026/09/23 16:02:38 INFO Registered completed upload object_key=log/pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv lb # [ 188.844460] niks3-server[1114]: 2026/09/23 16:02:38 INFO Received complete push request method=POST path=/api/pushes/67/complete lb # [ 188.849371] niks3-server[1114]: 2026/09/23 16:02:38 INFO Registered completed upload object_key=l3s7m1wb77d0cgdpbn5bcb47ibrwjvmx.narinfo worker1 # [ 188.930986] nix-grpc-daemon[1677]: time=2026-09-23T16:02:38.549Z level=INFO msg="Upload complete. (264ms)" worker1 # [ 188.943267] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=2 drv=pgfqjrvqz7k2z3ab3gk4xjy7130b5jcd-slow-q1.drv assign_id=4 outputs=1 worker1 # [ 188.964676] nix-daemon[849]: reaped child process 1927, status = succeeded client # [ 188.917607] systemd[1]: burst.service: Deactivated successfully. client # [ 188.922129] systemd[1]: burst.service: Consumed 229ms CPU time over 6.664s wall clock time, 55.6M memory peak, 14.1K incoming IP traffic, 19.2K outgoing IP traffic. client: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; } client: (finished: must succeed: systemctl show -p Result --value burst | grep -qx success || { journalctl -u burst >&2; false; }, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: queue gauges show a burst while every build blocks, in 8.08 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 190.415637] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:56332 worker2 # [ 190.332834] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42964 worker1 # [ 190.466316] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:40Z level=debug event=want client=2 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker1 # [ 190.473342] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:40Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 190.482657] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:40Z level=debug event=want client=2 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker1 # [ 190.490682] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:40Z level=debug event=want client=2 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 190.498278] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 190.505150] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 190.511685] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 190.526566] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 190.674385] nix-daemon[849]: accepted connection from pid 1970, user nix-grpc-daemon (trusted) worker1 # [ 190.698094] nix-daemon[849]: reaped child process 1973, status = succeeded lb # [ 190.615299] niks3-server[1114]: 2026/09/23 16:02:40 INFO Received push request method=POST path=/api/pushes worker1 # [ 190.707507] nix-grpc-daemon[1677]: time=2026-09-23T16:02:40.326Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 190.709143] nix-grpc-daemon[1677]: time=2026-09-23T16:02:40.326Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 190.643014] niks3-server[1114]: 2026/09/23 16:02:40 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls worker1 # [ 190.736557] nix-grpc-daemon[1677]: time=2026-09-23T16:02:40.356Z level=INFO msg="Uploading 1 narinfos" lb # [ 190.651645] niks3-server[1114]: 2026/09/23 16:02:40 INFO Received sign narinfos request method=POST path=/api/pushes/68/sign lb # [ 190.657334] niks3-server[1114]: 2026/09/23 16:02:40 INFO Signed narinfos id=68 count=1 lb # [ 190.661648] niks3-server[1114]: 2026/09/23 16:02:40 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst lb # [ 190.678312] niks3-server[1114]: 2026/09/23 16:02:40 INFO Received complete push request method=POST path=/api/pushes/68/complete worker1 # [ 190.764042] nix-grpc-daemon[1677]: time=2026-09-23T16:02:40.383Z level=INFO msg="Upload complete. (223ms)" lb # [ 190.685472] niks3-server[1114]: 2026/09/23 16:02:40 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 190.770965] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 190.786437] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 190.793352] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 190.798762] nix-daemon[849]: reaped child process 1968, status = succeeded worker1 # [ 190.810049] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 192.115660] nix-daemon[849]: reaped child process 1977, status = succeeded worker1 # [ 192.182342] nix-daemon[849]: accepted connection from pid 1993, user nix-grpc-daemon (trusted) worker1 # [ 192.202899] nix-daemon[849]: reaped child process 1996, status = succeeded lb # [ 192.126620] niks3-server[1114]: 2026/09/23 16:02:41 INFO Received push request method=POST path=/api/pushes worker1 # [ 192.219652] nix-grpc-daemon[1677]: time=2026-09-23T16:02:41.837Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 192.222871] nix-grpc-daemon[1677]: time=2026-09-23T16:02:41.837Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 192.172196] niks3-server[1114]: 2026/09/23 16:02:41 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst worker1 # [ 192.264448] nix-grpc-daemon[1677]: time=2026-09-23T16:02:41.884Z level=INFO msg="Uploading 1 narinfos" lb # [ 192.186225] niks3-server[1114]: 2026/09/23 16:02:41 INFO Received sign narinfos request method=POST path=/api/pushes/69/sign lb # [ 192.195278] niks3-server[1114]: 2026/09/23 16:02:41 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 192.205681] niks3-server[1114]: 2026/09/23 16:02:41 INFO Signed narinfos id=69 count=1 lb # [ 192.211387] niks3-server[1114]: 2026/09/23 16:02:41 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 192.223133] niks3-server[1114]: 2026/09/23 16:02:41 INFO Received complete push request method=POST path=/api/pushes/69/complete worker1 # [ 192.310484] nix-grpc-daemon[1677]: time=2026-09-23T16:02:41.930Z level=INFO msg="Upload complete. (287ms)" lb # [ 192.230451] niks3-server[1114]: 2026/09/23 16:02:41 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 192.329209] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=5 outputs=1 worker1 # [ 192.346114] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:41Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 192.356819] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 192.364423] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:41Z level=debug event=want client=2 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 192.378343] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 192.387823] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 192.394179] nix-daemon[849]: reaped child process 1975, status = succeeded worker1 # [ 192.398510] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 192.520666] nix-daemon[849]: accepted connection from pid 2002, user nix-grpc-daemon (trusted) worker1 # [ 192.539523] nix-daemon[849]: reaped child process 2005, status = succeeded lb # [ 192.461900] niks3-server[1114]: 2026/09/23 16:02:42 INFO Received push request method=POST path=/api/pushes worker1 # [ 192.553348] nix-grpc-daemon[1677]: time=2026-09-23T16:02:42.172Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 192.555063] nix-grpc-daemon[1677]: time=2026-09-23T16:02:42.172Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 192.498052] niks3-server[1114]: 2026/09/23 16:02:42 INFO Received sign narinfos request method=POST path=/api/pushes/70/sign worker1 # [ 192.587313] nix-grpc-daemon[1677]: time=2026-09-23T16:02:42.207Z level=INFO msg="Uploading 1 narinfos" lb # [ 192.510698] niks3-server[1114]: 2026/09/23 16:02:42 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst lb # [ 192.522194] niks3-server[1114]: 2026/09/23 16:02:42 INFO Signed narinfos id=70 count=1 lb # [ 192.528305] niks3-server[1114]: 2026/09/23 16:02:42 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 192.540766] niks3-server[1114]: 2026/09/23 16:02:42 INFO Received complete push request method=POST path=/api/pushes/70/complete worker1 # [ 192.627958] nix-grpc-daemon[1677]: time=2026-09-23T16:02:42.247Z level=INFO msg="Upload complete. (234ms)" lb # [ 192.547827] niks3-server[1114]: 2026/09/23 16:02:42 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 192.638425] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 192.655767] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 192.662248] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 192.667332] nix-daemon[849]: reaped child process 2000, status = succeeded worker1 # [ 192.680481] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 193.315523] nix-daemon[849]: reaped child process 2009, status = succeeded worker1 # [ 193.411758] nix-daemon[849]: accepted connection from pid 2025, user nix-grpc-daemon (trusted) worker1 # [ 193.432753] nix-daemon[849]: reaped child process 2028, status = succeeded lb # [ 193.354657] niks3-server[1114]: 2026/09/23 16:02:42 INFO Received push request method=POST path=/api/pushes worker1 # [ 193.443670] nix-grpc-daemon[1677]: time=2026-09-23T16:02:43.062Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 193.445261] nix-grpc-daemon[1677]: time=2026-09-23T16:02:43.062Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 193.385131] niks3-server[1114]: 2026/09/23 16:02:43 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls worker1 # [ 193.474315] nix-grpc-daemon[1677]: time=2026-09-23T16:02:43.094Z level=INFO msg="Uploading 1 narinfos" lb # [ 193.393837] niks3-server[1114]: 2026/09/23 16:02:43 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst lb # [ 193.403647] niks3-server[1114]: 2026/09/23 16:02:43 INFO Received sign narinfos request method=POST path=/api/pushes/71/sign lb # [ 193.412579] niks3-server[1114]: 2026/09/23 16:02:43 INFO Signed narinfos id=71 count=1 lb # [ 193.414571] niks3-server[1114]: 2026/09/23 16:02:43 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 193.421435] niks3-server[1114]: 2026/09/23 16:02:43 INFO Received complete push request method=POST path=/api/pushes/71/complete lb # [ 193.425302] niks3-server[1114]: 2026/09/23 16:02:43 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker1 # [ 193.506167] nix-grpc-daemon[1677]: time=2026-09-23T16:02:43.126Z level=INFO msg="Upload complete. (216ms)" worker1 # [ 193.519581] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=6 outputs=1 worker1 # [ 193.532310] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:43Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 193.535548] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 193.544166] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:43Z level=debug event=want client=2 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 193.547577] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 193.550353] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 193.561717] nix-daemon[849]: reaped child process 2007, status = succeeded worker1 # [ 193.563107] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 193.678232] nix-daemon[849]: accepted connection from pid 2034, user nix-grpc-daemon (trusted) worker1 # [ 193.699210] nix-daemon[849]: reaped child process 2037, status = succeeded lb # [ 193.621906] niks3-server[1114]: 2026/09/23 16:02:43 INFO Received push request method=POST path=/api/pushes worker1 # [ 193.711308] nix-grpc-daemon[1677]: time=2026-09-23T16:02:43.330Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 193.712930] nix-grpc-daemon[1677]: time=2026-09-23T16:02:43.330Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" worker1 # [ 193.738637] nix-grpc-daemon[1677]: time=2026-09-23T16:02:43.358Z level=INFO msg="Uploading 1 narinfos" lb # [ 193.651875] niks3-server[1114]: 2026/09/23 16:02:43 INFO Received sign narinfos request method=POST path=/api/pushes/72/sign lb # [ 193.666630] niks3-server[1114]: 2026/09/23 16:02:43 INFO Signed narinfos id=72 count=1 lb # [ 193.673851] niks3-server[1114]: 2026/09/23 16:02:43 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 193.686270] niks3-server[1114]: 2026/09/23 16:02:43 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst worker1 # [ 193.774481] nix-grpc-daemon[1677]: time=2026-09-23T16:02:43.394Z level=INFO msg="Upload complete. (206ms)" lb # [ 193.695010] niks3-server[1114]: 2026/09/23 16:02:43 INFO Received complete push request method=POST path=/api/pushes/72/complete lb # [ 193.700673] niks3-server[1114]: 2026/09/23 16:02:43 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 193.784289] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 193.792805] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 193.803259] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 193.812374] nix-daemon[849]: reaped child process 2032, status = succeeded worker1 # [ 193.822212] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 194.700526] nix-daemon[849]: reaped child process 2041, status = succeeded worker1 # [ 194.795769] nix-daemon[849]: accepted connection from pid 2057, user nix-grpc-daemon (trusted) worker1 # [ 194.814845] nix-daemon[849]: reaped child process 2060, status = succeeded lb # [ 194.739048] niks3-server[1114]: 2026/09/23 16:02:44 INFO Received push request method=POST path=/api/pushes worker1 # [ 194.832212] nix-grpc-daemon[1677]: time=2026-09-23T16:02:44.449Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 194.833772] nix-grpc-daemon[1677]: time=2026-09-23T16:02:44.449Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 194.778495] niks3-server[1114]: 2026/09/23 16:02:44 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker1 # [ 194.873963] nix-grpc-daemon[1677]: time=2026-09-23T16:02:44.493Z level=INFO msg="Uploading 1 narinfos" lb # [ 194.792672] niks3-server[1114]: 2026/09/23 16:02:44 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 194.803058] niks3-server[1114]: 2026/09/23 16:02:44 INFO Received sign narinfos request method=POST path=/api/pushes/73/sign lb # [ 194.815670] niks3-server[1114]: 2026/09/23 16:02:44 INFO Signed narinfos id=73 count=1 worker1 # [ 194.902665] nix-grpc-daemon[1677]: time=2026-09-23T16:02:44.522Z level=INFO msg="Upload complete. (270ms)" lb # [ 194.823688] niks3-server[1114]: 2026/09/23 16:02:44 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 194.833012] niks3-server[1114]: 2026/09/23 16:02:44 INFO Received complete push request method=POST path=/api/pushes/73/complete lb # [ 194.838246] niks3-server[1114]: 2026/09/23 16:02:44 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker1 # [ 194.917813] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=7 outputs=1 worker1 # [ 194.940281] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:44Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 194.949787] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 194.954918] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:44Z level=debug event=want client=2 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 194.960397] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 194.965696] nix-grpc-daemon[1677]: time=2026-09-23T16:02:44.584Z level=INFO msg="All 1 paths already cached" worker1 # [ 194.969746] nix-daemon[849]: reaped child process 2039, status = succeeded worker1 # [ 194.984215] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 194.989458] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 195.117625] nix-daemon[849]: accepted connection from pid 2066, user nix-grpc-daemon (trusted) worker1 # [ 195.134440] nix-daemon[849]: reaped child process 2069, status = succeeded lb # [ 195.059897] niks3-server[1114]: 2026/09/23 16:02:44 INFO Received push request method=POST path=/api/pushes worker1 # [ 195.149740] nix-grpc-daemon[1677]: time=2026-09-23T16:02:44.769Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 195.151453] nix-grpc-daemon[1677]: time=2026-09-23T16:02:44.769Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 195.088591] niks3-server[1114]: 2026/09/23 16:02:44 INFO Received sign narinfos request method=POST path=/api/pushes/74/sign worker1 # [ 195.176489] nix-grpc-daemon[1677]: time=2026-09-23T16:02:44.796Z level=INFO msg="Uploading 1 narinfos" lb # [ 195.101913] niks3-server[1114]: 2026/09/23 16:02:44 INFO Signed narinfos id=74 count=1 lb # [ 195.111685] niks3-server[1114]: 2026/09/23 16:02:44 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst lb # [ 195.127934] niks3-server[1114]: 2026/09/23 16:02:44 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls worker1 # [ 195.218251] nix-grpc-daemon[1677]: time=2026-09-23T16:02:44.838Z level=INFO msg="Upload complete. (225ms)" lb # [ 195.138129] niks3-server[1114]: 2026/09/23 16:02:44 INFO Received complete push request method=POST path=/api/pushes/74/complete lb # [ 195.143683] niks3-server[1114]: 2026/09/23 16:02:44 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 195.228368] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 195.245693] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 195.252425] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 195.257810] nix-daemon[849]: reaped child process 2064, status = succeeded worker1 # [ 195.271753] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 196.939620] nix-daemon[849]: reaped child process 2073, status = succeeded worker1 # [ 197.049185] nix-daemon[849]: accepted connection from pid 2089, user nix-grpc-daemon (trusted) worker1 # [ 197.067691] nix-daemon[849]: reaped child process 2092, status = succeeded lb # [ 196.993887] niks3-server[1114]: 2026/09/23 16:02:46 INFO Received push request method=POST path=/api/pushes worker1 # [ 197.086334] nix-grpc-daemon[1677]: time=2026-09-23T16:02:46.704Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 197.087952] nix-grpc-daemon[1677]: time=2026-09-23T16:02:46.704Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 197.032573] niks3-server[1114]: 2026/09/23 16:02:46 INFO Received sign narinfos request method=POST path=/api/pushes/75/sign worker1 # [ 197.122070] nix-grpc-daemon[1677]: time=2026-09-23T16:02:46.741Z level=INFO msg="Uploading 1 narinfos" lb # [ 197.045922] niks3-server[1114]: 2026/09/23 16:02:46 INFO Signed narinfos id=75 count=1 lb # [ 197.054993] niks3-server[1114]: 2026/09/23 16:02:46 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 197.067700] niks3-server[1114]: 2026/09/23 16:02:46 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 197.073044] niks3-server[1114]: 2026/09/23 16:02:46 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 197.077987] niks3-server[1114]: 2026/09/23 16:02:46 INFO Received complete push request method=POST path=/api/pushes/75/complete worker1 # [ 197.163278] nix-grpc-daemon[1677]: time=2026-09-23T16:02:46.783Z level=INFO msg="Upload complete. (280ms)" lb # [ 197.084467] niks3-server[1114]: 2026/09/23 16:02:46 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker1 # [ 197.185135] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=8 outputs=1 worker1 # [ 197.200961] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:46Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 197.212199] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 197.218384] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:46Z level=debug event=want client=2 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 197.224448] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 197.237925] nix-daemon[849]: reaped child process 2071, status = succeeded worker1 # [ 197.239987] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 197.248566] nix-grpc-daemon[1677]: time=2026-09-23T16:02:46.843Z level=INFO msg="All 1 paths already cached" worker1 # [ 197.253791] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 197.379825] nix-daemon[849]: accepted connection from pid 2098, user nix-grpc-daemon (trusted) worker1 # [ 197.398275] nix-daemon[849]: reaped child process 2101, status = succeeded lb # [ 197.322151] niks3-server[1114]: 2026/09/23 16:02:46 INFO Received push request method=POST path=/api/pushes worker1 # [ 197.412745] nix-grpc-daemon[1677]: time=2026-09-23T16:02:47.032Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 197.414239] nix-grpc-daemon[1677]: time=2026-09-23T16:02:47.032Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" worker1 # [ 197.437606] nix-grpc-daemon[1677]: time=2026-09-23T16:02:47.057Z level=INFO msg="Uploading 1 narinfos" lb # [ 197.351141] niks3-server[1114]: 2026/09/23 16:02:46 INFO Received sign narinfos request method=POST path=/api/pushes/76/sign lb # [ 197.363695] niks3-server[1114]: 2026/09/23 16:02:46 INFO Signed narinfos id=76 count=1 lb # [ 197.370435] niks3-server[1114]: 2026/09/23 16:02:46 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst lb # [ 197.386283] niks3-server[1114]: 2026/09/23 16:02:46 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls worker1 # [ 197.473984] nix-grpc-daemon[1677]: time=2026-09-23T16:02:47.093Z level=INFO msg="Upload complete. (220ms)" lb # [ 197.395352] niks3-server[1114]: 2026/09/23 16:02:46 INFO Received complete push request method=POST path=/api/pushes/76/complete lb # [ 197.400643] niks3-server[1114]: 2026/09/23 16:02:47 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 197.484356] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 197.498017] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 197.504253] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 197.510520] nix-daemon[849]: reaped child process 2096, status = succeeded worker1 # [ 197.522051] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) lb # [ 198.094169] envoy[897]: conn peer=[2001:db8:1::1]:51962 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9744 tx=5256 ms=6436 worker1 # [ 198.571855] nix-daemon[849]: reaped child process 2105, status = succeeded worker1 # [ 198.667866] nix-daemon[849]: accepted connection from pid 2121, user nix-grpc-daemon (trusted) worker1 # [ 198.685336] nix-daemon[849]: reaped child process 2124, status = succeeded lb # [ 198.611021] niks3-server[1114]: 2026/09/23 16:02:48 INFO Received push request method=POST path=/api/pushes worker1 # [ 198.702628] nix-grpc-daemon[1677]: time=2026-09-23T16:02:48.321Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 198.707754] nix-grpc-daemon[1677]: time=2026-09-23T16:02:48.321Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 198.658657] niks3-server[1114]: 2026/09/23 16:02:48 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls worker1 # [ 198.749842] nix-grpc-daemon[1677]: time=2026-09-23T16:02:48.369Z level=INFO msg="Uploading 1 narinfos" lb # [ 198.670158] niks3-server[1114]: 2026/09/23 16:02:48 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 198.681234] niks3-server[1114]: 2026/09/23 16:02:48 INFO Received sign narinfos request method=POST path=/api/pushes/77/sign lb # [ 198.691996] niks3-server[1114]: 2026/09/23 16:02:48 INFO Signed narinfos id=77 count=1 worker1 # [ 198.779027] nix-grpc-daemon[1677]: time=2026-09-23T16:02:48.398Z level=INFO msg="Upload complete. (245ms)" lb # [ 198.698799] niks3-server[1114]: 2026/09/23 16:02:48 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 198.704548] niks3-server[1114]: 2026/09/23 16:02:48 INFO Received complete push request method=POST path=/api/pushes/77/complete lb # [ 198.710833] niks3-server[1114]: 2026/09/23 16:02:48 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker1 # [ 198.795275] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=9 outputs=1 worker1 # [ 198.809052] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:48Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 198.820989] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 198.826372] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:48Z level=debug event=want client=2 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 198.831431] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 198.836379] nix-grpc-daemon[1677]: time=2026-09-23T16:02:48.455Z level=INFO msg="All 1 paths already cached" worker1 # [ 198.838938] nix-daemon[849]: reaped child process 2103, status = succeeded worker1 # [ 198.841660] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 198.855785] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 198.980246] nix-daemon[849]: accepted connection from pid 2130, user nix-grpc-daemon (trusted) worker1 # [ 199.001605] nix-daemon[849]: reaped child process 2133, status = succeeded lb # [ 198.918576] niks3-server[1114]: 2026/09/23 16:02:48 INFO Received push request method=POST path=/api/pushes worker1 # [ 199.009846] nix-grpc-daemon[1677]: time=2026-09-23T16:02:48.629Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 199.011285] nix-grpc-daemon[1677]: time=2026-09-23T16:02:48.629Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 198.948975] niks3-server[1114]: 2026/09/23 16:02:48 INFO Received sign narinfos request method=POST path=/api/pushes/78/sign worker1 # [ 199.039070] nix-grpc-daemon[1677]: time=2026-09-23T16:02:48.658Z level=INFO msg="Uploading 1 narinfos" lb # [ 198.963609] niks3-server[1114]: 2026/09/23 16:02:48 INFO Signed narinfos id=78 count=1 lb # [ 198.971968] niks3-server[1114]: 2026/09/23 16:02:48 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 198.988124] niks3-server[1114]: 2026/09/23 16:02:48 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 198.991454] niks3-server[1114]: 2026/09/23 16:02:48 INFO Received complete push request method=POST path=/api/pushes/78/complete worker1 # [ 199.079502] nix-grpc-daemon[1677]: time=2026-09-23T16:02:48.699Z level=INFO msg="Upload complete. (218ms)" lb # [ 198.998174] niks3-server[1114]: 2026/09/23 16:02:48 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 199.087711] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 199.102651] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 199.109055] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 199.113833] nix-daemon[849]: reaped child process 2128, status = succeeded worker1 # [ 199.127457] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 199.767307] nix-daemon[849]: reaped child process 2137, status = succeeded worker1 # [ 199.857260] nix-daemon[849]: accepted connection from pid 2153, user nix-grpc-daemon (trusted) worker1 # [ 199.876277] nix-daemon[849]: reaped child process 2156, status = succeeded lb # [ 199.801209] niks3-server[1114]: 2026/09/23 16:02:49 INFO Received push request method=POST path=/api/pushes worker1 # [ 199.892413] nix-grpc-daemon[1677]: time=2026-09-23T16:02:49.511Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 199.893922] nix-grpc-daemon[1677]: time=2026-09-23T16:02:49.511Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 199.839609] niks3-server[1114]: 2026/09/23 16:02:49 INFO Received sign narinfos request method=POST path=/api/pushes/79/sign worker1 # [ 199.929867] nix-grpc-daemon[1677]: time=2026-09-23T16:02:49.549Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.854183] niks3-server[1114]: 2026/09/23 16:02:49 INFO Signed narinfos id=79 count=1 lb # [ 199.864987] niks3-server[1114]: 2026/09/23 16:02:49 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 199.882204] niks3-server[1114]: 2026/09/23 16:02:49 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 199.893883] niks3-server[1114]: 2026/09/23 16:02:49 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 199.898610] niks3-server[1114]: 2026/09/23 16:02:49 INFO Received complete push request method=POST path=/api/pushes/79/complete worker1 # [ 199.980280] nix-grpc-daemon[1677]: time=2026-09-23T16:02:49.600Z level=INFO msg="Upload complete. (244ms)" lb # [ 199.901876] niks3-server[1114]: 2026/09/23 16:02:49 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker1 # [ 200.000570] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=10 outputs=1 worker1 # [ 200.016955] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:49Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 200.025087] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 200.029813] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:49Z level=debug event=want client=2 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 200.035009] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 200.040116] nix-daemon[849]: reaped child process 2135, status = succeeded worker1 # [ 200.051989] nix-grpc-daemon[1677]: time=2026-09-23T16:02:49.653Z level=INFO msg="All 2 paths already cached" worker1 # [ 200.054523] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 200.058072] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 200.182107] nix-daemon[849]: accepted connection from pid 2162, user nix-grpc-daemon (trusted) worker1 # [ 200.198002] nix-daemon[849]: reaped child process 2165, status = succeeded lb # [ 200.123659] niks3-server[1114]: 2026/09/23 16:02:49 INFO Received push request method=POST path=/api/pushes worker1 # [ 200.214082] nix-grpc-daemon[1677]: time=2026-09-23T16:02:49.833Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 200.215617] nix-grpc-daemon[1677]: time=2026-09-23T16:02:49.833Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 200.153304] niks3-server[1114]: 2026/09/23 16:02:49 INFO Received sign narinfos request method=POST path=/api/pushes/80/sign worker1 # [ 200.240675] nix-grpc-daemon[1677]: time=2026-09-23T16:02:49.860Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.165810] niks3-server[1114]: 2026/09/23 16:02:49 INFO Signed narinfos id=80 count=1 lb # [ 200.172721] niks3-server[1114]: 2026/09/23 16:02:49 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 200.191821] niks3-server[1114]: 2026/09/23 16:02:49 INFO Received complete push request method=POST path=/api/pushes/80/complete worker1 # [ 200.279552] nix-grpc-daemon[1677]: time=2026-09-23T16:02:49.899Z level=INFO msg="Upload complete. (216ms)" lb # [ 200.200571] niks3-server[1114]: 2026/09/23 16:02:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 200.206194] niks3-server[1114]: 2026/09/23 16:02:49 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 200.288422] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 200.303734] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 200.310744] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 200.316754] nix-daemon[849]: reaped child process 2160, status = succeeded worker1 # [ 200.328864] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 201.567973] nix-daemon[849]: reaped child process 2169, status = succeeded worker1 # [ 201.674860] nix-daemon[849]: accepted connection from pid 2185, user nix-grpc-daemon (trusted) worker1 # [ 201.698494] nix-daemon[849]: reaped child process 2188, status = succeeded lb # [ 201.616826] niks3-server[1114]: 2026/09/23 16:02:51 INFO Received push request method=POST path=/api/pushes worker1 # [ 201.710006] nix-grpc-daemon[1677]: time=2026-09-23T16:02:51.327Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 201.711663] nix-grpc-daemon[1677]: time=2026-09-23T16:02:51.328Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 201.657900] niks3-server[1114]: 2026/09/23 16:02:51 INFO Received sign narinfos request method=POST path=/api/pushes/81/sign worker1 # [ 201.751668] nix-grpc-daemon[1677]: time=2026-09-23T16:02:51.371Z level=INFO msg="Uploading 1 narinfos" lb # [ 201.674783] niks3-server[1114]: 2026/09/23 16:02:51 INFO Signed narinfos id=81 count=1 lb # [ 201.681786] niks3-server[1114]: 2026/09/23 16:02:51 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 201.691556] niks3-server[1114]: 2026/09/23 16:02:51 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 201.700854] niks3-server[1114]: 2026/09/23 16:02:51 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 201.703638] niks3-server[1114]: 2026/09/23 16:02:51 INFO Received complete push request method=POST path=/api/pushes/81/complete worker1 # [ 201.790024] nix-grpc-daemon[1677]: time=2026-09-23T16:02:51.409Z level=INFO msg="Upload complete. (248ms)" lb # [ 201.710377] niks3-server[1114]: 2026/09/23 16:02:51 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker1 # [ 201.801832] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=11 outputs=1 worker1 # [ 201.816369] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:51Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 201.825522] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 201.830564] nix-daemon[849]: reaped child process 2167, status = succeeded worker1 # [ 201.834043] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 201.845606] nix-grpc-daemon[1677]: time=2026-09-23T16:02:51.465Z level=INFO msg="All 2 paths already cached" worker1 # [ 201.854503] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 201.867129] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 202.007669] nix-daemon[849]: accepted connection from pid 2192, user nix-grpc-daemon (trusted) worker1 # [ 202.032591] nix-daemon[849]: reaped child process 2195, status = succeeded lb # [ 201.955558] niks3-server[1114]: 2026/09/23 16:02:51 INFO Received push request method=POST path=/api/pushes worker1 # [ 202.046035] nix-grpc-daemon[1677]: time=2026-09-23T16:02:51.665Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 202.047575] nix-grpc-daemon[1677]: time=2026-09-23T16:02:51.665Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 201.989832] niks3-server[1114]: 2026/09/23 16:02:51 INFO Received sign narinfos request method=POST path=/api/pushes/82/sign worker1 # [ 202.078707] nix-grpc-daemon[1677]: time=2026-09-23T16:02:51.698Z level=INFO msg="Uploading 1 narinfos" lb # [ 202.003255] niks3-server[1114]: 2026/09/23 16:02:51 INFO Signed narinfos id=82 count=1 lb # [ 202.010788] niks3-server[1114]: 2026/09/23 16:02:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 202.026066] niks3-server[1114]: 2026/09/23 16:02:51 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst lb # [ 202.038813] niks3-server[1114]: 2026/09/23 16:02:51 INFO Received complete push request method=POST path=/api/pushes/82/complete worker1 # [ 202.117533] nix-grpc-daemon[1677]: time=2026-09-23T16:02:51.737Z level=INFO msg="Upload complete. (238ms)" lb # [ 202.044307] niks3-server[1114]: 2026/09/23 16:02:51 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 202.128666] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 202.144770] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 202.153059] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 202.158923] nix-daemon[849]: reaped child process 2190, status = succeeded worker1 # [ 202.170117] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 203.279293] nix-daemon[849]: reaped child process 2199, status = succeeded worker1 # [ 203.350714] nix-daemon[849]: accepted connection from pid 2215, user nix-grpc-daemon (trusted) worker1 # [ 203.369297] nix-daemon[849]: reaped child process 2218, status = succeeded lb # [ 203.293433] niks3-server[1114]: 2026/09/23 16:02:52 INFO Received push request method=POST path=/api/pushes worker1 # [ 203.387649] nix-grpc-daemon[1677]: time=2026-09-23T16:02:53.006Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 203.389284] nix-grpc-daemon[1677]: time=2026-09-23T16:02:53.006Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 203.338485] niks3-server[1114]: 2026/09/23 16:02:52 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst worker1 # [ 203.432916] nix-grpc-daemon[1677]: time=2026-09-23T16:02:53.052Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.352849] niks3-server[1114]: 2026/09/23 16:02:52 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 203.361551] niks3-server[1114]: 2026/09/23 16:02:52 INFO Received sign narinfos request method=POST path=/api/pushes/83/sign lb # [ 203.371341] niks3-server[1114]: 2026/09/23 16:02:52 INFO Signed narinfos id=83 count=1 lb # [ 203.376716] niks3-server[1114]: 2026/09/23 16:02:52 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 203.381054] niks3-server[1114]: 2026/09/23 16:02:52 INFO Received complete push request method=POST path=/api/pushes/83/complete worker1 # [ 203.461701] nix-grpc-daemon[1677]: time=2026-09-23T16:02:53.081Z level=INFO msg="Upload complete. (279ms)" lb # [ 203.384393] niks3-server[1114]: 2026/09/23 16:02:52 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker1 # [ 203.477224] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=12 outputs=1 worker1 # [ 203.497052] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:53Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 203.501288] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 203.506857] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 203.511602] nix-daemon[849]: reaped child process 2197, status = succeeded worker1 # [ 203.514777] nix-grpc-daemon[1677]: time=2026-09-23T16:02:53.134Z level=INFO msg="All 2 paths already cached" worker1 # [ 203.523042] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 203.535902] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 203.682563] nix-daemon[849]: accepted connection from pid 2222, user nix-grpc-daemon (trusted) worker1 # [ 203.700515] nix-daemon[849]: reaped child process 2225, status = succeeded lb # [ 203.624791] niks3-server[1114]: 2026/09/23 16:02:53 INFO Received push request method=POST path=/api/pushes worker1 # [ 203.714594] nix-grpc-daemon[1677]: time=2026-09-23T16:02:53.334Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 203.716132] nix-grpc-daemon[1677]: time=2026-09-23T16:02:53.334Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 203.653785] niks3-server[1114]: 2026/09/23 16:02:53 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 203.746783] nix-grpc-daemon[1677]: time=2026-09-23T16:02:53.366Z level=INFO msg="Uploading 1 narinfos" lb # [ 203.668320] niks3-server[1114]: 2026/09/23 16:02:53 INFO Received sign narinfos request method=POST path=/api/pushes/84/sign lb # [ 203.677912] niks3-server[1114]: 2026/09/23 16:02:53 INFO Signed narinfos id=84 count=1 lb # [ 203.692107] niks3-server[1114]: 2026/09/23 16:02:53 INFO Received complete push request method=POST path=/api/pushes/84/complete lb # [ 203.702621] niks3-server[1114]: 2026/09/23 16:02:53 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls lb # [ 203.706788] niks3-server[1114]: 2026/09/23 16:02:53 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 203.788259] nix-grpc-daemon[1677]: time=2026-09-23T16:02:53.407Z level=INFO msg="Upload complete. (239ms)" worker1 # [ 203.800333] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 203.816754] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1 # [ 203.824465] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 203.835075] nix-daemon[849]: reaped child process 2220, status = succeeded worker1 # [ 203.843680] nix-daemon[849]: accepted connection from pid 1601, user nix-grpc-daemon (trusted) worker1 # [ 205.353848] nix-daemon[849]: reaped child process 2229, status = succeeded worker1 # [ 205.424377] nix-daemon[849]: accepted connection from pid 2245, user nix-grpc-daemon (trusted) worker1 # [ 205.443281] nix-daemon[849]: reaped child process 2248, status = succeeded lb # [ 205.367153] niks3-server[1114]: 2026/09/23 16:02:54 INFO Received push request method=POST path=/api/pushes worker1 # [ 205.459731] nix-grpc-daemon[1677]: time=2026-09-23T16:02:55.077Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 205.461431] nix-grpc-daemon[1677]: time=2026-09-23T16:02:55.077Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 205.409912] niks3-server[1114]: 2026/09/23 16:02:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls worker1 # [ 205.503008] nix-grpc-daemon[1677]: time=2026-09-23T16:02:55.122Z level=INFO msg="Uploading 1 narinfos" lb # [ 205.424469] niks3-server[1114]: 2026/09/23 16:02:55 INFO Received sign narinfos request method=POST path=/api/pushes/85/sign lb # [ 205.433358] niks3-server[1114]: 2026/09/23 16:02:55 INFO Signed narinfos id=85 count=1 lb # [ 205.435865] niks3-server[1114]: 2026/09/23 16:02:55 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 205.452099] niks3-server[1114]: 2026/09/23 16:02:55 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 205.456523] niks3-server[1114]: 2026/09/23 16:02:55 INFO Received complete push request method=POST path=/api/pushes/85/complete lb # [ 205.462785] niks3-server[1114]: 2026/09/23 16:02:55 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 205.533102] nix-grpc-daemon[1677]: time=2026-09-23T16:02:55.152Z level=INFO msg="Upload complete. (278ms)" worker1 # [ 205.549433] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56332 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=13 outputs=1 worker1 # [ 205.567030] nix-daemon[849]: reaped child process 2227, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 15.43 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 205.662481] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: 3a69f8bb4bfe4cabb24287c0432ca03a client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics client # [ 205.858377] nix[1628]: don't know how to build these paths: client # [ 205.859473] nix[1628]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker2 # [ 205.854009] nix-grpc-daemon[1873]: ts=2026-09-23T16:02:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42964 worker1 # [ 205.950518] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:56332 worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker1 # [ 205.972780] nix-grpc-daemon[1601]: ts=2026-09-23T16:02:55Z level=debug event=want client=3 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 client # [ 205.887994] nix[1628]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip}, waiting up to 30s for a worker lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 208.090805] envoy[897]: conn peer=[2001:db8:1::1]:51974 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27127 tx=12356 ms=15153 client # [ 235.893871] nix[1628]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, the workers offer {benchmark,big-parallel,gccarch-armv8-a,kvm,nixos-test,vip} client # [ 235.906666] nix[1628]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 235.946186] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 235.954426] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 235.958578] systemd[1]: gpu.service: Consumed 191ms CPU time over 30.289s wall clock time, 37.4M memory peak, 5.6K incoming IP traffic, 5.2K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.06 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 46.23 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.14 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 237.711752] nix-grpc-daemon[1601]: ts=2026-09-23T16:03:27Z level=info event=unhealthy reason=min_free lb # [ 238.097609] envoy[897]: conn peer=[2001:db8:1::1]:59716 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=931 tx=613 ms=30067 worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.10 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 238.788355] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 238.795811] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42964 worker1 # [ 238.914635] nix-grpc-daemon[1601]: ts=2026-09-23T16:03:28Z level=debug event=want client=4 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker1 # [ 238.920997] nix-grpc-daemon[1601]: ts=2026-09-23T16:03:28Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 238.833739] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 238.849280] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42964 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 238.866626] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 238.882228] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker2 # [ 239.038982] nix-daemon[842]: accepted connection from pid 2000, user nix-grpc-daemon (trusted) worker2 # [ 239.059299] nix-daemon[842]: reaped child process 2003, status = succeeded lb # [ 239.074317] niks3-server[1114]: 2026/09/23 16:03:28 INFO Received push request method=POST path=/api/pushes worker2 # [ 239.077155] nix-grpc-daemon[1933]: time=2026-09-23T16:03:28.700Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 239.079738] nix-grpc-daemon[1933]: time=2026-09-23T16:03:28.702Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" worker2 # [ 239.118913] nix-grpc-daemon[1933]: time=2026-09-23T16:03:28.742Z level=INFO msg="Uploading 1 narinfos" lb # [ 239.116948] niks3-server[1114]: 2026/09/23 16:03:28 INFO Received sign narinfos request method=POST path=/api/pushes/86/sign lb # [ 239.132064] niks3-server[1114]: 2026/09/23 16:03:28 INFO Signed narinfos id=86 count=1 lb # [ 239.143551] niks3-server[1114]: 2026/09/23 16:03:28 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 239.151908] niks3-server[1114]: 2026/09/23 16:03:28 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 239.164223] niks3-server[1114]: 2026/09/23 16:03:28 INFO Received complete push request method=POST path=/api/pushes/86/complete worker2 # [ 239.165528] nix-grpc-daemon[1933]: time=2026-09-23T16:03:28.789Z level=INFO msg="Upload complete. (266ms)" lb # [ 239.187995] niks3-server[1114]: 2026/09/23 16:03:28 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 239.175753] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42964 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 239.190643] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 239.204663] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker2 # [ 239.211768] nix-daemon[842]: reaped child process 1998, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... worker2 # [ 239.225902] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) client # farm-a> worker2-next: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 240.536864] nix-daemon[842]: reaped child process 2007, status = succeeded worker2 # [ 240.609447] nix-daemon[842]: accepted connection from pid 2023, user nix-grpc-daemon (trusted) worker2 # [ 240.629713] nix-daemon[842]: reaped child process 2026, status = succeeded lb # [ 240.637423] niks3-server[1114]: 2026/09/23 16:03:30 INFO Received push request method=POST path=/api/pushes worker2 # [ 240.640399] nix-grpc-daemon[1933]: time=2026-09-23T16:03:30.263Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 240.641975] nix-grpc-daemon[1933]: time=2026-09-23T16:03:30.263Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 240.679994] niks3-server[1114]: 2026/09/23 16:03:30 INFO Received sign narinfos request method=POST path=/api/pushes/87/sign worker2 # [ 240.681370] nix-grpc-daemon[1933]: time=2026-09-23T16:03:30.304Z level=INFO msg="Uploading 1 narinfos" lb # [ 240.693580] niks3-server[1114]: 2026/09/23 16:03:30 INFO Signed narinfos id=87 count=1 lb # [ 240.695904] niks3-server[1114]: 2026/09/23 16:03:30 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 240.708355] niks3-server[1114]: 2026/09/23 16:03:30 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls worker2 # [ 240.710555] nix-grpc-daemon[1933]: time=2026-09-23T16:03:30.334Z level=INFO msg="Upload complete. (270ms)" lb # [ 240.718887] niks3-server[1114]: 2026/09/23 16:03:30 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 240.726108] niks3-server[1114]: 2026/09/23 16:03:30 INFO Received complete push request method=POST path=/api/pushes/87/complete lb # [ 240.731326] niks3-server[1114]: 2026/09/23 16:03:30 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 240.725170] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=14 outputs=1 worker1 # [ 240.821753] nix-grpc-daemon[1601]: ts=2026-09-23T16:03:30Z level=debug event=want client=4 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker1 # [ 240.822121] nix-grpc-daemon[1601]: ts=2026-09-23T16:03:30Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 240.742144] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 240.752683] nix-daemon[842]: reaped child process 2005, status = succeeded worker2 # [ 240.755934] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 240.768894] nix-grpc-daemon[1933]: time=2026-09-23T16:03:30.392Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 240.778626] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 240.793069] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker2 # [ 240.936056] nix-daemon[842]: accepted connection from pid 2030, user nix-grpc-daemon (trusted) worker2 # [ 240.953462] nix-daemon[842]: reaped child process 2033, status = succeeded lb # [ 240.967321] niks3-server[1114]: 2026/09/23 16:03:30 INFO Received push request method=POST path=/api/pushes worker2 # [ 240.969384] nix-grpc-daemon[1933]: time=2026-09-23T16:03:30.592Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 240.970993] nix-grpc-daemon[1933]: time=2026-09-23T16:03:30.592Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 240.998381] niks3-server[1114]: 2026/09/23 16:03:30 INFO Received sign narinfos request method=POST path=/api/pushes/88/sign worker2 # [ 240.997386] nix-grpc-daemon[1933]: time=2026-09-23T16:03:30.620Z level=INFO msg="Uploading 1 narinfos" lb # [ 241.012118] niks3-server[1114]: 2026/09/23 16:03:30 INFO Signed narinfos id=88 count=1 lb # [ 241.014878] niks3-server[1114]: 2026/09/23 16:03:30 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 241.026735] niks3-server[1114]: 2026/09/23 16:03:30 INFO Received complete push request method=POST path=/api/pushes/88/complete lb # [ 241.031827] niks3-server[1114]: 2026/09/23 16:03:30 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst worker2 # [ 241.036616] nix-grpc-daemon[1933]: time=2026-09-23T16:03:30.660Z level=INFO msg="Upload complete. (232ms)" lb # [ 241.046778] niks3-server[1114]: 2026/09/23 16:03:30 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 241.046894] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42964 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 241.063452] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 241.070032] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker2 # [ 241.075702] nix-daemon[842]: reaped child process 2028, status = succeeded worker2 # [ 241.086713] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... client # farm-b> worker2-next: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 242.949619] nix-daemon[842]: reaped child process 2037, status = succeeded worker2 # [ 243.078158] nix-daemon[842]: accepted connection from pid 2053, user nix-grpc-daemon (trusted) worker2 # [ 243.096870] nix-daemon[842]: reaped child process 2056, status = succeeded lb # [ 243.113819] niks3-server[1114]: 2026/09/23 16:03:32 INFO Received push request method=POST path=/api/pushes worker2 # [ 243.118242] nix-grpc-daemon[1933]: time=2026-09-23T16:03:32.739Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 243.120307] nix-grpc-daemon[1933]: time=2026-09-23T16:03:32.739Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 243.159696] niks3-server[1114]: 2026/09/23 16:03:32 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls worker2 # [ 243.161001] nix-grpc-daemon[1933]: time=2026-09-23T16:03:32.784Z level=INFO msg="Uploading 1 narinfos" lb # [ 243.172645] niks3-server[1114]: 2026/09/23 16:03:32 INFO Received sign narinfos request method=POST path=/api/pushes/89/sign lb # [ 243.180380] niks3-server[1114]: 2026/09/23 16:03:32 INFO Signed narinfos id=89 count=1 lb # [ 243.182789] niks3-server[1114]: 2026/09/23 16:03:32 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 243.197906] niks3-server[1114]: 2026/09/23 16:03:32 INFO Received complete push request method=POST path=/api/pushes/89/complete lb # [ 243.203583] niks3-server[1114]: 2026/09/23 16:03:32 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 243.207789] niks3-server[1114]: 2026/09/23 16:03:32 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 243.193678] nix-grpc-daemon[1933]: time=2026-09-23T16:03:32.817Z level=INFO msg="Upload complete. (293ms)" worker2 # [ 243.205436] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 duration_s=2 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=15 outputs=1 worker1 # [ 243.303270] nix-grpc-daemon[1601]: ts=2026-09-23T16:03:32Z level=debug event=want client=4 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker1 # [ 243.309658] nix-grpc-daemon[1601]: ts=2026-09-23T16:03:32Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 243.225593] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 243.235739] nix-daemon[842]: reaped child process 2035, status = succeeded worker2 # [ 243.244625] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 243.259823] nix-grpc-daemon[1933]: time=2026-09-23T16:03:32.883Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 243.271370] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 243.285617] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker2 # [ 243.433173] nix-daemon[842]: accepted connection from pid 2060, user nix-grpc-daemon (trusted) worker2 # [ 243.454547] nix-daemon[842]: reaped child process 2063, status = succeeded lb # [ 243.466048] niks3-server[1114]: 2026/09/23 16:03:33 INFO Received push request method=POST path=/api/pushes worker2 # [ 243.466210] nix-grpc-daemon[1933]: time=2026-09-23T16:03:33.089Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 243.467699] nix-grpc-daemon[1933]: time=2026-09-23T16:03:33.089Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 243.495531] niks3-server[1114]: 2026/09/23 16:03:33 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst lb # [ 243.509145] niks3-server[1114]: 2026/09/23 16:03:33 INFO Received sign narinfos request method=POST path=/api/pushes/90/sign worker2 # [ 243.506168] nix-grpc-daemon[1933]: time=2026-09-23T16:03:33.129Z level=INFO msg="Uploading 1 narinfos" lb # [ 243.521117] niks3-server[1114]: 2026/09/23 16:03:33 INFO Signed narinfos id=90 count=1 lb # [ 243.528769] niks3-server[1114]: 2026/09/23 16:03:33 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 243.542849] niks3-server[1114]: 2026/09/23 16:03:33 INFO Received complete push request method=POST path=/api/pushes/90/complete worker2 # [ 243.542717] nix-grpc-daemon[1933]: time=2026-09-23T16:03:33.166Z level=INFO msg="Upload complete. (242ms)" lb # [ 243.552723] niks3-server[1114]: 2026/09/23 16:03:33 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 243.553221] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42964 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 243.570694] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 worker2 # [ 243.577870] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) worker2 # [ 243.587501] nix-daemon[842]: reaped child process 2058, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... client # farm-top> worker2-next: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 243.600179] nix-daemon[842]: accepted connection from pid 1873, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 244.438763] nix-daemon[842]: reaped child process 2068, status = succeeded worker2 # [ 244.554472] nix-daemon[842]: accepted connection from pid 2084, user nix-grpc-daemon (trusted) worker2 # [ 244.575235] nix-daemon[842]: reaped child process 2087, status = succeeded lb # [ 244.591751] niks3-server[1114]: 2026/09/23 16:03:34 INFO Received push request method=POST path=/api/pushes worker2 # [ 244.594546] nix-grpc-daemon[1933]: time=2026-09-23T16:03:34.215Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 244.596074] nix-grpc-daemon[1933]: time=2026-09-23T16:03:34.215Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 244.637795] niks3-server[1114]: 2026/09/23 16:03:34 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls worker2 # [ 244.639516] nix-grpc-daemon[1933]: time=2026-09-23T16:03:34.263Z level=INFO msg="Uploading 1 narinfos" lb # [ 244.649378] niks3-server[1114]: 2026/09/23 16:03:34 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 244.658466] niks3-server[1114]: 2026/09/23 16:03:34 INFO Received sign narinfos request method=POST path=/api/pushes/91/sign lb # [ 244.670706] niks3-server[1114]: 2026/09/23 16:03:34 INFO Signed narinfos id=91 count=1 worker2 # [ 244.668952] nix-grpc-daemon[1933]: time=2026-09-23T16:03:34.292Z level=INFO msg="Upload complete. (257ms)" lb # [ 244.677933] niks3-server[1114]: 2026/09/23 16:03:34 INFO Received complete push request method=POST path=/api/pushes/91/complete lb # [ 244.681523] niks3-server[1114]: 2026/09/23 16:03:34 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 244.686978] niks3-server[1114]: 2026/09/23 16:03:34 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 244.678964] nix-grpc-daemon[1873]: ts=2026-09-23T16:03:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42964 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=16 outputs=1 worker2 # [ 244.697823] nix-daemon[842]: reaped child process 2066, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.pem&client-key=/nix/store/hshhzk1ggy1xxf00y8n24b7qg938ckjz-farm-certs/ci.key' --eval-store auto -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain >&2, in 6.17 seconds) client: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/vr4gwv4y4d4pl04zngqql7lcz1lvgab1-job.nix --argstr tag drain outPath, in 0.17 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.16 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 245.718108] nix-grpc-daemon[1601]: ts=2026-09-23T16:03:35Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 9.92 seconds) (finished: run the VM test script, in 247.17 seconds) test script finished in 247.39s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) client # [2026-09-23T16:03:35Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-23T16:03:35Z INFO virtiofsd] Client disconnected, shutting down client # [2026-09-23T16:03:35Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) lb # [2026-09-23T16:03:35Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-23T16:03:35Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-09-23T16:03:35Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) worker1 # [2026-09-23T16:03:36Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-23T16:03:36Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-09-23T16:03:36Z INFO virtiofsd] Client disconnected, shutting down kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/3fl7bdkdxk2k4nssy1d1161isbzn6bsr-python3-3.14.7/bin/python3.14) worker2 # [2026-09-23T16:03:36Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-23T16:03:36Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-09-23T16:03:36Z INFO virtiofsd] Client disconnected, shutting down (finished: cleanup, in 1.03 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh