tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm lb # Disk image does not exist, creating the virtualisation disk image... worker1 # Disk image does not exist, creating the virtualisation disk image... client # Disk image does not exist, creating the virtualisation disk image... lb # Formatting '/build/vm-state-lb/tmp.XwQTrlyUcl', fmt=raw size=1073741824 worker1 # Formatting '/build/vm-state-worker1/tmp.ucsWFDBUHS', fmt=raw size=1073741824 worker2: QEMU running (pid 52) lb: QEMU running (pid 50) worker2 # Disk image does not exist, creating the virtualisation disk image... lb # mke2fs 1.47.4 (6-Mar-2025) worker1 # mke2fs 1.47.4 (6-Mar-2025) client # Formatting '/build/vm-state-client/tmp.99GUyMyCMi', fmt=raw size=1073741824 worker1: QEMU running (pid 51) client: QEMU running (pid 49) client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Discarding device blocks: 0/262144 done lb # Discarding device blocks: 0/262144 done worker2 # Formatting '/build/vm-state-worker2/tmp.4nWT7QshVw', fmt=raw size=1073741824 (finished: start all VMs, in 0.47 seconds) lb # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Discarding device blocks: 0/262144 done worker2 # mke2fs 1.47.4 (6-Mar-2025) client: waiting for unit network-addresses-eth1.service lb # Filesystem UUID: 1b7320b8-7621-4426-9f3e-79345037d1c9 worker2 # Discarding device blocks: 0/262144 done client: waiting for the VM to finish booting lb # Superblock backups stored on blocks: worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Filesystem UUID: 30cb300f-6f10-42cd-9129-3e7aa90cf021 lb # 32768, 98304, 163840, 229376 worker2 # Filesystem UUID: 931ea2e4-7f1d-4064-a59c-52d5258ca021 client # Filesystem UUID: 6f3a39a3-5cde-474a-8553-04ad9e368e0d worker1 # Superblock backups stored on blocks: lb # worker2 # Superblock backups stored on blocks: client # Superblock backups stored on blocks: worker1 # 32768, 98304, 163840, 229376 lb # Allocating group tables: 0/8 done worker2 # 32768, 98304, 163840, 229376 client # 32768, 98304, 163840, 229376 worker1 # lb # Writing inode tables: 0/8 done worker2 # client # worker1 # Allocating group tables: 0/8 done lb # Creating journal (8192 blocks): done worker2 # Allocating group tables: 0/8 done worker2 # Writing inode tables: 0/8 done worker1 # Writing inode tables: 0/8 done lb # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Creating journal (8192 blocks): done client # Allocating group tables: 0/8 done lb # worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Creating journal (8192 blocks): done worker1 # worker2 # Writing superblocks and filesystem accounting information: 0/8 done lb # Virtualisation disk image created. client # Writing inode tables: 0/8 done worker1 # Virtualisation disk image created. client # Creating journal (8192 blocks): done worker2 # client # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Virtualisation disk image created. client # client # Virtualisation disk image created. client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 client # [ 0.000000] KASLR enabled client # [ 0.000000] random: crng init done client # [ 0.000000] Machine model: linux,dummy-virt client # [ 0.000000] efi: UEFI not found. client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.000000] Zone ranges: client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] DMA32 empty client # [ 0.000000] Normal empty client # [ 0.000000] Device empty client # [ 0.000000] Movable zone start for each node client # [ 0.000000] Early memory node ranges client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.000000] psci: probing for conduit method from DT. client # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 client # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.000000] alternatives: applying boot alternatives client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test/init regInfo=/nix/store/kw37kf8y651cwikgpy10xp7y2ldijiqs-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/kw37kf8y651cwikgpy10xp7y2ldijiqs-closure-info/registration", will be passed to user space. client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] Fallback order for Node 0: 0 client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 client # [ 0.000000] Policy zone: DMA client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] ftrace: allocated 294 pages with 4 groups client # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] GICv3: 0 Extended SPIs implemented client # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000032] arm-pv: using stolen time PV client # [ 0.000652] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.000817] Console: colour dummy device 80x25 client # [ 0.000825] printk: legacy console [tty0] enabled client # [ 0.001012] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) client # [ 0.001019] pid_max: default: 32768 minimum: 301 client # [ 0.001090] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.001263] landlock: Up and running. client # [ 0.001266] Yama: becoming mindful. client # [ 0.001881] LSM support for eBPF active client # [ 0.002021] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.002053] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.003131] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.003922] rcu: Hierarchical SRCU implementation. client # [ 0.003926] rcu: Max phase no-delay instances is 1000. client # [ 0.005189] fsl-mc MSI: its@8080000 domain created client # [ 0.005280] EFI services will not be available. client # [ 0.005359] smp: Bringing up secondary CPUs ... client # [ 0.005368] smp: Brought up 1 node, 1 CPU client # [ 0.005371] SMP: Total of 1 processors activated. client # [ 0.005376] CPU: All CPU(s) started at EL1 client # [ 0.005388] CPU features: detected: Branch Target Identification client # [ 0.005392] CPU features: detected: ARMv8.4 Translation Table Level client # [ 0.005396] CPU features: detected: Instruction cache invalidation not required for I/D coherence client # [ 0.005399] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.005403] CPU features: detected: Common not Private translations client # [ 0.005406] CPU features: detected: CRC32 instructions client # [ 0.005409] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.005413] CPU features: detected: Data cache clean to Point of Persistence client # [ 0.005416] CPU features: detected: Data independent timing control (DIT) client # [ 0.005419] CPU features: detected: E0PD client # [ 0.005422] CPU features: detected: Enhanced Counter Virtualization client # [ 0.005425] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.005428] CPU features: detected: Enhanced Virtualization Traps client # [ 0.005431] CPU features: detected: Fine Grained Traps worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.005435] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.005441] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.005444] CPU features: detected: LSE atomic instructions worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled client # [ 0.005447] CPU features: detected: Privileged Access Never worker1 # [ 0.000000] random: crng init done client # [ 0.005449] CPU features: detected: PMUv3 worker1 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] client # [ 0.005452] CPU features: detected: RAS Extension Support worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.005455] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] KASLR enabled client # [ 0.005458] CPU features: detected: Random Number Generator lb # [ 0.000000] random: crng init done worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] client # [ 0.005460] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.000000] Zone ranges: lb # [ 0.000000] Machine model: linux,dummy-virt lb # [ 0.000000] efi: UEFI not found. client # [ 0.005463] CPU features: detected: Stage-2 Force Write-Back worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] DMA32 empty worker1 # [ 0.000000] Normal empty lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT client # [ 0.005466] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.000000] random: crng init done worker1 # [ 0.000000] Device empty worker2 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] Movable zone start for each node client # [ 0.005471] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] Early memory node ranges client # [ 0.005512] alternatives: applying system-wide alternatives lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] lb # [ 0.000000] Zone ranges: worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.008483] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] DMA32 empty lb # [ 0.000000] Normal empty worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] Zone ranges: lb # [ 0.000000] Device empty client # [ 0.008642] Memory: 1406520K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) worker1 # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] Movable zone start for each node client # [ 0.009029] devtmpfs: initialized worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] Early memory node ranges worker2 # [ 0.000000] DMA32 empty worker2 # [ 0.000000] Normal empty client # [ 0.010850] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] Device empty worker1 # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] Movable zone start for each node client # [ 0.010872] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 worker2 # [ 0.000000] Early memory node ranges lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.011056] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.011061] 0 pages in range for non-PLT usage lb # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.011062] 508288 pages in range for PLT usage worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 client # [ 0.011171] pinctrl core: initialized pinctrl subsystem client # [ 0.011954] DMI not present or invalid. lb # [ 0.000000] psci: Trusted OS migration not required worker2 # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.015696] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.017898] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] CPU features: detected: Spectre-v4 worker2 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.018073] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 lb # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.018271] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.018292] audit: initializing netlink subsys (disabled) worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.018894] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 lb # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.018896] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.018900] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.018905] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.000000] CPU features: detected: Spectre-v4 lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker2 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.018908] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/gy3k7x527c38djcmpycpycfhnskkzynp-nixos-system-worker1-test/init regInfo=/nix/store/b4g7ngbiscxlrax8kca3f93vbr2k88bd-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.018933] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 client # [ 0.018942] cpuidle: using governor ladder worker2 # [ 0.000000] alternatives: applying boot alternatives client # [ 0.018949] cpuidle: using governor menu worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/b4g7ngbiscxlrax8kca3f93vbr2k88bd-closure-info/registration", will be passed to user space. client # [ 0.019141] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.019159] ASID allocator initialised with 65536 entries worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/14bqwb8zl951hxla1qpmchqzwfgwlqnx-nixos-system-lb-test/init regInfo=/nix/store/hxsww7q411z4rrmrw9s7nvsxa10s5ypn-closure-info/registration console=ttyAMA0,115200n8 console=tty0 client # [ 0.020472] Serial: AMBA PL011 UART driver worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.025835] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.025968] printk: console [ttyAMA0] enabled worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/hxsww7q411z4rrmrw9s7nvsxa10s5ypn-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jzdfkj5rn54mxddyl2kfg84vs1zgm4ba-nixos-system-worker2-test/init regInfo=/nix/store/a861za859qjzvnmb0mjbxjbnm95qmjfq-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/a861za859qjzvnmb0mjbxjbnm95qmjfq-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] Policy zone: DMA lb # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups lb # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] rcu: RCU event tracing is enabled. client # [ 0.148388] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000000] allocated 3145728 bytes of page_ext client # [ 0.148408] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.148413] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. client # [ 0.148417] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.148422] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.148426] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. client # [ 0.148430] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.148434] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 client # [ 0.155505] fbcon: Taking over console worker1 # [ 0.000000] GICv3: 256 SPIs implemented worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.155521] ACPI: Interpreter disabled. worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 client # [ 0.157506] iommu: Default domain type: Translated worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI client # [ 0.157515] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.159126] SCSI subsystem initialized lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449e0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @449f0000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a00000 worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.164715] usbcore: registered new interface driver usbfs lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.164753] usbcore: registered new interface driver hub worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.164771] usbcore: registered new device driver usb lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.165059] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.165065] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.165082] PTP clock support registered worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.165131] EDAC MC: Ver: 3.0.0 worker1 # [ 0.000031] arm-pv: using stolen time PV worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.169486] scmi_core: SCMI protocol bus registered worker1 # [ 0.000413] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.000585] Console: colour dummy device 80x25 worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.170425] FPGA manager framework lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000593] printk: legacy console [tty0] enabled client # [ 0.171340] vgaarb: loaded worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000029] arm-pv: using stolen time PV client # [ 0.171946] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.000782] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.000789] pid_max: default: 32768 minimum: 301 lb # [ 0.000410] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker1 # [ 0.000856] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.000605] Console: colour dummy device 80x25 worker2 # [ 0.000029] arm-pv: using stolen time PV worker1 # [ 0.001035] landlock: Up and running. worker1 # [ 0.001038] Yama: becoming mindful. lb # [ 0.000613] printk: legacy console [tty0] enabled worker1 # [ 0.001502] LSM support for eBPF active worker2 # [ 0.000407] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) client # [ 0.175453] VFS: Disk quotas dquot_6.6.0 lb # [ 0.000827] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.001665] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.000588] Console: colour dummy device 80x25 lb # [ 0.000834] pid_max: default: 32768 minimum: 301 worker2 # [ 0.000596] printk: legacy console [tty0] enabled client # [ 0.175489] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker1 # [ 0.001702] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000912] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.001047] landlock: Up and running. worker1 # [ 0.002817] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.000791] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.001050] Yama: becoming mindful. worker1 # [ 0.003507] rcu: Hierarchical SRCU implementation. worker2 # [ 0.000798] pid_max: default: 32768 minimum: 301 lb # [ 0.001500] LSM support for eBPF active worker1 # [ 0.003511] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.000876] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker1 # [ 0.004712] fsl-mc MSI: its@8080000 domain created lb # [ 0.001653] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.001029] landlock: Up and running. client # [ 0.179029] netfs: FS-Cache loaded worker2 # [ 0.001031] Yama: becoming mindful. worker1 # [ 0.004803] EFI services will not be available. client # [ 0.179154] pnp: PnP ACPI: disabled lb # [ 0.001691] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.001471] LSM support for eBPF active worker1 # [ 0.004922] smp: Bringing up secondary CPUs ... worker1 # [ 0.004932] smp: Brought up 1 node, 1 CPU lb # [ 0.002815] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.001632] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.004935] SMP: Total of 1 processors activated. lb # [ 0.003539] rcu: Hierarchical SRCU implementation. worker1 # [ 0.004940] CPU: All CPU(s) started at EL1 worker2 # [ 0.001668] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.003543] rcu: Max phase no-delay instances is 1000. worker1 # [ 0.004951] CPU features: detected: Branch Target Identification lb # [ 0.004736] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.002704] cacheinfo: Unable to detect cache hierarchy for CPU 0 lb # [ 0.004836] EFI services will not be available. worker2 # [ 0.003392] rcu: Hierarchical SRCU implementation. worker1 # [ 0.004955] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.004903] smp: Bringing up secondary CPUs ... worker2 # [ 0.003396] rcu: Max phase no-delay instances is 1000. lb # [ 0.004912] smp: Brought up 1 node, 1 CPU worker1 # [ 0.004959] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.004576] fsl-mc MSI: its@8080000 domain created client # [ 0.183047] NET: Registered PF_INET protocol family lb # [ 0.004915] SMP: Total of 1 processors activated. worker2 # [ 0.004663] EFI services will not be available. lb # [ 0.004921] CPU: All CPU(s) started at EL1 client # [ 0.183297] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.004963] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.004732] smp: Bringing up secondary CPUs ... lb # [ 0.004931] CPU features: detected: Branch Target Identification worker2 # [ 0.004740] smp: Brought up 1 node, 1 CPU worker1 # [ 0.004966] CPU features: detected: Common not Private translations worker2 # [ 0.004743] SMP: Total of 1 processors activated. lb # [ 0.004937] CPU features: detected: ARMv8.4 Translation Table Level worker1 # [ 0.004969] CPU features: detected: CRC32 instructions worker2 # [ 0.004748] CPU: All CPU(s) started at EL1 worker1 # [ 0.004972] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.004759] CPU features: detected: Branch Target Identification lb # [ 0.004940] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.004976] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.004763] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.004943] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.004979] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.004766] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.004947] CPU features: detected: Common not Private translations worker1 # [ 0.004982] CPU features: detected: E0PD lb # [ 0.004950] CPU features: detected: CRC32 instructions worker2 # [ 0.004770] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker1 # [ 0.004984] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.004953] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.004773] CPU features: detected: Common not Private translations worker1 # [ 0.004988] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.004776] CPU features: detected: CRC32 instructions lb # [ 0.004956] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.004991] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.004779] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.004960] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.004994] CPU features: detected: Fine Grained Traps lb # [ 0.004963] CPU features: detected: E0PD worker2 # [ 0.004783] CPU features: detected: Data cache clean to Point of Persistence worker1 # [ 0.004997] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.004965] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.004786] CPU features: detected: Data independent timing control (DIT) worker1 # [ 0.005002] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.004968] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.004789] CPU features: detected: E0PD worker1 # [ 0.005005] CPU features: detected: LSE atomic instructions lb # [ 0.004972] CPU features: detected: Enhanced Virtualization Traps worker2 # [ 0.004792] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.005008] CPU features: detected: Privileged Access Never lb # [ 0.004975] CPU features: detected: Fine Grained Traps worker1 # [ 0.005010] CPU features: detected: PMUv3 worker2 # [ 0.004794] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.005013] CPU features: detected: RAS Extension Support worker2 # [ 0.004798] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.004979] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.005016] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.004801] CPU features: detected: Fine Grained Traps lb # [ 0.004984] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.005019] CPU features: detected: Random Number Generator lb # [ 0.004987] CPU features: detected: LSE atomic instructions worker2 # [ 0.004804] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.004990] CPU features: detected: Privileged Access Never worker1 # [ 0.005021] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.004809] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.004992] CPU features: detected: PMUv3 worker1 # [ 0.005024] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.004812] CPU features: detected: LSE atomic instructions lb # [ 0.004995] CPU features: detected: RAS Extension Support worker1 # [ 0.005027] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.004815] CPU features: detected: Privileged Access Never lb # [ 0.004998] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.004817] CPU features: detected: PMUv3 worker1 # [ 0.005032] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.005001] CPU features: detected: Random Number Generator worker2 # [ 0.004820] CPU features: detected: RAS Extension Support worker1 # [ 0.005068] alternatives: applying system-wide alternatives lb # [ 0.005003] CPU features: detected: Speculation barrier (SB) worker2 # [ 0.004822] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.008083] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.005006] CPU features: detected: Stage-2 Force Write-Back worker2 # [ 0.004825] CPU features: detected: Random Number Generator lb # [ 0.005009] CPU features: detected: TLB range maintenance instructions worker2 # [ 0.004828] CPU features: detected: Speculation barrier (SB) worker1 # [ 0.008244] Memory: 1406556K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker2 # [ 0.004830] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.005014] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.008657] devtmpfs: initialized worker2 # [ 0.004833] CPU features: detected: TLB range maintenance instructions lb # [ 0.005050] alternatives: applying system-wide alternatives worker1 # [ 0.010391] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.004838] CPU features: detected: Speculative Store Bypassing Safe (SSBS) lb # [ 0.008079] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.010415] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.004875] alternatives: applying system-wide alternatives worker1 # [ 0.010604] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.008272] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) worker2 # [ 0.007842] CPU features: detected: BBM Level 2 without TLB conflict abort lb # [ 0.008671] devtmpfs: initialized lb # [ 0.010448] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.008114] Memory: 1406516K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker2 # [ 0.008527] devtmpfs: initialized lb # [ 0.010470] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.010263] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.010673] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.010678] 0 pages in range for non-PLT usage worker2 # [ 0.010284] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). lb # [ 0.010679] 508288 pages in range for PLT usage worker2 # [ 0.010457] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.010793] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.010462] 0 pages in range for non-PLT usage lb # [ 0.011557] DMI not present or invalid. worker2 # [ 0.010463] 508288 pages in range for PLT usage lb # [ 0.014743] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.010573] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.011333] DMI not present or invalid. lb # [ 0.016942] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.014511] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.017129] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.010609] 0 pages in range for non-PLT usage worker1 # [ 0.010610] 508288 pages in range for PLT usage lb # [ 0.017325] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.010725] pinctrl core: initialized pinctrl subsystem lb # [ 0.017347] audit: initializing netlink subsys (disabled) worker1 # [ 0.011444] DMI not present or invalid. lb # [ 0.017907] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.014678] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.017909] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.016850] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.017913] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.017029] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.017919] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.017231] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.212151] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.017253] audit: initializing netlink subsys (disabled) worker1 # [ 0.017855] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.212201] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.017857] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.212232] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.017861] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.016660] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.212310] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.017866] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.016848] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.212469] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.017869] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.212549] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.017053] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.017893] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.017073] audit: initializing netlink subsys (disabled) worker1 # [ 0.017901] cpuidle: using governor ladder client # [ 0.212581] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.017907] cpuidle: using governor menu worker2 # [ 0.017680] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.212616] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.018090] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.017682] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.212721] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.018105] ASID allocator initialised with 65536 entries client # [ 0.212751] NET: Registered PF_XDP protocol family worker2 # [ 0.017686] thermal_sys: Registered thermal governor 'step_wise' worker1 # [ 0.019369] Serial: AMBA PL011 UART driver lb # [ 0.017921] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.212771] PCI: CLS 0 bytes, default 64 worker2 # [ 0.017691] thermal_sys: Registered thermal governor 'user_space' client # [ 0.213016] Trying to unpack rootfs image as initramfs... lb # [ 0.017946] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.024495] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.017694] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.017954] cpuidle: using governor ladder worker1 # [ 0.024654] printk: console [ttyAMA0] enabled lb # [ 0.017960] cpuidle: using governor menu worker2 # [ 0.017724] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.017733] cpuidle: using governor ladder lb # [ 0.018150] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker1 # [ 0.144237] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.017739] cpuidle: using governor menu lb # [ 0.018165] ASID allocator initialised with 65536 entries worker1 # [ 0.144259] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.019341] Serial: AMBA PL011 UART driver worker2 # [ 0.017918] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.229252] kvm [1]: HYP mode not available worker1 # [ 0.144264] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.017933] ASID allocator initialised with 65536 entries lb # [ 0.024647] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker2 # [ 0.019069] Serial: AMBA PL011 UART driver worker1 # [ 0.144268] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.024793] printk: console [ttyAMA0] enabled worker2 # [ 0.024206] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 worker1 # [ 0.144273] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.024361] printk: console [ttyAMA0] enabled lb # [ 0.144742] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.144277] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.144762] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.144282] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.143759] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.144767] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker1 # [ 0.144286] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.143780] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.144772] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page worker2 # [ 0.143785] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.144776] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.143790] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.144780] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.151575] fbcon: Taking over console worker2 # [ 0.143794] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.151590] ACPI: Interpreter disabled. lb # [ 0.144785] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.143798] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.153402] iommu: Default domain type: Translated lb # [ 0.144789] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.153411] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.143803] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.143807] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker1 # [ 0.155055] SCSI subsystem initialized lb # [ 0.152072] fbcon: Taking over console lb # [ 0.152086] ACPI: Interpreter disabled. lb # [ 0.153938] iommu: Default domain type: Translated worker2 # [ 0.151219] fbcon: Taking over console lb # [ 0.153947] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.151235] ACPI: Interpreter disabled. worker2 # [ 0.153082] iommu: Default domain type: Translated lb # [ 0.155668] SCSI subsystem initialized worker2 # [ 0.153092] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.154848] SCSI subsystem initialized worker1 # [ 0.162570] usbcore: registered new interface driver usbfs worker1 # [ 0.162603] usbcore: registered new interface driver hub worker1 # [ 0.162621] usbcore: registered new device driver usb worker1 # [ 0.162930] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.162936] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.162946] PTP clock support registered worker1 # [ 0.162986] EDAC MC: Ver: 3.0.0 lb # [ 0.163252] usbcore: registered new interface driver usbfs lb # [ 0.163285] usbcore: registered new interface driver hub worker1 # [ 0.167655] scmi_core: SCMI protocol bus registered lb # [ 0.163303] usbcore: registered new device driver usb worker2 # [ 0.162384] usbcore: registered new interface driver usbfs lb # [ 0.163605] pps_core: LinuxPPS API ver. 1 registered worker1 # [ 0.168601] FPGA manager framework worker2 # [ 0.162418] usbcore: registered new interface driver hub worker1 # [ 0.169571] vgaarb: loaded worker2 # [ 0.162445] usbcore: registered new device driver usb lb # [ 0.163611] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.162742] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.163628] PTP clock support registered lb # [ 0.163670] EDAC MC: Ver: 3.0.0 worker1 # [ 0.170213] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.162748] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker1 # [ 0.170865] VFS: Disk quotas dquot_6.6.0 lb # [ 0.168303] scmi_core: SCMI protocol bus registered worker2 # [ 0.162758] PTP clock support registered worker2 # [ 0.162799] EDAC MC: Ver: 3.0.0 worker1 # [ 0.170892] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.169267] FPGA manager framework worker2 # [ 0.167413] scmi_core: SCMI protocol bus registered worker1 # [ 0.173240] netfs: FS-Cache loaded lb # [ 0.170281] vgaarb: loaded worker1 # [ 0.173353] pnp: PnP ACPI: disabled worker2 # [ 0.168372] FPGA manager framework worker2 # [ 0.169339] vgaarb: loaded lb # [ 0.170916] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.172366] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.169981] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.172396] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.170591] VFS: Disk quotas dquot_6.6.0 lb # [ 0.173997] netfs: FS-Cache loaded worker2 # [ 0.170618] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.174095] pnp: PnP ACPI: disabled worker2 # [ 0.172980] netfs: FS-Cache loaded worker2 # [ 0.173106] pnp: PnP ACPI: disabled worker1 # [ 0.179377] NET: Registered PF_INET protocol family worker1 # [ 0.179665] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) lb # [ 0.180314] NET: Registered PF_INET protocol family lb # [ 0.180604] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.179148] NET: Registered PF_INET protocol family worker2 # [ 0.179429] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.209840] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.209894] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.209923] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.210000] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.210142] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.209914] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.209969] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.214953] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.211282] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.214996] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211337] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.212114] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.215035] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211369] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.212235] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.215128] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.211448] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.212377] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.215159] NET: Registered PF_XDP protocol family worker1 # [ 0.215177] PCI: CLS 0 bytes, default 64 lb # [ 0.211590] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.212484] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.215409] Trying to unpack rootfs image as initramfs... lb # [ 0.211684] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.212524] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.211724] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.212562] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.212685] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.211763] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.212737] NET: Registered PF_XDP protocol family lb # [ 0.211853] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.212757] PCI: CLS 0 bytes, default 64 lb # [ 0.211883] NET: Registered PF_XDP protocol family worker2 # [ 0.213025] Trying to unpack rootfs image as initramfs... lb # [ 0.211903] PCI: CLS 0 bytes, default 64 lb # [ 0.212163] Trying to unpack rootfs image as initramfs... worker1 # [ 0.227185] kvm [1]: HYP mode not available lb # [ 0.228501] kvm [1]: HYP mode not available client # [ 0.324623] Initialise system trusted keyrings client # [ 0.325362] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.230002] kvm [1]: HYP mode not available client # [ 0.332342] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.333206] 9p: Installing v9fs 9p2000 file system support client # [ 0.353188] Key type asymmetric registered client # [ 0.353214] Asymmetric key parser 'x509' registered client # [ 0.353283] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.355391] io scheduler mq-deadline registered client # [ 0.355402] io scheduler kyber registered client # [ 0.368659] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.369978] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.370357] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.370373] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.370385] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.370394] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.370411] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.370433] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.370506] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 client # [ 0.370516] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.370522] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.370527] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] client # [ 0.370532] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.370589] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.371024] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.371209] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.371225] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.371254] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.371272] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.371732] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.371916] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] client # [ 0.371932] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.389946] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.390428] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.390611] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] client # [ 0.390626] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.390656] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.391108] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.391288] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] client # [ 0.391304] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.391336] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.391799] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.404035] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.404063] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.404093] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.404593] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.324545] Initialise system trusted keyrings client # [ 0.404780] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.325287] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.404796] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.404826] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.326604] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.405308] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.405491] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.405507] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.326255] Initialise system trusted keyrings client # [ 0.405536] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.327363] 9p: Installing v9fs 9p2000 file system support client # [ 0.405552] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.327055] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.406005] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.328343] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.326557] Initialise system trusted keyrings client # [ 0.406193] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.327309] workingset: timestamp_bits=42 max_order=19 bucket_order=0 client # [ 0.406224] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.406685] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.329114] 9p: Installing v9fs 9p2000 file system support worker2 # [ 0.328596] squashfs: version 4.0 (2009/01/31) Phillip Lougher client # [ 0.406874] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.329351] 9p: Installing v9fs 9p2000 file system support client # [ 0.406904] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.407317] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.407498] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.407749] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.428065] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] client # [ 0.428090] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.428119] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.428615] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.428804] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.428820] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.428850] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.429456] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.429467] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned client # [ 0.429473] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.429518] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.349936] Key type asymmetric registered client # [ 0.429565] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker1 # [ 0.355299] Key type asymmetric registered worker2 # [ 0.349963] Asymmetric key parser 'x509' registered worker1 # [ 0.355328] Asymmetric key parser 'x509' registered client # [ 0.429612] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.353039] Key type asymmetric registered worker1 # [ 0.355404] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) lb # [ 0.353068] Asymmetric key parser 'x509' registered client # [ 0.429658] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.357482] io scheduler mq-deadline registered lb # [ 0.353142] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.357493] io scheduler kyber registered client # [ 0.429704] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.429751] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.429798] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.429844] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.429891] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.429993] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.430039] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker2 # [ 0.358066] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) client # [ 0.430061] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.359137] io scheduler mq-deadline registered worker2 # [ 0.359147] io scheduler kyber registered client # [ 0.430083] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned client # [ 0.430104] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.358971] io scheduler mq-deadline registered lb # [ 0.358990] io scheduler kyber registered client # [ 0.430128] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.430150] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.430171] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned client # [ 0.430193] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned client # [ 0.430215] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.430237] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.430260] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.430283] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.430304] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.430325] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.430347] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.430368] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.430390] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.370114] pl061_gpio 9030000.pl061: PL061 GPIO chip registered client # [ 0.430411] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.430432] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.430454] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.370724] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.371374] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.430476] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.371489] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.430504] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker1 # [ 0.371727] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.371878] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: client # [ 0.430513] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker1 # [ 0.371753] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.430518] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.371895] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 client # [ 0.431695] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.371772] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.371077] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.371907] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 lb # [ 0.371753] ledtrig-cpu: registered to indicate activity on CPUs worker1 # [ 0.371780] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.371916] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 lb # [ 0.372136] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.371804] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.371937] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits lb # [ 0.372154] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.371826] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.371962] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.372166] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.371896] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.372041] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.371906] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.372175] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.372051] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.371913] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.372057] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.372207] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.371918] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker2 # [ 0.372062] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.371923] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.372233] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.372068] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] lb # [ 0.372310] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.372022] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.372127] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.372320] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.372460] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.372326] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.372565] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.372646] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] client # [ 0.476084] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 43354 usecs worker2 # [ 0.372756] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.372332] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.372663] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.372773] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.372337] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.372692] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.372802] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.372709] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.372423] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.372819] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.373160] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.372864] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.373292] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.373343] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.373050] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.373479] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.373359] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.373067] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.373494] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.373389] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.373096] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.373524] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.373113] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.373834] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.373975] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.374017] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.373570] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.374033] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.373753] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.393346] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.374064] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.373769] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.393366] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.373799] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.374562] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.393396] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.374743] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.374244] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.393862] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.374759] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.374426] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.374792] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.374442] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.397069] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.374471] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.375258] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.397088] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.375440] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.374942] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.397121] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.375456] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.375123] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.375486] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.397576] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.375148] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.397757] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.375181] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.375931] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.397773] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.376112] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] lb # [ 0.375638] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.397802] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.376129] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.375819] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.376158] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.375835] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.375865] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.376608] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.376790] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.376350] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.376806] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.376533] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.376836] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.376550] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.376852] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.376579] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.377328] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.377037] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.496786] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.377514] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.377220] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.498906] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.377544] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.377235] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.377265] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.377992] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.377281] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.378178] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.378208] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.377738] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint lb # [ 0.377924] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.377953] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.378400] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.378586] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.378616] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.410315] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.410518] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.410535] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.410565] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.411058] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.509965] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.411246] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] client # [ 0.511917] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.411262] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.411292] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.411308] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.426710] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.411775] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.426898] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.411965] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.427150] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.411995] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.427449] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.412447] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.427466] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412637] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.427496] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.412666] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.427952] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.413071] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.428134] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.427069] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.413255] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker1 # [ 0.428151] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.427275] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.413505] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.428181] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.522969] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.427529] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.413796] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.428753] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.427807] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.413813] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.427824] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.428764] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.413843] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.427854] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.428770] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.414320] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.428322] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.414504] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.428815] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.414519] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.428506] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.428863] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.428521] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.414549] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.428910] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.428550] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.415137] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker1 # [ 0.428958] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.429127] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.415148] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker1 # [ 0.429005] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.429140] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.415154] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker1 # [ 0.429054] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.429146] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned worker2 # [ 0.415197] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker1 # [ 0.429102] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.429191] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.415244] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.529154] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.429151] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.429238] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.415290] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned client # [ 0.531331] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.429199] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.429285] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.415337] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.429276] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.429332] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.415384] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker1 # [ 0.429323] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.429379] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned worker2 # [ 0.415429] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker1 # [ 0.429344] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.429428] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned worker2 # [ 0.415476] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker1 # [ 0.429366] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.429475] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.415522] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.429388] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.429523] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned worker1 # [ 0.429413] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.415569] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker1 # [ 0.429435] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.429570] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned worker2 # [ 0.415632] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.429458] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.415677] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.429630] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned worker1 # [ 0.429480] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.415699] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.429676] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned worker1 # [ 0.429503] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.415720] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.429698] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker1 # [ 0.429525] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.415742] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.429719] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker1 # [ 0.429548] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.541543] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.415766] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.429741] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker1 # [ 0.429571] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.543776] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.415788] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.429765] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker1 # [ 0.429593] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.415810] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.429788] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker1 # [ 0.429614] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.415832] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.429809] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker1 # [ 0.429637] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker2 # [ 0.415854] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.429831] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.429658] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.415877] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned lb # [ 0.429853] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker1 # [ 0.429680] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.429702] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.415899] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned lb # [ 0.429876] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.429725] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned worker2 # [ 0.415922] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.429898] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.429747] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker2 # [ 0.415944] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.429921] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.429770] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.415965] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.429942] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.429796] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.415986] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.429964] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.429806] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.416007] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.429986] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.429811] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.416029] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.430007] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker2 # [ 0.416050] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.430028] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker2 # [ 0.416072] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.430049] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned worker2 # [ 0.416094] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned lb # [ 0.430071] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.554818] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker1 # [ 0.469027] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.416116] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned lb # [ 0.430093] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker2 # [ 0.416143] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] lb # [ 0.430115] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned worker2 # [ 0.416153] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.430142] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.416158] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.430152] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] worker2 # [ 0.417342] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.430156] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.558145] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) lb # [ 0.431343] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.571388] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.574026] msm_serial: driver initialized client # [ 0.574203] SuperH (H)SCI(F) driver initialized client # [ 0.574259] STM32 USART driver initialized worker1 # [ 0.493135] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.490578] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.493311] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker1 # [ 0.499387] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.501467] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.500302] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.503344] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.511730] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker1 # [ 0.513695] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.507347] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker2 # [ 0.509270] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.511572] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) lb # [ 0.513576] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.515580] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.517624] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.525068] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.520668] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) client # [ 0.612626] loop: module loaded client # [ 0.612857] virtio_blk virtio5: 1/0/0 default/read/poll queues client # [ 0.613723] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.528299] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.523744] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker2 # [ 0.525774] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.528145] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) lb # [ 0.530247] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.538490] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.540761] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.535455] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.537728] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.624824] megasas: 07.734.00.00-rc1 lb # [ 0.541830] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.544294] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.625643] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.627592] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.627632] Intel/Sharp Extended Query Table at 0x0031 client # [ 0.629354] Using buffer write method client # [ 0.629443] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.544509] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) lb # [ 0.546720] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.631267] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.631303] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.550450] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.548598] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.645004] Using buffer write method client # [ 0.645044] Concatenating MTD devices: worker2 # [ 0.551696] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.645049] (0): "0.flash" client # [ 0.645053] (1): "0.flash" client # [ 0.645057] into device "0.flash" lb # [ 0.564242] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.567472] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.566834] msm_serial: driver initialized worker1 # [ 0.570122] msm_serial: driver initialized worker2 # [ 0.564664] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.567567] SuperH (H)SCI(F) driver initialized worker1 # [ 0.570848] SuperH (H)SCI(F) driver initialized lb # [ 0.567628] STM32 USART driver initialized worker1 # [ 0.570906] STM32 USART driver initialized worker2 # [ 0.567214] msm_serial: driver initialized worker2 # [ 0.567361] SuperH (H)SCI(F) driver initialized worker2 # [ 0.567414] STM32 USART driver initialized worker1 # [ 0.603199] loop: module loaded worker1 # [ 0.603412] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.601721] loop: module loaded worker1 # [ 0.604229] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.601931] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.602695] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.602907] loop: module loaded worker2 # [ 0.603104] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.603845] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.611232] megasas: 07.734.00.00-rc1 worker1 # [ 0.611956] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.608081] megasas: 07.734.00.00-rc1 worker2 # [ 0.610642] megasas: 07.734.00.00-rc1 lb # [ 0.608845] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.611376] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.613661] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.613687] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.622279] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.622366] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.624216] Using buffer write method worker1 # [ 0.624304] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.622988] Using buffer write method worker1 # [ 0.626130] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.623058] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker1 # [ 0.626175] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.627808] Using buffer write method worker1 # [ 0.627845] Concatenating MTD devices: worker1 # [ 0.627849] (0): "0.flash" worker1 # [ 0.627853] (1): "0.flash" worker1 # [ 0.627856] into device "0.flash" lb # [ 0.632215] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.632269] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.633863] Using buffer write method lb # [ 0.633958] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.634017] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.634047] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.635526] Using buffer write method worker2 # [ 0.635554] Concatenating MTD devices: worker2 # [ 0.635558] (0): "0.flash" worker2 # [ 0.635562] (1): "0.flash" worker2 # [ 0.635565] into device "0.flash" lb # [ 0.639123] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.639166] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.640697] Using buffer write method lb # [ 0.640733] Concatenating MTD devices: lb # [ 0.640738] (0): "0.flash" lb # [ 0.640741] (1): "0.flash" lb # [ 0.640745] into device "0.flash" client # [ 0.892221] Freeing initrd memory: 26160K client # [ 0.898379] tun: Universal TUN/TAP device driver, 1.6 client # [ 0.902112] thunder_xcv, ver 1.0 client # [ 0.902163] thunder_bgx, ver 1.0 client # [ 0.902186] nicpf, ver 1.0 client # [ 0.902766] e1000: Intel(R) PRO/1000 Network Driver client # [ 0.902773] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.902797] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.902804] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.902832] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.902838] igb: Copyright (c) 2007-2014 Intel Corporation. client # [ 0.902860] igbvf: Intel(R) Gigabit Virtual Function Network Driver client # [ 0.902866] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 0.903001] sky2: driver version 1.30 client # [ 0.911543] usbcore: registered new interface driver usb-storage client # [ 0.911678] usbcore: registered new interface driver usbserial_generic client # [ 0.911694] usbserial: USB Serial support registered for generic client # [ 0.914903] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.914935] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.915163] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.917915] hv_vmbus: registering driver hyperv_keyboard client # [ 0.919444] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.919470] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:51 UTC (1789901451) client # [ 0.919768] i2c_dev: i2c /dev entries driver client # [ 0.924878] sdhci: Secure Digital Host Controller Interface driver client # [ 0.924893] sdhci: Copyright(c) Pierre Ossman client # [ 0.925166] Synopsys Designware Multimedia Card Interface Driver client # [ 0.925539] sdhci-pltfm: SDHCI platform and OF driver helper client # [ 0.927235] hid: raw HID events driver (C) Jiri Kosina client # [ 0.927474] usbcore: registered new interface driver usbhid client # [ 0.927480] usbhid: USB HID core driver client # [ 0.932388] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 client # [ 0.932760] hub 1-0:1.0: USB hub found client # [ 0.932778] hub 1-0:1.0: 6 ports detected client # [ 0.935410] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.938039] drop_monitor: Initializing network drop monitor service client # [ 0.938230] NET: Registered PF_INET6 protocol family client # [ 0.940122] Segment Routing with IPv6 client # [ 0.940151] In-situ OAM (IOAM) with IPv6 client # [ 0.940179] NET: Registered PF_PACKET protocol family client # [ 0.941816] 9pnet: Installing 9P2000 support client # [ 0.944556] Key type dns_resolver registered client # [ 0.950751] registered taskstats version 1 client # [ 0.950907] Loading compiled-in X.509 certificates client # [ 0.959601] Demotion targets for Node 0: null client # [ 0.959713] Key type .fscrypt registered client # [ 0.959719] Key type fscrypt-provisioning registered client # [ 0.959815] ima: No TPM chip found, activating TPM-bypass! client # [ 0.959834] ima: Allocated hash algorithm: sha1 client # [ 0.959856] ima: No architecture policies found client # [ 0.964112] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.881438] Freeing initrd memory: 26148K worker2 # [ 0.887443] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.895573] Freeing initrd memory: 26148K lb # [ 0.894426] Freeing initrd memory: 26140K client # [ 0.982193] clk: Disabling unused clocks client # [ 0.982229] PM: genpd: Disabling unused power domains worker2 # [ 0.891269] thunder_xcv, ver 1.0 worker2 # [ 0.891315] thunder_bgx, ver 1.0 client # [ 0.986484] Freeing unused kernel memory: 4736K worker2 # [ 0.891337] nicpf, ver 1.0 client # [ 0.986694] Run /init as init process worker2 # [ 0.891890] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.901708] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.891897] e1000: Copyright (c) 1999-2006 Intel Corporation. worker2 # [ 0.891922] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.891930] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. lb # [ 0.900636] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.891959] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.891964] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.891987] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.905602] thunder_xcv, ver 1.0 worker2 # [ 0.891993] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.905653] thunder_bgx, ver 1.0 worker1 # [ 0.905677] nicpf, ver 1.0 worker2 # [ 0.892124] sky2: driver version 1.30 worker2 # [ 0.893716] usbcore: registered new interface driver usb-storage worker2 # [ 0.893802] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.893818] usbserial: USB Serial support registered for generic worker2 # [ 0.894732] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.894758] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 0.904480] thunder_xcv, ver 1.0 worker1 # [ 0.907507] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.904530] thunder_bgx, ver 1.0 worker2 # [ 0.894949] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.904553] nicpf, ver 1.0 worker1 # [ 0.907520] e1000: Copyright (c) 1999-2006 Intel Corporation. lb # [ 0.905107] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.907551] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.906655] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.905115] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.907561] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.906994] hub 1-0:1.0: USB hub found lb # [ 0.905139] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.907023] hub 1-0:1.0: 6 ports detected worker1 # [ 0.907591] igb: Intel(R) Gigabit Ethernet Network Driver lb # [ 0.905147] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.907596] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.905177] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.907621] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.909487] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.905183] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 0.907627] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. client # [ 1.002255] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.905206] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.907781] sky2: driver version 1.30 lb # [ 0.905212] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.909421] usbcore: registered new interface driver usb-storage lb # [ 0.905347] sky2: driver version 1.30 worker2 # [ 0.911008] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.909540] usbcore: registered new interface driver usbserial_generic lb # [ 0.907682] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.911035] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:51 UTC (1789901451) worker1 # [ 0.909555] usbserial: USB Serial support registered for generic lb # [ 0.907714] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker2 # [ 0.911333] i2c_dev: i2c /dev entries driver worker1 # [ 0.910147] hv_vmbus: registering driver hyperv_keyboard lb # [ 0.907958] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.910934] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 0.910968] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.911155] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.917156] usbcore: registered new interface driver usb-storage lb # [ 0.917272] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.922960] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.917287] usbserial: USB Serial support registered for generic worker2 # [ 0.916269] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.924047] hub 1-0:1.0: USB hub found worker2 # [ 0.916282] sdhci: Copyright(c) Pierre Ossman lb # [ 0.917963] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.924531] hub 1-0:1.0: 6 ports detected worker2 # [ 0.916545] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.916926] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.921554] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.921889] hub 1-0:1.0: USB hub found worker1 # [ 0.925622] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.921911] hub 1-0:1.0: 6 ports detected worker1 # [ 0.925654] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:51 UTC (1789901451) worker2 # [ 0.921225] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.925995] i2c_dev: i2c /dev entries driver worker2 # [ 0.921498] usbcore: registered new interface driver usbhid lb # [ 0.924183] rtc-pl031 9010000.pl031: registered as rtc0 worker2 # [ 0.921505] usbhid: USB HID core driver lb # [ 0.924213] rtc-pl031 9010000.pl031: setting system clock to 2026-09-20T10:50:51 UTC (1789901451) lb # [ 0.924567] i2c_dev: i2c /dev entries driver worker2 # [ 0.924380] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.925893] drop_monitor: Initializing network drop monitor service worker2 # [ 0.927952] NET: Registered PF_INET6 protocol family lb # [ 0.929538] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.931070] sdhci: Secure Digital Host Controller Interface driver worker2 # [ 0.929385] Segment Routing with IPv6 lb # [ 0.929549] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.931083] sdhci: Copyright(c) Pierre Ossman worker2 # [ 0.929419] In-situ OAM (IOAM) with IPv6 lb # [ 0.929821] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.931355] Synopsys Designware Multimedia Card Interface Driver worker2 # [ 0.929449] NET: Registered PF_PACKET protocol family lb # [ 0.930201] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.931731] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.933436] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.933686] usbcore: registered new interface driver usbhid worker1 # [ 0.933692] usbhid: USB HID core driver lb # [ 0.934651] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.931260] 9pnet: Installing 9P2000 support worker2 # [ 0.933431] Key type dns_resolver registered lb # [ 0.935631] usbcore: registered new interface driver usbhid lb # [ 0.935641] usbhid: USB HID core driver worker1 # [ 0.939310] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.940840] drop_monitor: Initializing network drop monitor service lb # [ 0.937904] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.941033] NET: Registered PF_INET6 protocol family worker1 # [ 0.944069] Segment Routing with IPv6 lb # [ 0.940586] drop_monitor: Initializing network drop monitor service worker1 # [ 0.944091] In-situ OAM (IOAM) with IPv6 lb # [ 0.940767] NET: Registered PF_INET6 protocol family worker1 # [ 0.944134] NET: Registered PF_PACKET protocol family lb # [ 0.942724] Segment Routing with IPv6 worker1 # [ 0.945781] 9pnet: Installing 9P2000 support lb # [ 0.942743] In-situ OAM (IOAM) with IPv6 lb # [ 0.942777] NET: Registered PF_PACKET protocol family worker2 # [ 0.940290] registered taskstats version 1 worker2 # [ 0.940435] Loading compiled-in X.509 certificates lb # [ 0.944626] 9pnet: Installing 9P2000 support worker1 # [ 0.948716] Key type dns_resolver registered lb # [ 0.946782] Key type dns_resolver registered worker2 # [ 0.948828] Demotion targets for Node 0: null worker2 # [ 0.948992] Key type .fscrypt registered worker2 # [ 0.949002] Key type fscrypt-provisioning registered worker2 # [ 0.949097] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.949117] ima: Allocated hash algorithm: sha1 worker2 # [ 0.949144] ima: No architecture policies found lb # [ 0.953533] registered taskstats version 1 worker1 # [ 0.955192] registered taskstats version 1 lb # [ 0.953712] Loading compiled-in X.509 certificates worker2 # [ 0.953188] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker1 # [ 0.955354] Loading compiled-in X.509 certificates worker1 # [ 0.964108] Demotion targets for Node 0: null worker1 # [ 0.964242] Key type .fscrypt registered worker1 # [ 0.964250] Key type fscrypt-provisioning registered lb # [ 0.962240] Demotion targets for Node 0: null worker1 # [ 0.964349] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.962349] Key type .fscrypt registered worker1 # [ 0.964369] ima: Allocated hash algorithm: sha1 lb # [ 0.962355] Key type fscrypt-provisioning registered worker1 # [ 0.964391] ima: No architecture policies found lb # [ 0.962453] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.962472] ima: Allocated hash algorithm: sha1 lb # [ 0.962501] ima: No architecture policies found worker1 # [ 0.968608] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.966943] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.970917] clk: Disabling unused clocks worker2 # [ 0.970946] PM: genpd: Disabling unused power domains worker2 # [ 0.975202] Freeing unused kernel memory: 4736K worker2 # [ 0.975429] Run /init as init process worker1 # [ 0.987136] clk: Disabling unused clocks worker1 # [ 0.987175] PM: genpd: Disabling unused power domains lb # [ 0.984627] clk: Disabling unused clocks lb # [ 0.984663] PM: genpd: Disabling unused power domains worker1 # [ 0.991460] Freeing unused kernel memory: 4736K worker1 # [ 0.991698] Run /init as init process lb # [ 0.988893] Freeing unused kernel memory: 4736K lb # [ 0.989124] Run /init as init process worker2 # [ 0.992265] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.005219] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.008499] systemd[1]: Successfully made /usr/ read-only. client # [ 1.180025] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.154059] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.166995] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.170303] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.332187] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.338067] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.350286] systemd[1]: Detected virtualization qemu. client # [ 1.350383] systemd[1]: Detected architecture arm64. client # [ 1.350408] systemd[1]: Running in initrd. client # [ 1.351375] systemd[1]: Initializing machine ID from random generator. client # [ 1.351782] systemd[1]: Hostname set to . worker2 # [ 1.308331] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.319411] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.322642] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 client # [ 1.416242] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker2 # [ 1.327084] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.339067] systemd[1]: Detected virtualization qemu. worker2 # [ 1.341068] systemd[1]: Detected architecture arm64. worker2 # [ 1.343088] systemd[1]: Running in initrd. worker2 # [ 1.345691] systemd[1]: Initializing machine ID from random generator. lb # [ 1.340042] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.343319] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.348645] systemd[1]: Hostname set to . lb # [ 1.352121] systemd[1]: Detected virtualization qemu. worker1 # [ 1.355406] systemd[1]: Detected virtualization qemu. lb # [ 1.354105] systemd[1]: Detected architecture arm64. worker1 # [ 1.357391] systemd[1]: Detected architecture arm64. lb # [ 1.356084] systemd[1]: Running in initrd. worker1 # [ 1.359375] systemd[1]: Running in initrd. lb # [ 1.358657] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.361932] systemd[1]: Initializing machine ID from random generator. lb # [ 1.361666] systemd[1]: Hostname set to . worker1 # [ 1.364913] systemd[1]: Hostname set to . worker2 # [ 1.394299] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.407270] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.410547] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.536001] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.518071] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.531007] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.534330] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.663791] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.690295] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.695423] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.650470] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.669163] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.676739] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.676394] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.681516] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.779498] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.692618] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.693708] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.698275] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.790329] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.699071] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 client # [ 1.791575] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.792989] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.794052] systemd[1]: Reached target Path Units. client # [ 1.794868] systemd[1]: Reached target Slice Units. client # [ 1.795701] systemd[1]: Reached target Swaps. client # [ 1.796561] systemd[1]: Reached target Timer Units. client # [ 1.797566] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.798782] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.799905] systemd[1]: Listening on Journal Sockets. client # [ 1.801062] systemd[1]: Listening on udev Control Socket. client # [ 1.801192] systemd[1]: Listening on udev Kernel Socket. client # [ 1.801217] systemd[1]: Reached target Socket Units. client # [ 1.805445] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.815947] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.817281] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.829583] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.852118] systemd[1]: Starting Journal Service... client # [ 1.856161] systemd[1]: Starting Load Kernel Modules... client # [ 1.857094] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.765771] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.864892] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.777519] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.778762] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.780079] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.781146] systemd[1]: Reached target Path Units. worker2 # [ 1.781964] systemd[1]: Reached target Slice Units. worker2 # [ 1.782901] systemd[1]: Reached target Swaps. worker2 # [ 1.783653] systemd[1]: Reached target Timer Units. worker1 # [ 1.789001] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.785839] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.784660] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.785895] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.787192] systemd[1]: Listening on Journal Sockets. worker2 # [ 1.787340] systemd[1]: Listening on udev Control Socket. client # [ 1.880119] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.787468] systemd[1]: Listening on udev Kernel Socket. client # [ 1.881180] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 1.787491] systemd[1]: Reached target Socket Units. worker2 # [ 1.792490] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.800306] systemd[1]: Created slice Slice /system/modprobe. lb # [ 1.797429] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.801365] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 1.798643] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.802579] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.803503] systemd[1]: Reached target Path Units. worker1 # [ 1.804216] systemd[1]: Reached target Slice Units. worker1 # [ 1.804925] systemd[1]: Reached target Swaps. worker2 # [ 1.799341] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.805586] systemd[1]: Reached target Timer Units. lb # [ 1.800165] systemd[1]: Expecting device /dev/disk/by-label/nixos... lb # [ 1.800204] systemd[1]: Reached target Path Units. worker1 # [ 1.806513] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.892666] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.800590] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.800226] systemd[1]: Reached target Slice Units. worker1 # [ 1.807544] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.800249] systemd[1]: Reached target Swaps. worker1 # [ 1.808518] systemd[1]: Listening on Journal Sockets. lb # [ 1.800269] systemd[1]: Reached target Timer Units. worker1 # [ 1.809381] systemd[1]: Listening on udev Control Socket. lb # [ 1.800470] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.810301] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.800628] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.811102] systemd[1]: Reached target Socket Units. lb # [ 1.800771] systemd[1]: Listening on Journal Sockets. lb # [ 1.800906] systemd[1]: Listening on udev Control Socket. lb # [ 1.801022] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.813272] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.801044] systemd[1]: Reached target Socket Units. lb # [ 1.812092] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.810141] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.902643] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.903868] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.822474] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 1.818173] systemd[1]: Starting Journal Service... worker1 # [ 1.823492] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.823186] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.824337] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.827816] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.922786] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.923393] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.838685] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.854482] systemd[1]: Starting Journal Service... lb # [ 1.851520] systemd[1]: Starting Journal Service... worker2 # [ 1.854217] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.854341] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.862188] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.863263] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.948065] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.952890] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.953126] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.953135] [drm] features: -context_init client # [ 1.953845] [drm] number of scanouts: 1 worker2 # [ 1.864631] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.953863] [drm] number of cap sets: 0 worker1 # [ 1.876441] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.870225] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.875200] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.872750] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.964218] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.876156] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.879031] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.968443] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.883874] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.880475] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.881412] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.885682] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.891963] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.893418] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.890175] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker2 # [ 1.890481] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.890525] [drm] features: -context_init worker2 # [ 1.891248] [drm] number of scanouts: 1 worker2 # [ 1.891266] [drm] number of cap sets: 0 client # [ 1.980352] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.980377] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 1.899706] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.900867] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.901155] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.898125] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.898526] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.902410] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.912407] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.908991] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 2.000464] Console: switching to colour frame buffer device 160x50 worker1 # [ 1.918703] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.919069] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.915902] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 1.915932] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker1 # [ 1.933492] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.928796] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 1.934552] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.939330] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.939563] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.939572] [drm] features: -context_init worker1 # [ 1.940290] [drm] number of scanouts: 1 worker1 # [ 1.940309] [drm] number of cap sets: 0 client # [ 2.028587] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 2.028770] systemd[1]: Reached target Preparation for Local File Systems. client # [ 2.028795] systemd[1]: Reached target Local File Systems. lb # [ 1.942651] systemd-journald[73]: Collecting audit messages is disabled. client # [ 2.032845] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.040777] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 1.950742] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.946387] Console: switching to colour frame buffer device 160x50 worker2 # [ 1.952943] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 1.960233] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.962839] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.962674] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.962704] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.966704] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.970403] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 2.064272] systemd[1]: Finished Load Kernel Modules. lb # [ 1.971207] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.975846] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 lb # [ 1.976076] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.982541] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.976085] [drm] features: -context_init lb # [ 1.976792] [drm] number of scanouts: 1 worker1 # [ 1.985158] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.976809] [drm] number of cap sets: 0 client # [ 2.072422] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.991386] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 1.991406] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.998291] systemd[1]: Finished Load Kernel Modules. worker2 # [ 2.002028] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.998680] Console: switching to colour frame buffer device 160x50 worker1 # [ 2.005462] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.089748] systemd-modules-load[74]: Inserted module 'dm_mod' client # [ 2.092258] systemd-modules-load[74]: Module 'virtio_balloon' is built in client # [ 2.093413] systemd-modules-load[74]: Module 'virtio_console' is built in client # [ 2.094462] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.095406] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.020494] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 2.112472] systemd[1]: Started Journal Service. worker1 # [ 2.026902] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 2.027140] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 2.027176] systemd[1]: Reached target Local File Systems. worker2 # [ 2.026555] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 2.028638] systemd[1]: Reached target Local File Systems. worker1 # [ 2.034760] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.034821] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 2.035038] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 2.035061] systemd[1]: Reached target Local File Systems. worker2 # [ 2.039593] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 2.043443] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.124187] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 2.055021] Console: switching to colour frame buffer device 160x50 lb # [ 2.055720] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 2.132188] systemd[1]: Starting Create System Files and Directories... client # [ 2.134923] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 2.062535] systemd[1]: Finished Load Kernel Modules. lb # [ 2.065974] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.066027] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.069259] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 2.066698] systemd[1]: Finished Apply Kernel Variables. client # [ 2.159326] systemd[1]: Finished Create System Files and Directories. client # [ 2.174942] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.107032] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.106274] systemd[1]: Started Journal Service. lb # [ 2.119164] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.100373] systemd-modules-load[74]: Inserted module 'dm_mod' worker2 # [ 2.101483] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker2 # [ 2.102589] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.103649] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.130514] systemd[1]: Started Journal Service. worker2 # [ 2.109374] systemd-modules-load[74]: Module 'virtio_rng' is built in worker1 # [ 2.119638] systemd-modules-load[74]: Inserted module 'dm_mod' worker1 # [ 2.120959] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker2 # [ 2.115379] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.128325] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.123450] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 2.144524] systemd[1]: Started Journal Service. worker1 # [ 2.136342] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.137439] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 2.133459] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.134882] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.139477] systemd[1]: Starting Create System Files and Directories... worker1 # [ 2.143902] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 2.144562] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.148444] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.238474] systemd[1]: Starting Virtual Console Setup... lb # [ 2.150886] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.149780] systemd[1]: Finished Create System Files and Directories. lb # [ 2.161953] systemd[1]: Starting Create System Files and Directories... lb # [ 2.164559] systemd-udevd[79]: Using default interface naming scheme 'v261'. worker2 # [ 2.166744] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.185275] systemd[1]: Finished Create System Files and Directories. worker1 # [ 2.189512] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.211055] systemd[1]: Finished Create System Files and Directories. client # [ 2.301366] systemd-vconsole-setup[104]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.304118] systemd[1]: Finished Virtual Console Setup. lb # [ 2.217600] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 2.232248] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.250040] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.276491] systemd-vconsole-setup[102]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.280143] systemd[1]: Finished Virtual Console Setup. lb # [ 2.292891] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.300528] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.304103] systemd[1]: Finished Virtual Console Setup. lb # [ 2.344771] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.348889] systemd[1]: Finished Virtual Console Setup. client # [ 2.901559] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.902495] systemd[1]: Reached target System Initialization. client # [ 2.903291] systemd[1]: Reached target Basic System. worker2 # [ 2.873356] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.874674] systemd[1]: Reached target System Initialization. worker2 # [ 2.880479] systemd[1]: Reached target Basic System. worker1 # [ 2.893275] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.894217] systemd[1]: Reached target System Initialization. worker1 # [ 2.895021] systemd[1]: Reached target Basic System. client # [ 3.028340] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.957209] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.958926] systemd[1]: Reached target System Initialization. lb # [ 2.959797] systemd[1]: Reached target Basic System. client # [ 3.057505] (udev-worker)[102]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.073813] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.003971] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.019925] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.133753] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.135949] systemd[1]: Reached target Initrd Root Device. client # [ 3.139872] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.049425] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.060639] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 3.053397] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.080893] (udev-worker)[98]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.192276] systemd-fsck[113]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.199989] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.114455] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.208356] systemd[1]: Mounting /sysroot... worker2 # [ 3.116285] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.119884] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... lb # [ 3.126396] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.145415] (udev-worker)[95]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.156236] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 3.152324] (udev-worker)[95]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.158984] systemd[1]: Reached target Initrd Root Device. client # [ 3.258943] EXT4-fs (vda): mounted filesystem 6f3a39a3-5cde-474a-8553-04ad9e368e0d r/w with ordered data mode. Quota mode: none. worker1 # [ 3.161253] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.249176] systemd[1]: Mounted /sysroot. client # [ 3.251006] systemd[1]: Reached target Initrd Root File System. client # [ 3.260135] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.178428] systemd-fsck[111]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.187215] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.189907] systemd[1]: Mounting /sysroot... client # [ 3.283646] systemd-sysroot-fstab-check[121]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.292109] systemd[1]: Reload requested from client PID 121 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.296115] systemd[1]: Reloading... worker1 # [ 3.215322] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.212609] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.221505] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.219324] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.227268] systemd[1]: Mounting /sysroot... lb # [ 3.223564] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.240937] EXT4-fs (vda): mounted filesystem 931ea2e4-7f1d-4064-a59c-52d5258ca021 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.229038] systemd[1]: Mounted /sysroot. worker2 # [ 3.231237] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.235754] systemd[1]: Starting Mountpoints Configured in the Real Root... worker1 # [ 3.286507] EXT4-fs (vda): mounted filesystem 30cb300f-6f10-42cd-9129-3e7aa90cf021 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.265433] systemd-sysroot-fstab-check[119]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.277840] systemd[1]: Mounted /sysroot. worker2 # [ 3.270039] systemd[1]: Reload requested from client PID 119 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.279768] systemd[1]: Reached target Initrd Root File System. lb # [ 3.276453] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.275458] systemd[1]: Reloading... worker1 # [ 3.284383] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.284093] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.287153] systemd[1]: Mounting /sysroot... worker1 # [ 3.307739] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.314567] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.319880] systemd[1]: Reloading... lb # [ 3.335730] EXT4-fs (vda): mounted filesystem 1b7320b8-7621-4426-9f3e-79345037d1c9 r/w with ordered data mode. Quota mode: none. lb # [ 3.327718] systemd[1]: Mounted /sysroot. lb # [ 3.330113] systemd[1]: Reached target Initrd Root File System. lb # [ 3.333892] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.357107] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.363085] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.368397] systemd[1]: Reloading... client # [ 3.503691] systemd[1]: Reloading finished in 210 ms. client # [ 3.536180] systemd-sysroot-fstab-check[121]: Requesting initrd-fs.target/start/replace... client # [ 3.539909] systemd-sysroot-fstab-check[121]: Requesting swap.target/start/replace... client # [ 3.545818] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.552176] systemd[1]: initrd-parse-etc.service: Deactivated successfully. client # [ 3.556716] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 3.557879] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.484118] systemd[1]: Reloading finished in 208 ms. client # [ 3.581083] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.583917] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.510061] systemd-sysroot-fstab-check[119]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.524976] systemd[1]: Reloading finished in 205 ms. worker2 # [ 3.520093] systemd-sysroot-fstab-check[119]: Requesting swap.target/start/replace... worker2 # [ 3.522359] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.527385] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.530380] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 3.535221] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.558140] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.551958] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.561759] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker2 # [ 3.553447] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.564842] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.572946] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.574980] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.578212] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.576119] systemd[1]: Reloading finished in 207 ms. worker1 # [ 3.595821] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.597460] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.608174] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... lb # [ 3.612190] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.617812] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 3.620730] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.626461] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.628861] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.652094] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.653831] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.854469] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.865242] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.879364] systemd[1]: Mounting /sysroot/run... client # [ 3.910876] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.923887] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.927159] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.942207] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.866974] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.956259] systemd[1]: Mounted /sysroot/run. lb # [ 3.870156] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.877330] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.868515] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.973503] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.890021] systemd[1]: Mounting /sysroot/run... lb # [ 3.887453] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.977226] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.888117] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.891260] systemd[1]: Mounting /sysroot/run... lb # [ 3.901834] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.906481] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.995694] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.903478] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.912813] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.920846] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 4.011333] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.012547] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.929378] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.941272] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.954973] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.959531] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.970350] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.974594] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.987783] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.995187] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.985886] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.994781] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.000731] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.994176] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 4.001066] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 4.010200] systemd[1]: Mounted /sysroot/run. worker2 # [ 4.006738] systemd[1]: Mounted /sysroot/run. lb # [ 4.012124] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 4.016147] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.007492] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 4.019304] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 4.021223] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 4.031926] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.033260] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 4.027213] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.033532] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.031311] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.036782] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.038740] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.034264] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.068590] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.074872] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.069639] systemd[1]: Reached target Initrd File Systems. lb # [ 4.076293] systemd[1]: Reached target Initrd File Systems. worker2 # [ 4.071735] systemd[1]: Starting Find NixOS closure... lb # [ 4.079725] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.082690] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.090347] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.122342] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.120268] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.137695] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.133078] systemd[1]: Finished Find NixOS closure. lb # [ 4.139649] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.135613] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.141337] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.148875] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 4.167928] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.171406] systemd[1]: Stopped target Basic System. lb # [ 4.179383] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.180842] systemd[1]: Stopped target Basic System. lb # [ 4.181931] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.177372] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 4.179224] systemd[1]: Stopped target Path Units. lb # [ 4.185138] systemd[1]: Stopped target Path Units. worker2 # [ 4.180496] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.186375] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 4.183269] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.190881] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.192571] systemd[1]: Stopped target Slice Units. worker2 # [ 4.188846] systemd[1]: Stopped target Slice Units. worker2 # [ 4.189582] systemd[1]: Stopped target Socket Units. lb # [ 4.195953] systemd[1]: Stopped target Socket Units. worker2 # [ 4.191553] systemd[1]: Stopped target System Initialization. lb # [ 4.200229] systemd[1]: Stopped target System Initialization. lb # [ 4.201043] systemd[1]: Stopped target Swaps. lb # [ 4.201682] systemd[1]: Stopped target Timer Units. worker2 # [ 4.197052] systemd[1]: Stopped target Swaps. lb # [ 4.202356] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.197714] systemd[1]: Stopped target Timer Units. lb # [ 4.203152] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.198396] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 4.199189] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 4.199993] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.204001] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.214943] systemd[1]: Stopped Find NixOS closure. lb # [ 4.216491] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 4.212624] systemd[1]: Stopped Find NixOS closure. lb # [ 4.218407] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.213380] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 4.214347] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 4.215183] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 4.224867] systemd[1]: Stopped Apply Kernel Variables. lb # [ 4.230203] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.231238] systemd[1]: Stopped Apply Kernel Variables. lb # [ 4.233046] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 4.228225] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 4.238018] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.240179] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.236688] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.243325] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.238461] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 4.243940] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 4.247406] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.253503] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.257417] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.254594] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 4.255518] systemd[1]: Stopped target Local File Systems. worker2 # [ 4.257589] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.264374] systemd[1]: Stopped target Local File Systems. lb # [ 4.265245] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 4.259879] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.266798] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 4.262540] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.263357] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.269687] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 4.264520] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.270526] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 4.265534] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.266258] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 4.267232] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.273870] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.274912] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.277494] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.278487] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 4.279387] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.280509] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.281318] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 4.276136] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.282314] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 4.277199] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker2 # [ 4.278116] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 4.279566] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 4.281010] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.281945] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.288097] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 4.282935] systemd[1]: systemd-udevd.service: Consumed 1.092s CPU time over 2.248s wall clock time, 20.8M memory peak. lb # [ 4.289111] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 4.284435] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 4.285403] systemd[1]: Closed udev Control Socket. worker2 # [ 4.286086] systemd[1]: Starting Cleanup udev Database... lb # [ 4.291107] systemd[1]: systemd-udevd.service: Consumed 1.035s CPU time over 2.258s wall clock time, 17M memory peak. worker2 # [ 4.286832] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 4.287860] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.296549] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. lb # [ 4.297588] systemd[1]: Closed udev Control Socket. lb # [ 4.298273] systemd[1]: Starting Cleanup udev Database... lb # [ 4.299023] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.300369] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.301345] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 4.296238] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.302501] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 4.297647] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.303506] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 4.298745] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.304602] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 4.299734] systemd[1]: Stopped Create List of Static Device Nodes. client # [ 4.405812] (udev-worker)[97]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory client # [ 4.412152] (udev-worker)[97]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.324454] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.326451] systemd[1]: Finished Cleanup udev Database. worker2 # [ 4.328469] systemd[1]: Reached target Switch Root. lb # [ 4.335385] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 4.332461] systemd[1]: Starting NixOS Activation... lb # [ 4.338264] systemd[1]: Finished Cleanup udev Database. lb # [ 4.340504] systemd[1]: Reached target Switch Root. lb # [ 4.341257] systemd[1]: Starting NixOS Activation... client # [ 4.429637] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.432276] systemd[1]: Stopped Virtual Console Setup. client # [ 4.439097] systemd[1]: Stopping Virtual Console Setup... client # [ 4.439968] systemd[1]: Starting Virtual Console Setup... client # [ 4.464999] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.467440] systemd[1]: Finished Virtual Console Setup. worker1 # [ 4.416627] (udev-worker)[102]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.422611] (udev-worker)[102]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker1 # [ 4.444806] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.446537] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.448321] systemd[1]: Stopping Virtual Console Setup... worker1 # [ 4.456134] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.471954] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.473581] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.476831] systemd[1]: Starting Virtual Console Setup... worker2 # [ 4.494654] initrd-nixos-activation-start[172]: booting system configuration /nix/store/jzdfkj5rn54mxddyl2kfg84vs1zgm4ba-nixos-system-worker2-test worker1 # [ 4.503934] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.500426] initrd-nixos-activation-start[172]: booting system configuration /nix/store/14bqwb8zl951hxla1qpmchqzwfgwlqnx-nixos-system-lb-test worker1 # [ 4.507482] systemd[1]: Finished Virtual Console Setup. lb # [ 4.565755] initrd-nixos-activation-start[172]: running activation script... worker2 # [ 4.560991] initrd-nixos-activation-start[172]: running activation script... client # [ 4.857866] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.922468] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.928177] systemd[1]: Reached target Initrd File Systems. client # [ 4.938385] systemd[1]: Starting Find NixOS closure... client # [ 4.941124] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.870123] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.994169] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.998685] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 5.013141] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.929886] systemd[1]: Mounted /sysroot/nix/store. client # [ 5.015882] systemd[1]: Reached target Initrd Default Target. client # [ 5.017777] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.935422] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.938323] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.948446] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 5.053687] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.055740] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.060226] systemd[1]: Stopped target Initrd Default Target. client # [ 5.061451] systemd[1]: Stopped target Basic System. client # [ 5.064333] systemd[1]: Stopped target Initrd Root Device. client # [ 5.066870] systemd[1]: Stopped target Path Units. client # [ 5.067859] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.071188] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.076267] systemd[1]: Stopped target Slice Units. client # [ 5.077188] systemd[1]: Stopped target Socket Units. client # [ 5.078028] systemd[1]: Stopped target System Initialization. client # [ 5.078968] systemd[1]: Stopped target Swaps. worker2 # [ 4.985401] initrd-nixos-activation-start[195]: setting up /etc... client # [ 5.079720] systemd[1]: Stopped target Timer Units. lb # [ 4.991920] initrd-nixos-activation-start[195]: setting up /etc... client # [ 5.084238] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.085222] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.000178] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 5.086143] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.087287] systemd[1]: Stopped Find NixOS closure. worker1 # [ 5.003705] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 5.091851] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 5.094204] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.095872] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.018954] systemd[1]: Finished Find NixOS closure. client # [ 5.105144] systemd[1]: Stopped Apply Kernel Variables. client # [ 5.105937] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 5.022054] systemd[1]: Reached target Initrd Default Target. worker1 # [ 5.023895] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 5.111520] systemd[1]: Stopped Load Kernel Modules. client # [ 5.116387] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.120149] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.122393] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.123416] systemd[1]: Stopped Create System Files and Directories. client # [ 5.126979] systemd[1]: Stopped target Local File Systems. client # [ 5.129470] systemd[1]: Stopped target Preparation for Local File Systems. client # [ 5.131192] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. client # [ 5.136480] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.137294] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.138377] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.139395] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.054668] systemd[1]: Stopped target Initrd Default Target. client # [ 5.140237] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 5.141285] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.142109] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.143069] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.143862] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.060559] systemd[1]: Stopped target Basic System. worker1 # [ 5.061610] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 5.062656] systemd[1]: Stopped target Path Units. worker1 # [ 5.063587] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 5.067110] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 5.152388] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.153428] systemd[1]: systemd-udevd.service: Consumed 1.383s CPU time over 3.109s wall clock time, 22.4M memory peak. client # [ 5.156114] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.072244] systemd[1]: Stopped target Slice Units. worker1 # [ 5.073139] systemd[1]: Stopped target Socket Units. worker1 # [ 5.074020] systemd[1]: Stopped target System Initialization. worker1 # [ 5.074973] systemd[1]: Stopped target Swaps. client # [ 5.160196] systemd[1]: Closed udev Control Socket. worker1 # [ 5.075726] systemd[1]: Stopped target Timer Units. client # [ 5.160939] systemd[1]: Starting Cleanup udev Database... client # [ 5.161698] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.162732] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.164185] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.080377] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 5.081333] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 5.082639] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 5.168381] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.169392] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.085477] systemd[1]: Stopped Find NixOS closure. client # [ 5.172142] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.087616] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 5.089840] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 5.093041] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 5.104226] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 5.106822] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.194850] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.111140] systemd[1]: Stopped Load Kernel Modules. client # [ 5.196877] systemd[1]: Finished Cleanup udev Database. client # [ 5.200554] systemd[1]: Reached target Switch Root. client # [ 5.201323] systemd[1]: Starting NixOS Activation... worker1 # [ 5.118469] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 5.121930] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 5.126539] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 5.128185] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 5.130243] systemd[1]: Stopped target Local File Systems. worker1 # [ 5.131487] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 5.136730] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 5.137805] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 5.138566] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 5.139579] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 5.145598] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 5.146432] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 5.147360] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 5.148387] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 5.149377] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 5.150215] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 5.151187] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 5.151991] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 5.160460] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 5.161490] systemd[1]: systemd-udevd.service: Consumed 1.393s CPU time over 3.114s wall clock time, 22.4M memory peak. worker1 # [ 5.163117] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 5.168203] systemd[1]: Closed udev Control Socket. worker1 # [ 5.168921] systemd[1]: Starting Cleanup udev Database... worker1 # [ 5.169661] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 5.170681] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 5.171523] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.176489] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.177486] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 5.178441] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.201800] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.204515] systemd[1]: Finished Cleanup udev Database. worker1 # [ 5.208539] systemd[1]: Reached target Switch Root. worker1 # [ 5.209338] systemd[1]: Starting NixOS Activation... lb # [ 5.253305] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.248425] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.256156] systemd[1]: Finished NixOS Activation. worker2 # [ 5.251143] systemd[1]: Finished NixOS Activation. lb # [ 5.260283] systemd[1]: Starting Switch Root... worker2 # [ 5.256234] systemd[1]: Starting Switch Root... client # [ 5.360785] initrd-nixos-activation-start[180]: booting system configuration /nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test lb # [ 5.279985] systemd[1]: Switching root. worker2 # [ 5.275519] systemd[1]: Switching root. client # [ 5.424540] initrd-nixos-activation-start[180]: running activation script... worker1 # [ 5.373055] initrd-nixos-activation-start[181]: booting system configuration /nix/store/gy3k7x527c38djcmpycpycfhnskkzynp-nixos-system-worker1-test worker1 # [ 5.437911] initrd-nixos-activation-start[181]: running activation script... lb # [ 5.474502] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker2 # [ 5.473574] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 5.837094] initrd-nixos-activation-start[203]: setting up /etc... worker1 # [ 5.852764] initrd-nixos-activation-start[204]: setting up /etc... client # [ 6.098538] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.101321] systemd[1]: Finished NixOS Activation. client # [ 6.102524] systemd[1]: Starting Switch Root... client # [ 6.120181] systemd[1]: Switching root. lb # [ 6.074090] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.072723] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.087205] systemd[1]: Detected virtualization qemu. worker2 # [ 6.085690] systemd[1]: Detected virtualization qemu. lb # [ 6.090346] systemd[1]: Detected architecture arm64. worker2 # [ 6.089702] systemd[1]: Detected architecture arm64. worker2 # [ 6.091970] systemd[1]: Detected first boot. lb # [ 6.093545] systemd[1]: Detected first boot. worker2 # [ 6.099410] systemd[1]: Initializing machine ID from random generator. lb # [ 6.102044] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.122817] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 6.125640] systemd[1]: Finished NixOS Activation. worker1 # [ 6.126817] systemd[1]: Starting Switch Root... worker1 # [ 6.143929] systemd[1]: Switching root. client # [ 6.308363] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.329038] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.427277] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.454547] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 6.617502] systemd[1]: Applying preset policy. worker2 # [ 6.650472] systemd[1]: Applying preset policy. client # [ 6.907473] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.919778] systemd[1]: Detected virtualization qemu. client # [ 6.923663] systemd[1]: Detected architecture arm64. client # [ 6.925981] systemd[1]: Detected first boot. client # [ 6.933314] systemd[1]: Initializing machine ID from random generator. worker1 # [ 6.939035] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.951236] systemd[1]: Detected virtualization qemu. worker1 # [ 6.954362] systemd[1]: Detected architecture arm64. worker1 # [ 6.958313] systemd[1]: Detected first boot. worker1 # [ 6.965525] systemd[1]: Initializing machine ID from random generator. lb # [ 7.145571] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.160485] systemd[1]: Populated /etc with preset unit settings. client # [ 7.275553] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 7.317090] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.477488] systemd[1]: Applying preset policy. worker1 # [ 7.504774] systemd[1]: Applying preset policy. worker2 # [ 7.689794] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.691418] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 7.693768] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 7.698587] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.700766] systemd[1]: Created slice User and Session Slice. lb # [ 7.705938] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 7.703147] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 7.707538] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 7.705438] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.707791] systemd[1]: Expecting device /dev/hvc0... lb # [ 7.710810] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 7.709604] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 7.711489] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 7.714878] systemd[1]: Created slice Slice /system/getty. worker2 # [ 7.713390] systemd[1]: Stopped target initrd-fs.target. lb # [ 7.717271] systemd[1]: Created slice User and Session Slice. worker2 # [ 7.715337] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 7.718523] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 7.716461] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.718066] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 7.720467] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 7.719678] systemd[1]: Reached target Path Units. lb # [ 7.722770] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 7.721064] systemd[1]: Reached target Remote File Systems. lb # [ 7.723853] systemd[1]: Expecting device /dev/ttyAMA0... lb # [ 7.725271] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 7.722632] systemd[1]: Reached target Slice Units. worker2 # [ 7.724789] systemd[1]: Reached target Swaps. lb # [ 7.726777] systemd[1]: Stopped target initrd-fs.target. lb # [ 7.728911] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 7.729995] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 7.728691] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 7.731573] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 7.733133] systemd[1]: Reached target Path Units. lb # [ 7.734463] systemd[1]: Reached target Remote File Systems. worker2 # [ 7.733570] systemd[1]: Listening on Process Core Dump Socket. lb # [ 7.736010] systemd[1]: Reached target Slice Units. lb # [ 7.738023] systemd[1]: Reached target Swaps. worker2 # [ 7.737677] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 7.742700] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 7.741931] systemd[1]: Listening on Factory Reset Management. worker2 # [ 7.743204] systemd[1]: Listening on Hostname Service Socket. lb # [ 7.747715] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 7.749447] systemd[1]: Starting Journal Log Access Socket... lb # [ 7.751726] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 7.751762] systemd[1]: Listening on Journal Audit Socket. lb # [ 7.755745] systemd[1]: Listening on Factory Reset Management. lb # [ 7.756991] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 7.756409] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 7.758974] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 7.763494] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 7.761606] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.765987] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 7.764318] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 7.770476] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 7.772979] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 7.775521] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.776323] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 7.777978] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 7.777774] systemd[1]: Listening on udev Control Socket. worker2 # [ 7.779383] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 7.785010] systemd[1]: Mounting Huge Pages File System... lb # [ 7.790054] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 7.789408] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 7.792548] systemd[1]: Listening on udev Control Socket. lb # [ 7.794618] systemd[1]: Listening on udev Varlink Socket. lb # [ 7.799793] systemd[1]: Mounting Huge Pages File System... worker2 # [ 7.800017] systemd[1]: Mounting Kernel Debug File System... lb # [ 7.805373] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 7.806582] systemd[1]: Mounting Kernel Trace File System... lb # [ 7.812575] systemd[1]: Mounting Kernel Debug File System... lb # [ 7.826332] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 7.825600] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 7.834106] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 7.840308] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 7.849232] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 7.846168] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 7.851115] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 7.852384] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 7.858965] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.859319] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 7.878849] systemd[1]: Mounting Kernel Configuration File System... lb # [ 7.882145] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 7.878116] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 7.878554] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.976791] systemd[1]: Populated /etc with preset unit settings. lb # [ 7.886176] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.888541] systemd[1]: Starting Journal Service... lb # [ 7.951438] systemd[1]: Starting Load Kernel Module fuse... lb # [ 7.967820] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.984600] systemd[1]: Starting Load Kernel Modules... lb # [ 7.995590] systemd[1]: Starting Journal Service... worker1 # [ 8.010727] systemd[1]: Populated /etc with preset unit settings. lb # [ 8.014164] systemd[1]: Starting Load Kernel Modules... worker2 # [ 8.026637] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.041227] fuse: init (API version 7.45) worker2 # [ 8.048470] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 8.048990] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.059884] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.066690] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 8.072528] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 8.077334] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.082482] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 8.083006] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.083477] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.088657] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 8.083959] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.093113] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.114996] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.118648] systemd-journald[267]: Collecting audit messages is enabled. worker2 # [ 8.128867] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.122067] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.136685] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.125680] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.148231] systemd[1]: Started Journal Service. lb # [ 8.147094] systemd-modules-load[268]: Module 'atkbd' is built in lb # [ 8.152250] systemd-modules-load[268]: Module 'loop' is built in lb # [ 8.156782] systemd[1]: Listening on Journal Log Access Socket. lb # [ 8.157664] systemd[1]: Mounted Huge Pages File System. lb # [ 8.158414] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 8.159252] systemd[1]: Mounted Kernel Debug File System. lb # [ 8.167023] systemd[1]: Mounted Kernel Trace File System. lb # [ 8.172781] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.173714] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.174844] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 8.175703] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.186508] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 8.202049] systemd[1]: Finished Load Kernel Modules. lb # [ 8.192637] systemd[1]: Finished Load Kernel Module fuse. worker2 # [ 8.206174] EXT4-fs (vda): re-mounted 931ea2e4-7f1d-4064-a59c-52d5258ca021. lb # [ 8.195475] systemd[1]: Finished Load Kernel Modules. worker2 # [ 8.210849] systemd[1]: Starting Firewall... worker2 # [ 8.219670] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.221134] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.214425] systemd[1]: Mounting FUSE Control File System... worker2 # [ 8.229383] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 8.233194] EXT4-fs (vda): re-mounted 1b7320b8-7621-4426-9f3e-79345037d1c9. lb # [ 8.224702] systemd[1]: Starting Firewall... worker2 # [ 8.237425] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.239992] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.242276] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.251015] systemd-journald[267]: Collecting audit messages is enabled. lb # [ 8.239801] systemd-oomd[269]: No swap; memory pressure usage will be degraded worker2 # [ 8.265070] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 8.254950] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.265438] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.270558] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.280318] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 8.291145] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.312896] systemd[1]: Started Journal Service. worker2 # [ 8.304590] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.306175] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.313271] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 8.332616] fuse: init (API version 7.45) worker2 # [ 8.320590] systemd-modules-load[268]: Module 'atkbd' is built in lb # [ 8.331967] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 8.333858] systemd-modules-load[268]: Module 'loop' is built in lb # [ 8.340648] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 8.345663] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.356266] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 8.358353] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 8.386648] systemd-oomd[269]: No swap; memory pressure usage will be degraded worker2 # [ 8.397024] systemd[1]: modprobe@fuse.service: Deactivated successfully. client # [ 8.507136] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.508547] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.400843] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.512834] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.405954] systemd[1]: Finished Load/Save OS Random Seed. client # [ 8.516646] systemd[1]: Created slice Slice /system/getty. client # [ 8.518237] systemd[1]: Created slice User and Session Slice. client # [ 8.519589] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.412963] systemd[1]: Reached target First Boot Complete. client # [ 8.522250] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 8.523608] systemd[1]: Expecting device /dev/hvc0... client # [ 8.525237] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.527551] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.528797] systemd[1]: Stopped target initrd-fs.target. client # [ 8.531086] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 8.419016] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 8.532258] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.532604] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.532884] systemd[1]: Reached target Path Units. client # [ 8.533142] systemd[1]: Reached target Remote File Systems. client # [ 8.533380] systemd[1]: Reached target Slice Units. client # [ 8.533615] systemd[1]: Reached target Swaps. client # [ 8.541138] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 8.439735] systemd[1]: Mounted FUSE Control File System. client # [ 8.546331] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 8.439417] systemd[1]: Finished Apply Kernel Variables. client # [ 8.550547] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.554839] systemd[1]: Listening on Factory Reset Management. client # [ 8.557065] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 8.468196] systemd-journald[267]: Received client request to flush runtime journal. client # [ 8.562818] systemd[1]: Starting Journal Log Access Socket... client # [ 8.566063] systemd[1]: Listening on Journal Audit Socket. lb # [ 8.466274] systemd[1]: Finished Apply Kernel Variables. client # [ 8.570708] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.573380] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.576098] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.578630] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.590022] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.501588] systemd-journald[267]: Received client request to flush runtime journal. client # [ 8.592538] systemd[1]: Listening on udev Control Socket. client # [ 8.594653] systemd[1]: Listening on udev Varlink Socket. client # [ 8.599854] systemd[1]: Mounting Huge Pages File System... client # [ 8.608580] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.619543] systemd[1]: Mounting Kernel Debug File System... client # [ 8.625285] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.546003] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 8.547689] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 8.549223] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 8.554121] systemd[1]: Created slice Slice /system/getty. worker1 # [ 8.556747] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.534492] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 8.558333] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.644122] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 8.538075] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 8.560107] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.562821] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.540580] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.564725] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 8.566730] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 8.568717] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 8.570736] systemd[1]: Stopped target initrd-root-fs.target. client # [ 8.657817] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 8.572714] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.661030] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.574814] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 8.576886] systemd[1]: Reached target Path Units. worker1 # [ 8.578808] systemd[1]: Reached target Remote File Systems. worker1 # [ 8.580737] systemd[1]: Reached target Slice Units. worker1 # [ 8.582758] systemd[1]: Reached target Swaps. worker1 # [ 8.587200] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 8.574791] systemd[1]: Finished Load/Save OS Random Seed. client # [ 8.679019] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 8.592722] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.681429] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.597284] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 8.581684] systemd[1]: Reached target First Boot Complete. client # [ 8.685980] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.601790] systemd[1]: Listening on Factory Reset Management. lb # [ 8.583141] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 8.603205] systemd[1]: Listening on Hostname Service Socket. lb # [ 8.586304] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 8.609594] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.592680] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.611979] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.616911] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 8.619521] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.709662] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.622420] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.625645] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.715190] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.637221] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 8.638649] systemd[1]: Listening on udev Control Socket. worker1 # [ 8.640287] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 8.619479] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 8.644866] systemd[1]: Mounting Huge Pages File System... worker2 # [ 8.623777] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 8.650358] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 8.628746] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 8.657232] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 8.670836] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.680051] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.672190] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 8.674556] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 8.694079] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 8.696710] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 8.785374] systemd[1]: Starting Journal Service... lb # [ 8.682013] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 8.677997] systemd[1]: Mounting /run/wrappers... worker2 # [ 8.680409] systemd[1]: Mounting FUSE Control File System... worker1 # [ 8.707647] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 8.709920] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.711919] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 8.709085] systemd[1]: Mounting /run/wrappers... client # [ 8.812788] systemd[1]: Starting Load Kernel Modules... worker1 # [ 8.728678] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 8.729085] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.745007] systemd[1]: Starting Journal Service... worker2 # [ 8.732110] systemd[1]: Mounted FUSE Control File System. client # [ 8.855383] fuse: init (API version 7.45) client # [ 8.861687] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.763857] systemd[1]: Mounted /run/wrappers. worker2 # [ 8.765399] systemd[1]: Reached target Local File Systems. worker2 # [ 8.776191] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 8.887328] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 8.781842] systemd[1]: Starting register-nix-paths.service... client # [ 8.891086] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.793294] systemd[1]: Mounted /run/wrappers. worker2 # [ 8.787216] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 8.789286] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.795352] systemd[1]: Reached target Local File Systems. worker1 # [ 8.820913] systemd[1]: Starting Load Kernel Modules... lb # [ 8.804980] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 8.804682] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 8.812190] systemd[1]: Starting register-nix-paths.service... client # [ 8.917036] systemd[1]: Starting Coldplug All udev Devices... lb # [ 8.816273] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 8.817422] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 8.813349] systemd[1]: Starting Create System Files and Directories... client # [ 8.927760] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 8.850614] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.834029] systemd[1]: Starting Save Transient machine-id to Disk... client # [ 8.943625] systemd[1]: Mounted Huge Pages File System. client # [ 8.948998] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 8.864804] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 8.952103] systemd[1]: Mounted Kernel Debug File System. client # [ 8.957188] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 8.871601] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.963491] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 8.879252] systemd[1]: Starting Coldplug All udev Devices... client # [ 8.969332] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.866983] systemd[1]: Starting Create System Files and Directories... client # [ 8.974423] systemd-journald[274]: Collecting audit messages is enabled. worker1 # [ 8.888943] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 8.891569] systemd[1]: Mounted Huge Pages File System. client # [ 8.977966] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.978594] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.979160] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 8.894721] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 8.898092] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 8.902874] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 8.905258] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.992093] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.993048] systemd[1]: Finished Load Kernel Modules. client # [ 8.983896] systemd[1]: Queued start job for default target Multi-User System. client # [ 9.003765] systemd[1]: Mounting FUSE Control File System... client # [ 8.993299] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 9.000661] systemd-modules-load[275]: Module 'atkbd' is built in client # [ 9.017588] EXT4-fs (vda): re-mounted 6f3a39a3-5cde-474a-8553-04ad9e368e0d. client # [ 9.005786] systemd-modules-load[275]: Module 'loop' is built in worker2 # [ 8.918798] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.027692] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.932410] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.047501] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 8.974607] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 8.986723] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 9.074315] systemd[1]: Started Journal Service. client # [ 9.061076] systemd-oomd[276]: No swap; memory pressure usage will be degraded client # [ 9.070689] systemd[1]: Finished Remount Root and Kernel File Systems. client # [ 9.078171] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 8.990745] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 9.009745] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.056057] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 9.059587] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 9.133491] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 9.067615] EXT4-fs (vda): re-mounted 30cb300f-6f10-42cd-9129-3e7aa90cf021. client # [ 9.142310] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 9.053125] systemd-udevd[307]: Using default interface naming scheme 'v261'. client # [ 9.148065] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 9.080181] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 9.082850] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 9.085060] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 9.160288] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 9.069187] systemd[1]: Finished Create System Files and Directories. client # [ 9.163300] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 9.076730] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 9.099949] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 9.100300] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 9.088537] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.110988] systemd[1]: Finished Load Kernel Modules. client # [ 9.186401] systemd[1]: Mounted FUSE Control File System. client # [ 9.198285] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.128021] systemd[1]: Starting Firewall... worker1 # [ 9.137494] systemd-journald[275]: Collecting audit messages is enabled. worker1 # [ 9.145529] systemd[1]: Starting Apply Kernel Variables... lb # [ 9.134585] systemd[1]: Finished Create System Files and Directories. client # [ 9.224604] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 9.235600] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.171803] systemd[1]: Started Journal Service. worker1 # [ 9.162435] systemd[1]: Queued start job for default target Multi-User System. client # [ 9.250456] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 9.168390] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.253702] systemd[1]: Reached target First Boot Complete. lb # [ 9.175849] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 9.282278] systemd-journald[274]: Received client request to flush runtime journal. worker1 # [ 9.170703] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 9.187052] systemd-modules-load[276]: Module 'atkbd' is built in worker2 # [ 9.178406] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.205822] fuse: init (API version 7.45) worker1 # [ 9.198219] systemd-modules-load[276]: Module 'loop' is built in worker1 # [ 9.215835] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 9.234375] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 9.242913] systemd[1]: Finished Load Kernel Module fuse. client # [ 9.327377] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 9.247018] systemd-udevd[312]: Using default interface naming scheme 'v261'. worker1 # [ 9.256843] systemd-oomd[277]: No swap; memory pressure usage will be degraded worker1 # [ 9.272195] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 9.275039] systemd[1]: Reached target First Boot Complete. worker1 # [ 9.281549] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 9.370590] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.371623] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.374316] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 9.318399] systemd-journald[275]: Received client request to flush runtime journal. worker2 # [ 9.298164] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 9.303176] systemd[1]: Starting Update is Completed... lb # [ 9.327628] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 9.380916] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.383840] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 9.394059] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.395725] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 9.482081] systemd-udevd[306]: Using default interface naming scheme 'v261'. worker2 # [ 9.389691] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.498075] systemd[1]: Mounting /run/wrappers... lb # [ 9.407291] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 9.424253] systemd[1]: Starting Update is Completed... worker2 # [ 9.425317] systemd[1]: Finished Update is Completed. client # [ 9.550778] systemd[1]: Mounted /run/wrappers. client # [ 9.552474] systemd[1]: Reached target Local File Systems. client # [ 9.558885] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 9.567089] systemd[1]: Starting register-nix-paths.service... client # [ 9.572407] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.575018] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. client # [ 9.582020] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.502886] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 9.504444] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 9.509199] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.609579] systemd[1]: Starting Create System Files and Directories... worker1 # [ 9.539486] systemd[1]: Mounting /run/wrappers... lb # [ 9.543584] systemd[1]: Finished Update is Completed. worker1 # [ 9.543436] systemd[1]: Mounting FUSE Control File System... worker1 # [ 9.588986] systemd[1]: Mounted FUSE Control File System. client # [ 9.684320] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 9.596514] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.697459] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.619493] systemd[1]: Mounted /run/wrappers. worker1 # [ 9.628727] systemd[1]: Reached target Local File Systems. worker1 # [ 9.630776] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 9.634396] systemd[1]: Starting register-nix-paths.service... worker1 # [ 9.648405] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 9.657763] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 9.663698] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 9.670958] systemd[1]: Starting Create System Files and Directories... client # [ 9.784924] systemd[1]: Finished Create System Files and Directories. client # [ 9.793925] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.808516] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.817290] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.736805] systemd-udevd[315]: Using default interface naming scheme 'v261'. worker1 # [ 9.781677] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 9.793272] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.910970] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.979175] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.987265] systemd[1]: Starting Update is Completed... worker1 # [ 9.904356] systemd[1]: Finished Create System Files and Directories. worker1 # [ 9.910465] systemd[1]: Starting Rebuild Journal Catalog... worker1 # [ 9.925165] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 10.049881] systemd[1]: Finished Update is Completed. worker2 # [ 9.996755] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 10.001472] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 10.042638] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 10.096151] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 10.092915] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 10.095487] systemd[1]: Finished Create SUID/SGID Wrappers. worker1 # [ 10.123496] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 10.128770] systemd[1]: Starting Update is Completed... worker1 # [ 10.270133] systemd[1]: Finished Update is Completed. worker2 # [ 10.415676] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 10.458927] systemd[1]: Finished register-nix-paths.service. client # [ 10.556117] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.564346] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.607277] systemd[1]: Finished Firewall. worker1 # [ 10.717300] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 10.718949] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 10.780758] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.783167] systemd[1]: Reached target System Initialization. lb # [ 10.786294] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 10.789804] systemd[1]: Started niks3 garbage collection timer. lb # [ 10.797096] systemd[1]: Started Daily Cleanup of Temporary Directories. lb # [ 10.798087] systemd[1]: Reached target Timer Units. lb # [ 10.798813] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 10.803135] systemd[1]: Listening on niks3 server socket. lb # [ 10.806815] systemd[1]: Listening on Nix Daemon Socket. client # [ 10.900368] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.812278] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 10.813815] systemd[1]: Reached target Socket Units. lb # [ 10.819267] systemd[1]: Reached target Basic System. lb # [ 10.823118] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 10.829991] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 10.847127] systemd[1]: Starting Post-Boot Actions... lb # [ 10.871511] systemd[1]: Started Reset console on configuration changes. client # [ 10.969789] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 10.888630] systemd[1]: Starting resolvconf update... worker2 # [ 10.907623] systemd[1]: Finished Coldplug All udev Devices. lb # [ 10.924891] systemd[1]: Started rustfs.service. lb # [ 10.971265] systemd[1]: Starting rustfs-bucket.service... lb # [ 10.982516] systemd[1]: Finished Firewall. lb # [ 10.998059] nsncd[492]: Sep 20 10:51:01.584 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 11.013895] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.020995] systemd[1]: Finished Post-Boot Actions. lb # [ 11.076806] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.083436] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.096234] systemd[1]: Starting D-Bus System Message Bus... client # [ 11.204795] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 11.112253] systemd[1]: Finished register-nix-paths.service. worker2 # [ 11.114633] systemd[1]: Reached target System Initialization. worker2 # [ 11.116145] systemd[1]: Started Discard unused filesystem blocks once a week. worker2 # [ 11.119757] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 11.121065] systemd[1]: Reached target Timer Units. worker2 # [ 11.122511] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 11.129002] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.129979] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 11.130953] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 11.139522] systemd[1]: Starting User Login Management... lb # [ 11.146614] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 11.142668] systemd[1]: Reached target Socket Units. worker2 # [ 11.147443] systemd[1]: Reached target Basic System. worker2 # [ 11.150375] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 11.161146] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.259097] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 11.170753] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.179183] systemd[1]: Started Reset console on configuration changes. worker2 # [ 11.186675] systemd[1]: Starting resolvconf update... worker2 # [ 11.192374] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 11.269900] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.328338] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.341720] systemd[1]: Finished Firewall. worker2 # [ 11.332467] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.434595] systemd[1]: Finished register-nix-paths.service. worker2 # [ 11.340744] nsncd[490]: Sep 20 10:51:01.937 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.437836] systemd[1]: Reached target System Initialization. client # [ 11.439970] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.442132] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 11.352634] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.447490] systemd[1]: Reached target Timer Units. client # [ 11.449608] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 11.355499] systemd[1]: Starting User Login Management... client # [ 11.451259] systemd[1]: Listening on Nix Daemon Socket. client # [ 11.457169] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 11.458381] systemd[1]: Reached target Socket Units. client # [ 11.459098] systemd[1]: Reached target Basic System. client # [ 11.459836] systemd[1]: Started backdoor.service. worker2 # [ 11.372583] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.467677] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 11.479874] systemd[1]: Starting nftables firewall... lb # [ 11.393342] dbus-broker-launch[521]: Looking up NSS user entry for 'systemd-timesync'... client # [ 11.505372] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.515001] systemd[1]: Starting Post-Boot Actions... lb # [ 11.426909] dbus-broker-launch[521]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.423986] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.434151] dbus-broker-launch[521]: Invalid user-name in /nix/store/r3k08synkldj3yxnxmc97ljig0y68d44-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 11.448080] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' lb # [ 11.452433] systemd-logind[526]: New seat seat0. worker2 # [ 11.454393] dbus-broker-launch[494]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.464560] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.471568] systemd[1]: Stopping Host and Network Name Lookups... client # [ 11.561073] systemd[1]: Started Reset console on configuration changes. lb # [ 11.479188] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 11.487904] systemd[1]: Stopping User and Group Name Lookups... client # [ 11.577273] systemd[1]: Starting resolvconf update... lb # [ 11.494021] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.500969] systemd[1]: Started User Login Management. worker1 # [ 11.505969] systemd[1]: Finished Coldplug All udev Devices. client # connecting to host... lb # [ 11.506281] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.495930] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.512578] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.521998] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.535712] systemd[1]: Starting linger-users.service... lb # [ 11.546263] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.541879] systemd-logind[502]: New seat seat0. client: Guest shell says: b'Spawning backdoor root shell...\n' worker1 # [ 11.560533] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 11.554848] systemd[1]: Started User Login Management. worker2 # [ 11.557935] systemd[1]: Starting linger-users.service... lb # [ 11.563850] dbus-broker-launch[521]: Ready worker2 # [ 11.565009] dbus-broker-launch[494]: Ready client # [ 11.661297] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.581656] systemd[1]: Stopped target Host and Network Name Lookups. client: connected to guest root shell worker2 # [ 11.583789] systemd[1]: Stopping Host and Network Name Lookups... client: (connecting took 12.03 seconds) worker2 # [ 11.588774] systemd[1]: Stopped target User and Group Name Lookups. client: (finished: waiting for the VM to finish booting, in 12.03 seconds) worker2 # [ 11.594942] systemd[1]: Stopping User and Group Name Lookups... client # [ 11.672473] (udev-worker)[326]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.603674] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.691537] nsncd[397]: Sep 20 10:51:02.284 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.614732] systemd[1]: nscd.service: Deactivated successfully. client # [ 11.704849] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.615984] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 11.711953] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.620678] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.720808] systemd[1]: Reached target User and Group Name Lookups. client # [ 11.737173] systemd[1]: Starting D-Bus System Message Bus... client # [ 11.738323] (udev-worker)[332]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 11.668547] systemd[1]: Finished resolvconf update. lb # [ 11.670712] systemd[1]: Reached target Preparation for Network. client # [ 11.750785] (udev-worker)[332]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.670473] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.675183] systemd[1]: Finished linger-users.service. lb # [ 11.680703] nsncd[581]: Sep 20 10:51:02.268 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.774149] systemd[1]: Starting User Login Management... lb # [ 11.690502] systemd[1]: Starting DHCP Client... lb # [ 11.693439] systemd[1]: Starting Extra networking commands.... lb # [ 11.701311] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.789807] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 11.702716] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.698574] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.701656] nsncd[558]: Sep 20 10:51:02.305 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 11.709672] systemd[1]: Finished linger-users.service. worker2 # [ 11.707483] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.711825] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.731508] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.738360] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.744265] systemd[1]: Finished resolvconf update. worker2 # [ 11.747996] systemd[1]: Reached target Preparation for Network. worker2 # [ 11.752507] systemd[1]: Starting DHCP Client... worker1 # [ 11.764963] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 11.757094] systemd[1]: Starting Extra networking commands.... worker1 # [ 11.782743] systemd[1]: Finished register-nix-paths.service. worker1 # [ 11.786809] systemd[1]: Reached target System Initialization. worker1 # [ 11.789701] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 11.792379] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 11.796228] systemd[1]: Reached target Timer Units. worker1 # [ 11.799190] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 11.804403] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 11.807369] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 11.813933] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.822872] systemd[1]: Reached target Socket Units. lb # [ 11.836423] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker1 # [ 11.827910] systemd[1]: Reached target Basic System. worker1 # [ 11.843182] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 11.848180] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.863619] systemd[1]: Starting Post-Boot Actions... worker1 # [ 11.873004] systemd[1]: Started Reset console on configuration changes. worker1 # [ 11.886729] systemd[1]: Starting resolvconf update... worker1 # [ 11.893508] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 11.908701] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 11.921522] systemd[1]: Started backdoor.service. client # [ 12.007277] dbus-broker-launch[426]: Looking up NSS user entry for 'systemd-timesync'... client # [ 12.042403] dbus-broker-launch[426]: NSS returned no entry for 'systemd-timesync' client # [ 12.043509] dbus-broker-launch[426]: Invalid user-name in /nix/store/i87y3v12qnxz4jgnndbs0w0ih92vmmjw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 11.967274] systemd[1]: Starting Virtual Console Setup... client # [ 12.070220] systemd-logind[430]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 11.993193] systemd[1]: Finished Post-Boot Actions. client # [ 12.077920] systemd-logind[430]: New seat seat0. client # [ 12.083078] systemd[1]: Started User Login Management. client # [ 12.091875] systemd[1]: Starting linger-users.service... client # [ 12.099068] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 12.016464] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 12.019688] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 12.027493] systemd[1]: Starting Virtual Console Setup... client # [ 12.129370] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 12.130394] systemd[1]: Stopping Host and Network Name Lookups... client # [ 12.131211] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 12.043561] dhcpcd[616]: dhcpcd-10.3.2 starting worker2 # [ 12.044969] dhcpcd[594]: dhcpcd-10.3.2 starting worker1 # [ 12.047204] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 12.057270] systemd[1]: Reached target Host and Network Name Lookups. client # [ 12.144410] systemd[1]: Stopping User and Group Name Lookups... lb # [ 12.062236] dhcpcd[663]: dev: loaded udev worker1 # [ 12.066790] nsncd[496]: Sep 20 10:51:02.637 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 12.152474] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 12.069893] dhcpcd[663]: no valid interfaces found worker2 # [ 12.067197] dhcpcd[635]: dev: loaded udev client # [ 12.160761] systemd[1]: nscd.service: Deactivated successfully. client # [ 12.161657] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 12.072610] dhcpcd[663]: no valid interfaces found worker1 # [ 12.081347] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 12.075703] dhcpcd[635]: no valid interfaces found worker1 # connecting to host... worker2 # [ 12.077497] dhcpcd[635]: no valid interfaces found worker2 # [ 12.081022] dhcpcd[635]: libudev: received NULL device worker1 # [ 12.090766] systemd[1]: Starting User Login Management... worker2 # [ 12.083051] dhcpcd[635]: libudev: received NULL device client # [ 12.178055] dbus-broker-launch[426]: Ready lb # [ 12.095194] systemd[1]: Finished Extra networking commands.. client # [ 12.188351] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 12.100907] systemd[1]: Reached target Network. worker1 # [ 12.113139] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 12.111576] systemd[1]: Starting PostgreSQL Server... lb # [ 12.116980] systemd[1]: Starting Permit User Sessions... client # [ 12.213330] systemd[1]: linger-users.service: Deactivated successfully. client # [ 12.219789] systemd[1]: Finished linger-users.service. worker2 # [ 12.134018] systemd[1]: Finished Extra networking commands.. worker2 # [ 12.138493] systemd[1]: Reached target Network. worker2 # [ 12.141685] systemd[1]: Starting Permit User Sessions... worker1 # [ 12.169526] dbus-broker-launch[500]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 12.190962] dbus-broker-launch[500]: NSS returned no entry for 'systemd-timesync' worker2 # [ 12.189515] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.198264] dbus-broker-launch[500]: Invalid user-name in /nix/store/vbp0wjh4964al3ar1y5dzizpgih0kf2v-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" client # [ 12.286946] nsncd[496]: Sep 20 10:51:02.879 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 12.197284] systemd[1]: Started Getty on tty1. client # [ 12.292835] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 12.201123] systemd[1]: Reached target Login Prompts. client # [ 12.295435] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 12.210943] systemd[1]: Finished Permit User Sessions. client # [ 12.299640] systemd[1]: Reached target User and Group Name Lookups. lb # [ 12.230156] systemd[1]: Started Getty on tty1. client # [ 12.320714] systemd[1]: Finished resolvconf update. lb # [ 12.234472] systemd[1]: Reached target Login Prompts. worker1 # [ 12.239952] systemd[1]: Started D-Bus System Message Bus. client # [ 12.332333] systemd[1]: Starting DHCP Client... worker2 # [ 12.245773] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 12.346654] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.287113] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 12.289881] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 12.290782] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 12.291657] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 12.310104] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 12.320444] systemd-logind[511]: New seat seat0. worker1 # [ 12.328219] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 12.329082] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 12.329912] systemd[1]: Started User Login Management. worker1 # [ 12.330881] dbus-broker-launch[500]: Ready worker1 # [ 12.331507] systemd[1]: Starting linger-users.service... client # [ 12.438766] mousedev: PS/2 mouse device common for all mice worker1 # [ 12.346219] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 12.407547] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 12.410629] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 12.411837] nsncd[569]: Sep 20 10:51:02.998 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 12.424994] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 12.428325] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 12.433151] systemd[1]: Finished linger-users.service. worker2 # [ 12.428245] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 12.546183] systemd-logind[430]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 12.470257] systemd[1]: Finished resolvconf update. worker1 # [ 12.471062] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.475796] systemd[1]: Starting DHCP Client... client # [ 12.561271] dhcpcd[533]: dhcpcd-10.3.2 starting worker1 # [ 12.480845] systemd[1]: Starting Extra networking commands.... client # [ 12.576537] dhcpcd[543]: dev: loaded udev worker2 # [ 12.489798] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 12.496593] systemd[1]: Started backdoor.service. client # [ 12.606017] systemd[1]: Finished nftables firewall. client # [ 12.608827] systemd[1]: Reached target Preparation for Network. client # [ 12.616384] systemd[1]: Starting Address configuration of eth1... lb # [ 12.528393] postgresql-pre-start[682]: The files belonging to this database system will be owned by user "postgres". lb # [ 12.530128] postgresql-pre-start[682]: This user must also own the server process. client # [ 12.625060] systemd[1]: Starting Extra networking commands.... lb # [ 12.544127] postgresql-pre-start[682]: The database cluster will be initialized with locale "en_US.UTF-8". client # [ 12.647772] 8021q: 802.1Q VLAN Support v1.8 lb # [ 12.548088] postgresql-pre-start[682]: The default database encoding has accordingly been set to "UTF8". lb # [ 12.552364] postgresql-pre-start[682]: The default text search configuration will be set to "english". worker1 # [ 12.558387] (udev-worker)[369]: Network interface NamePolicy= disabled on kernel command line. lb # [ 12.555120] postgresql-pre-start[682]: Data page checksums are enabled. lb # [ 12.559881] postgresql-pre-start[682]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.564628] postgresql-pre-start[682]: creating subdirectories ... ok lb # [ 12.567989] postgresql-pre-start[682]: selecting dynamic shared memory implementation ... posix worker1 # [ 12.571628] (udev-worker)[381]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 12.579576] (udev-worker)[381]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.592508] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.618031] (udev-worker)[659]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # connecting to host... worker2 # [ 12.632455] (udev-worker)[659]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.642726] (udev-worker)[660]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.689117] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.783003] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.797143] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 12.727713] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.728285] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 12.809465] network-addresses-eth1-start[547]: adding address 192.168.1.1/24... done worker2 # [ 12.733635] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.734074] cfg80211: failed to load regulatory.db worker1 # [ 12.733089] dhcpcd[602]: dhcpcd-10.3.2 starting client # [ 12.833706] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.834217] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 12.840049] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.840412] cfg80211: failed to load regulatory.db worker1 # [ 12.751767] dhcpcd[642]: dev: loaded udev client # [ 12.840830] network-addresses-eth1-start[547]: adding address 2001:db8:1::1/64... done worker2 # [ 12.756583] systemd-vconsole-setup[627]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 12.764814] systemd[1]: Finished Virtual Console Setup. lb # [ 12.778759] postgresql-pre-start[682]: selecting default "max_connections" ... 100 worker1 # [ 12.785015] systemd-logind[511]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 12.871559] systemd[1]: Finished Address configuration of eth1. worker1 # [ 12.810991] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 12.812603] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.821229] systemd[1]: Starting Address configuration of eth1... client # [ 12.923432] dhcpcd[602]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (554) - Operation not permitted worker1 # [ 12.844197] systemd[1]: Finished Extra networking commands.. worker1 # [ 12.845083] systemd[1]: Reached target Network. client # [ 12.930434] dhcpcd[602]: .resolvconf-wrapped: clearing stale lock pid 554 worker1 # [ 12.858634] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.864465] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.869055] systemd[1]: Starting Address configuration of eth1... client # [ 12.989919] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.978197] dhcpcd[543]: eth0: waiting for carrier client # [ 12.979773] dhcpcd[543]: eth0: carrier acquired worker1 # [ 12.910823] cfg80211: Loading compiled-in X.509 certificates for regulatory database client # [ 12.993930] systemd[1]: Finished Extra networking commands.. client # [ 12.997447] systemd[1]: Reached target Network. client # [ 13.003260] dhcpcd[543]: DUID 00:01:00:01:32:42:77:17:52:54:00:12:34:56 client # [ 13.006509] dhcpcd[543]: eth0: IAID 00:12:34:56 client # [ 13.007193] systemd[1]: Starting Permit User Sessions... client # [ 13.007940] dhcpcd[543]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 12.949097] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.949632] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.954975] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 12.955318] cfg80211: failed to load regulatory.db worker1 # [ 12.960525] systemd[1]: Finished Permit User Sessions. worker1 # [ 12.966898] systemd[1]: Started Getty on tty1. worker1 # [ 12.968608] systemd[1]: Reached target Login Prompts. client # [ 13.057805] systemd[1]: Finished Permit User Sessions. client # [ 13.068270] systemd[1]: Started Getty on tty1. lb # [ 12.979176] postgresql-pre-start[682]: selecting default "shared_buffers" ... 128MB worker2 # [ 12.996877] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 13.071538] systemd[1]: Reached target Login Prompts. worker2 # [ 12.989950] systemd-logind[502]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 13.010896] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 12.995542] dhcpcd[635]: eth0: waiting for carrier worker2 # [ 12.998604] dhcpcd[635]: eth0: carrier acquired lb # [ 13.011346] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.028376] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 13.012628] network-addresses-eth1-start[679]: adding address 192.168.1.4/24... done worker2 # [ 13.018890] dhcpcd[635]: DUID 00:01:00:01:32:42:77:17:52:54:00:12:34:56 worker2 # [ 13.021657] dhcpcd[635]: eth0: IAID 00:12:34:56 worker2 # [ 13.023385] dhcpcd[635]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 13.041246] network-addresses-eth1-start[657]: adding address 192.168.1.3/24... done worker2 # [ 13.033533] network-addresses-eth1-start[679]: adding address 2001:db8:1::4/64... done lb # [ 13.040246] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 13.044665] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.039171] systemd-logind[502]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 13.067637] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 13.056289] dhcpcd[642]: eth0: waiting for carrier lb # [ 13.051516] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 13.061068] dhcpcd[642]: eth0: waiting for carrier lb # [ 13.060314] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.063629] dhcpcd[642]: eth0: carrier acquired client: (finished: waiting for unit network-addresses-eth1.service, in 13.47 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } worker2 # [ 13.057876] systemd[1]: Finished Address configuration of eth1. worker1 # [ 13.066847] network-addresses-eth1-start[657]: adding address 2001:db8:1::3/64... done worker1 # [ 13.086099] dhcpcd[642]: DUID 00:01:00:01:32:42:77:17:52:54:00:12:34:56 worker1 # [ 13.088707] dhcpcd[642]: eth0: IAID 00:12:34:56 worker1 # [ 13.090591] dhcpcd[642]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 13.098524] systemd[1]: Finished Address configuration of eth1. client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting worker2 # [ 13.143617] mousedev: PS/2 mouse device common for all mice worker1 # [ 13.194367] mousedev: PS/2 mouse device common for all mice worker2 # [ 13.250981] systemd-logind[502]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker1 # [ 13.314940] systemd-logind[511]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 13.333129] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 13.366658] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 13.375806] systemd[1]: Started backdoor.service. lb # [ 13.469232] 8021q: 802.1Q VLAN Support v1.8 lb # connecting to host... lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.44 seconds) lb: (finished: waiting for the VM to finish booting, in 0.44 seconds) lb # [ 13.566698] (udev-worker)[688]: Network interface NamePolicy= disabled on kernel command line. lb # [ 13.634233] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 13.682747] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 13.685832] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 13.777976] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.690094] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 13.690406] cfg80211: failed to load regulatory.db lb # [ 13.704513] systemd-vconsole-setup[707]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 13.718155] (udev-worker)[693]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 13.724462] (udev-worker)[693]: Network interface NamePolicy= disabled on kernel command line. lb # [ 13.736807] systemd[1]: Finished Virtual Console Setup. worker2 # [ 13.746593] dhcpcd[635]: eth0: soliciting a DHCP lease worker2 # [ 13.752670] dhcpcd[635]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 13.760448] dhcpcd[635]: eth0: probing address 10.0.2.15/24 worker1 # [ 13.784738] dhcpcd[642]: eth0: soliciting a DHCP lease worker1 # [ 13.793104] dhcpcd[642]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 13.800238] dhcpcd[642]: eth0: probing address 10.0.2.15/24 worker1 # [ 13.957791] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.988843] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 13.977433] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 13.983564] dhcpcd[663]: eth0: waiting for carrier lb # [ 13.989453] dhcpcd[663]: eth0: carrier acquired lb # [ 13.993810] systemd[1]: Starting Address configuration of eth1... client # [ 14.095718] systemd[1]: Starting Virtual Console Setup... lb # [ 14.009996] dhcpcd[663]: DUID 00:01:00:01:32:42:77:18:52:54:00:12:34:56 lb # [ 14.012443] dhcpcd[663]: eth0: IAID 00:12:34:56 lb # [ 14.014329] dhcpcd[663]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 14.134134] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 14.135287] systemd[1]: Stopped Virtual Console Setup. client # [ 14.139141] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 14.142806] systemd[1]: Starting Virtual Console Setup... lb # [ 14.117275] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 14.107064] systemd-logind[526]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 14.195316] systemd-logind[430]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 14.129064] network-addresses-eth1-start[741]: adding address 192.168.1.2/24... done lb # [ 14.146307] network-addresses-eth1-start[741]: adding address 2001:db8:1::2/64... done lb # [ 14.170468] systemd[1]: Finished Address configuration of eth1. lb # [ 14.245033] mousedev: PS/2 mouse device common for all mice worker1 # [ 14.254976] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 14.251937] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 14.260429] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 14.261473] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 14.262177] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 14.266029] systemd[1]: Starting Virtual Console Setup... worker1 # [ 14.280631] systemd[1]: Starting Virtual Console Setup... worker2 # [ 14.285112] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 14.290960] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 14.291733] dhcpcd[635]: eth0: soliciting an IPv6 router worker1 # [ 14.303554] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 14.304942] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 14.294138] dhcpcd[635]: eth0: Router Advertisement from fe80::2 worker1 # [ 14.308002] systemd[1]: Starting Virtual Console Setup... worker2 # [ 14.298877] dhcpcd[635]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 14.304826] systemd[1]: Starting Virtual Console Setup... worker2 # [ 14.305582] dhcpcd[635]: eth0: adding route to fec0::/64 worker2 # [ 14.306298] dhcpcd[635]: eth0: adding default route via fe80::2 worker1 # [ 14.354899] systemd-logind[511]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 14.413918] systemd-logind[526]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 14.430537] dhcpcd[663]: eth0: soliciting a DHCP lease lb # [ 14.436535] dhcpcd[663]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 14.444243] dhcpcd[663]: eth0: probing address 10.0.2.15/24 client # [ 14.587150] systemd-vconsole-setup[649]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 14.591252] systemd[1]: Finished Virtual Console Setup. worker2 # [ 14.626451] systemd-vconsole-setup[703]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.630401] systemd[1]: Finished Virtual Console Setup. worker1 # [ 14.749540] systemd-vconsole-setup[700]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 14.754698] systemd[1]: Finished Virtual Console Setup. client # [ 14.838946] dhcpcd[543]: eth0: soliciting an IPv6 router client # [ 14.843853] dhcpcd[543]: eth0: Router Advertisement from fe80::2 client # [ 14.846710] dhcpcd[543]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 14.849619] dhcpcd[543]: eth0: adding route to fec0::/64 client # [ 14.851905] dhcpcd[543]: eth0: adding default route via fe80::2 client # [ 14.887113] dhcpcd[543]: eth0: soliciting a DHCP lease client # [ 14.893246] dhcpcd[543]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 14.896506] dhcpcd[543]: eth0: probing address 10.0.2.15/24 lb: (finished: waiting for unit network-addresses-eth1.service, in 1.77 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.06 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.12 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.04 seconds) lb: waiting for unit niks3.service worker1 # [ 15.689331] dhcpcd[642]: eth0: soliciting an IPv6 router worker1 # [ 15.693051] dhcpcd[642]: eth0: Router Advertisement from fe80::2 worker1 # [ 15.695754] dhcpcd[642]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 15.698925] dhcpcd[642]: eth0: adding route to fec0::/64 worker1 # [ 15.701304] dhcpcd[642]: eth0: adding default route via fe80::2 lb # [ 16.071297] dhcpcd[663]: eth0: soliciting an IPv6 router lb # [ 16.072845] dhcpcd[663]: eth0: Router Advertisement from fe80::2 lb # [ 16.074760] dhcpcd[663]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 16.077323] dhcpcd[663]: eth0: adding route to fec0::/64 lb # [ 16.079531] dhcpcd[663]: eth0: adding default route via fe80::2 lb # [ 16.096581] postgresql-pre-start[682]: selecting default time zone ... UTC lb # [ 16.102251] postgresql-pre-start[682]: creating configuration files ... ok lb # [ 16.228780] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 16.230000] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 16.231039] systemd[1]: Stopped Virtual Console Setup. lb # [ 16.231749] systemd[1]: Stopping Virtual Console Setup... lb # [ 16.243159] systemd[1]: Starting Virtual Console Setup... lb # [ 16.284134] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 16.288123] systemd[1]: Stopped Virtual Console Setup. lb # [ 16.302235] systemd[1]: Starting Virtual Console Setup... lb # [ 16.356346] systemd-logind[526]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 16.662048] postgresql-pre-start[682]: running bootstrap script ... ok lb # [ 16.781419] systemd-vconsole-setup[790]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 16.790365] systemd[1]: Finished Virtual Console Setup. lb # [ 17.385983] postgresql-pre-start[682]: performing post-bootstrap initialization ... ok lb # [ 17.507725] postgresql-pre-start[682]: syncing data to disk ... ok lb # [ 17.508977] postgresql-pre-start[682]: initdb: warning: enabling "trust" authentication for local connections lb # [ 17.511666] postgresql-pre-start[682]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 17.514134] postgresql-pre-start[682]: Success. You can now start the database server using: lb # [ 17.515355] postgresql-pre-start[682]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 17.678814] postgres[808]: [808] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.682919] postgres[808]: [808] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.686888] postgres[808]: [808] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.689071] postgres[808]: [808] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.705052] postgres[826]: [826] LOG: database system was shut down at 2026-09-20 10:51:07 GMT lb # [ 17.712757] postgres[808]: [808] LOG: database system is ready to accept connections lb # [ 17.717544] systemd[1]: Started PostgreSQL Server. lb # [ 17.724133] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 17.976727] postgresql-setup-start[837]: CREATE DATABASE lb # [ 18.030200] postgresql-setup-start[842]: CREATE ROLE lb # [ 18.058229] postgresql-setup-start[844]: ALTER DATABASE lb # [ 18.066159] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 18.068532] systemd[1]: Reached target PostgreSQL. lb # [ 19.014645] dhcpcd[663]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 19.074466] dhcpcd[635]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 19.079629] dhcpcd[635]: eth0: adding route to 10.0.2.0/24 worker2 # [ 19.083009] dhcpcd[635]: eth0: adding default route via 10.0.2.2 lb # [ 19.018042] dhcpcd[663]: eth0: adding route to 10.0.2.0/24 lb # [ 19.018231] dhcpcd[663]: eth0: adding default route via 10.0.2.2 lb # [ 19.181135] systemd[1]: Started DHCP Client. lb # [ 19.187206] systemd[1]: Reached target Network is Online. lb # [ 19.190014] systemd[1]: Started Envoy reverse proxy. lb # [ 19.197922] systemd[1]: Started mock-oidc.service. worker2 # [ 19.253437] systemd[1]: Started DHCP Client. worker2 # [ 19.255639] systemd[1]: Reached target Multi-User System. worker2 # [ 19.256874] systemd[1]: Startup finished in 961ms (kernel) + 4.619s (initrd) + 13.674s (userspace) = 19.255s. lb # [ 19.303639] mock-oidc-server[917]: Mock OIDC Server running lb # [ 19.305136] mock-oidc-server[917]: OIDC Address: 192.168.1.2:8080 lb # [ 19.306458] mock-oidc-server[917]: Issue Address: 0.0.0.0:8081 lb # [ 19.307890] mock-oidc-server[917]: Issuer: http://192.168.1.2:8080/oidc lb # [ 19.309673] mock-oidc-server[917]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 19.311114] mock-oidc-server[917]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 19.313209] mock-oidc-server[917]: Issue tokens: http://0.0.0.0:8081/issue?sub=... worker1 # [ 19.553694] dhcpcd[642]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 19.555792] dhcpcd[642]: eth0: adding route to 10.0.2.0/24 worker1 # [ 19.558352] dhcpcd[642]: eth0: adding default route via 10.0.2.2 worker1 # [ 19.693418] systemd[1]: Started DHCP Client. worker1 # [ 19.695054] systemd[1]: Reached target Multi-User System. worker1 # [ 19.696679] systemd[1]: Startup finished in 982ms (kernel) + 5.462s (initrd) + 13.250s (userspace) = 19.695s. client # [ 19.865443] dhcpcd[543]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 19.864131] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 19.866022] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 19.868188] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 19.873802] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 19.875974] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 19.878095] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 19.881139] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 19.883057] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 19.886305] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 19.889531] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 19.891429] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 19.894667] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 19.914716] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 19.921716] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 19.925420] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 19.930737] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 19.943494] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr client # [ 19.869473] dhcpcd[543]: eth0: adding route to 10.0.2.0/24 client # [ 19.869839] dhcpcd[543]: eth0: adding default route via 10.0.2.2 client # [ 20.035407] systemd[1]: Started DHCP Client. lb # [ 19.946409] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal client # [ 20.039384] systemd[1]: Reached target Multi-User System. lb # [ 19.950894] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case client # [ 20.040527] systemd[1]: Startup finished in 975ms (kernel) + 5.444s (initrd) + 13.619s (userspace) = 20.038s. lb # [ 19.953653] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 19.964333] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 19.969606] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 19.974015] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 19.976863] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 19.984825] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 19.986895] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 19.990813] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 19.996568] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 19.998558] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 20.002103] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 20.004150] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 20.007673] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 20.011429] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 20.014580] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 20.018279] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 20.026837] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 20.030403] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 20.032676] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 20.036089] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 20.039355] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 20.043059] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.045754] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 20.048256] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 20.050333] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 20.053492] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 20.056802] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 20.069930] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 20.102329] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 20.105592] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 20.107534] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 20.111132] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 20.114356] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 20.117439] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 20.119495] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 20.122431] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 20.124473] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 20.126453] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 20.129733] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 20.138510] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 20.141889] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 20.148946] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 20.152385] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 20.155499] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 20.159567] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 20.162655] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 20.165701] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 20.172444] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 20.175757] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 20.178187] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 20.184350] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 20.188202] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 20.191219] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 20.204975] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 20.210650] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 20.215877] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 20.223485] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 20.227618] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 20.231219] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 20.234106] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 20.238311] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 20.245077] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 20.251918] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 20.254453] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 20.256522] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 20.261483] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 20.271554] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 20.275810] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 20.278480] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 20.288177] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy worker1 # [ 20.301701] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 20.298108] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 20.302804] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 20.306591] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 20.309237] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 20.315217] envoy[916]: [2026-09-20 10:51:10.453][916][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 20.318192] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 20.320750] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 20.330633] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 20.340206] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 20.343829] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 20.354248] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 20.358219] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 20.361370] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 20.363579] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 20.366862] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 20.369847] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 20.376925] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 20.380152] envoy[916]: [2026-09-20 10:51:10.454][916][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 20.383372] envoy[916]: [2026-09-20 10:51:10.500][916][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 20.385465] envoy[916]: [2026-09-20 10:51:10.503][916][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 20.401957] envoy[916]: [2026-09-20 10:51:10.503][916][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 20.403803] envoy[916]: [2026-09-20 10:51:10.503][916][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 20.413529] envoy[916]: [2026-09-20 10:51:10.503][916][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 20.415627] envoy[916]: [2026-09-20 10:51:10.632][916][info][main] [source/server/server.cc:968] runtime: {} lb # [ 20.417375] envoy[916]: [2026-09-20 10:51:10.644][916][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 20.419312] envoy[916]: [2026-09-20 10:51:10.644][916][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 20.421355] envoy[916]: [2026-09-20 10:51:10.644][916][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 20.423104] envoy[916]: [2026-09-20 10:51:10.660][916][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 20.425106] envoy[916]: [2026-09-20 10:51:10.660][916][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 20.426900] envoy[916]: [2026-09-20 10:51:10.660][916][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 20.428781] envoy[916]: [2026-09-20 10:51:10.877][916][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 20.430542] envoy[916]: [2026-09-20 10:51:10.928][916][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 20.432552] envoy[916]: [2026-09-20 10:51:10.929][916][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 20.436324] envoy[916]: [2026-09-20 10:51:10.929][916][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 20.561846] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 20.574422] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 20.585866] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 20.598226] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 20.623236] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 20.628242] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 20.645083] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 20.650076] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 20.672220] envoy[916]: [2026-09-20 10:51:11.262][916][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 20.680173] envoy[916]: [2026-09-20 10:51:11.262][916][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized lb # [ 20.691268] envoy[916]: [2026-09-20 10:51:11.262][916][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker2 # [ 20.695804] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:50051 lb # [ 20.704239] envoy[916]: [2026-09-20 10:51:11.262][916][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker2 # [ 20.710038] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.720395] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.722281] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.911399] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.923554] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.916923] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.928955] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.117794] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.129717] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.123126] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.134944] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.324142] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.335840] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.329583] nix-grpc-daemon[777]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.341126] nix-grpc-daemon[774]: ts=2026-09-20T10:51:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.530564] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.541805] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.536340] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.546964] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.739106] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.749177] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.743367] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.753877] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.939718] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.954728] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.945480] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.960185] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.146362] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.160999] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.151831] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.166273] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.352728] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.367088] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.358041] nix-grpc-daemon[777]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.372425] nix-grpc-daemon[774]: ts=2026-09-20T10:51:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.559155] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.573355] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.564787] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.578362] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.768473] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.781470] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.775834] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.791617] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.968466] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.981625] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.973864] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.986890] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.174488] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.187759] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.179767] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.192955] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.380904] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.393796] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.386286] nix-grpc-daemon[777]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.399047] nix-grpc-daemon[774]: ts=2026-09-20T10:51:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.587246] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.599912] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.593158] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.604736] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.803629] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.796165] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.807872] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.800328] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.004774] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.996499] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.010098] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.001887] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.211174] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.202812] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.216652] nix-grpc-daemon[774]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.208286] nix-grpc-daemon[777]: ts=2026-09-20T10:51:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.417665] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.409226] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.423131] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.414754] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.624091] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.615607] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.629427] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.621114] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.831478] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.824155] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.828465] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.837342] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.024805] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.038247] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.030506] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.043785] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.231461] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.244910] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.237262] nix-grpc-daemon[777]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.251153] nix-grpc-daemon[774]: ts=2026-09-20T10:51:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.438344] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.451973] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.443871] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.457099] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.644853] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.657820] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.650250] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.663055] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.853661] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.866173] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.858206] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.870562] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.054357] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.066477] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.059883] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.071775] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 26.101565] rustfs-bucket-start[989]: mb s3://farm lb # [ 26.111118] systemd[1]: Finished rustfs-bucket.service. lb # [ 26.122795] systemd[1]: Starting niks3 server... worker2 # [ 26.261047] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.272838] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.266829] nix-grpc-daemon[777]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.277767] nix-grpc-daemon[774]: ts=2026-09-20T10:51:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 26.339931] postgres[1005]: [1005] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 26.341855] postgres[1005]: [1005] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 26.376561] niks3-server[998]: 2026/09/20 10:51:16 OK 20241026095416_initial_model.sql (22.45ms) lb # [ 26.379903] niks3-server[998]: 2026/09/20 10:51:16 OK 20251210153512_drop_unused_gin_index.sql (1.85ms) lb # [ 26.385805] niks3-server[998]: 2026/09/20 10:51:16 OK 20251218171726_add_pins.sql (4.3ms) lb # [ 26.390489] niks3-server[998]: 2026/09/20 10:51:16 OK 20260628120000_add_object_size_and_stats.sql (4.64ms) lb # [ 26.395389] niks3-server[998]: 2026/09/20 10:51:16 OK 20260905000000_add_claims.sql (4.83ms) lb # [ 26.399976] niks3-server[998]: 2026/09/20 10:51:16 OK 20260920000000_drop_claims.sql (4.5ms) lb # [ 26.401216] niks3-server[998]: 2026/09/20 10:51:16 goose: successfully migrated database to version: 20260920000000 lb # [ 26.406197] niks3-server[998]: 2026/09/20 10:51:16 OK 1_commit_pending_closure.sql (6.19ms) lb # [ 26.409320] niks3-server[998]: 2026/09/20 10:51:16 OK 2_object_stats_trigger.sql (3ms) lb # [ 26.410646] niks3-server[998]: 2026/09/20 10:51:16 goose: up to current file version: 2 lb # [ 26.414760] niks3-server[998]: 2026/09/20 10:51:17 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key lb # [ 26.459426] niks3-server[998]: 2026/09/20 10:51:17 INFO Read proxy enabled — serving cache objects from S3 lb # [ 26.461454] niks3-server[998]: 2026/09/20 10:51:17 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 26.465685] niks3-server[998]: 2026/09/20 10:51:17 INFO systemd watchdog enabled interval=15s lb # [ 26.470705] systemd[1]: Started niks3 server. lb # [ 26.471429] niks3-server[998]: 2026/09/20 10:51:17 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 26.473973] systemd[1]: Reached target Multi-User System. worker1 # [ 26.474668] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:50051 lb # [ 26.475170] systemd[1]: Startup finished in 978ms (kernel) + 4.610s (initrd) + 20.879s (userspace) = 26.468s. worker2 # [ 26.467738] nix-grpc-daemon[777]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.480147] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 26.482059] niks3-server[998]: 2026/09/20 10:51:17 INFO lead: acquired remote=192.168.1.3:39686 worker2 # [ 26.473324] nix-grpc-daemon[777]: ts=2026-09-20T10:51:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.488679] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_take_over worker1 # [ 26.681081] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.674377] nix-grpc-daemon[777]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.686501] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.679792] nix-grpc-daemon[777]: ts=2026-09-20T10:51:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.888896] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.882027] nix-grpc-daemon[777]: ts=2026-09-20T10:51:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.900442] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 26.906442] nix-grpc-daemon[774]: ts=2026-09-20T10:51:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: waiting for unit niks3.service, in 11.70 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.06 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 27.143007] envoy[916]: conn peer=[::1]:59826 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy ??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 128 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.14 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker2 # [ 27.912799] nix-grpc-daemon[777]: ts=2026-09-20T10:51:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 27.925906] systemd[1]: Started Nix Daemon. worker2 # [ 28.250373] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 28.294902] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5) worker2 # [ 28.334553] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 34 ms (attempt 2/5) worker2 # [ 28.368897] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 3/5) worker2 # [ 28.428535] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 418 ms (attempt 4/5) worker2 # [ 28.849235] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 28.899575] nix-grpc-daemon[774]: ts=2026-09-20T10:51:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 28.915371] systemd[1]: Started Nix Daemon. worker1 # [ 29.203138] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 29.231514] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 43 ms (attempt 1/5) worker1 # [ 29.277788] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 2/5) worker1 # [ 29.378629] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 3/5) worker1 # [ 29.473846] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 246 ms (attempt 4/5) worker1 # [ 29.730033] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 29.747095] nix-grpc-daemon[774]: ts=2026-09-20T10:51:20Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 29.751918] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 29.767710] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.12 seconds) client: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds) worker1 # [ 30.251332] nix-grpc-daemon[774]: ts=2026-09-20T10:51:20Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 30.260500] nix-grpc-daemon[774]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:38656 worker2 # [ 30.276158] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=info event=oidc_jwks provider=mock keys=1 lb # [ 30.286710] envoy[916]: conn peer=[2001:db8:1::1]:57722 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=383 ms=1913 worker2 # [ 30.282965] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:53412 worker2 # [ 30.291482] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 30.308243] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:53412 worker2 # [ 30.317818] nix-grpc-daemon[777]: ts=2026-09-20T10:51:20Z level=debug event=path_info_miss path=5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test error="error: path '/nix/store/5rrxzpsp33jzaxb9v245gd67mmn0zxp0-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.05 seconds) worker1 # [ 32.645264] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 32.926223] nix-grpc-daemon[777]: ts=2026-09-20T10:51:23Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.40 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 33.182599] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38656 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 33.188541] nix-grpc-daemon[777]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53412 worker1 # [ 33.239632] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker1 # [ 33.245926] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 33.293327] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 33.318885] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 client # copying 1 paths to 'lb:50051'... worker1 # [ 33.336125] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 33.362426] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 33.399508] nix-grpc-daemon[774]: ts=2026-09-20T10:51:23Z level=info event=niks3_push_started pid=846 worker1 # [ 33.881905] nix-daemon[833]: accepted connection from pid 859, user nix-grpc-daemon (trusted) worker1 # [ 33.902471] nix-daemon[833]: reaped child process 862, status = succeeded worker1 # [ 34.078828] nix-daemon[833]: accepted connection from pid 864, user nix-grpc-daemon (trusted) worker1 # [ 34.099167] nix-daemon[833]: reaped child process 867, status = succeeded lb # [ 34.108179] niks3-server[998]: 2026/09/20 10:51:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 34.137902] nix-grpc-daemon[846]: time=2026-09-20T10:51:24.725Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 34.141994] nix-grpc-daemon[846]: time=2026-09-20T10:51:24.728Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 34.185939] niks3-server[998]: 2026/09/20 10:51:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 34.198160] niks3-server[998]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 34.228163] niks3-server[998]: 2026/09/20 10:51:24 INFO Signed narinfos id=1 count=1 worker1 # [ 34.235650] nix-grpc-daemon[846]: time=2026-09-20T10:51:24.823Z level=INFO msg="Uploading 1 narinfos" lb # [ 34.247059] niks3-server[998]: 2026/09/20 10:51:24 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 34.260499] niks3-server[998]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 34.266054] niks3-server[998]: 2026/09/20 10:51:24 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo lb # [ 34.274755] niks3-server[998]: 2026/09/20 10:51:24 INFO Completed upload id=1 worker1 # [ 34.279262] nix-grpc-daemon[846]: time=2026-09-20T10:51:24.867Z level=INFO msg="Upload complete. (585ms)" worker1 # [ 34.291583] nix-grpc-daemon[774]: ts=2026-09-20T10:51:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 34.311379] nix-grpc-daemon[774]: ts=2026-09-20T10:51:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 34.320411] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 34.325685] nix-daemon[833]: reaped child process 844, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... worker1 # [ 34.342260] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv client # farm-a> LOG-farm-a-t1 worker1 # [ 35.586963] nix-daemon[833]: reaped child process 871, status = succeeded worker1 # [ 35.776258] nix-daemon[833]: accepted connection from pid 886, user nix-grpc-daemon (trusted) worker1 # [ 35.797067] nix-daemon[833]: reaped child process 889, status = succeeded lb # [ 35.805356] niks3-server[998]: 2026/09/20 10:51:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 35.823120] nix-grpc-daemon[846]: time=2026-09-20T10:51:26.411Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 35.825780] nix-grpc-daemon[846]: time=2026-09-20T10:51:26.413Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 35.861613] niks3-server[998]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 35.870912] niks3-server[998]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst worker1 # [ 35.885233] nix-grpc-daemon[846]: time=2026-09-20T10:51:26.472Z level=INFO msg="Uploading 1 narinfos" lb # [ 35.880935] niks3-server[998]: 2026/09/20 10:51:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 35.888578] niks3-server[998]: 2026/09/20 10:51:26 INFO Signed narinfos id=2 count=1 lb # [ 35.890886] niks3-server[998]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls lb # [ 35.901264] niks3-server[998]: 2026/09/20 10:51:26 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 35.908858] niks3-server[998]: 2026/09/20 10:51:26 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo lb # [ 35.913050] niks3-server[998]: 2026/09/20 10:51:26 INFO Completed upload id=2 worker1 # [ 35.917305] nix-grpc-daemon[846]: time=2026-09-20T10:51:26.505Z level=INFO msg="Upload complete. (361ms)" worker1 # [ 35.941033] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker1 # [ 35.954967] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker1 # [ 35.958594] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 35.962349] nix-daemon[833]: reaped child process 869, status = succeeded worker1 # [ 35.984842] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 36.000989] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 client # copying 1 paths to 'lb:50051'... worker1 # [ 36.017140] nix-grpc-daemon[846]: time=2026-09-20T10:51:26.604Z level=INFO msg="All 1 paths already cached" worker1 # [ 36.023581] nix-grpc-daemon[774]: ts=2026-09-20T10:51:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 36.050867] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 36.290402] nix-daemon[833]: accepted connection from pid 895, user nix-grpc-daemon (trusted) worker1 # [ 36.309824] nix-daemon[833]: reaped child process 899, status = succeeded worker1 # [ 36.481371] nix-daemon[833]: accepted connection from pid 901, user nix-grpc-daemon (trusted) worker1 # [ 36.501706] nix-daemon[833]: reaped child process 904, status = succeeded lb # [ 36.508513] niks3-server[998]: 2026/09/20 10:51:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 36.522975] nix-grpc-daemon[846]: time=2026-09-20T10:51:27.110Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 36.524606] nix-grpc-daemon[846]: time=2026-09-20T10:51:27.111Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 36.544854] niks3-server[998]: 2026/09/20 10:51:27 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst worker1 # [ 36.565572] nix-grpc-daemon[846]: time=2026-09-20T10:51:27.153Z level=INFO msg="Uploading 1 narinfos" lb # [ 36.559961] niks3-server[998]: 2026/09/20 10:51:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 36.572253] niks3-server[998]: 2026/09/20 10:51:27 INFO Signed narinfos id=3 count=1 lb # [ 36.578426] niks3-server[998]: 2026/09/20 10:51:27 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 36.587366] niks3-server[998]: 2026/09/20 10:51:27 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete lb # [ 36.595510] niks3-server[998]: 2026/09/20 10:51:27 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo lb # [ 36.600000] niks3-server[998]: 2026/09/20 10:51:27 INFO Completed upload id=3 worker1 # [ 36.603783] nix-grpc-daemon[846]: time=2026-09-20T10:51:27.192Z level=INFO msg="Upload complete. (522ms)" worker1 # [ 36.612305] nix-grpc-daemon[774]: ts=2026-09-20T10:51:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 36.627599] nix-grpc-daemon[774]: ts=2026-09-20T10:51:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 36.635252] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 36.641042] nix-daemon[833]: reaped child process 893, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker1 # [ 36.656238] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 37.680582] nix-daemon[833]: reaped child process 908, status = succeeded client # farm-b> LOG-farm-b-t1 worker1 # [ 37.838709] nix-daemon[833]: accepted connection from pid 923, user nix-grpc-daemon (trusted) worker1 # [ 37.858368] nix-daemon[833]: reaped child process 926, status = succeeded lb # [ 37.866798] niks3-server[998]: 2026/09/20 10:51:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 37.882065] nix-grpc-daemon[846]: time=2026-09-20T10:51:28.469Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 37.883808] nix-grpc-daemon[846]: time=2026-09-20T10:51:28.469Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 37.906256] niks3-server[998]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 37.918705] niks3-server[998]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst lb # [ 37.929836] niks3-server[998]: 2026/09/20 10:51:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 37.934857] niks3-server[998]: 2026/09/20 10:51:28 INFO Signed narinfos id=4 count=1 worker1 # [ 37.939012] nix-grpc-daemon[846]: time=2026-09-20T10:51:28.526Z level=INFO msg="Uploading 1 narinfos" lb # [ 37.939639] niks3-server[998]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 37.956439] niks3-server[998]: 2026/09/20 10:51:28 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete lb # [ 37.965812] niks3-server[998]: 2026/09/20 10:51:28 INFO Completed upload id=4 worker1 # [ 37.969986] nix-grpc-daemon[846]: time=2026-09-20T10:51:28.558Z level=INFO msg="Upload complete. (303ms)" lb # [ 37.969030] niks3-server[998]: 2026/09/20 10:51:28 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker1 # [ 37.988672] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker1 # [ 38.004284] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker1 # [ 38.008640] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 38.012548] nix-daemon[833]: reaped child process 906, status = succeeded worker1 # [ 38.032174] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 38.047354] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 38.062263] nix-grpc-daemon[846]: time=2026-09-20T10:51:28.650Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 38.073018] nix-grpc-daemon[774]: ts=2026-09-20T10:51:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 38.087544] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 38.285406] nix-daemon[833]: accepted connection from pid 932, user nix-grpc-daemon (trusted) worker1 # [ 38.304455] nix-daemon[833]: reaped child process 935, status = succeeded worker1 # [ 38.480097] nix-daemon[833]: accepted connection from pid 937, user nix-grpc-daemon (trusted) worker1 # [ 38.498625] nix-daemon[833]: reaped child process 940, status = succeeded lb # [ 38.507431] niks3-server[998]: 2026/09/20 10:51:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 38.521554] nix-grpc-daemon[846]: time=2026-09-20T10:51:29.110Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 38.523639] nix-grpc-daemon[846]: time=2026-09-20T10:51:29.111Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 38.539791] niks3-server[998]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst lb # [ 38.552638] niks3-server[998]: 2026/09/20 10:51:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign worker1 # [ 38.564206] nix-grpc-daemon[846]: time=2026-09-20T10:51:29.152Z level=INFO msg="Uploading 1 narinfos" lb # [ 38.560208] niks3-server[998]: 2026/09/20 10:51:29 INFO Signed narinfos id=5 count=1 lb # [ 38.568271] niks3-server[998]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 38.579513] niks3-server[998]: 2026/09/20 10:51:29 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete worker1 # [ 38.590792] nix-grpc-daemon[846]: time=2026-09-20T10:51:29.179Z level=INFO msg="Upload complete. (486ms)" lb # [ 38.587145] niks3-server[998]: 2026/09/20 10:51:29 INFO Completed upload id=5 lb # [ 38.589892] niks3-server[998]: 2026/09/20 10:51:29 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 38.600471] nix-grpc-daemon[774]: ts=2026-09-20T10:51:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 38.612344] nix-grpc-daemon[774]: ts=2026-09-20T10:51:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 38.619326] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 38.624255] nix-daemon[833]: reaped child process 930, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker1 # [ 38.638417] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-t1 worker1 # [ 39.881036] nix-daemon[833]: reaped child process 944, status = succeeded worker1 # [ 40.064867] nix-daemon[833]: accepted connection from pid 960, user nix-grpc-daemon (trusted) worker1 # [ 40.086224] nix-daemon[833]: reaped child process 963, status = succeeded lb # [ 40.094467] niks3-server[998]: 2026/09/20 10:51:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.112318] nix-grpc-daemon[846]: time=2026-09-20T10:51:30.700Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 40.116119] nix-grpc-daemon[846]: time=2026-09-20T10:51:30.702Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 40.143089] niks3-server[998]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst worker1 # [ 40.168688] nix-grpc-daemon[846]: time=2026-09-20T10:51:30.756Z level=INFO msg="Uploading 1 narinfos" lb # [ 40.155766] niks3-server[998]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 40.169357] niks3-server[998]: 2026/09/20 10:51:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 40.179079] niks3-server[998]: 2026/09/20 10:51:30 INFO Signed narinfos id=6 count=1 worker1 # [ 40.192741] nix-grpc-daemon[846]: time=2026-09-20T10:51:30.781Z level=INFO msg="Upload complete. (343ms)" lb # [ 40.189163] niks3-server[998]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 40.200849] niks3-server[998]: 2026/09/20 10:51:30 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 40.206831] niks3-server[998]: 2026/09/20 10:51:30 INFO Completed upload id=6 worker1 # [ 40.205189] nix-grpc-daemon[774]: ts=2026-09-20T10:51:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 lb # [ 40.210996] niks3-server[998]: 2026/09/20 10:51:30 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo worker1 # [ 40.225996] nix-daemon[833]: reaped child process 942, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 7.30 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath lb # [ 40.285098] envoy[916]: conn peer=[2001:db8:1::1]:57728 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=118 lb # [ 40.287485] envoy[916]: conn peer=[2001:db8:1::1]:43688 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=20 lb # [ 40.289922] envoy[916]: conn peer=[2001:db8:1::1]:43696 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=13 lb # [ 40.291906] envoy[916]: conn peer=[2001:db8:1::1]:43704 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9523 tx=3812 ms=7051 client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.24 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.31 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.99 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.32 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 41.799980] nix-grpc-daemon[774]: ts=2026-09-20T10:51:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38656 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # [ 41.819227] nix-grpc-daemon[774]: ts=2026-09-20T10:51:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 41.831378] nix-grpc-daemon[846]: time=2026-09-20T10:51:32.418Z level=INFO msg="All 2 paths already cached" worker1 # [ 41.850316] nix-grpc-daemon[774]: ts=2026-09-20T10:51:32Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.34 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.22 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.49 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 42.929737] nix-grpc-daemon[777]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53412 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker2 # [ 42.941351] nix-grpc-daemon[777]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53412 worker1 # [ 42.981339] nix-grpc-daemon[774]: ts=2026-09-20T10:51:33Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker1 # [ 42.986788] nix-grpc-daemon[774]: ts=2026-09-20T10:51:33Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 43.025942] nix-grpc-daemon[774]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 43.041484] nix-grpc-daemon[774]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 43.057795] nix-grpc-daemon[846]: time=2026-09-20T10:51:33.645Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker1 # [ 43.068133] nix-grpc-daemon[774]: ts=2026-09-20T10:51:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 43.083690] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 43.298120] nix-daemon[833]: accepted connection from pid 993, user nix-grpc-daemon (trusted) worker1 # [ 43.319178] nix-daemon[833]: reaped child process 996, status = succeeded worker1 # [ 43.499546] nix-daemon[833]: accepted connection from pid 998, user nix-grpc-daemon (trusted) worker1 # [ 43.518228] nix-daemon[833]: reaped child process 1001, status = succeeded lb # [ 43.529821] niks3-server[998]: 2026/09/20 10:51:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 43.545949] nix-grpc-daemon[846]: time=2026-09-20T10:51:34.134Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 43.547478] nix-grpc-daemon[846]: time=2026-09-20T10:51:34.134Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 43.567015] niks3-server[998]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst lb # [ 43.582105] niks3-server[998]: 2026/09/20 10:51:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign worker1 # [ 43.590034] nix-grpc-daemon[846]: time=2026-09-20T10:51:34.178Z level=INFO msg="Uploading 1 narinfos" lb # [ 43.590930] niks3-server[998]: 2026/09/20 10:51:34 INFO Signed narinfos id=7 count=1 lb # [ 43.597971] niks3-server[998]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 43.608099] niks3-server[998]: 2026/09/20 10:51:34 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 43.614194] niks3-server[998]: 2026/09/20 10:51:34 INFO Completed upload id=7 lb # [ 43.616604] niks3-server[998]: 2026/09/20 10:51:34 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo worker1 # [ 43.617245] nix-grpc-daemon[846]: time=2026-09-20T10:51:34.205Z level=INFO msg="Upload complete. (516ms)" worker1 # [ 43.626628] nix-grpc-daemon[774]: ts=2026-09-20T10:51:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 43.642554] nix-grpc-daemon[774]: ts=2026-09-20T10:51:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 43.648774] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 43.654133] nix-daemon[833]: reaped child process 991, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... worker1 # [ 43.667099] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv client # farm-top> LOG-farm-top-t1b worker1 # [ 44.917552] nix-daemon[833]: reaped child process 1005, status = succeeded worker1 # [ 45.100555] nix-daemon[833]: accepted connection from pid 1020, user nix-grpc-daemon (trusted) worker1 # [ 45.121517] nix-daemon[833]: reaped child process 1023, status = succeeded lb # [ 45.131707] niks3-server[998]: 2026/09/20 10:51:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.144400] nix-grpc-daemon[846]: time=2026-09-20T10:51:35.731Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 45.145861] nix-grpc-daemon[846]: time=2026-09-20T10:51:35.731Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 45.166695] niks3-server[998]: 2026/09/20 10:51:35 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 45.179604] niks3-server[998]: 2026/09/20 10:51:35 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 45.191221] niks3-server[998]: 2026/09/20 10:51:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker1 # [ 45.200229] nix-grpc-daemon[846]: time=2026-09-20T10:51:35.788Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.200975] niks3-server[998]: 2026/09/20 10:51:35 INFO Signed narinfos id=8 count=1 lb # [ 45.205019] niks3-server[998]: 2026/09/20 10:51:35 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 45.212335] niks3-server[998]: 2026/09/20 10:51:35 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 45.218271] niks3-server[998]: 2026/09/20 10:51:35 INFO Completed upload id=8 worker1 # [ 45.221416] nix-grpc-daemon[846]: time=2026-09-20T10:51:35.809Z level=INFO msg="Upload complete. (340ms)" lb # [ 45.220757] niks3-server[998]: 2026/09/20 10:51:35 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker1 # [ 45.237166] nix-grpc-daemon[774]: ts=2026-09-20T10:51:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker1 # [ 45.252203] nix-daemon[833]: reaped child process 1003, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.64 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.24 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.29 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 45.894896] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client # Running as unit: dedup1.service; invocation ID: a9c0466643004567944265bb4d727904 client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup worker1 # [ 46.100983] nix-grpc-daemon[774]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38656 client # [ 46.194233] nix[883]: don't know how to build these paths: client # [ 46.195238] nix[883]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 46.121046] nix-grpc-daemon[774]: ts=2026-09-20T10:51:36Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 46.117470] nix-grpc-daemon[777]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 worker1 # [ 46.130826] nix-grpc-daemon[774]: ts=2026-09-20T10:51:36Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 46.139119] nix-grpc-daemon[777]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53412 client # [ 46.241251] nix[883]: copying 1 paths to 'lb:50051'... client # [ 46.245033] nix[883]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 46.151540] nix-grpc-daemon[777]: ts=2026-09-20T10:51:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 46.164505] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 46.188851] nix-grpc-daemon[777]: ts=2026-09-20T10:51:36Z level=info event=niks3_push_started pid=861 worker2 # [ 46.638620] nix-daemon[833]: accepted connection from pid 875, user nix-grpc-daemon (trusted) worker2 # [ 46.658086] nix-daemon[833]: reaped child process 878, status = succeeded worker2 # [ 46.833673] nix-daemon[833]: accepted connection from pid 880, user nix-grpc-daemon (trusted) worker2 # [ 46.853034] nix-daemon[833]: reaped child process 883, status = succeeded lb # [ 46.874475] niks3-server[998]: 2026/09/20 10:51:37 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 46.882600] nix-grpc-daemon[861]: time=2026-09-20T10:51:37.487Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 46.884502] nix-grpc-daemon[861]: time=2026-09-20T10:51:37.487Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 46.929419] niks3-server[998]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst worker2 # [ 46.931887] nix-grpc-daemon[861]: time=2026-09-20T10:51:37.538Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.937706] niks3-server[998]: 2026/09/20 10:51:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign client # [ 47.017597] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. lb # [ 46.944893] niks3-server[998]: 2026/09/20 10:51:37 INFO Signed narinfos id=9 count=1 client # Running as unit: dedup2.service; invocation ID: 1304e0449550433488e6cf46c3ee8513 lb # [ 46.949914] niks3-server[998]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 46.958710] niks3-server[998]: 2026/09/20 10:51:37 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete lb # [ 46.963336] niks3-server[998]: 2026/09/20 10:51:37 INFO Completed upload id=9 worker2 # [ 46.958477] nix-grpc-daemon[861]: time=2026-09-20T10:51:37.565Z level=INFO msg="Upload complete. (507ms)" client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds) lb # [ 46.965624] niks3-server[998]: 2026/09/20 10:51:37 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 46.968367] nix-grpc-daemon[777]: ts=2026-09-20T10:51:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 46.980550] nix-grpc-daemon[777]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 46.988401] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 46.993889] nix-daemon[833]: reaped child process 859, status = succeeded client # [ 47.096396] nix[883]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 47.005924] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 47.274203] nix-grpc-daemon[774]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38656 client # [ 47.366185] nix[899]: don't know how to build these paths: client # [ 47.367497] nix[899]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 47.296106] nix-grpc-daemon[774]: ts=2026-09-20T10:51:37Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 47.295220] nix-grpc-daemon[777]: ts=2026-09-20T10:51:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 client # [ 47.396073] nix[899]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client: must succeed: sleep 2 lb # [ 50.286972] envoy[916]: conn peer=[2001:db8:1::1]:37578 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=72 lb # [ 50.291992] envoy[916]: conn peer=[2001:db8:1::1]:37582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1705 ms=2308 client: (finished: must succeed: sleep 2, in 2.07 seconds) ??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 client: waiting for success: ! systemctl is-active dedup1 dedup2 ??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39 worker2 # [ 50.652507] nix-daemon[833]: reaped child process 887, status = succeeded worker2 # [ 50.837686] nix-daemon[833]: accepted connection from pid 916, user nix-grpc-daemon (trusted) worker2 # [ 50.855952] nix-daemon[833]: reaped child process 919, status = succeeded lb # [ 50.873458] niks3-server[998]: 2026/09/20 10:51:41 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 50.885462] nix-grpc-daemon[861]: time=2026-09-20T10:51:41.489Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 50.887638] nix-grpc-daemon[861]: time=2026-09-20T10:51:41.490Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 50.916915] niks3-server[998]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 50.937263] niks3-server[998]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst worker2 # [ 50.948106] nix-grpc-daemon[861]: time=2026-09-20T10:51:41.554Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.952416] niks3-server[998]: 2026/09/20 10:51:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 50.961733] niks3-server[998]: 2026/09/20 10:51:41 INFO Signed narinfos id=10 count=1 lb # [ 50.967981] niks3-server[998]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 50.976777] niks3-server[998]: 2026/09/20 10:51:41 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 50.984927] niks3-server[998]: 2026/09/20 10:51:41 INFO Completed upload id=10 worker2 # [ 50.979979] nix-grpc-daemon[861]: time=2026-09-20T10:51:41.586Z level=INFO msg="Upload complete. (361ms)" lb # [ 50.988585] niks3-server[998]: 2026/09/20 10:51:41 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 50.993218] nix-grpc-daemon[777]: ts=2026-09-20T10:51:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=3 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 51.012272] nix-grpc-daemon[777]: ts=2026-09-20T10:51:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 51.018857] nix-daemon[833]: reaped child process 885, status = succeeded client # [ 51.150150] systemd[1]: dedup2.service: Deactivated successfully. client # [ 51.154561] systemd[1]: dedup2.service: Consumed 191ms CPU time over 4.137s wall clock time, 31M memory peak, 7.4K incoming IP traffic, 6.4K outgoing IP traffic. client # [ 51.163061] systemd[1]: dedup1.service: Deactivated successfully. client # [ 51.167001] systemd[1]: dedup1.service: Consumed 170ms CPU time over 5.267s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.08 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) (finished: subtest: two clients wanting the same drv build it once, in 6.30 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 52.356820] systemd[1]: Started Nix Daemon. client # [ 52.547896] nix-daemon[940]: accepted connection from pid 937, user root (trusted) worker2 # [ 52.661047] nix-grpc-daemon[777]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53412 worker1 # [ 52.676886] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 52.691187] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker1 # [ 52.698510] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 52.736066] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 52.752607] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 52.768117] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 52.785323] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 52.996962] nix-daemon[833]: accepted connection from pid 1060, user nix-grpc-daemon (trusted) worker1 # [ 53.017106] nix-daemon[833]: reaped child process 1063, status = succeeded worker1 # [ 53.193698] nix-daemon[833]: accepted connection from pid 1065, user nix-grpc-daemon (trusted) worker1 # [ 53.214385] nix-daemon[833]: reaped child process 1068, status = succeeded lb # [ 53.225605] niks3-server[998]: 2026/09/20 10:51:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 53.241967] nix-grpc-daemon[846]: time=2026-09-20T10:51:43.829Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 53.243513] nix-grpc-daemon[846]: time=2026-09-20T10:51:43.829Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 53.261533] niks3-server[998]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 53.278126] niks3-server[998]: 2026/09/20 10:51:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker1 # [ 53.288546] nix-grpc-daemon[846]: time=2026-09-20T10:51:43.876Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.287930] niks3-server[998]: 2026/09/20 10:51:43 INFO Signed narinfos id=11 count=1 lb # [ 53.294868] niks3-server[998]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 53.303673] niks3-server[998]: 2026/09/20 10:51:43 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 53.313575] niks3-server[998]: 2026/09/20 10:51:43 INFO Completed upload id=11 worker1 # [ 53.317790] nix-grpc-daemon[846]: time=2026-09-20T10:51:43.906Z level=INFO msg="Upload complete. (514ms)" lb # [ 53.316768] niks3-server[998]: 2026/09/20 10:51:43 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker1 # [ 53.328434] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 53.344331] nix-grpc-daemon[774]: ts=2026-09-20T10:51:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 53.352350] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 53.358016] nix-daemon[833]: reaped child process 1058, status = succeeded worker1 # [ 53.371257] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 54.801919] nix-daemon[833]: reaped child process 1072, status = succeeded worker1 # [ 54.982060] nix-daemon[833]: accepted connection from pid 1087, user nix-grpc-daemon (trusted) worker1 # [ 55.003573] nix-daemon[833]: reaped child process 1090, status = succeeded lb # [ 55.018161] niks3-server[998]: 2026/09/20 10:51:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 55.033987] nix-grpc-daemon[846]: time=2026-09-20T10:51:45.621Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 55.035525] nix-grpc-daemon[846]: time=2026-09-20T10:51:45.621Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" worker1 # [ 55.093171] nix-grpc-daemon[846]: time=2026-09-20T10:51:45.681Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.074967] niks3-server[998]: 2026/09/20 10:51:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign lb # [ 55.094586] niks3-server[998]: 2026/09/20 10:51:45 INFO Signed narinfos id=12 count=1 lb # [ 55.107730] niks3-server[998]: 2026/09/20 10:51:45 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 55.119389] niks3-server[998]: 2026/09/20 10:51:45 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 55.124441] niks3-server[998]: 2026/09/20 10:51:45 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 55.134076] niks3-server[998]: 2026/09/20 10:51:45 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 55.139339] niks3-server[998]: 2026/09/20 10:51:45 INFO Completed upload id=12 worker1 # [ 55.143726] nix-grpc-daemon[846]: time=2026-09-20T10:51:45.732Z level=INFO msg="Upload complete. (355ms)" lb # [ 55.142397] niks3-server[998]: 2026/09/20 10:51:45 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo worker1 # [ 55.161501] nix-grpc-daemon[774]: ts=2026-09-20T10:51:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker2 # [ 55.157079] nix-grpc-daemon[777]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53412 worker1 # [ 55.181946] nix-daemon[833]: reaped child process 1070, status = succeeded worker2 # [ 55.171167] nix-grpc-daemon[777]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker2 # [ 55.234624] nix-grpc-daemon[777]: ts=2026-09-20T10:51:45Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 55.241974] nix-grpc-daemon[777]: ts=2026-09-20T10:51:45Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 55.599499] nix-grpc-daemon[777]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 55.610248] nix-grpc-daemon[777]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 55.627323] nix-grpc-daemon[861]: time=2026-09-20T10:51:46.231Z level=INFO msg="All 1 paths already cached" worker1 # [ 55.652952] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker1 # [ 55.660833] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 55.671864] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 55.686171] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 55.704117] nix-grpc-daemon[846]: time=2026-09-20T10:51:46.292Z level=INFO msg="All 1 paths already cached" worker1 # [ 55.716733] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 55.732744] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 55.959103] nix-daemon[833]: accepted connection from pid 1096, user nix-grpc-daemon (trusted) worker1 # [ 55.978599] nix-daemon[833]: reaped child process 1099, status = succeeded worker1 # [ 56.167059] nix-daemon[833]: accepted connection from pid 1101, user nix-grpc-daemon (trusted) worker1 # [ 56.185713] nix-daemon[833]: reaped child process 1104, status = succeeded lb # [ 56.196950] niks3-server[998]: 2026/09/20 10:51:46 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 56.213428] nix-grpc-daemon[846]: time=2026-09-20T10:51:46.801Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 56.214960] nix-grpc-daemon[846]: time=2026-09-20T10:51:46.801Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 56.231168] niks3-server[998]: 2026/09/20 10:51:46 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker1 # [ 56.258107] nix-grpc-daemon[846]: time=2026-09-20T10:51:46.846Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.247908] niks3-server[998]: 2026/09/20 10:51:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 56.263692] niks3-server[998]: 2026/09/20 10:51:46 INFO Signed narinfos id=13 count=1 lb # [ 56.269585] niks3-server[998]: 2026/09/20 10:51:46 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 56.276556] niks3-server[998]: 2026/09/20 10:51:46 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 56.292758] niks3-server[998]: 2026/09/20 10:51:46 INFO Completed upload id=13 worker1 # [ 56.297108] nix-grpc-daemon[846]: time=2026-09-20T10:51:46.885Z level=INFO msg="Upload complete. (544ms)" lb # [ 56.296089] niks3-server[998]: 2026/09/20 10:51:46 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker1 # [ 56.310231] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 56.324759] nix-grpc-daemon[774]: ts=2026-09-20T10:51:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 56.331726] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 56.337692] nix-daemon[833]: reaped child process 1094, status = succeeded worker1 # [ 56.353565] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 57.787481] nix-daemon[833]: reaped child process 1108, status = succeeded worker1 # [ 57.993827] nix-daemon[833]: accepted connection from pid 1123, user nix-grpc-daemon (trusted) worker1 # [ 58.013982] nix-daemon[833]: reaped child process 1126, status = succeeded lb # [ 58.023078] niks3-server[998]: 2026/09/20 10:51:48 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 58.040231] nix-grpc-daemon[846]: time=2026-09-20T10:51:48.626Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 58.041765] nix-grpc-daemon[846]: time=2026-09-20T10:51:48.626Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 58.067757] niks3-server[998]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 58.082000] niks3-server[998]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker1 # [ 58.094347] nix-grpc-daemon[846]: time=2026-09-20T10:51:48.682Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.093015] niks3-server[998]: 2026/09/20 10:51:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 58.099783] niks3-server[998]: 2026/09/20 10:51:48 INFO Signed narinfos id=14 count=1 lb # [ 58.103616] niks3-server[998]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 58.110670] niks3-server[998]: 2026/09/20 10:51:48 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete lb # [ 58.116107] niks3-server[998]: 2026/09/20 10:51:48 INFO Completed upload id=14 worker1 # [ 58.120361] nix-grpc-daemon[846]: time=2026-09-20T10:51:48.708Z level=INFO msg="Upload complete. (351ms)" lb # [ 58.118308] niks3-server[998]: 2026/09/20 10:51:48 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker1 # [ 58.137148] nix-grpc-daemon[774]: ts=2026-09-20T10:51:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker1 # [ 58.152396] nix-grpc-daemon[774]: ts=2026-09-20T10:51:48Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 58.157567] nix-daemon[833]: reaped child process 1106, status = succeeded worker2 # [ 58.169271] nix-grpc-daemon[777]: ts=2026-09-20T10:51:48Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 58.188086] nix-grpc-daemon[777]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker2 # [ 58.213262] nix-grpc-daemon[777]: ts=2026-09-20T10:51:48Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 58.574240] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:38656 worker2 # [ 58.577405] nix-grpc-daemon[777]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 58.593942] nix-grpc-daemon[861]: time=2026-09-20T10:51:49.199Z level=INFO msg="All 2 paths already cached" worker1 # [ 58.626602] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker1 # [ 58.634467] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 58.644591] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 58.660215] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 58.679362] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.267Z level=INFO msg="All 2 paths already cached" worker1 # [ 58.693436] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 58.709413] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 58.955313] nix-daemon[833]: accepted connection from pid 1132, user nix-grpc-daemon (trusted) worker1 # [ 58.975965] nix-daemon[833]: reaped child process 1135, status = succeeded worker1 # [ 59.169842] nix-daemon[833]: accepted connection from pid 1137, user nix-grpc-daemon (trusted) worker1 # [ 59.190008] nix-daemon[833]: reaped child process 1140, status = succeeded lb # [ 59.199837] niks3-server[998]: 2026/09/20 10:51:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 59.218894] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.806Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 59.220697] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.806Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 59.251268] niks3-server[998]: 2026/09/20 10:51:49 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst lb # [ 59.264964] niks3-server[998]: 2026/09/20 10:51:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker1 # [ 59.276223] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.864Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.274521] niks3-server[998]: 2026/09/20 10:51:49 INFO Signed narinfos id=15 count=1 lb # [ 59.288551] niks3-server[998]: 2026/09/20 10:51:49 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 59.295171] niks3-server[998]: 2026/09/20 10:51:49 INFO Completed upload id=15 worker1 # [ 59.298019] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.886Z level=INFO msg="Upload complete. (567ms)" lb # [ 59.297050] niks3-server[998]: 2026/09/20 10:51:49 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls worker1 # [ 59.313314] nix-grpc-daemon[846]: time=2026-09-20T10:51:49.891Z level=WARN msg="Failed to register uploaded object" key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 59.329542] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 59.341867] nix-grpc-daemon[774]: ts=2026-09-20T10:51:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 59.348899] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 59.351108] nix-daemon[833]: reaped child process 1130, status = succeeded worker1 # [ 59.366946] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) lb # [ 60.287059] envoy[916]: conn peer=[2001:db8:1::1]:37604 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1082 ms=3755 lb # [ 60.292317] envoy[916]: conn peer=[2001:db8:1::1]:37592 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1370 ms=4927 lb # [ 60.292451] envoy[916]: conn peer=[2001:db8:1::1]:59586 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3415 tx=1771 ms=2643 lb # [ 60.292619] envoy[916]: conn peer=[2001:db8:1::1]:59592 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=333 ms=81 lb # [ 60.292730] envoy[916]: conn peer=[2001:db8:1::1]:59608 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3875 tx=1873 ms=2681 lb # [ 60.292857] envoy[916]: conn peer=[2001:db8:1::1]:59612 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=376 ms=118 worker1 # [ 61.025128] nix-daemon[833]: reaped child process 1144, status = succeeded worker1 # [ 61.216066] nix-daemon[833]: accepted connection from pid 1159, user nix-grpc-daemon (trusted) worker1 # [ 61.238227] nix-daemon[833]: reaped child process 1162, status = succeeded lb # [ 61.248957] niks3-server[998]: 2026/09/20 10:51:51 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 61.264462] nix-grpc-daemon[846]: time=2026-09-20T10:51:51.851Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 61.265973] nix-grpc-daemon[846]: time=2026-09-20T10:51:51.851Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 61.305222] niks3-server[998]: 2026/09/20 10:51:51 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 61.316356] niks3-server[998]: 2026/09/20 10:51:51 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst lb # [ 61.326162] niks3-server[998]: 2026/09/20 10:51:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign worker1 # [ 61.335208] nix-grpc-daemon[846]: time=2026-09-20T10:51:51.922Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.334250] niks3-server[998]: 2026/09/20 10:51:51 INFO Signed narinfos id=16 count=1 lb # [ 61.339391] niks3-server[998]: 2026/09/20 10:51:51 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 61.352684] niks3-server[998]: 2026/09/20 10:51:51 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 61.360314] niks3-server[998]: 2026/09/20 10:51:51 INFO Completed upload id=16 worker1 # [ 61.364669] nix-grpc-daemon[846]: time=2026-09-20T10:51:51.953Z level=INFO msg="Upload complete. (382ms)" lb # [ 61.362968] niks3-server[998]: 2026/09/20 10:51:51 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker2 # [ 61.374092] nix-grpc-daemon[777]: ts=2026-09-20T10:51:51Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53412 worker1 # [ 61.381340] nix-grpc-daemon[774]: ts=2026-09-20T10:51:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=2 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker1 # [ 61.399141] nix-daemon[833]: reaped child process 1142, status = succeeded worker2 # [ 61.389048] nix-grpc-daemon[777]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker1 # [ 61.444143] nix-grpc-daemon[774]: ts=2026-09-20T10:51:52Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 61.452156] nix-grpc-daemon[774]: ts=2026-09-20T10:51:52Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_out=232 client # [ 61.637735] nix-daemon[940]: reaped child process 942, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 9.54 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.05 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.04 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 9.67 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.46 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.21 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.26 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 63.001099] nix-daemon[940]: accepted connection from pid 1020, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 63.120132] nix-grpc-daemon[774]: ts=2026-09-20T10:51:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 63.127182] nix-grpc-daemon[774]: ts=2026-09-20T10:51:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 63.350035] nix-daemon[833]: accepted connection from pid 1169, user nix-grpc-daemon (trusted) worker1 # [ 63.369370] nix-daemon[833]: reaped child process 1172, status = succeeded lb # [ 63.378072] niks3-server[998]: 2026/09/20 10:51:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 63.393965] nix-grpc-daemon[846]: time=2026-09-20T10:51:53.981Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 63.395656] nix-grpc-daemon[846]: time=2026-09-20T10:51:53.981Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 63.415829] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 63.428457] niks3-server[998]: 2026/09/20 10:51:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker1 # [ 63.439395] nix-grpc-daemon[846]: time=2026-09-20T10:51:54.027Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.438770] niks3-server[998]: 2026/09/20 10:51:54 INFO Signed narinfos id=17 count=1 lb # [ 63.445145] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 63.454709] niks3-server[998]: 2026/09/20 10:51:54 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete lb # [ 63.462863] niks3-server[998]: 2026/09/20 10:51:54 INFO Completed upload id=17 worker1 # [ 63.465518] nix-grpc-daemon[846]: time=2026-09-20T10:51:54.053Z level=INFO msg="Upload complete. (332ms)" lb # [ 63.466131] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker1 # [ 63.492402] nix-grpc-daemon[774]: ts=2026-09-20T10:51:54Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker1 # [ 63.498627] nix-grpc-daemon[774]: ts=2026-09-20T10:51:54Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 63.535155] nix-grpc-daemon[777]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 63.555752] nix-grpc-daemon[777]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53412 client # copying 2 paths to 'lb:50051'... client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... worker2 # [ 63.577625] nix-grpc-daemon[777]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53412 client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 63.594584] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 63.843447] nix-daemon[833]: accepted connection from pid 938, user nix-grpc-daemon (trusted) worker2 # [ 63.863922] nix-daemon[833]: reaped child process 941, status = succeeded worker2 # [ 64.051717] nix-daemon[833]: accepted connection from pid 943, user nix-grpc-daemon (trusted) worker2 # [ 64.070706] nix-daemon[833]: reaped child process 946, status = succeeded lb # [ 64.089625] niks3-server[998]: 2026/09/20 10:51:54 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 64.103420] niks3-server[998]: 2026/09/20 10:51:54 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 64.112629] nix-grpc-daemon[861]: time=2026-09-20T10:51:54.718Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 64.114614] nix-grpc-daemon[861]: time=2026-09-20T10:51:54.718Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" worker2 # [ 64.118658] nix-grpc-daemon[861]: time=2026-09-20T10:51:54.723Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" lb # [ 64.167175] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 64.178918] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 64.195732] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 64.202268] niks3-server[998]: 2026/09/20 10:51:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign lb # [ 64.212532] niks3-server[998]: 2026/09/20 10:51:54 INFO Signed narinfos id=18 count=1 worker2 # [ 64.206421] nix-grpc-daemon[861]: time=2026-09-20T10:51:54.811Z level=INFO msg="Uploading 3 narinfos" lb # [ 64.214574] niks3-server[998]: 2026/09/20 10:51:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 64.223836] niks3-server[998]: 2026/09/20 10:51:54 INFO Signed narinfos id=19 count=2 lb # [ 64.228292] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 64.241619] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 64.250818] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 64.259067] niks3-server[998]: 2026/09/20 10:51:54 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 64.263821] niks3-server[998]: 2026/09/20 10:51:54 INFO Completed upload id=18 lb # [ 64.266759] niks3-server[998]: 2026/09/20 10:51:54 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete lb # [ 64.269760] niks3-server[998]: 2026/09/20 10:51:54 INFO Completed upload id=19 worker2 # [ 64.264915] nix-grpc-daemon[861]: time=2026-09-20T10:51:54.871Z level=INFO msg="Upload complete. (639ms)" lb # [ 64.272367] niks3-server[998]: 2026/09/20 10:51:54 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo worker2 # [ 64.277654] nix-grpc-daemon[777]: ts=2026-09-20T10:51:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=2 nar_bytes_in=984 worker2 # [ 64.297133] nix-grpc-daemon[777]: ts=2026-09-20T10:51:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 64.307808] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 64.320440] nix-daemon[833]: reaped child process 936, status = succeeded worker2 # [ 64.340601] nix-grpc-daemon[777]: copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' from 'http://lb:5751'... client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker2 # [ 64.364969] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 65.419725] nix-daemon[833]: reaped child process 951, status = succeeded worker2 # [ 65.590906] nix-daemon[833]: accepted connection from pid 966, user nix-grpc-daemon (trusted) worker2 # [ 65.609878] nix-daemon[833]: reaped child process 969, status = succeeded lb # [ 65.628687] niks3-server[998]: 2026/09/20 10:51:56 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 65.634839] nix-grpc-daemon[861]: time=2026-09-20T10:51:56.240Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 65.658381] niks3-server[998]: 2026/09/20 10:51:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker2 # [ 65.663581] nix-grpc-daemon[861]: time=2026-09-20T10:51:56.270Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.674104] niks3-server[998]: 2026/09/20 10:51:56 INFO Signed narinfos id=20 count=1 lb # [ 65.682657] niks3-server[998]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv lb # [ 65.695923] niks3-server[998]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 65.706040] niks3-server[998]: 2026/09/20 10:51:56 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete worker2 # [ 65.708388] nix-grpc-daemon[861]: time=2026-09-20T10:51:56.315Z level=INFO msg="Upload complete. (324ms)" lb # [ 65.716364] niks3-server[998]: 2026/09/20 10:51:56 INFO Completed upload id=20 lb # [ 65.721634] niks3-server[998]: 2026/09/20 10:51:56 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo worker2 # [ 65.721177] nix-grpc-daemon[777]: ts=2026-09-20T10:51:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 worker2 # [ 65.738450] nix-daemon[833]: reaped child process 948, status = succeeded client # copying 1 paths... worker2 # [ 65.763329] nix-grpc-daemon[777]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:53412 client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker1 # [ 65.803626] nix-grpc-daemon[774]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 65.821625] nix-grpc-daemon[774]: copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'http://lb:5751'... worker1 # [ 65.844756] nix-grpc-daemon[774]: ts=2026-09-20T10:51:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_out=120 client # [ 66.062807] nix-daemon[940]: reaped child process 1023, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.31 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 66.282333] nix-daemon[940]: accepted connection from pid 1041, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker2 # [ 66.387169] nix-grpc-daemon[777]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:53412 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 66.401508] nix-grpc-daemon[774]: ts=2026-09-20T10:51:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 66.413064] nix-grpc-daemon[846]: time=2026-09-20T10:51:57.000Z level=INFO msg="All 1 paths already cached" worker1 # [ 66.431210] nix-grpc-daemon[774]: ts=2026-09-20T10:51:57Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker1 # [ 66.439085] nix-grpc-daemon[774]: ts=2026-09-20T10:51:57Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 66.448417] nix-grpc-daemon[774]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 66.460504] nix-grpc-daemon[774]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:38656 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 66.484993] nix-grpc-daemon[774]: ts=2026-09-20T10:51:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 66.500283] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 66.523763] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5) worker1 # [ 66.591318] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 2/5) worker1 # [ 66.755074] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 3/5) worker1 # [ 66.929929] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 691 ms (attempt 4/5) worker1 # [ 67.629189] nix-grpc-daemon[774]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 67.636994] nix-grpc-daemon[774]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 67.881313] nix-daemon[833]: accepted connection from pid 1185, user nix-grpc-daemon (trusted) worker1 # [ 67.900715] nix-daemon[833]: reaped child process 1188, status = succeeded worker1 # [ 68.073495] nix-daemon[833]: accepted connection from pid 1190, user nix-grpc-daemon (trusted) worker1 # [ 68.090600] nix-daemon[833]: reaped child process 1193, status = succeeded worker1 # [ 68.115019] nix-grpc-daemon[846]: time=2026-09-20T10:51:58.702Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 68.116601] nix-grpc-daemon[846]: time=2026-09-20T10:51:58.702Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 68.099896] niks3-server[998]: 2026/09/20 10:51:58 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 68.130639] niks3-server[998]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst worker1 # [ 68.147055] nix-grpc-daemon[846]: time=2026-09-20T10:51:58.735Z level=INFO msg="Uploading 1 narinfos" lb # [ 68.146304] niks3-server[998]: 2026/09/20 10:51:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign lb # [ 68.157307] niks3-server[998]: 2026/09/20 10:51:58 INFO Signed narinfos id=21 count=1 lb # [ 68.163320] niks3-server[998]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls worker1 # [ 68.176913] nix-grpc-daemon[846]: time=2026-09-20T10:51:58.765Z level=INFO msg="Upload complete. (499ms)" lb # [ 68.173087] niks3-server[998]: 2026/09/20 10:51:58 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 68.178830] niks3-server[998]: 2026/09/20 10:51:58 INFO Completed upload id=21 worker1 # [ 68.183211] nix-grpc-daemon[774]: ts=2026-09-20T10:51:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 paths=1 nar_bytes_in=568 lb # [ 68.183124] niks3-server[998]: 2026/09/20 10:51:58 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker1 # [ 68.197195] nix-grpc-daemon[774]: ts=2026-09-20T10:51:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 68.204615] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) worker1 # [ 68.209276] nix-daemon[833]: reaped child process 1179, status = succeeded client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 68.223359] nix-daemon[833]: accepted connection from pid 774, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 69.070248] nix-daemon[833]: reaped child process 1197, status = succeeded worker1 # [ 69.250827] nix-daemon[833]: accepted connection from pid 1212, user nix-grpc-daemon (trusted) worker1 # [ 69.268909] nix-daemon[833]: reaped child process 1215, status = succeeded lb # [ 69.277605] niks3-server[998]: 2026/09/20 10:51:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 69.296266] nix-grpc-daemon[846]: time=2026-09-20T10:51:59.881Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 69.313170] niks3-server[998]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls worker1 # [ 69.325932] nix-grpc-daemon[846]: time=2026-09-20T10:51:59.914Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.325655] niks3-server[998]: 2026/09/20 10:51:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign lb # [ 69.336850] niks3-server[998]: 2026/09/20 10:51:59 INFO Signed narinfos id=22 count=1 lb # [ 69.341747] niks3-server[998]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 69.353914] nix-grpc-daemon[846]: time=2026-09-20T10:51:59.942Z level=INFO msg="Upload complete. (320ms)" lb # [ 69.351260] niks3-server[998]: 2026/09/20 10:51:59 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete lb # [ 69.357362] niks3-server[998]: 2026/09/20 10:51:59 INFO Completed upload id=22 lb # [ 69.360497] niks3-server[998]: 2026/09/20 10:51:59 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo client # copying 1 paths... worker1 # [ 69.365720] nix-grpc-daemon[774]: ts=2026-09-20T10:51:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker1 # [ 69.381497] nix-grpc-daemon[774]: ts=2026-09-20T10:51:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:38656 client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker1 # [ 69.386199] nix-daemon[833]: reaped child process 1195, status = succeeded worker2 # [ 69.402123] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 69.415860] nix-grpc-daemon[777]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... worker2 # [ 69.433603] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=1 nar_bytes_out=120 client # [ 69.657939] nix-daemon[940]: reaped child process 1044, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.59 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 69.876432] nix-daemon[940]: accepted connection from pid 1062, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 69.991551] nix-grpc-daemon[774]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:38656 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 69.987367] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 69.998148] nix-grpc-daemon[861]: time=2026-09-20T10:52:00.604Z level=INFO msg="All 1 paths already cached" worker1 # [ 70.025934] nix-grpc-daemon[774]: ts=2026-09-20T10:52:00Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker1 # [ 70.032846] nix-grpc-daemon[774]: ts=2026-09-20T10:52:00Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 70.026783] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 70.042351] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 70.057997] nix-grpc-daemon[861]: time=2026-09-20T10:52:00.664Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 70.068956] nix-grpc-daemon[777]: ts=2026-09-20T10:52:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 70.084966] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted) lb # [ 70.287876] envoy[916]: conn peer=[2001:db8:1::1]:59628 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4313 tx=2223 ms=2899 worker2 # [ 70.290114] nix-daemon[833]: accepted connection from pid 974, user nix-grpc-daemon (trusted) worker2 # [ 70.310054] nix-daemon[833]: reaped child process 977, status = succeeded worker2 # [ 70.482901] nix-daemon[833]: accepted connection from pid 979, user nix-grpc-daemon (trusted) worker2 # [ 70.502662] nix-daemon[833]: reaped child process 982, status = succeeded lb # [ 70.292882] envoy[916]: conn peer=[2001:db8:1::1]:41234 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=412 tx=407 ms=33 lb # [ 70.293020] envoy[916]: conn peer=[2001:db8:1::1]:41238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3849 tx=1766 ms=2787 lb # [ 70.293207] envoy[916]: conn peer=[2001:db8:1::1]:41254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=108 lb # [ 70.293315] envoy[916]: conn peer=[2001:db8:1::1]:41260 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1827 ms=3104 lb # [ 70.293418] envoy[916]: conn peer=[2001:db8:1::1]:41264 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=95 lb # [ 70.519976] niks3-server[998]: 2026/09/20 10:52:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 70.548698] nix-grpc-daemon[861]: time=2026-09-20T10:52:01.155Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 70.550778] nix-grpc-daemon[861]: time=2026-09-20T10:52:01.157Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 70.574850] niks3-server[998]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst lb # [ 70.590751] niks3-server[998]: 2026/09/20 10:52:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker2 # [ 70.591439] nix-grpc-daemon[861]: time=2026-09-20T10:52:01.197Z level=INFO msg="Uploading 1 narinfos" lb # [ 70.602507] niks3-server[998]: 2026/09/20 10:52:01 INFO Signed narinfos id=23 count=1 lb # [ 70.609281] niks3-server[998]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 70.616684] niks3-server[998]: 2026/09/20 10:52:01 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 70.622867] niks3-server[998]: 2026/09/20 10:52:01 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo lb # [ 70.628819] niks3-server[998]: 2026/09/20 10:52:01 INFO Completed upload id=23 worker2 # [ 70.623882] nix-grpc-daemon[861]: time=2026-09-20T10:52:01.230Z level=INFO msg="Upload complete. (521ms)" worker2 # [ 70.635756] nix-grpc-daemon[777]: ts=2026-09-20T10:52:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=0 paths=1 nar_bytes_in=568 worker2 # [ 70.653336] nix-grpc-daemon[777]: ts=2026-09-20T10:52:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 worker2 # [ 70.664330] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 70.667430] nix-daemon[833]: reaped child process 972, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker2 # [ 70.681115] nix-daemon[833]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker2 # [ 71.705183] nix-daemon[833]: reaped child process 986, status = succeeded worker2 # [ 71.871078] nix-daemon[833]: accepted connection from pid 1001, user nix-grpc-daemon (trusted) worker2 # [ 71.890433] nix-daemon[833]: reaped child process 1004, status = succeeded lb # [ 71.908904] niks3-server[998]: 2026/09/20 10:52:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.915178] nix-grpc-daemon[861]: time=2026-09-20T10:52:02.520Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 71.942605] niks3-server[998]: 2026/09/20 10:52:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign worker2 # [ 71.944459] nix-grpc-daemon[861]: time=2026-09-20T10:52:02.551Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.956951] niks3-server[998]: 2026/09/20 10:52:02 INFO Signed narinfos id=24 count=1 lb # [ 71.959834] niks3-server[998]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 71.971073] niks3-server[998]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls worker2 # [ 71.970976] nix-grpc-daemon[861]: time=2026-09-20T10:52:02.577Z level=INFO msg="Upload complete. (279ms)" lb # [ 71.977942] niks3-server[998]: 2026/09/20 10:52:02 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 71.982457] niks3-server[998]: 2026/09/20 10:52:02 INFO Completed upload id=24 lb # [ 71.984077] niks3-server[998]: 2026/09/20 10:52:02 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo worker2 # [ 71.980849] nix-grpc-daemon[777]: ts=2026-09-20T10:52:02Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53412 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 worker2 # [ 71.991704] nix-daemon[833]: reaped child process 984, status = succeeded client # copying 1 paths... worker1 # [ 72.038451] nix-grpc-daemon[774]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 72.054138] nix-grpc-daemon[774]: copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'http://lb:5751'... client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker1 # [ 72.102984] nix-grpc-daemon[774]: ts=2026-09-20T10:52:02Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38656 worker1 # [ 72.108370] nix-grpc-daemon[774]: ts=2026-09-20T10:52:02Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:38656 duration_s=0 paths=1 nar_bytes_out=120 client # [ 72.316670] nix-daemon[940]: reaped child process 1065, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.66 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 10.54 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.46 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.43 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.25 seconds) worker2 # [ 73.649364] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 73.655697] nix-grpc-daemon[777]: ts=2026-09-20T10:52:04Z level=info event=signal_exit worker2 # [ 74.915600] nix-grpc-daemon[777]: ts=2026-09-20T10:52:05Z level=info event=scheduler_restarting worker1 # [ 74.926488] nix-grpc-daemon[774]: ts=2026-09-20T10:52:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38652 worker1 # [ 74.926863] nix-grpc-daemon[774]: ts=2026-09-20T10:52:05Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 74.946776] nix-grpc-daemon[777]: ts=2026-09-20T10:52:05Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 74.974850] nix-daemon[833]: reaped child process 835, status = succeeded worker2 # [ 75.807765] nix-grpc-daemon[777]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 75.808288] nix-grpc-daemon[777]: E0000 00:00:1789901526.414282 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker2 # [ 75.819733] nix-grpc-daemon[777]: E0000 00:00:1789901526.426350 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 76.096627] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 76.099751] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 76.109872] systemd[1]: nix-grpc-daemon.service: Consumed 1.785s CPU time over 55.792s wall clock time, 51.5M memory peak, 44.4K incoming IP traffic, 76.3K outgoing IP traffic. worker2 # [ 76.119705] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 76.125813] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 76.128903] systemd[1]: nix-grpc-daemon.socket: Consumed 625us CPU time over 1min 5.004s wall clock time, 256K memory peak, 58.5K incoming IP traffic, 51.6K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 76.475390] nix-grpc-daemon[774]: ts=2026-09-20T10:52:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:38656 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker1 # [ 76.483099] nix-grpc-daemon[774]: ts=2026-09-20T10:52:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:38656 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.28 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.04 seconds) worker2 # [ 76.610619] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 76.703808] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 77.082228] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 77.300809] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:07Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 77.303458] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:07Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 77.311834] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:07Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 77.332345] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 77.357096] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:07Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 77.368792] nix-grpc-daemon[774]: ts=2026-09-20T10:52:07Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 77.696707] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=signal_exit worker1 # [ 77.927094] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_yield worker2 # [ 77.929400] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:08Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 77.935289] niks3-server[998]: 2026/09/20 10:52:08 INFO lead: released remote=192.168.1.3:39686 worker1 # [ 77.939440] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38652 worker1 # [ 77.947225] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 77.951537] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 77.955644] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38652 worker1 # [ 77.960185] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 78.130294] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.135746] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.148384] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.153736] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.338154] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:08Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.342518] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.354551] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.359923] nix-grpc-daemon[774]: ts=2026-09-20T10:52:08Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.538559] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.543870] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.560803] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.566209] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 78.744767] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.749939] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.768904] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 78.773016] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.932149] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=scheduler_restarting worker2 # [ 78.950884] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 78.956192] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 78.974691] nix-daemon[833]: reaped child process 835, status = succeeded worker1 # [ 78.999135] nix-grpc-daemon[774]: ts=2026-09-20T10:52:09Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 79.157227] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.162667] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 79.365270] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.369517] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 79.565823] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.571211] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 79.772128] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.777282] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 79.797970] nix-grpc-daemon[774]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 79.802672] nix-grpc-daemon[774]: E0000 00:00:1789901530.385019 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 79.826032] nix-grpc-daemon[774]: E0000 00:00:1789901530.414311 817 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 79.978168] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 79.983565] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 80.012985] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 80.022024] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 80.027911] systemd[1]: nix-grpc-daemon.service: Consumed 3.937s CPU time over 59.708s wall clock time, 65.7M memory peak, 90.5K incoming IP traffic, 172.8K outgoing IP traffic. worker1 # [ 80.043331] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 80.047326] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 80.050150] systemd[1]: nix-grpc-daemon.socket: Consumed 611us CPU time over 1min 8.251s wall clock time, 256K memory peak, 92K incoming IP traffic, 73.6K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 80.184523] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.189836] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 80.292226] envoy[916]: conn peer=[2001:db8:1::1]:41276 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3725 tx=1918 ms=2169 lb # [ 80.292597] envoy[916]: conn peer=[2001:db8:1::1]:34870 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=63 lb # [ 80.292736] envoy[916]: conn peer=[2001:db8:1::4]:33160 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4968 tx=1454 ms=54240 lb # [ 80.292853] envoy[916]: conn peer=[2001:db8:1::1]:34872 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=24 lb # [ 80.292980] envoy[916]: conn peer=[2001:db8:1::3]:40046 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=6642 tx=2047 ms=58267 worker2 # [ 80.383062] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 80.401253] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.412173] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.424985] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker2 # [ 80.436519] nix-grpc-daemon[1025]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5) worker2 # [ 80.459388] nix-grpc-daemon[1025]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 2/5) worker2 # [ 80.481937] nix-grpc-daemon[1025]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 246 ms (attempt 3/5) worker2 # [ 80.593507] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.598777] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 80.735495] nix-grpc-daemon[1025]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 427 ms (attempt 4/5) worker2 # [ 80.799668] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 80.805134] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.005954] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.011225] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.170738] nix-grpc-daemon[1025]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 81.196730] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 81.211904] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.222411] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.236279] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker2 # [ 81.253839] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:11Z level=info event=niks3_push_started pid=1081 worker2 # [ 81.414419] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.435542] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.621000] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.640276] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.655005] nix-daemon[833]: accepted connection from pid 1094, user nix-grpc-daemon (trusted) worker2 # [ 81.673656] nix-daemon[833]: reaped child process 1097, status = succeeded lb # [ 81.691584] niks3-server[998]: 2026/09/20 10:52:12 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 81.701461] niks3-server[998]: 2026/09/20 10:52:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 81.707825] nix-grpc-daemon[1081]: time=2026-09-20T10:52:12.312Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 81.710418] nix-grpc-daemon[1081]: time=2026-09-20T10:52:12.312Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" worker2 # [ 81.712450] nix-grpc-daemon[1081]: time=2026-09-20T10:52:12.312Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" lb # [ 81.754937] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 81.766965] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst lb # [ 81.778181] niks3-server[998]: 2026/09/20 10:52:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign worker2 # [ 81.780116] nix-grpc-daemon[1081]: time=2026-09-20T10:52:12.386Z level=INFO msg="Uploading 3 narinfos" lb # [ 81.788251] niks3-server[998]: 2026/09/20 10:52:12 INFO Signed narinfos id=25 count=1 lb # [ 81.790399] niks3-server[998]: 2026/09/20 10:52:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 81.800282] niks3-server[998]: 2026/09/20 10:52:12 INFO Signed narinfos id=26 count=2 lb # [ 81.802229] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 81.809520] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 81.824072] niks3-server[998]: 2026/09/20 10:52:12 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete worker2 # [ 81.824273] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:50051 lb # [ 81.833842] niks3-server[998]: 2026/09/20 10:52:12 INFO Completed upload id=26 lb # [ 81.836738] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo worker2 # [ 81.829874] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 81.840706] niks3-server[998]: 2026/09/20 10:52:12 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 81.843497] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo worker2 # [ 81.838661] nix-grpc-daemon[1081]: time=2026-09-20T10:52:12.445Z level=INFO msg="Upload complete. (359ms)" lb # [ 81.845961] niks3-server[998]: 2026/09/20 10:52:12 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 81.848748] niks3-server[998]: 2026/09/20 10:52:12 INFO Completed upload id=25 worker2 # [ 81.848384] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 81.866673] nix-daemon[833]: reaped child process 1079, status = succeeded client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 1.76 seconds) worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.04 seconds) worker1 # [ 82.024863] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 82.030173] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 82.030857] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.036294] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.229749] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 82.232335] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 82.240787] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 82.242521] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 82.237062] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:50051 lb # [ 82.246413] niks3-server[998]: 2026/09/20 10:52:12 INFO lead: acquired remote=192.168.1.3:34370 worker2 # [ 82.242547] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.256503] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=scheduler_take_over lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 82.288840] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.290723] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2 # [ 82.445410] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.449610] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.491979] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.497144] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.646379] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.651879] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.697805] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.703147] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.852850] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 82.858514] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.904205] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.909536] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 83.059470] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.074082] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 83.110259] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 83.115848] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.19 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1 # [ 83.705487] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 84.243175] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=signal_exit worker1 # [ 84.254278] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=scheduler_yield lb # [ 84.254415] niks3-server[998]: 2026/09/20 10:52:14 INFO lead: released remote=192.168.1.3:34370 worker1 # [ 84.260140] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 84.265538] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38986 worker1 # [ 84.270169] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 84.264160] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:14Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 84.275231] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:38986 worker1 # [ 84.279810] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:14Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 84.460824] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.468137] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 84.464107] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.469530] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 84.675887] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.670810] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.683665] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 84.676405] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 84.884880] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.877423] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.882845] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker1 # [ 84.892549] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 85.083878] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.093505] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 85.098946] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.093444] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 85.263851] nix-grpc-daemon[1241]: ts=2026-09-20T10:52:15Z level=info event=scheduler_restarting worker2 # [ 85.296416] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.300659] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.497296] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.503241] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.704083] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.709430] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 85.910592] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 85.916222] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.013528] nix-grpc-daemon[1241]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 86.013900] nix-grpc-daemon[1241]: E0000 00:00:1789901536.601763 1284 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 86.025678] nix-grpc-daemon[1241]: E0000 00:00:1789901536.614004 1284 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 86.117219] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.122585] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 86.276712] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 86.279648] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 86.289674] systemd[1]: nix-grpc-daemon.service: Consumed 216ms CPU time over 4.241s wall clock time, 12.8M memory peak, 8.1K incoming IP traffic, 8.7K outgoing IP traffic. worker1 # [ 86.303196] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 86.307308] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 86.310392] systemd[1]: nix-grpc-daemon.socket: Consumed 916us CPU time over 4.288s wall clock time, 256K memory peak, 15.4K incoming IP traffic, 12.2K outgoing IP traffic. worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker2 # [ 86.325864] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.331536] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.526334] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.531680] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.732512] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.738069] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 86.938915] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 86.944441] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 87.145369] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.150779] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 87.334210] niks3-server[998]: 2026/09/20 10:52:17 INFO lead: acquired remote=192.168.1.4:36852 worker2 # [ 87.329446] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_take_over worker2 # [ 87.352853] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 87.374509] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.17 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker2 # [ 87.776138] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:36962 client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 87.786963] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 87.815076] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker2 # [ 87.822930] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 87.863860] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 87.880706] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36962 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker2 # [ 87.898603] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 87.914527] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker2 # [ 88.120635] nix-daemon[833]: accepted connection from pid 1121, user nix-grpc-daemon (trusted) worker2 # [ 88.143376] nix-daemon[833]: reaped child process 1124, status = succeeded worker2 # [ 88.324326] nix-daemon[833]: accepted connection from pid 1126, user nix-grpc-daemon (trusted) worker2 # [ 88.343090] nix-daemon[833]: reaped child process 1129, status = succeeded lb # [ 88.361328] niks3-server[998]: 2026/09/20 10:52:18 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 88.367212] nix-grpc-daemon[1081]: time=2026-09-20T10:52:18.973Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 88.368905] nix-grpc-daemon[1081]: time=2026-09-20T10:52:18.973Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 88.396904] niks3-server[998]: 2026/09/20 10:52:18 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 88.414213] niks3-server[998]: 2026/09/20 10:52:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign lb # [ 88.420616] niks3-server[998]: 2026/09/20 10:52:19 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 88.440302] niks3-server[998]: 2026/09/20 10:52:19 INFO Signed narinfos id=27 count=1 worker2 # [ 88.436064] nix-grpc-daemon[1081]: time=2026-09-20T10:52:19.042Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.455587] niks3-server[998]: 2026/09/20 10:52:19 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete worker2 # [ 88.457574] nix-grpc-daemon[1081]: time=2026-09-20T10:52:19.064Z level=INFO msg="Upload complete. (523ms)" lb # [ 88.464809] niks3-server[998]: 2026/09/20 10:52:19 INFO Completed upload id=27 lb # [ 88.469448] niks3-server[998]: 2026/09/20 10:52:19 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker2 # [ 88.470727] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=0 paths=1 nar_bytes_in=520 worker2 # [ 88.487273] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 88.496728] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker2 # [ 88.500943] nix-daemon[833]: reaped child process 1119, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> worker2: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker2 # [ 88.515671] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) client # farm-a> LOG-farm-a-on-standby worker2 # [ 89.761338] nix-daemon[833]: reaped child process 1133, status = succeeded worker2 # [ 89.934726] nix-daemon[833]: accepted connection from pid 1148, user nix-grpc-daemon (trusted) worker2 # [ 89.953644] nix-daemon[833]: reaped child process 1151, status = succeeded lb # [ 89.972970] niks3-server[998]: 2026/09/20 10:52:20 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 89.977911] nix-grpc-daemon[1081]: time=2026-09-20T10:52:20.584Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 89.981525] nix-grpc-daemon[1081]: time=2026-09-20T10:52:20.586Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 90.005060] niks3-server[998]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 90.029334] niks3-server[998]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst worker2 # [ 90.031984] nix-grpc-daemon[1081]: time=2026-09-20T10:52:20.637Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.042027] niks3-server[998]: 2026/09/20 10:52:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign lb # [ 90.051895] niks3-server[998]: 2026/09/20 10:52:20 INFO Signed narinfos id=28 count=1 lb # [ 90.058804] niks3-server[998]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 90.062360] niks3-server[998]: 2026/09/20 10:52:20 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 90.072431] niks3-server[998]: 2026/09/20 10:52:20 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo lb # [ 90.080079] niks3-server[998]: 2026/09/20 10:52:20 INFO Completed upload id=28 worker2 # [ 90.075236] nix-grpc-daemon[1081]: time=2026-09-20T10:52:20.682Z level=INFO msg="Upload complete. (347ms)" worker2 # [ 90.097421] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker2 # [ 90.112261] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker2 # [ 90.118246] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 90.122054] nix-daemon[833]: reaped child process 1131, status = succeeded worker2 # [ 90.144750] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 90.160600] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 90.175610] nix-grpc-daemon[1081]: time=2026-09-20T10:52:20.782Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker2 # [ 90.185899] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 90.199708] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) lb # [ 90.294212] envoy[916]: conn peer=[2001:db8:1::1]:34886 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1007 tx=305 ms=1483 lb # [ 90.299321] envoy[916]: conn peer=[2001:db8:1::3]:33992 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1568 tx=536 ms=3026 worker2 # [ 90.409430] nix-daemon[833]: accepted connection from pid 1157, user nix-grpc-daemon (trusted) worker2 # [ 90.428707] nix-daemon[833]: reaped child process 1160, status = succeeded worker2 # [ 90.613806] nix-daemon[833]: accepted connection from pid 1162, user nix-grpc-daemon (trusted) worker2 # [ 90.639516] nix-daemon[833]: reaped child process 1165, status = succeeded lb # [ 90.654255] niks3-server[998]: 2026/09/20 10:52:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 90.660990] nix-grpc-daemon[1081]: time=2026-09-20T10:52:21.267Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 90.662554] nix-grpc-daemon[1081]: time=2026-09-20T10:52:21.267Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 90.688453] niks3-server[998]: 2026/09/20 10:52:21 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 90.700433] niks3-server[998]: 2026/09/20 10:52:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign worker2 # [ 90.701524] nix-grpc-daemon[1081]: time=2026-09-20T10:52:21.308Z level=INFO msg="Uploading 1 narinfos" lb # [ 90.709305] niks3-server[998]: 2026/09/20 10:52:21 INFO Signed narinfos id=29 count=1 lb # [ 90.719419] niks3-server[998]: 2026/09/20 10:52:21 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 90.731054] niks3-server[998]: 2026/09/20 10:52:21 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 90.740637] niks3-server[998]: 2026/09/20 10:52:21 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo lb # [ 90.745435] niks3-server[998]: 2026/09/20 10:52:21 INFO Completed upload id=29 worker2 # [ 90.740209] nix-grpc-daemon[1081]: time=2026-09-20T10:52:21.347Z level=INFO msg="Upload complete. (523ms)" worker2 # [ 90.748796] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 90.760738] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 90.772805] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker2 # [ 90.778054] nix-daemon[833]: reaped child process 1155, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... worker2 # [ 90.789970] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) client # farm-b> worker2: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv client # farm-b> LOG-farm-b-on-standby worker2 # [ 91.632513] nix-daemon[833]: reaped child process 1169, status = succeeded worker2 # [ 91.801191] nix-daemon[833]: accepted connection from pid 1184, user nix-grpc-daemon (trusted) worker2 # [ 91.820936] nix-daemon[833]: reaped child process 1187, status = succeeded lb # [ 91.840657] niks3-server[998]: 2026/09/20 10:52:22 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 91.846988] nix-grpc-daemon[1081]: time=2026-09-20T10:52:22.452Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 91.849017] nix-grpc-daemon[1081]: time=2026-09-20T10:52:22.452Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 91.874082] niks3-server[998]: 2026/09/20 10:52:22 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 91.891756] niks3-server[998]: 2026/09/20 10:52:22 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 91.900301] niks3-server[998]: 2026/09/20 10:52:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker2 # [ 91.901058] nix-grpc-daemon[1081]: time=2026-09-20T10:52:22.507Z level=INFO msg="Uploading 1 narinfos" lb # [ 91.906350] niks3-server[998]: 2026/09/20 10:52:22 INFO Signed narinfos id=30 count=1 lb # [ 91.911272] niks3-server[998]: 2026/09/20 10:52:22 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 91.922017] niks3-server[998]: 2026/09/20 10:52:22 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 91.931202] niks3-server[998]: 2026/09/20 10:52:22 INFO Completed upload id=30 worker2 # [ 91.926294] nix-grpc-daemon[1081]: time=2026-09-20T10:52:22.533Z level=INFO msg="Upload complete. (323ms)" lb # [ 91.934332] niks3-server[998]: 2026/09/20 10:52:22 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo worker2 # [ 91.943698] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker2 # [ 91.960354] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker2 # [ 91.966552] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 91.970733] nix-daemon[833]: reaped child process 1167, status = succeeded worker2 # [ 91.987013] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 92.002539] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 92.016838] nix-grpc-daemon[1081]: time=2026-09-20T10:52:22.623Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker2 # [ 92.027027] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 92.044140] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker2 # [ 92.244107] nix-daemon[833]: accepted connection from pid 1193, user nix-grpc-daemon (trusted) worker2 # [ 92.262353] nix-daemon[833]: reaped child process 1196, status = succeeded worker2 # [ 92.431880] nix-daemon[833]: accepted connection from pid 1198, user nix-grpc-daemon (trusted) worker2 # [ 92.450820] nix-daemon[833]: reaped child process 1201, status = succeeded lb # [ 92.467297] niks3-server[998]: 2026/09/20 10:52:23 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 92.471855] nix-grpc-daemon[1081]: time=2026-09-20T10:52:23.078Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 92.473488] nix-grpc-daemon[1081]: time=2026-09-20T10:52:23.078Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 92.496562] niks3-server[998]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker2 # [ 92.502186] nix-grpc-daemon[1081]: time=2026-09-20T10:52:23.108Z level=INFO msg="Uploading 1 narinfos" lb # [ 92.510264] niks3-server[998]: 2026/09/20 10:52:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 92.522708] niks3-server[998]: 2026/09/20 10:52:23 INFO Signed narinfos id=31 count=1 lb # [ 92.526544] niks3-server[998]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls lb # [ 92.534496] niks3-server[998]: 2026/09/20 10:52:23 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete worker2 # [ 92.533722] nix-grpc-daemon[1081]: time=2026-09-20T10:52:23.140Z level=INFO msg="Upload complete. (474ms)" lb # [ 92.539663] niks3-server[998]: 2026/09/20 10:52:23 INFO Completed upload id=31 lb # [ 92.542775] niks3-server[998]: 2026/09/20 10:52:23 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker2 # [ 92.540137] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 92.551873] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 92.555350] nix-daemon[833]: reaped child process 1191, status = succeeded worker2 # [ 92.562565] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... client # farm-top> worker2: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker2 # [ 92.575701] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) client # farm-top> LOG-farm-top-on-standby worker2 # [ 94.021577] nix-daemon[833]: reaped child process 1205, status = succeeded worker2 # [ 94.206158] nix-daemon[833]: accepted connection from pid 1220, user nix-grpc-daemon (trusted) worker2 # [ 94.224333] nix-daemon[833]: reaped child process 1223, status = succeeded lb # [ 94.241541] niks3-server[998]: 2026/09/20 10:52:24 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 94.250308] nix-grpc-daemon[1081]: time=2026-09-20T10:52:24.855Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 94.251820] nix-grpc-daemon[1081]: time=2026-09-20T10:52:24.855Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 94.277196] niks3-server[998]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 94.294907] niks3-server[998]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst worker2 # [ 94.303730] nix-grpc-daemon[1081]: time=2026-09-20T10:52:24.910Z level=INFO msg="Uploading 1 narinfos" lb # [ 94.303063] niks3-server[998]: 2026/09/20 10:52:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign lb # [ 94.312699] niks3-server[998]: 2026/09/20 10:52:24 INFO Signed narinfos id=32 count=1 lb # [ 94.314991] niks3-server[998]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 94.325193] niks3-server[998]: 2026/09/20 10:52:24 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete lb # [ 94.331820] niks3-server[998]: 2026/09/20 10:52:24 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo lb # [ 94.336720] niks3-server[998]: 2026/09/20 10:52:24 INFO Completed upload id=32 worker2 # [ 94.331552] nix-grpc-daemon[1081]: time=2026-09-20T10:52:24.938Z level=INFO msg="Upload complete. (342ms)" worker2 # [ 94.345163] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker2 # [ 94.361521] nix-daemon[833]: reaped child process 1203, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 6.86 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.23 seconds) worker1 # [ 94.718551] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 94.728493] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 94.931600] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:25Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 94.934086] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:25Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 94.941092] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:25Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 94.949443] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 94.984956] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 94.977969] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 11.92 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 95.510525] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: a29f27c9c86c4648ae0b83f1ac16cefa client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds) worker1 # [ 95.670891] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44862 worker1 # [ 95.685752] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted) client # [ 95.787892] nix[1164]: don't know how to build these paths: client # [ 95.789198] nix[1164]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker2 # [ 95.709470] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker2 # [ 95.714851] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 95.755704] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 95.771078] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:36962 client # [ 95.876862] nix[1164]: copying 1 paths to 'lb:50051'... client # [ 95.881431] nix[1164]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker2 # [ 95.788669] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 95.804219] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker2 # [ 96.007550] nix-daemon[833]: accepted connection from pid 1236, user nix-grpc-daemon (trusted) worker2 # [ 96.026846] nix-daemon[833]: reaped child process 1239, status = succeeded worker2 # [ 96.200063] nix-daemon[833]: accepted connection from pid 1241, user nix-grpc-daemon (trusted) worker2 # [ 96.216886] nix-daemon[833]: reaped child process 1244, status = succeeded lb # [ 96.234566] niks3-server[998]: 2026/09/20 10:52:26 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 96.239578] nix-grpc-daemon[1081]: time=2026-09-20T10:52:26.845Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 96.241172] nix-grpc-daemon[1081]: time=2026-09-20T10:52:26.845Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 96.262981] niks3-server[998]: 2026/09/20 10:52:26 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst lb # [ 96.277395] niks3-server[998]: 2026/09/20 10:52:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker2 # [ 96.277865] nix-grpc-daemon[1081]: time=2026-09-20T10:52:26.884Z level=INFO msg="Uploading 1 narinfos" lb # [ 96.289342] niks3-server[998]: 2026/09/20 10:52:26 INFO Signed narinfos id=33 count=1 lb # [ 96.295030] niks3-server[998]: 2026/09/20 10:52:26 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 96.305471] niks3-server[998]: 2026/09/20 10:52:26 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 96.309769] niks3-server[998]: 2026/09/20 10:52:26 INFO Completed upload id=33 worker2 # [ 96.304705] nix-grpc-daemon[1081]: time=2026-09-20T10:52:26.911Z level=INFO msg="Upload complete. (483ms)" lb # [ 96.312230] niks3-server[998]: 2026/09/20 10:52:26 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker2 # [ 96.312272] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=0 paths=1 nar_bytes_in=416 worker2 # [ 96.324446] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 worker2 # [ 96.333578] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) worker2 # [ 96.337057] nix-daemon[833]: reaped child process 1234, status = succeeded client # [ 96.438902] nix[1164]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker2 # [ 96.348260] nix-daemon[833]: accepted connection from pid 1025, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker1: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker1 # [ 98.399495] systemd-journald[275]: Received client request to rotate journal, rotating. worker1 # [ 98.426630] systemd-journald[275]: Vacuuming done, freed 0B of archived journals from /var/log/journal/23e09f1877c049239a23bc64cf61eab9. worker1: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds) worker2: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker2 # [ 98.474611] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds) ??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead. File "/nix/store/sqpbfna43hn5hr5aj1l73jgim4hg0gwn-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 573 client: must succeed: sleep 5.0 worker2 # [ 99.332912] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:29Z level=info event=draining lb # [ 100.297118] envoy[916]: conn peer=[2001:db8:1::1]:60752 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9636 tx=3889 ms=6578 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker2 # [ 103.987506] nix-daemon[833]: reaped child process 1248, status = succeeded worker2 # [ 104.167341] nix-daemon[833]: accepted connection from pid 1288, user nix-grpc-daemon (trusted) worker2 # [ 104.185321] nix-daemon[833]: reaped child process 1291, status = succeeded lb # [ 104.207466] niks3-server[998]: 2026/09/20 10:52:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 104.236544] nix-grpc-daemon[1081]: time=2026-09-20T10:52:34.841Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 104.238325] nix-grpc-daemon[1081]: time=2026-09-20T10:52:34.841Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 104.306204] niks3-server[998]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst lb # [ 104.316475] niks3-server[998]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 104.329359] niks3-server[998]: 2026/09/20 10:52:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign worker2 # [ 104.325897] nix-grpc-daemon[1081]: time=2026-09-20T10:52:34.931Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.339448] niks3-server[998]: 2026/09/20 10:52:34 INFO Signed narinfos id=34 count=1 lb # [ 104.346274] niks3-server[998]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 104.356862] niks3-server[998]: 2026/09/20 10:52:34 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 104.371840] niks3-server[998]: 2026/09/20 10:52:34 INFO Completed upload id=34 worker2 # [ 104.369252] nix-grpc-daemon[1081]: time=2026-09-20T10:52:34.976Z level=INFO msg="Upload complete. (406ms)" lb # [ 104.376480] niks3-server[998]: 2026/09/20 10:52:34 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker2 # [ 104.390409] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36962 duration_s=8 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker2 # [ 104.414690] nix-daemon[833]: reaped child process 1246, status = succeeded client # [ 104.531953] systemd[1]: rs.service: Deactivated successfully. client # [ 104.536666] systemd[1]: rs.service: Consumed 161ms CPU time over 9.025s wall clock time, 38.9M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic. worker2 # [ 105.334886] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:35Z level=info event=signal_exit worker2 # [ 105.558721] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_yield lb # [ 105.567266] niks3-server[998]: 2026/09/20 10:52:36 INFO lead: released remote=192.168.1.4:36852 worker1 # [ 105.575130] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 105.566362] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:35984 worker2 # [ 105.573913] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 105.578329] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 105.582803] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:35984 worker2 # [ 105.588412] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 105.774588] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.768184] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.781851] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.773639] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 105.974747] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 105.983582] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 105.980535] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 105.991113] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.26 seconds) client: waiting for success: ! systemctl is-active rs worker2 # [ 106.182299] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.191898] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.188181] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 106.197635] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: waiting for success: ! systemctl is-active rs, in 0.09 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.06 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 106.398392] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 106.389714] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.404283] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:36Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.398455] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.11 seconds) worker2 # [ 106.566813] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:37Z level=info event=scheduler_restarting worker1 # [ 106.607650] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.612429] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 106.630778] nix-grpc-daemon[1025]: ts=2026-09-20T10:52:37Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 106.654306] nix-daemon[833]: reaped child process 1074, status = succeeded worker1 # [ 106.808534] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 106.814079] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 107.014880] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.020391] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.180426] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 107.183475] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 107.193854] systemd[1]: nix-grpc-daemon.service: Consumed 2.074s CPU time over 30.096s wall clock time, 36.6M memory peak, 60.3K incoming IP traffic, 114K outgoing IP traffic. worker2 # [ 107.207617] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 107.221628] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 107.226861] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:37Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.409917] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 107.413482] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 107.427494] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.423357] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 107.432720] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:38Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 107.434082] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 107.440143] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=scheduler_take_over lb # [ 107.446536] niks3-server[998]: 2026/09/20 10:52:38 INFO lead: acquired remote=192.168.1.4:43280 worker2 # [ 107.474158] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.481066] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) worker1 # [ 107.634812] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:38Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 107.626674] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:38Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 13.41 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 108.921737] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.10 seconds) worker2 # [ 109.091294] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:39842 worker2 # [ 109.103108] nix-daemon[833]: accepted connection from pid 1298, user nix-grpc-daemon (trusted) client # Running as unit: mid.service; invocation ID: b95d14811de743e7a91b76ad07a48b0a client # [ 109.215902] nix[1199]: don't know how to build these paths: client # [ 109.218387] nix[1199]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 109.139341] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:39Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 109.146405] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:39Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 109.191265] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39842 worker2 # [ 109.212763] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 1/5) worker2 # [ 109.266378] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 2/5) worker2 # [ 109.296942] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 84 ms (attempt 3/5) worker2 # [ 109.388505] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 4/5) worker2 # [ 109.398366] nix-grpc-daemon[1298]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 109.422139] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39842 client # [ 109.528247] nix[1199]: copying 1 paths to 'lb:50051'... worker2 # [ 109.439890] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39842 client # [ 109.535767] nix[1199]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 109.455831] nix-daemon[833]: accepted connection from pid 1298, user nix-grpc-daemon (trusted) worker2 # [ 109.491589] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:40Z level=info event=niks3_push_started pid=1366 worker2 # [ 109.877031] nix-daemon[833]: accepted connection from pid 1379, user nix-grpc-daemon (trusted) worker2 # [ 109.896534] nix-daemon[833]: reaped child process 1382, status = succeeded worker2 # [ 110.068212] nix-daemon[833]: accepted connection from pid 1384, user nix-grpc-daemon (trusted) worker2 # [ 110.087601] nix-daemon[833]: reaped child process 1387, status = succeeded lb # [ 110.104872] niks3-server[998]: 2026/09/20 10:52:40 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 110.111221] nix-grpc-daemon[1366]: time=2026-09-20T10:52:40.717Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 110.115183] nix-grpc-daemon[1366]: time=2026-09-20T10:52:40.719Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 110.144543] niks3-server[998]: 2026/09/20 10:52:40 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 110.157174] nix-grpc-daemon[1366]: time=2026-09-20T10:52:40.763Z level=INFO msg="Uploading 1 narinfos" lb # [ 110.161722] niks3-server[998]: 2026/09/20 10:52:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 110.175923] niks3-server[998]: 2026/09/20 10:52:40 INFO Signed narinfos id=35 count=1 lb # [ 110.179210] niks3-server[998]: 2026/09/20 10:52:40 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls lb # [ 110.191364] niks3-server[998]: 2026/09/20 10:52:40 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete worker2 # [ 110.192538] nix-grpc-daemon[1366]: time=2026-09-20T10:52:40.799Z level=INFO msg="Upload complete. (485ms)" lb # [ 110.198809] niks3-server[998]: 2026/09/20 10:52:40 INFO Completed upload id=35 worker2 # [ 110.203311] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39842 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 110.206742] nix-grpc-daemon[1298]: ts=2026-09-20T10:52:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39842 worker2 # [ 110.209443] nix-grpc-daemon[1366]: time=2026-09-20T10:52:40.816Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 110.213152] nix-daemon[833]: reaped child process 1364, status = succeeded worker2 # [ 110.216882] nix-daemon[833]: accepted connection from pid 1298, user nix-grpc-daemon (trusted) worker2 # [ 110.228584] nix-daemon[833]: accepted connection from pid 1298, user nix-grpc-daemon (trusted) client # [ 110.321009] nix[1199]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... lb # [ 110.294859] envoy[916]: conn peer=[2001:db8:1::1]:57456 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2966 tx=1328 ms=8746 lb # [ 110.300139] envoy[916]: conn peer=[2001:db8:1::4]:46368 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7096 tx=2101 ms=29254 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 112.800689] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1298 (nix-grpc-daemon) on client request. worker2 # [ 112.802302] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 112.829132] niks3-server[998]: 2026/09/20 10:52:43 INFO lead: released remote=192.168.1.4:43280 worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.08 seconds) client # [ 112.926481] nix[1199]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again client: must succeed: sleep 5.0 worker1 # [ 112.841979] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:43Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 112.932878] nix[1199]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 112.851057] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 112.860354] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 112.861720] systemd[1]: nix-grpc-daemon.service: Consumed 518ms CPU time over 5.641s wall clock time, 33.8M memory peak, 12.2K incoming IP traffic, 16.2K outgoing IP traffic. worker2 # [ 112.869532] nix-daemon[833]: reaped child process 1393, status = succeeded worker2 # [ 112.871300] nix-daemon[833]: reaped child process 1357, status = succeeded worker2 # [ 112.880613] nix-daemon[1395]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 112.886088] nix-daemon[833]: reaped child process 1395, status = failed with exit code 1 worker1 # [ 113.041924] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.036589] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1. worker2 # [ 113.045609] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 113.251296] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 113.253801] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 113.261144] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 113.262897] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 113.275540] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=scheduler_take_over lb # [ 113.280733] niks3-server[998]: 2026/09/20 10:52:43 INFO lead: acquired remote=192.168.1.4:52530 worker2 # [ 113.290975] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 113.305009] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.306923] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 113.342119] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 113.344953] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:43Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 113.397639] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44862 worker1 # [ 113.420669] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 1/5) worker1 # [ 113.484375] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 2/5) worker1 # [ 113.508571] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 258 ms (attempt 3/5) worker1 # [ 113.774085] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 650 ms (attempt 4/5) worker1 # [ 114.433956] nix-grpc-daemon[1305]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 114.455915] nix-grpc-daemon[1305]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'... worker1 # [ 114.494100] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted) worker1 # [ 114.516173] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted) client # [ 114.599678] nix[1199]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... client: (finished: must succeed: sleep 5.0, in 5.07 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 118.341979] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:48Z level=info event=niks3_push_started pid=1456 worker1 # [ 118.399344] nix-daemon[833]: reaped child process 1432, status = succeeded worker1 # [ 118.755489] nix-daemon[833]: accepted connection from pid 1469, user nix-grpc-daemon (trusted) worker1 # [ 118.773881] nix-daemon[833]: reaped child process 1472, status = succeeded lb # [ 118.785817] niks3-server[998]: 2026/09/20 10:52:49 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 118.800465] nix-grpc-daemon[1456]: time=2026-09-20T10:52:49.387Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 118.801984] nix-grpc-daemon[1456]: time=2026-09-20T10:52:49.387Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 118.844704] niks3-server[998]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv lb # [ 118.859607] niks3-server[998]: 2026/09/20 10:52:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign worker1 # [ 118.865254] nix-grpc-daemon[1456]: time=2026-09-20T10:52:49.452Z level=INFO msg="Uploading 1 narinfos" lb # [ 118.870297] niks3-server[998]: 2026/09/20 10:52:49 INFO Signed narinfos id=36 count=1 lb # [ 118.877837] niks3-server[998]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls lb # [ 118.889973] niks3-server[998]: 2026/09/20 10:52:49 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 118.902451] niks3-server[998]: 2026/09/20 10:52:49 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 118.911485] niks3-server[998]: 2026/09/20 10:52:49 INFO Completed upload id=36 worker1 # [ 118.914914] nix-grpc-daemon[1456]: time=2026-09-20T10:52:49.503Z level=INFO msg="Upload complete. (329ms)" worker1 # [ 118.928333] nix-grpc-daemon[1456]: time=2026-09-20T10:52:49.508Z level=WARN msg="Failed to register uploaded object" key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 118.944584] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44862 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 118.952270] nix-daemon[833]: reaped child process 1430, status = succeeded client # [ 119.055782] systemd[1]: mid.service: Deactivated successfully. client # [ 119.060264] systemd[1]: mid.service: Consumed 193ms CPU time over 10.138s wall clock time, 38.9M memory peak, 9.6K incoming IP traffic, 10.8K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.06 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.66 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 119.550717] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 455aae791f6b499a8a612d8be0cd2f4e client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.06 seconds) worker1 # [ 119.688746] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44862 client # [ 119.780708] nix[1234]: don't know how to build these paths: client # [ 119.782331] nix[1234]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 119.703708] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:50Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker2 # [ 119.709095] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:50Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 119.754095] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 119.769047] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 119.791975] nix-grpc-daemon[1431]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 1/5) worker2 # [ 119.852440] nix-grpc-daemon[1431]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 2/5) worker2 # [ 119.916909] nix-grpc-daemon[1431]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 383 ms (attempt 3/5) lb # [ 120.297986] envoy[916]: conn peer=[2001:db8:1::4]:42154 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=470 tx=226 ms=5370 lb # [ 120.303032] envoy[916]: conn peer=[2001:db8:1::1]:57220 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3884 tx=1677 ms=9851 worker2 # [ 120.307480] nix-grpc-daemon[1431]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 4/5) worker2 # [ 120.325591] nix-grpc-daemon[1431]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 120.347991] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34618 client # [ 120.455589] nix[1234]: copying 1 paths to 'lb:50051'... client # [ 120.462161] nix[1234]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker2 # [ 120.368102] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 120.382726] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 120.411063] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:51Z level=info event=niks3_push_started pid=1503 worker2 # [ 120.832280] nix-daemon[833]: accepted connection from pid 1516, user nix-grpc-daemon (trusted) worker2 # [ 120.853125] nix-daemon[833]: reaped child process 1523, status = succeeded worker2 # [ 121.033561] nix-daemon[833]: accepted connection from pid 1525, user nix-grpc-daemon (trusted) worker2 # [ 121.052000] nix-daemon[833]: reaped child process 1528, status = succeeded lb # [ 121.069217] niks3-server[998]: 2026/09/20 10:52:51 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 121.079831] nix-grpc-daemon[1503]: time=2026-09-20T10:52:51.684Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 121.081660] nix-grpc-daemon[1503]: time=2026-09-20T10:52:51.685Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 121.122386] niks3-server[998]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst worker2 # [ 121.127415] nix-grpc-daemon[1503]: time=2026-09-20T10:52:51.733Z level=INFO msg="Uploading 1 narinfos" lb # [ 121.134968] niks3-server[998]: 2026/09/20 10:52:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign lb # [ 121.146735] niks3-server[998]: 2026/09/20 10:52:51 INFO Signed narinfos id=37 count=1 lb # [ 121.152295] niks3-server[998]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 121.162892] niks3-server[998]: 2026/09/20 10:52:51 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete lb # [ 121.167715] niks3-server[998]: 2026/09/20 10:52:51 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo lb # [ 121.174703] niks3-server[998]: 2026/09/20 10:52:51 INFO Completed upload id=37 worker2 # [ 121.169971] nix-grpc-daemon[1503]: time=2026-09-20T10:52:51.776Z level=INFO msg="Upload complete. (529ms)" worker2 # [ 121.183046] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 121.200102] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 121.207637] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 121.214322] nix-daemon[833]: reaped child process 1501, status = succeeded client # [ 121.319962] nix[1234]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker2 # [ 121.230337] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) client: must succeed: systemctl kill -s INT intr client # [ 123.246282] systemd[1]: intr.service: Sent signal SIGINT to main process 1234 (nix) on client request. client # [ 123.254740] nix[1234]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client # [ 123.264092] nix[1234]: error: interrupted by the user client: (finished: must succeed: systemctl kill -s INT intr, in 0.08 seconds) client # [ 123.296262] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 123.300946] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 123.303024] systemd[1]: intr.service: Consumed 143ms CPU time over 3.748s wall clock time, 39.2M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic. worker2 # [ 123.260734] nix-daemon[1532]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 123.272995] nix-daemon[833]: reaped child process 1530, status = succeeded worker2 # [ 123.277657] nix-daemon[833]: reaped child process 1532, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.90 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 123.474841] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: c1d09e632463494eb6629ff747b07178 client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds) worker1 # [ 123.630814] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44862 client # [ 123.722971] nix[1253]: don't know how to build these paths: client # [ 123.723959] nix[1253]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 123.640626] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:54Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 123.646994] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:54Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 123.658716] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44862 worker1 # [ 123.674829] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44862 client # [ 123.772165] nix[1253]: copying 1 paths to 'lb:50051'... client # [ 123.774659] nix[1253]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 123.689552] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44862 worker1 # [ 123.704923] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted) worker1 # [ 123.914465] nix-daemon[833]: accepted connection from pid 1500, user nix-grpc-daemon (trusted) worker1 # [ 123.934366] nix-daemon[833]: reaped child process 1503, status = succeeded worker1 # [ 124.112981] nix-daemon[833]: accepted connection from pid 1505, user nix-grpc-daemon (trusted) worker1 # [ 124.131716] nix-daemon[833]: reaped child process 1508, status = succeeded lb # [ 124.139710] niks3-server[998]: 2026/09/20 10:52:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 124.155645] nix-grpc-daemon[1456]: time=2026-09-20T10:52:54.743Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 124.157297] nix-grpc-daemon[1456]: time=2026-09-20T10:52:54.743Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 124.178079] niks3-server[998]: 2026/09/20 10:52:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign worker1 # [ 124.189785] nix-grpc-daemon[1456]: time=2026-09-20T10:52:54.777Z level=INFO msg="Uploading 1 narinfos" lb # [ 124.190876] niks3-server[998]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker1 # [ 124.212037] nix-grpc-daemon[1456]: time=2026-09-20T10:52:54.800Z level=INFO msg="Upload complete. (490ms)" lb # [ 124.208298] niks3-server[998]: 2026/09/20 10:52:54 INFO Signed narinfos id=38 count=1 lb # [ 124.210907] niks3-server[998]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 124.215885] niks3-server[998]: 2026/09/20 10:52:54 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete worker1 # [ 124.219833] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44862 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 124.220926] niks3-server[998]: 2026/09/20 10:52:54 INFO Completed upload id=38 lb # [ 124.224429] niks3-server[998]: 2026/09/20 10:52:54 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo worker1 # [ 124.232114] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44862 worker1 # [ 124.238470] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted) worker1 # [ 124.242801] nix-daemon[833]: reaped child process 1498, status = succeeded worker1 # [ 124.253274] nix-daemon[833]: accepted connection from pid 1305, user nix-grpc-daemon (trusted) client # [ 124.336553] nix[1253]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 126.105733] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 126.160197] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.11 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker2 # [ 126.467336] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 126.474868] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 126.501440] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 126.508385] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 126.552939] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 126.568580] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34618 client # copying 1 paths to 'lb:50051'... worker2 # [ 126.584385] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker2 # [ 126.609207] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 126.811832] nix-daemon[833]: accepted connection from pid 1582, user nix-grpc-daemon (trusted) worker2 # [ 126.831357] nix-daemon[833]: reaped child process 1585, status = succeeded worker1 # [ 126.959759] nix-grpc-daemon[1305]: ts=2026-09-20T10:52:57Z level=info event=draining worker2 # [ 127.005361] nix-daemon[833]: accepted connection from pid 1587, user nix-grpc-daemon (trusted) worker2 # [ 127.025064] nix-daemon[833]: reaped child process 1590, status = succeeded lb # [ 127.042018] niks3-server[998]: 2026/09/20 10:52:57 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 127.047063] nix-grpc-daemon[1503]: time=2026-09-20T10:52:57.653Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 127.048653] nix-grpc-daemon[1503]: time=2026-09-20T10:52:57.653Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" lb # [ 127.075444] niks3-server[998]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst worker2 # [ 127.088298] nix-grpc-daemon[1503]: time=2026-09-20T10:52:57.694Z level=INFO msg="Uploading 1 narinfos" lb # [ 127.093075] niks3-server[998]: 2026/09/20 10:52:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 127.104198] niks3-server[998]: 2026/09/20 10:52:57 INFO Signed narinfos id=39 count=1 lb # [ 127.110336] niks3-server[998]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 127.119139] niks3-server[998]: 2026/09/20 10:52:57 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete worker2 # [ 127.119987] nix-grpc-daemon[1503]: time=2026-09-20T10:52:57.726Z level=INFO msg="Upload complete. (493ms)" lb # [ 127.126982] niks3-server[998]: 2026/09/20 10:52:57 INFO Completed upload id=39 lb # [ 127.130944] niks3-server[998]: 2026/09/20 10:52:57 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo worker2 # [ 127.128327] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 127.144315] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 127.150724] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 127.155821] nix-daemon[833]: reaped child process 1580, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... worker2 # [ 127.168246] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker2 # [ 127.789025] nix-daemon[833]: reaped child process 1594, status = succeeded client # farm-a> LOG-farm-a-during-drain worker2 # [ 127.955344] nix-daemon[833]: accepted connection from pid 1609, user nix-grpc-daemon (trusted) worker2 # [ 127.975895] nix-daemon[833]: reaped child process 1612, status = succeeded lb # [ 127.992676] niks3-server[998]: 2026/09/20 10:52:58 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 128.002991] nix-grpc-daemon[1503]: time=2026-09-20T10:52:58.606Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 128.005367] nix-grpc-daemon[1503]: time=2026-09-20T10:52:58.607Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 128.033864] niks3-server[998]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 128.041546] niks3-server[998]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 128.050479] niks3-server[998]: 2026/09/20 10:52:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign lb # [ 128.055239] niks3-server[998]: 2026/09/20 10:52:58 INFO Signed narinfos id=40 count=1 worker2 # [ 128.051192] nix-grpc-daemon[1503]: time=2026-09-20T10:52:58.656Z level=INFO msg="Uploading 1 narinfos" lb # [ 128.058669] niks3-server[998]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 128.068054] niks3-server[998]: 2026/09/20 10:52:58 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 128.072769] niks3-server[998]: 2026/09/20 10:52:58 INFO Completed upload id=40 worker2 # [ 128.067760] nix-grpc-daemon[1503]: time=2026-09-20T10:52:58.674Z level=INFO msg="Upload complete. (287ms)" lb # [ 128.074755] niks3-server[998]: 2026/09/20 10:52:58 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker2 # [ 128.080484] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker2 # [ 128.092343] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker2 # [ 128.095035] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 128.098315] nix-daemon[833]: reaped child process 1592, status = succeeded worker2 # [ 128.133184] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 128.148132] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 128.162747] nix-grpc-daemon[1503]: time=2026-09-20T10:52:58.769Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 128.173110] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker2 # [ 128.196181] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 128.401720] nix-daemon[833]: accepted connection from pid 1618, user nix-grpc-daemon (trusted) worker2 # [ 128.419583] nix-daemon[833]: reaped child process 1621, status = succeeded worker2 # [ 128.596155] nix-daemon[833]: accepted connection from pid 1623, user nix-grpc-daemon (trusted) worker2 # [ 128.619404] nix-daemon[833]: reaped child process 1626, status = succeeded lb # [ 128.633846] niks3-server[998]: 2026/09/20 10:52:59 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 128.642102] nix-grpc-daemon[1503]: time=2026-09-20T10:52:59.248Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 128.643622] nix-grpc-daemon[1503]: time=2026-09-20T10:52:59.248Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 128.666836] niks3-server[998]: 2026/09/20 10:52:59 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst worker2 # [ 128.675231] nix-grpc-daemon[1503]: time=2026-09-20T10:52:59.281Z level=INFO msg="Uploading 1 narinfos" lb # [ 128.682619] niks3-server[998]: 2026/09/20 10:52:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign lb # [ 128.693754] niks3-server[998]: 2026/09/20 10:52:59 INFO Signed narinfos id=41 count=1 lb # [ 128.702953] niks3-server[998]: 2026/09/20 10:52:59 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls worker2 # [ 128.702939] nix-grpc-daemon[1503]: time=2026-09-20T10:52:59.309Z level=INFO msg="Upload complete. (488ms)" lb # [ 128.708612] niks3-server[998]: 2026/09/20 10:52:59 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete lb # [ 128.713510] niks3-server[998]: 2026/09/20 10:52:59 INFO Completed upload id=41 lb # [ 128.716668] niks3-server[998]: 2026/09/20 10:52:59 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker2 # [ 128.712270] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 128.722981] nix-grpc-daemon[1431]: ts=2026-09-20T10:52:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 128.729604] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 128.734880] nix-daemon[833]: reaped child process 1616, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker2 # [ 128.749337] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 129.772149] nix-daemon[833]: reaped child process 1630, status = succeeded client # farm-b> LOG-farm-b-during-drain worker2 # [ 129.929828] nix-daemon[833]: accepted connection from pid 1645, user nix-grpc-daemon (trusted) worker2 # [ 129.949144] nix-daemon[833]: reaped child process 1648, status = succeeded lb # [ 129.970657] niks3-server[998]: 2026/09/20 10:53:00 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 129.976694] nix-grpc-daemon[1503]: time=2026-09-20T10:53:00.582Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 129.978215] nix-grpc-daemon[1503]: time=2026-09-20T10:53:00.582Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 130.005937] niks3-server[998]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 130.025817] niks3-server[998]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 130.034166] niks3-server[998]: 2026/09/20 10:53:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker2 # [ 130.033257] nix-grpc-daemon[1503]: time=2026-09-20T10:53:00.639Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.042559] niks3-server[998]: 2026/09/20 10:53:00 INFO Signed narinfos id=42 count=1 lb # [ 130.046886] niks3-server[998]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 130.054689] niks3-server[998]: 2026/09/20 10:53:00 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 130.061643] niks3-server[998]: 2026/09/20 10:53:00 INFO Completed upload id=42 worker2 # [ 130.056152] nix-grpc-daemon[1503]: time=2026-09-20T10:53:00.662Z level=INFO msg="Upload complete. (297ms)" lb # [ 130.064301] niks3-server[998]: 2026/09/20 10:53:00 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 130.073457] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker2 # [ 130.087348] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker2 # [ 130.091050] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 130.094740] nix-daemon[833]: reaped child process 1628, status = succeeded worker2 # [ 130.119398] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 130.141084] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 130.155110] nix-grpc-daemon[1503]: time=2026-09-20T10:53:00.761Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 130.165508] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker2 # [ 130.188614] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) lb # [ 130.299299] envoy[916]: conn peer=[2001:db8:1::1]:54240 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2944 tx=732 ms=3505 worker2 # [ 130.390319] nix-daemon[833]: accepted connection from pid 1654, user nix-grpc-daemon (trusted) worker2 # [ 130.411519] nix-daemon[833]: reaped child process 1657, status = succeeded worker2 # [ 130.584535] nix-daemon[833]: accepted connection from pid 1659, user nix-grpc-daemon (trusted) worker2 # [ 130.604726] nix-daemon[833]: reaped child process 1662, status = succeeded lb # [ 130.620954] niks3-server[998]: 2026/09/20 10:53:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 130.624062] nix-grpc-daemon[1503]: time=2026-09-20T10:53:01.230Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 130.625569] nix-grpc-daemon[1503]: time=2026-09-20T10:53:01.230Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 130.650049] niks3-server[998]: 2026/09/20 10:53:01 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst lb # [ 130.663908] niks3-server[998]: 2026/09/20 10:53:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign worker2 # [ 130.665820] nix-grpc-daemon[1503]: time=2026-09-20T10:53:01.272Z level=INFO msg="Uploading 1 narinfos" lb # [ 130.676685] niks3-server[998]: 2026/09/20 10:53:01 INFO Signed narinfos id=43 count=1 lb # [ 130.679603] niks3-server[998]: 2026/09/20 10:53:01 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 130.688197] niks3-server[998]: 2026/09/20 10:53:01 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete lb # [ 130.696738] niks3-server[998]: 2026/09/20 10:53:01 INFO Completed upload id=43 worker2 # [ 130.691733] nix-grpc-daemon[1503]: time=2026-09-20T10:53:01.298Z level=INFO msg="Upload complete. (485ms)" lb # [ 130.699797] niks3-server[998]: 2026/09/20 10:53:01 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker2 # [ 130.700358] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 130.708774] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 130.719121] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 130.726262] nix-daemon[833]: reaped child process 1652, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker2 # [ 130.736162] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv client # farm-top> LOG-farm-top-during-drain worker2 # [ 132.181531] nix-daemon[833]: reaped child process 1666, status = succeeded worker2 # [ 132.359785] nix-daemon[833]: accepted connection from pid 1681, user nix-grpc-daemon (trusted) worker2 # [ 132.377806] nix-daemon[833]: reaped child process 1684, status = succeeded lb # [ 132.396662] niks3-server[998]: 2026/09/20 10:53:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 132.403070] nix-grpc-daemon[1503]: time=2026-09-20T10:53:03.008Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 132.404661] nix-grpc-daemon[1503]: time=2026-09-20T10:53:03.008Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" worker2 # [ 132.444489] nix-grpc-daemon[1503]: time=2026-09-20T10:53:03.051Z level=INFO msg="Uploading 1 narinfos" lb # [ 132.438224] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 132.452443] niks3-server[998]: 2026/09/20 10:53:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign lb # [ 132.462027] niks3-server[998]: 2026/09/20 10:53:03 INFO Signed narinfos id=44 count=1 lb # [ 132.466537] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 132.470571] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls worker2 # [ 132.472771] nix-grpc-daemon[1503]: time=2026-09-20T10:53:03.079Z level=INFO msg="Upload complete. (324ms)" lb # [ 132.478246] niks3-server[998]: 2026/09/20 10:53:03 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 132.481960] niks3-server[998]: 2026/09/20 10:53:03 INFO Completed upload id=44 lb # [ 132.484856] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker2 # [ 132.484534] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker2 # [ 132.501358] nix-daemon[833]: reaped child process 1664, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.33 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.24 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 132.882629] nix-daemon[833]: reaped child process 1512, status = succeeded worker1 # [ 133.040989] nix-daemon[833]: accepted connection from pid 1552, user nix-grpc-daemon (trusted) worker1 # [ 133.060262] nix-daemon[833]: reaped child process 1555, status = succeeded lb # [ 133.067448] niks3-server[998]: 2026/09/20 10:53:03 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 133.081830] nix-grpc-daemon[1456]: time=2026-09-20T10:53:03.669Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 133.083319] nix-grpc-daemon[1456]: time=2026-09-20T10:53:03.669Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 133.106125] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker1 # [ 133.123147] nix-grpc-daemon[1456]: time=2026-09-20T10:53:03.710Z level=INFO msg="Uploading 1 narinfos" lb # [ 133.119645] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 133.130046] niks3-server[998]: 2026/09/20 10:53:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 133.135412] niks3-server[998]: 2026/09/20 10:53:03 INFO Signed narinfos id=45 count=1 worker1 # [ 133.144523] nix-grpc-daemon[1456]: time=2026-09-20T10:53:03.732Z level=INFO msg="Upload complete. (274ms)" lb # [ 133.140810] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 133.143574] niks3-server[998]: 2026/09/20 10:53:03 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 133.149568] niks3-server[998]: 2026/09/20 10:53:03 INFO Completed upload id=45 worker1 # [ 133.153701] nix-grpc-daemon[1305]: ts=2026-09-20T10:53:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44862 duration_s=8 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 lb # [ 133.152794] niks3-server[998]: 2026/09/20 10:53:03 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker1 # [ 133.166203] nix-daemon[833]: reaped child process 1510, status = succeeded client # [ 133.288650] systemd[1]: sw.service: Deactivated successfully. client # [ 133.293119] systemd[1]: sw.service: Consumed 158ms CPU time over 9.817s wall clock time, 37.1M memory peak, 8.4K incoming IP traffic, 8.8K outgoing IP traffic. worker1 # [ 133.962235] nix-grpc-daemon[1305]: ts=2026-09-20T10:53:04Z level=info event=signal_exit client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.06 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker2 # [ 135.195176] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34600 worker1 # [ 135.208800] nix-grpc-daemon[1305]: ts=2026-09-20T10:53:05Z level=info event=scheduler_restarting worker2 # [ 135.195581] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:05Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 135.232443] nix-grpc-daemon[1305]: ts=2026-09-20T10:53:05Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 135.259090] nix-daemon[833]: reaped child process 1361, status = succeeded worker1 # [ 135.439065] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 135.447003] systemd[1]: nix-grpc-daemon.service: Consumed 955ms CPU time over 40.710s wall clock time, 32.7M memory peak, 23.5K incoming IP traffic, 33.2K outgoing IP traffic. worker1 # [ 135.465856] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 135.660637] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 135.664058] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 135.672407] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 135.674117] systemd[1]: Started Nix worker-protocol over gRPC. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.68 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 135.726136] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:06Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 135.719091] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 12.61 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker2 # [ 136.175432] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34618 worker1 # [ 136.200617] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 136.214143] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 136.239189] nix-grpc-daemon[1569]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 3 ms (attempt 1/5) worker1 # [ 136.250030] nix-grpc-daemon[1569]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 146 ms (attempt 2/5) worker1 # [ 136.403607] nix-grpc-daemon[1569]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 224 ms (attempt 3/5) worker1 # [ 136.635256] nix-grpc-daemon[1569]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 354 ms (attempt 4/5) worker1 # [ 136.998671] nix-grpc-daemon[1569]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 137.042221] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:07Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker2 # [ 137.048364] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:07Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 137.054306] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:07Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker2 # [ 137.059558] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:07Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 137.097701] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 137.114935] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 137.130693] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 137.146241] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 137.175903] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:07Z level=info event=niks3_push_started pid=1625 worker1 # [ 137.563320] nix-daemon[833]: accepted connection from pid 1638, user nix-grpc-daemon (trusted) worker1 # [ 137.583762] nix-daemon[833]: reaped child process 1641, status = succeeded worker1 # [ 137.759793] nix-daemon[833]: accepted connection from pid 1643, user nix-grpc-daemon (trusted) worker1 # [ 137.776577] nix-daemon[833]: reaped child process 1646, status = succeeded lb # [ 137.790157] niks3-server[998]: 2026/09/20 10:53:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 137.803284] nix-grpc-daemon[1625]: time=2026-09-20T10:53:08.390Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 137.805045] nix-grpc-daemon[1625]: time=2026-09-20T10:53:08.390Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 137.842281] niks3-server[998]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst lb # [ 137.851828] niks3-server[998]: 2026/09/20 10:53:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign worker1 # [ 137.861293] nix-grpc-daemon[1625]: time=2026-09-20T10:53:08.449Z level=INFO msg="Uploading 1 narinfos" lb # [ 137.861526] niks3-server[998]: 2026/09/20 10:53:08 INFO Signed narinfos id=46 count=1 lb # [ 137.863880] niks3-server[998]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 137.874360] niks3-server[998]: 2026/09/20 10:53:08 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 137.881913] niks3-server[998]: 2026/09/20 10:53:08 INFO Completed upload id=46 worker1 # [ 137.886337] nix-grpc-daemon[1625]: time=2026-09-20T10:53:08.474Z level=INFO msg="Upload complete. (492ms)" lb # [ 137.884738] niks3-server[998]: 2026/09/20 10:53:08 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 137.896314] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 137.912328] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 137.919340] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 137.925040] nix-daemon[833]: reaped child process 1623, status = succeeded worker1 # [ 137.937168] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 139.173625] nix-daemon[833]: reaped child process 1650, status = succeeded worker1 # [ 139.339246] nix-daemon[833]: accepted connection from pid 1665, user nix-grpc-daemon (trusted) worker1 # [ 139.356549] nix-daemon[833]: reaped child process 1668, status = succeeded lb # [ 139.367915] niks3-server[998]: 2026/09/20 10:53:09 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 139.384443] nix-grpc-daemon[1625]: time=2026-09-20T10:53:09.970Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 139.385981] nix-grpc-daemon[1625]: time=2026-09-20T10:53:09.970Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 139.404466] niks3-server[998]: 2026/09/20 10:53:09 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 139.421571] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 139.433057] niks3-server[998]: 2026/09/20 10:53:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 139.443656] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.030Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.439351] niks3-server[998]: 2026/09/20 10:53:10 INFO Signed narinfos id=47 count=1 lb # [ 139.443513] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 139.453768] niks3-server[998]: 2026/09/20 10:53:10 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 139.460455] niks3-server[998]: 2026/09/20 10:53:10 INFO Completed upload id=47 worker1 # [ 139.464584] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.053Z level=INFO msg="Upload complete. (313ms)" lb # [ 139.462956] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker1 # [ 139.474366] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=1 worker2 # [ 139.467502] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:10Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 139.477600] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:10Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 139.492299] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 139.499029] nix-daemon[833]: reaped child process 1648, status = succeeded worker1 # [ 139.503087] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 139.511804] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 139.523314] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 139.712924] nix-daemon[833]: accepted connection from pid 1672, user nix-grpc-daemon (trusted) worker1 # [ 139.731505] nix-daemon[833]: reaped child process 1675, status = succeeded worker1 # [ 139.911427] nix-daemon[833]: accepted connection from pid 1677, user nix-grpc-daemon (trusted) worker1 # [ 139.930511] nix-daemon[833]: reaped child process 1680, status = succeeded lb # [ 139.938607] niks3-server[998]: 2026/09/20 10:53:10 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 139.952125] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.540Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 139.953632] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.540Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 139.970751] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst worker1 # [ 139.998320] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.586Z level=INFO msg="Uploading 1 narinfos" lb # [ 139.987945] niks3-server[998]: 2026/09/20 10:53:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign lb # [ 140.002403] niks3-server[998]: 2026/09/20 10:53:10 INFO Signed narinfos id=48 count=1 lb # [ 140.009400] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 140.019657] niks3-server[998]: 2026/09/20 10:53:10 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 140.024612] niks3-server[998]: 2026/09/20 10:53:10 INFO Completed upload id=48 worker1 # [ 140.028126] nix-grpc-daemon[1625]: time=2026-09-20T10:53:10.616Z level=INFO msg="Upload complete. (493ms)" lb # [ 140.027287] niks3-server[998]: 2026/09/20 10:53:10 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo worker1 # [ 140.036180] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 140.048859] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 140.058948] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 140.065206] nix-daemon[833]: reaped child process 1670, status = succeeded worker1 # [ 140.080392] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) lb # [ 140.300882] envoy[916]: conn peer=[2001:db8:1::1]:47864 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9638 tx=3894 ms=6040 lb # [ 140.305877] envoy[916]: conn peer=[2001:db8:1::1]:47862 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2922 tx=1309 ms=9545 lb # [ 140.310727] envoy[916]: conn peer=[2001:db8:1::3]:40708 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2392 tx=788 ms=40245 worker1 # [ 141.511367] nix-daemon[833]: reaped child process 1684, status = succeeded worker1 # [ 141.691171] nix-daemon[833]: accepted connection from pid 1699, user nix-grpc-daemon (trusted) worker1 # [ 141.710779] nix-daemon[833]: reaped child process 1702, status = succeeded lb # [ 141.719525] niks3-server[998]: 2026/09/20 10:53:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 141.734250] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.321Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 141.735809] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.321Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 141.756644] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst worker1 # [ 141.773345] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.361Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.769672] niks3-server[998]: 2026/09/20 10:53:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 141.785085] niks3-server[998]: 2026/09/20 10:53:12 INFO Signed narinfos id=49 count=1 lb # [ 141.787857] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 141.796864] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls lb # [ 141.805421] niks3-server[998]: 2026/09/20 10:53:12 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 141.810750] niks3-server[998]: 2026/09/20 10:53:12 INFO Completed upload id=49 worker1 # [ 141.814002] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.402Z level=INFO msg="Upload complete. (322ms)" lb # [ 141.815032] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker2 # [ 141.811816] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:12Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 141.825008] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=1 worker2 # [ 141.825048] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:12Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 141.841057] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 141.847134] nix-daemon[833]: reaped child process 1682, status = succeeded worker1 # [ 141.859698] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 141.873341] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 141.884991] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 142.074969] nix-daemon[833]: accepted connection from pid 1706, user nix-grpc-daemon (trusted) worker1 # [ 142.093552] nix-daemon[833]: reaped child process 1709, status = succeeded worker1 # [ 142.267553] nix-daemon[833]: accepted connection from pid 1711, user nix-grpc-daemon (trusted) worker1 # [ 142.285542] nix-daemon[833]: reaped child process 1714, status = succeeded lb # [ 142.294676] niks3-server[998]: 2026/09/20 10:53:12 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 142.307695] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.895Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 142.309375] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.895Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 142.323006] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst lb # [ 142.336327] niks3-server[998]: 2026/09/20 10:53:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign worker1 # [ 142.346886] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.935Z level=INFO msg="Uploading 1 narinfos" lb # [ 142.347242] niks3-server[998]: 2026/09/20 10:53:12 INFO Signed narinfos id=50 count=1 lb # [ 142.353089] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls lb # [ 142.361247] niks3-server[998]: 2026/09/20 10:53:12 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 142.367570] niks3-server[998]: 2026/09/20 10:53:12 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo lb # [ 142.372395] niks3-server[998]: 2026/09/20 10:53:12 INFO Completed upload id=50 worker1 # [ 142.376642] nix-grpc-daemon[1625]: time=2026-09-20T10:53:12.965Z level=INFO msg="Upload complete. (478ms)" worker1 # [ 142.384882] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 142.399509] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 142.405770] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 142.410668] nix-daemon[833]: reaped child process 1704, status = succeeded worker1 # [ 142.424205] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 143.665577] nix-daemon[833]: reaped child process 1718, status = succeeded worker1 # [ 143.849989] nix-daemon[833]: accepted connection from pid 1733, user nix-grpc-daemon (trusted) worker1 # [ 143.867443] nix-daemon[833]: reaped child process 1736, status = succeeded lb # [ 143.875947] niks3-server[998]: 2026/09/20 10:53:14 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 143.890587] nix-grpc-daemon[1625]: time=2026-09-20T10:53:14.477Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 143.892196] nix-grpc-daemon[1625]: time=2026-09-20T10:53:14.477Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 143.912377] niks3-server[998]: 2026/09/20 10:53:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 143.927723] nix-grpc-daemon[1625]: time=2026-09-20T10:53:14.515Z level=INFO msg="Uploading 1 narinfos" lb # [ 143.933379] niks3-server[998]: 2026/09/20 10:53:14 INFO Signed narinfos id=51 count=1 lb # [ 143.941051] niks3-server[998]: 2026/09/20 10:53:14 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst worker1 # [ 143.957426] nix-grpc-daemon[1625]: time=2026-09-20T10:53:14.545Z level=INFO msg="Upload complete. (322ms)" lb # [ 143.954957] niks3-server[998]: 2026/09/20 10:53:14 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 143.959239] niks3-server[998]: 2026/09/20 10:53:14 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 143.963419] niks3-server[998]: 2026/09/20 10:53:14 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete worker2 # [ 143.956130] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:14Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 lb # [ 143.966618] niks3-server[998]: 2026/09/20 10:53:14 INFO Completed upload id=51 worker1 # [ 143.968919] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=1 lb # [ 143.968828] niks3-server[998]: 2026/09/20 10:53:14 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker2 # [ 143.970211] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:14Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 143.983190] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 143.987891] nix-daemon[833]: reaped child process 1716, status = succeeded worker1 # [ 143.995046] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 144.006614] nix-grpc-daemon[1625]: time=2026-09-20T10:53:14.595Z level=INFO msg="All 1 paths already cached" worker1 # [ 144.014121] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 144.024913] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 144.213016] nix-daemon[833]: accepted connection from pid 1740, user nix-grpc-daemon (trusted) worker1 # [ 144.231676] nix-daemon[833]: reaped child process 1743, status = succeeded worker1 # [ 144.403830] nix-daemon[833]: accepted connection from pid 1745, user nix-grpc-daemon (trusted) worker1 # [ 144.421482] nix-daemon[833]: reaped child process 1748, status = succeeded lb # [ 144.430634] niks3-server[998]: 2026/09/20 10:53:15 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 144.445080] nix-grpc-daemon[1625]: time=2026-09-20T10:53:15.033Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 144.446566] nix-grpc-daemon[1625]: time=2026-09-20T10:53:15.033Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 144.458915] niks3-server[998]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 144.476490] nix-grpc-daemon[1625]: time=2026-09-20T10:53:15.064Z level=INFO msg="Uploading 1 narinfos" lb # [ 144.473847] niks3-server[998]: 2026/09/20 10:53:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 144.484366] niks3-server[998]: 2026/09/20 10:53:15 INFO Signed narinfos id=52 count=1 lb # [ 144.487084] niks3-server[998]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls lb # [ 144.496541] niks3-server[998]: 2026/09/20 10:53:15 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 144.502863] niks3-server[998]: 2026/09/20 10:53:15 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo lb # [ 144.507919] niks3-server[998]: 2026/09/20 10:53:15 INFO Completed upload id=52 worker1 # [ 144.512167] nix-grpc-daemon[1625]: time=2026-09-20T10:53:15.100Z level=INFO msg="Upload complete. (474ms)" worker1 # [ 144.520753] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 144.534352] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 144.540408] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 144.545402] nix-daemon[833]: reaped child process 1738, status = succeeded worker1 # [ 144.559021] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 145.605763] nix-daemon[833]: reaped child process 1752, status = succeeded worker1 # [ 145.792062] nix-daemon[833]: accepted connection from pid 1767, user nix-grpc-daemon (trusted) worker1 # [ 145.811944] nix-daemon[833]: reaped child process 1770, status = succeeded lb # [ 145.821905] niks3-server[998]: 2026/09/20 10:53:16 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 145.834059] nix-grpc-daemon[1625]: time=2026-09-20T10:53:16.422Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 145.838278] nix-grpc-daemon[1625]: time=2026-09-20T10:53:16.424Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 145.859732] niks3-server[998]: 2026/09/20 10:53:16 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 145.872894] niks3-server[998]: 2026/09/20 10:53:16 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 145.883136] niks3-server[998]: 2026/09/20 10:53:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker1 # [ 145.892661] nix-grpc-daemon[1625]: time=2026-09-20T10:53:16.480Z level=INFO msg="Uploading 1 narinfos" lb # [ 145.890498] niks3-server[998]: 2026/09/20 10:53:16 INFO Signed narinfos id=53 count=1 lb # [ 145.896628] niks3-server[998]: 2026/09/20 10:53:16 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 145.907586] niks3-server[998]: 2026/09/20 10:53:16 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 145.913034] niks3-server[998]: 2026/09/20 10:53:16 INFO Completed upload id=53 worker1 # [ 145.917215] nix-grpc-daemon[1625]: time=2026-09-20T10:53:16.505Z level=INFO msg="Upload complete. (347ms)" lb # [ 145.915721] niks3-server[998]: 2026/09/20 10:53:16 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker2 # [ 145.917189] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:16Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 145.930625] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=1 worker2 # [ 145.929969] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:16Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 145.948301] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 145.958734] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 145.964450] nix-daemon[833]: reaped child process 1750, status = succeeded worker1 # [ 145.971559] nix-grpc-daemon[1625]: time=2026-09-20T10:53:16.559Z level=INFO msg="All 1 paths already cached" worker1 # [ 145.980696] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 145.994000] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 146.189199] nix-daemon[833]: accepted connection from pid 1774, user nix-grpc-daemon (trusted) worker1 # [ 146.208992] nix-daemon[833]: reaped child process 1777, status = succeeded worker1 # [ 146.383762] nix-daemon[833]: accepted connection from pid 1779, user nix-grpc-daemon (trusted) worker1 # [ 146.400267] nix-daemon[833]: reaped child process 1782, status = succeeded lb # [ 146.410256] niks3-server[998]: 2026/09/20 10:53:17 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 146.435100] nix-grpc-daemon[1625]: time=2026-09-20T10:53:17.023Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 146.436708] nix-grpc-daemon[1625]: time=2026-09-20T10:53:17.023Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 146.452402] niks3-server[998]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst worker1 # [ 146.469547] nix-grpc-daemon[1625]: time=2026-09-20T10:53:17.057Z level=INFO msg="Uploading 1 narinfos" lb # [ 146.466707] niks3-server[998]: 2026/09/20 10:53:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 146.481410] niks3-server[998]: 2026/09/20 10:53:17 INFO Signed narinfos id=54 count=1 lb # [ 146.488307] niks3-server[998]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls lb # [ 146.497899] niks3-server[998]: 2026/09/20 10:53:17 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 146.502891] niks3-server[998]: 2026/09/20 10:53:17 INFO Completed upload id=54 lb # [ 146.505930] niks3-server[998]: 2026/09/20 10:53:17 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 146.506622] nix-grpc-daemon[1625]: time=2026-09-20T10:53:17.095Z level=INFO msg="Upload complete. (498ms)" worker1 # [ 146.516471] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 146.532487] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 146.540765] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 146.547729] nix-daemon[833]: reaped child process 1772, status = succeeded worker1 # [ 146.559845] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 147.608939] nix-daemon[833]: reaped child process 1786, status = succeeded worker1 # [ 147.777376] nix-daemon[833]: accepted connection from pid 1801, user nix-grpc-daemon (trusted) worker1 # [ 147.796817] nix-daemon[833]: reaped child process 1804, status = succeeded lb # [ 147.805068] niks3-server[998]: 2026/09/20 10:53:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.820434] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.406Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 147.822141] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.406Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 147.850515] niks3-server[998]: 2026/09/20 10:53:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 147.862126] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.450Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.862951] niks3-server[998]: 2026/09/20 10:53:18 INFO Signed narinfos id=55 count=1 lb # [ 147.870815] niks3-server[998]: 2026/09/20 10:53:18 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 147.882341] niks3-server[998]: 2026/09/20 10:53:18 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 147.887187] niks3-server[998]: 2026/09/20 10:53:18 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 147.890687] niks3-server[998]: 2026/09/20 10:53:18 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls lb # [ 147.896075] niks3-server[998]: 2026/09/20 10:53:18 INFO Completed upload id=55 worker1 # [ 147.900051] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.488Z level=INFO msg="Upload complete. (326ms)" lb # [ 147.898586] niks3-server[998]: 2026/09/20 10:53:18 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker2 # [ 147.899231] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:18Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 147.907950] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:18Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 147.913299] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=1 worker1 # [ 147.932290] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 147.942213] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 147.947534] nix-daemon[833]: reaped child process 1784, status = succeeded worker1 # [ 147.955343] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.543Z level=INFO msg="All 1 paths already cached" worker1 # [ 147.963008] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 147.975202] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 148.171004] nix-daemon[833]: accepted connection from pid 1808, user nix-grpc-daemon (trusted) worker1 # [ 148.191734] nix-daemon[833]: reaped child process 1811, status = succeeded worker1 # [ 148.368115] nix-daemon[833]: accepted connection from pid 1813, user nix-grpc-daemon (trusted) worker1 # [ 148.385276] nix-daemon[833]: reaped child process 1816, status = succeeded lb # [ 148.394330] niks3-server[998]: 2026/09/20 10:53:18 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.407390] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.995Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 148.409015] nix-grpc-daemon[1625]: time=2026-09-20T10:53:18.995Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 148.422024] niks3-server[998]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst worker1 # [ 148.440242] nix-grpc-daemon[1625]: time=2026-09-20T10:53:19.028Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.440176] niks3-server[998]: 2026/09/20 10:53:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign lb # [ 148.449679] niks3-server[998]: 2026/09/20 10:53:19 INFO Signed narinfos id=56 count=1 lb # [ 148.455241] niks3-server[998]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls worker1 # [ 148.465793] nix-grpc-daemon[1625]: time=2026-09-20T10:53:19.054Z level=INFO msg="Upload complete. (476ms)" lb # [ 148.464149] niks3-server[998]: 2026/09/20 10:53:19 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete worker1 # [ 148.472109] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 148.469601] niks3-server[998]: 2026/09/20 10:53:19 INFO Completed upload id=56 lb # [ 148.473076] niks3-server[998]: 2026/09/20 10:53:19 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 148.480770] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 148.490315] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 148.494679] nix-daemon[833]: reaped child process 1806, status = succeeded worker1 # [ 148.507276] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 149.927975] nix-daemon[833]: reaped child process 1820, status = succeeded worker1 # [ 150.084112] nix-daemon[833]: accepted connection from pid 1835, user nix-grpc-daemon (trusted) worker1 # [ 150.103912] nix-daemon[833]: reaped child process 1838, status = succeeded lb # [ 150.113402] niks3-server[998]: 2026/09/20 10:53:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.128401] nix-grpc-daemon[1625]: time=2026-09-20T10:53:20.715Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 150.129888] nix-grpc-daemon[1625]: time=2026-09-20T10:53:20.715Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 150.155499] niks3-server[998]: 2026/09/20 10:53:20 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 150.166857] niks3-server[998]: 2026/09/20 10:53:20 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 150.178849] niks3-server[998]: 2026/09/20 10:53:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 150.188351] nix-grpc-daemon[1625]: time=2026-09-20T10:53:20.776Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.185677] niks3-server[998]: 2026/09/20 10:53:20 INFO Signed narinfos id=57 count=1 lb # [ 150.191541] niks3-server[998]: 2026/09/20 10:53:20 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 150.200199] niks3-server[998]: 2026/09/20 10:53:20 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 150.208328] niks3-server[998]: 2026/09/20 10:53:20 INFO Completed upload id=57 worker1 # [ 150.211023] nix-grpc-daemon[1625]: time=2026-09-20T10:53:20.799Z level=INFO msg="Upload complete. (294ms)" lb # [ 150.211145] niks3-server[998]: 2026/09/20 10:53:20 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker2 # [ 150.213277] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:20Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 150.221068] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=1 worker2 # [ 150.226927] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:20Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 150.240303] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 150.249760] nix-daemon[833]: reaped child process 1818, status = succeeded worker1 # [ 150.253609] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 150.265794] nix-grpc-daemon[1625]: time=2026-09-20T10:53:20.854Z level=INFO msg="All 2 paths already cached" worker1 # [ 150.274307] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 150.286116] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 150.474133] nix-daemon[833]: accepted connection from pid 1842, user nix-grpc-daemon (trusted) worker1 # [ 150.493458] nix-daemon[833]: reaped child process 1845, status = succeeded worker1 # [ 150.668106] nix-daemon[833]: accepted connection from pid 1847, user nix-grpc-daemon (trusted) worker1 # [ 150.685091] nix-daemon[833]: reaped child process 1850, status = succeeded lb # [ 150.694820] niks3-server[998]: 2026/09/20 10:53:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.708503] nix-grpc-daemon[1625]: time=2026-09-20T10:53:21.296Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 150.710003] nix-grpc-daemon[1625]: time=2026-09-20T10:53:21.296Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 150.722844] niks3-server[998]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst worker1 # [ 150.740608] nix-grpc-daemon[1625]: time=2026-09-20T10:53:21.328Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.740594] niks3-server[998]: 2026/09/20 10:53:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign lb # [ 150.751008] niks3-server[998]: 2026/09/20 10:53:21 INFO Signed narinfos id=58 count=1 lb # [ 150.755849] niks3-server[998]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls worker1 # [ 150.768644] nix-grpc-daemon[1625]: time=2026-09-20T10:53:21.357Z level=INFO msg="Upload complete. (469ms)" lb # [ 150.764464] niks3-server[998]: 2026/09/20 10:53:21 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 150.770453] niks3-server[998]: 2026/09/20 10:53:21 INFO Completed upload id=58 worker1 # [ 150.774603] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 150.773782] niks3-server[998]: 2026/09/20 10:53:21 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo worker1 # [ 150.787777] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 150.794579] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 150.799285] nix-daemon[833]: reaped child process 1840, status = succeeded worker1 # [ 150.813103] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 151.833840] nix-daemon[833]: reaped child process 1854, status = succeeded worker1 # [ 151.987564] nix-daemon[833]: accepted connection from pid 1869, user nix-grpc-daemon (trusted) worker1 # [ 152.007688] nix-daemon[833]: reaped child process 1872, status = succeeded lb # [ 152.017650] niks3-server[998]: 2026/09/20 10:53:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.026809] nix-grpc-daemon[1625]: time=2026-09-20T10:53:22.614Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 152.032682] nix-grpc-daemon[1625]: time=2026-09-20T10:53:22.616Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 152.051222] niks3-server[998]: 2026/09/20 10:53:22 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 152.066883] niks3-server[998]: 2026/09/20 10:53:22 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst lb # [ 152.079347] niks3-server[998]: 2026/09/20 10:53:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign worker1 # [ 152.089065] nix-grpc-daemon[1625]: time=2026-09-20T10:53:22.677Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.087907] niks3-server[998]: 2026/09/20 10:53:22 INFO Signed narinfos id=59 count=1 lb # [ 152.092949] niks3-server[998]: 2026/09/20 10:53:22 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 152.101866] niks3-server[998]: 2026/09/20 10:53:22 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 152.107946] niks3-server[998]: 2026/09/20 10:53:22 INFO Completed upload id=59 lb # [ 152.110595] niks3-server[998]: 2026/09/20 10:53:22 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker1 # [ 152.110973] nix-grpc-daemon[1625]: time=2026-09-20T10:53:22.699Z level=INFO msg="Upload complete. (289ms)" worker2 # [ 152.112384] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:22Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 152.122399] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=1 worker1 # [ 152.140393] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 152.146929] nix-daemon[833]: reaped child process 1852, status = succeeded worker1 # [ 152.151196] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 152.160206] nix-grpc-daemon[1625]: time=2026-09-20T10:53:22.748Z level=INFO msg="All 2 paths already cached" worker1 # [ 152.167940] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 152.179119] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 152.365751] nix-daemon[833]: accepted connection from pid 1876, user nix-grpc-daemon (trusted) worker1 # [ 152.385362] nix-daemon[833]: reaped child process 1879, status = succeeded worker1 # [ 152.558822] nix-daemon[833]: accepted connection from pid 1881, user nix-grpc-daemon (trusted) worker1 # [ 152.578025] nix-daemon[833]: reaped child process 1884, status = succeeded lb # [ 152.586325] niks3-server[998]: 2026/09/20 10:53:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.600860] nix-grpc-daemon[1625]: time=2026-09-20T10:53:23.189Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 152.602385] nix-grpc-daemon[1625]: time=2026-09-20T10:53:23.189Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 152.615750] niks3-server[998]: 2026/09/20 10:53:23 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst worker1 # [ 152.633358] nix-grpc-daemon[1625]: time=2026-09-20T10:53:23.221Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.631854] niks3-server[998]: 2026/09/20 10:53:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign lb # [ 152.642191] niks3-server[998]: 2026/09/20 10:53:23 INFO Signed narinfos id=60 count=1 lb # [ 152.651486] niks3-server[998]: 2026/09/20 10:53:23 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls worker1 # [ 152.660641] nix-grpc-daemon[1625]: time=2026-09-20T10:53:23.249Z level=INFO msg="Upload complete. (468ms)" lb # [ 152.657095] niks3-server[998]: 2026/09/20 10:53:23 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 152.661610] niks3-server[998]: 2026/09/20 10:53:23 INFO Completed upload id=60 lb # [ 152.664189] niks3-server[998]: 2026/09/20 10:53:23 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo worker1 # [ 152.668719] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 152.679799] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 152.685892] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 152.690895] nix-daemon[833]: reaped child process 1874, status = succeeded worker1 # [ 152.702794] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 153.723963] nix-daemon[833]: reaped child process 1888, status = succeeded worker1 # [ 153.880485] nix-daemon[833]: accepted connection from pid 1903, user nix-grpc-daemon (trusted) worker1 # [ 153.900106] nix-daemon[833]: reaped child process 1906, status = succeeded lb # [ 153.908800] niks3-server[998]: 2026/09/20 10:53:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.923271] nix-grpc-daemon[1625]: time=2026-09-20T10:53:24.510Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 153.924880] nix-grpc-daemon[1625]: time=2026-09-20T10:53:24.510Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 153.945091] niks3-server[998]: 2026/09/20 10:53:24 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 153.957667] niks3-server[998]: 2026/09/20 10:53:24 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker1 # [ 153.970640] nix-grpc-daemon[1625]: time=2026-09-20T10:53:24.558Z level=INFO msg="Uploading 1 narinfos" lb # [ 153.969777] niks3-server[998]: 2026/09/20 10:53:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign lb # [ 153.976942] niks3-server[998]: 2026/09/20 10:53:24 INFO Signed narinfos id=61 count=1 lb # [ 153.979091] niks3-server[998]: 2026/09/20 10:53:24 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 153.985857] niks3-server[998]: 2026/09/20 10:53:24 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 153.990458] niks3-server[998]: 2026/09/20 10:53:24 INFO Completed upload id=61 worker1 # [ 153.994685] nix-grpc-daemon[1625]: time=2026-09-20T10:53:24.583Z level=INFO msg="Upload complete. (283ms)" lb # [ 153.992870] niks3-server[998]: 2026/09/20 10:53:24 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker2 # [ 153.994088] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:24Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 154.008601] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=1 worker1 # [ 154.019750] nix-daemon[833]: reaped child process 1886, status = succeeded worker1 # [ 154.048694] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 154.064511] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 154.078885] nix-grpc-daemon[1625]: time=2026-09-20T10:53:24.667Z level=INFO msg="All 2 paths already cached" worker1 # [ 154.088106] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 154.101868] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 154.297708] nix-daemon[833]: accepted connection from pid 1910, user nix-grpc-daemon (trusted) worker1 # [ 154.316682] nix-daemon[833]: reaped child process 1913, status = succeeded worker1 # [ 154.491300] nix-daemon[833]: accepted connection from pid 1915, user nix-grpc-daemon (trusted) worker1 # [ 154.511059] nix-daemon[833]: reaped child process 1918, status = succeeded lb # [ 154.518204] niks3-server[998]: 2026/09/20 10:53:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.531146] nix-grpc-daemon[1625]: time=2026-09-20T10:53:25.119Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 154.532740] nix-grpc-daemon[1625]: time=2026-09-20T10:53:25.119Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 154.548865] niks3-server[998]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 154.567067] nix-grpc-daemon[1625]: time=2026-09-20T10:53:25.155Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.566522] niks3-server[998]: 2026/09/20 10:53:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 154.576304] niks3-server[998]: 2026/09/20 10:53:25 INFO Signed narinfos id=62 count=1 lb # [ 154.581815] niks3-server[998]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls worker1 # [ 154.593269] nix-grpc-daemon[1625]: time=2026-09-20T10:53:25.181Z level=INFO msg="Upload complete. (475ms)" lb # [ 154.591093] niks3-server[998]: 2026/09/20 10:53:25 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 154.597400] niks3-server[998]: 2026/09/20 10:53:25 INFO Completed upload id=62 lb # [ 154.600874] niks3-server[998]: 2026/09/20 10:53:25 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 154.600302] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 154.613799] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 worker1 # [ 154.622922] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 154.625170] nix-daemon[833]: reaped child process 1908, status = succeeded worker1 # [ 154.638327] nix-daemon[833]: accepted connection from pid 1569, user nix-grpc-daemon (trusted) worker1 # [ 155.659297] nix-daemon[833]: reaped child process 1922, status = succeeded worker1 # [ 155.813363] nix-daemon[833]: accepted connection from pid 1937, user nix-grpc-daemon (trusted) worker1 # [ 155.832646] nix-daemon[833]: reaped child process 1940, status = succeeded lb # [ 155.846182] niks3-server[998]: 2026/09/20 10:53:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 155.860404] nix-grpc-daemon[1625]: time=2026-09-20T10:53:26.447Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 155.861857] nix-grpc-daemon[1625]: time=2026-09-20T10:53:26.447Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 155.882966] niks3-server[998]: 2026/09/20 10:53:26 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv lb # [ 155.899015] niks3-server[998]: 2026/09/20 10:53:26 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 155.910940] niks3-server[998]: 2026/09/20 10:53:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign worker1 # [ 155.919340] nix-grpc-daemon[1625]: time=2026-09-20T10:53:26.507Z level=INFO msg="Uploading 1 narinfos" lb # [ 155.918351] niks3-server[998]: 2026/09/20 10:53:26 INFO Signed narinfos id=63 count=1 lb # [ 155.922774] niks3-server[998]: 2026/09/20 10:53:26 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 155.928589] niks3-server[998]: 2026/09/20 10:53:26 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 155.934615] niks3-server[998]: 2026/09/20 10:53:26 INFO Completed upload id=63 worker1 # [ 155.938109] nix-grpc-daemon[1625]: time=2026-09-20T10:53:26.526Z level=INFO msg="Upload complete. (291ms)" lb # [ 155.936960] niks3-server[998]: 2026/09/20 10:53:26 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 155.949077] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53350 duration_s=1 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=1 worker1 # [ 155.965686] nix-daemon[833]: reaped child process 1920, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 20.09 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1 worker2 # [ 156.337400] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34618 worker1 # [ 156.357266] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:53350 worker2 # [ 156.374148] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:26Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.32 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 20.49 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.10 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 157.697881] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:28Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker1 # [ 158.888516] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:53350 worker2 # [ 158.883226] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 158.913106] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 158.920447] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 158.959408] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 158.976074] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34618 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 158.993106] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 159.008186] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 159.215827] nix-daemon[833]: accepted connection from pid 1709, user nix-grpc-daemon (trusted) worker2 # [ 159.232821] nix-daemon[833]: reaped child process 1712, status = succeeded worker2 # [ 159.413766] nix-daemon[833]: accepted connection from pid 1714, user nix-grpc-daemon (trusted) worker2 # [ 159.433819] nix-daemon[833]: reaped child process 1717, status = succeeded lb # [ 159.451242] niks3-server[998]: 2026/09/20 10:53:30 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 159.459575] nix-grpc-daemon[1503]: time=2026-09-20T10:53:30.065Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 159.461293] nix-grpc-daemon[1503]: time=2026-09-20T10:53:30.065Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 159.486649] niks3-server[998]: 2026/09/20 10:53:30 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst lb # [ 159.499257] niks3-server[998]: 2026/09/20 10:53:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign worker2 # [ 159.501262] nix-grpc-daemon[1503]: time=2026-09-20T10:53:30.107Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.510783] niks3-server[998]: 2026/09/20 10:53:30 INFO Signed narinfos id=64 count=1 lb # [ 159.516460] niks3-server[998]: 2026/09/20 10:53:30 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 159.527953] niks3-server[998]: 2026/09/20 10:53:30 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 159.533431] niks3-server[998]: 2026/09/20 10:53:30 INFO Completed upload id=64 worker2 # [ 159.528423] nix-grpc-daemon[1503]: time=2026-09-20T10:53:30.135Z level=INFO msg="Upload complete. (503ms)" lb # [ 159.536281] niks3-server[998]: 2026/09/20 10:53:30 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 159.535722] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 159.551401] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 159.560443] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 159.565776] nix-daemon[833]: reaped child process 1707, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 159.580260] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) lb # [ 160.301252] envoy[916]: conn peer=[2001:db8:1::1]:45092 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27131 tx=10789 ms=19780 client # farm-a> LOG-farm-a-drain worker2 # [ 160.609820] nix-daemon[833]: reaped child process 1721, status = succeeded worker2 # [ 160.774079] nix-daemon[833]: accepted connection from pid 1736, user nix-grpc-daemon (trusted) worker2 # [ 160.796236] nix-daemon[833]: reaped child process 1739, status = succeeded lb # [ 160.307566] envoy[916]: conn peer=[2001:db8:1::1]:54620 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=880 tx=483 ms=63 lb # [ 160.814082] niks3-server[998]: 2026/09/20 10:53:31 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 160.824432] nix-grpc-daemon[1503]: time=2026-09-20T10:53:31.429Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 160.826009] nix-grpc-daemon[1503]: time=2026-09-20T10:53:31.429Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 160.861290] niks3-server[998]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 160.874288] niks3-server[998]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 160.883819] niks3-server[998]: 2026/09/20 10:53:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 160.885230] nix-grpc-daemon[1503]: time=2026-09-20T10:53:31.491Z level=INFO msg="Uploading 1 narinfos" lb # [ 160.892871] niks3-server[998]: 2026/09/20 10:53:31 INFO Signed narinfos id=65 count=1 lb # [ 160.899374] niks3-server[998]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 160.909619] niks3-server[998]: 2026/09/20 10:53:31 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 160.915507] niks3-server[998]: 2026/09/20 10:53:31 INFO Completed upload id=65 worker2 # [ 160.909926] nix-grpc-daemon[1503]: time=2026-09-20T10:53:31.516Z level=INFO msg="Upload complete. (318ms)" lb # [ 160.918405] niks3-server[998]: 2026/09/20 10:53:31 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 160.927959] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=1 worker2 # [ 160.944145] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker2 # [ 160.948005] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 160.951866] nix-daemon[833]: reaped child process 1719, status = succeeded worker2 # [ 160.971302] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 160.986819] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 161.001256] nix-grpc-daemon[1503]: time=2026-09-20T10:53:31.608Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 161.011791] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 161.025707] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 161.235786] nix-daemon[833]: accepted connection from pid 1745, user nix-grpc-daemon (trusted) worker2 # [ 161.253104] nix-daemon[833]: reaped child process 1748, status = succeeded worker2 # [ 161.430254] nix-daemon[833]: accepted connection from pid 1750, user nix-grpc-daemon (trusted) worker2 # [ 161.447875] nix-daemon[833]: reaped child process 1753, status = succeeded lb # [ 161.465173] niks3-server[998]: 2026/09/20 10:53:32 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 161.469742] nix-grpc-daemon[1503]: time=2026-09-20T10:53:32.076Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 161.471275] nix-grpc-daemon[1503]: time=2026-09-20T10:53:32.076Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 161.492656] niks3-server[998]: 2026/09/20 10:53:32 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst lb # [ 161.506938] niks3-server[998]: 2026/09/20 10:53:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker2 # [ 161.507847] nix-grpc-daemon[1503]: time=2026-09-20T10:53:32.114Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.519878] niks3-server[998]: 2026/09/20 10:53:32 INFO Signed narinfos id=66 count=1 lb # [ 161.524993] niks3-server[998]: 2026/09/20 10:53:32 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 161.531921] niks3-server[998]: 2026/09/20 10:53:32 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete worker2 # [ 161.531359] nix-grpc-daemon[1503]: time=2026-09-20T10:53:32.138Z level=INFO msg="Upload complete. (489ms)" lb # [ 161.537190] niks3-server[998]: 2026/09/20 10:53:32 INFO Completed upload id=66 lb # [ 161.540788] niks3-server[998]: 2026/09/20 10:53:32 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo worker2 # [ 161.544357] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 161.554911] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 161.561740] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 161.566329] nix-daemon[833]: reaped child process 1743, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 161.578504] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 162.598040] nix-daemon[833]: reaped child process 1757, status = succeeded client # farm-b> LOG-farm-b-drain worker2 # [ 162.761125] nix-daemon[833]: accepted connection from pid 1772, user nix-grpc-daemon (trusted) worker2 # [ 162.778200] nix-daemon[833]: reaped child process 1775, status = succeeded lb # [ 162.799179] niks3-server[998]: 2026/09/20 10:53:33 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 162.804409] nix-grpc-daemon[1503]: time=2026-09-20T10:53:33.407Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 162.805949] nix-grpc-daemon[1503]: time=2026-09-20T10:53:33.407Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 162.830749] niks3-server[998]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 162.844585] niks3-server[998]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 162.854025] niks3-server[998]: 2026/09/20 10:53:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 162.854271] nix-grpc-daemon[1503]: time=2026-09-20T10:53:33.460Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.862932] niks3-server[998]: 2026/09/20 10:53:33 INFO Signed narinfos id=67 count=1 lb # [ 162.868236] niks3-server[998]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 162.875667] niks3-server[998]: 2026/09/20 10:53:33 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 162.882168] niks3-server[998]: 2026/09/20 10:53:33 INFO Completed upload id=67 worker2 # [ 162.877911] nix-grpc-daemon[1503]: time=2026-09-20T10:53:33.483Z level=INFO msg="Upload complete. (289ms)" lb # [ 162.884401] niks3-server[998]: 2026/09/20 10:53:33 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 162.892223] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=1 worker2 # [ 162.904674] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 162.908171] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 162.911506] nix-daemon[833]: reaped child process 1755, status = succeeded worker2 # [ 162.934715] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 162.949837] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 162.963161] nix-grpc-daemon[1503]: time=2026-09-20T10:53:33.569Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 162.973755] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 162.987406] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 163.186618] nix-daemon[833]: accepted connection from pid 1781, user nix-grpc-daemon (trusted) worker2 # [ 163.206426] nix-daemon[833]: reaped child process 1784, status = succeeded worker2 # [ 163.384401] nix-daemon[833]: accepted connection from pid 1786, user nix-grpc-daemon (trusted) worker2 # [ 163.402940] nix-daemon[833]: reaped child process 1789, status = succeeded lb # [ 163.419496] niks3-server[998]: 2026/09/20 10:53:34 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 163.424105] nix-grpc-daemon[1503]: time=2026-09-20T10:53:34.030Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 163.425587] nix-grpc-daemon[1503]: time=2026-09-20T10:53:34.030Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 163.452156] niks3-server[998]: 2026/09/20 10:53:34 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 163.468300] nix-grpc-daemon[1503]: time=2026-09-20T10:53:34.074Z level=INFO msg="Uploading 1 narinfos" lb # [ 163.467961] niks3-server[998]: 2026/09/20 10:53:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 163.480467] niks3-server[998]: 2026/09/20 10:53:34 INFO Signed narinfos id=68 count=1 lb # [ 163.485741] niks3-server[998]: 2026/09/20 10:53:34 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls lb # [ 163.493418] niks3-server[998]: 2026/09/20 10:53:34 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 163.498337] niks3-server[998]: 2026/09/20 10:53:34 INFO Completed upload id=68 worker2 # [ 163.493124] nix-grpc-daemon[1503]: time=2026-09-20T10:53:34.099Z level=INFO msg="Upload complete. (490ms)" lb # [ 163.501160] niks3-server[998]: 2026/09/20 10:53:34 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 163.500163] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 163.514445] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 worker2 # [ 163.521281] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker2 # [ 163.526993] nix-daemon[833]: reaped child process 1779, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... worker2 # [ 163.540209] nix-daemon[833]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv client # farm-top> LOG-farm-top-drain worker2 # [ 164.982266] nix-daemon[833]: reaped child process 1793, status = succeeded worker2 # [ 165.160629] nix-daemon[833]: accepted connection from pid 1808, user nix-grpc-daemon (trusted) worker2 # [ 165.176884] nix-daemon[833]: reaped child process 1811, status = succeeded lb # [ 165.197109] niks3-server[998]: 2026/09/20 10:53:35 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 165.204298] nix-grpc-daemon[1503]: time=2026-09-20T10:53:35.809Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 165.205931] nix-grpc-daemon[1503]: time=2026-09-20T10:53:35.809Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 165.228800] niks3-server[998]: 2026/09/20 10:53:35 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv lb # [ 165.246213] niks3-server[998]: 2026/09/20 10:53:35 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 165.259111] niks3-server[998]: 2026/09/20 10:53:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign worker2 # [ 165.260149] nix-grpc-daemon[1503]: time=2026-09-20T10:53:35.866Z level=INFO msg="Uploading 1 narinfos" lb # [ 165.269762] niks3-server[998]: 2026/09/20 10:53:35 INFO Signed narinfos id=69 count=1 lb # [ 165.275867] niks3-server[998]: 2026/09/20 10:53:35 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls worker2 # [ 165.278254] nix-grpc-daemon[1503]: time=2026-09-20T10:53:35.885Z level=INFO msg="Upload complete. (325ms)" lb # [ 165.284321] niks3-server[998]: 2026/09/20 10:53:35 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 165.290622] niks3-server[998]: 2026/09/20 10:53:35 INFO Completed upload id=69 lb # [ 165.294677] niks3-server[998]: 2026/09/20 10:53:35 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 165.293343] nix-grpc-daemon[1431]: ts=2026-09-20T10:53:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34618 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=1 worker2 # [ 165.310284] nix-daemon[833]: reaped child process 1791, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ca.pem&client-cert=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.pem&client-key=/nix/store/qnr217kg3abnw0irxipxjmff230hy3hd-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.71 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.23 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.15 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 166.709416] nix-grpc-daemon[1569]: ts=2026-09-20T10:53:37Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.11 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.52 seconds) (finished: run the VM test script, in 167.83 seconds) test script finished in 168.12s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.04 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh