tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm worker1 # Disk image does not exist, creating the virtualisation disk image... lb # Disk image does not exist, creating the virtualisation disk image... worker2 # Disk image does not exist, creating the virtualisation disk image... client: QEMU running (pid 49) lb: QEMU running (pid 50) worker1: QEMU running (pid 51) client # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 52) lb # Formatting '/build/vm-state-lb/tmp.E5uFvtwuku', fmt=raw size=1073741824 client # Formatting '/build/vm-state-client/tmp.FYRARm0Yff', fmt=raw size=1073741824 worker2 # Formatting '/build/vm-state-worker2/tmp.BsWXkj5nYl', fmt=raw size=1073741824 worker1 # Formatting '/build/vm-state-worker1/tmp.MYLEPhjQT0', fmt=raw size=1073741824 lb # mke2fs 1.47.4 (6-Mar-2025) (finished: start all VMs, in 0.54 seconds) worker1 # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/262144 done client: waiting for unit network-addresses-eth1.service worker1 # Discarding device blocks: 0/262144 done lb # Creating filesystem with 262144 4k blocks and 65536 inodes client: waiting for the VM to finish booting worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # Filesystem UUID: dc39a975-c708-411b-9408-140d620138b1 worker2 # mke2fs 1.47.4 (6-Mar-2025) client # mke2fs 1.47.4 (6-Mar-2025) worker1 # Filesystem UUID: a505a470-475f-4e3c-be79-dfe4ace5a1ec lb # Superblock backups stored on blocks: worker2 # Discarding device blocks: 0/262144 done client # Discarding device blocks: 0/262144 done worker1 # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376 worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes client # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # 32768, 98304, 163840, 229376 lb # worker2 # Filesystem UUID: d99f2033-5ec8-4d15-85ec-bb532d39d4c9 client # Filesystem UUID: f76c1d46-0987-4c81-bfb2-08ffb764ef4b worker1 # lb # Allocating group tables: 0/8 done worker2 # Superblock backups stored on blocks: client # Superblock backups stored on blocks: worker1 # Allocating group tables: 0/8 done lb # Writing inode tables: 0/8 done worker2 # 32768, 98304, 163840, 229376 client # 32768, 98304, 163840, 229376 worker1 # Writing inode tables: 0/8 done lb # Creating journal (8192 blocks): done worker2 # client # worker1 # Creating journal (8192 blocks): done lb # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Allocating group tables: 0/8 done client # Allocating group tables: 0/8 done client # Writing inode tables: 0/8 done worker1 # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Writing inode tables: 0/8 done client # Creating journal (8192 blocks): done lb # client # Writing superblocks and filesystem accounting information: 0/8 done lb # Virtualisation disk image created. worker2 # Creating journal (8192 blocks): done worker1 # worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # Virtualisation disk image created. worker2 # client # worker2 # Virtualisation disk image created. client # Virtualisation disk image created. worker1 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] KASLR enabled worker1 # [ 0.000000] random: crng init done worker1 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] efi: UEFI not found. worker1 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] Zone ranges: worker1 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] DMA32 empty worker1 # [ 0.000000] Normal empty worker1 # [ 0.000000] Device empty worker1 # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] Early memory node ranges worker1 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.000000] psci: PSCIv1.3 detected in firmware. worker1 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.000000] psci: SMC Calling Convention v1.1 worker1 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker1 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.000000] Detected PIPT I-cache on CPU0 worker1 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5vbszsyzv004gnsrdf7b2mfaix2sa0dq-nixos-system-worker1-test/init regInfo=/nix/store/w5mlawikgfxdl58sa9ysfv5h6mcrr1x6-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/w5mlawikgfxdl58sa9ysfv5h6mcrr1x6-closure-info/registration", will be passed to user space. worker1 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker1 # [ 0.000000] software IO TLB: area num 1. worker1 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker1 # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 worker1 # [ 0.000000] Policy zone: DMA worker1 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker1 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.000000] rcu: Hierarchical RCU implementation. worker1 # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. worker1 # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker1 # [ 0.000000] Rude variant of Tasks RCU enabled. worker1 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker2 # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker1 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] KASLR enabled worker2 # [ 0.000000] random: crng init done worker2 # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] efi: UEFI not found. lb # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] worker1 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] GICv3: 256 SPIs implemented lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] KASLR enabled worker2 # [ 0.000000] Zone ranges: lb # [ 0.000000] random: crng init done worker1 # [ 0.000000] Root IRQ handler: gic_handle_irq worker2 # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Machine model: linux,dummy-virt worker1 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] DMA32 empty lb # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] Normal empty worker1 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] Device empty lb # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 worker2 # [ 0.000000] Movable zone start for each node worker1 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000000] Early memory node ranges lb # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] Zone ranges: worker2 # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] lb # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 lb # [ 0.000000] DMA32 empty worker1 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) lb # [ 0.000000] Normal empty worker2 # [ 0.000000] psci: probing for conduit method from DT. lb # [ 0.000000] Device empty worker1 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Sep 7 15:23:00 UTC 2026 worker2 # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] Movable zone start for each node client # [ 0.000000] KASLR enabled worker1 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] Early memory node ranges client # [ 0.000000] random: crng init done worker2 # [ 0.000000] psci: Using standard PSCI v0.2 function IDs client # [ 0.000000] Machine model: linux,dummy-virt worker2 # [ 0.000000] psci: Trusted OS migration not required lb # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] efi: UEFI not found. worker2 # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] client # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT worker1 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns lb # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker2 # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x000000009fffffff] worker1 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). lb # [ 0.000000] psci: probing for conduit method from DT. worker2 # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 lb # [ 0.000000] psci: PSCIv1.3 detected in firmware. client # [ 0.000000] NODE_DATA(0) allocated [mem 0x9fdec700-0x9fdefe7f] worker2 # [ 0.000000] Detected PIPT I-cache on CPU0 client # [ 0.000000] Zone ranges: lb # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns client # [ 0.000000] DMA [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) lb # [ 0.000000] psci: Trusted OS migration not required client # [ 0.000000] DMA32 empty worker1 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns lb # [ 0.000000] psci: SMC Calling Convention v1.1 client # [ 0.000000] Normal empty worker2 # [ 0.000000] CPU features: detected: GICv3 CPU interface worker1 # [ 0.000041] arm-pv: using stolen time PV client # [ 0.000000] Device empty worker2 # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] Movable zone start for each node lb # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) worker2 # [ 0.000000] CPU features: detected: Spectre-BHB client # [ 0.000000] Early memory node ranges worker1 # [ 0.000947] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.001116] Console: colour dummy device 80x25 client # [ 0.000000] node 0: [mem 0x0000000040000000-0x000000009fffffff] lb # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.001124] printk: legacy console [tty0] enabled client # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x000000009fffffff] worker2 # [ 0.000000] alternatives: applying boot alternatives lb # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) client # [ 0.000000] cma: Reserved 32 MiB at 0x000000009c400000 worker1 # [ 0.001324] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000000] CPU features: detected: GICv3 CPU interface client # [ 0.000000] psci: probing for conduit method from DT. worker1 # [ 0.001330] pid_max: default: 32768 minimum: 301 lb # [ 0.000000] CPU features: detected: Spectre-v4 client # [ 0.000000] psci: PSCIv1.3 detected in firmware. lb # [ 0.000000] CPU features: detected: Spectre-BHB worker1 # [ 0.001406] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.000000] psci: Using standard PSCI v0.2 function IDs worker1 # [ 0.001613] landlock: Up and running. lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 client # [ 0.000000] psci: Trusted OS migration not required worker1 # [ 0.001615] Yama: becoming mindful. client # [ 0.000000] psci: SMC Calling Convention v1.1 lb # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.002520] LSM support for eBPF active worker2 # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6yvsrrlv2v3fnzjcmy4bw3slivzrwrqr-nixos-system-worker2-test/init regInfo=/nix/store/b8ic37vid8d5yxv85cz60grxwxgw2vyx-closure-info/registration console=ttyAMA0,115200n8 console=tty0 lb # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.002720] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) client # [ 0.000000] percpu: Embedded 76 pages/cpu s186648 r8192 d116456 u311296 worker1 # [ 0.002753] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000000] Detected PIPT I-cache on CPU0 worker2 # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/b8ic37vid8d5yxv85cz60grxwxgw2vyx-closure-info/registration", will be passed to user space. worker1 # [ 0.003861] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker1 # [ 0.004621] rcu: Hierarchical SRCU implementation. client # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) worker1 # [ 0.004625] rcu: Max phase no-delay instances is 1000. client # [ 0.000000] CPU features: detected: GICv3 CPU interface worker2 # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/7q1s737l14q4l5xb2660hk29x3d20j19-nixos-system-lb-test/init regInfo=/nix/store/cbbgdriybx566s3b1zm5jsl6z5kvfm7z-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker1 # [ 0.005798] fsl-mc MSI: its@8080000 domain created client # [ 0.000000] CPU features: detected: Spectre-v4 worker1 # [ 0.005883] EFI services will not be available. client # [ 0.000000] CPU features: detected: Spectre-BHB worker2 # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.005959] smp: Bringing up secondary CPUs ... client # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 worker1 # [ 0.005967] smp: Brought up 1 node, 1 CPU worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB client # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 worker1 # [ 0.005970] SMP: Total of 1 processors activated. lb # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/cbbgdriybx566s3b1zm5jsl6z5kvfm7z-closure-info/registration", will be passed to user space. worker2 # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] alternatives: applying boot alternatives worker1 # [ 0.005975] CPU: All CPU(s) started at EL1 lb # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker1 # [ 0.005987] CPU features: detected: Branch Target Identification lb # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.005992] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] Fallback order for Node 0: 0 lb # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.005995] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker2 # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB worker2 # [ 0.000000] Policy zone: DMA worker1 # [ 0.005999] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.000000] software IO TLB: area num 1. client # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/9b0ww2bi5z80fdwbhp6j472q7cahjy3h-nixos-system-client-test/init regInfo=/nix/store/sss4564bccwij88k7328qm31pya0512n-closure-info/registration console=ttyAMA0,115200n8 console=tty0 worker2 # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.006002] CPU features: detected: Common not Private translations lb # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB worker2 # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.006005] CPU features: detected: CRC32 instructions worker2 # [ 0.000000] allocated 3145728 bytes of page_ext lb # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) client # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/sss4564bccwij88k7328qm31pya0512n-closure-info/registration", will be passed to user space. worker1 # [ 0.006008] CPU features: detected: Data cache clean to Point of Deep Persistence lb # [ 0.000000] Fallback order for Node 0: 0 worker2 # [ 0.000000] ftrace: allocating 74885 entries in 294 pages client # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes worker2 # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.006012] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] Policy zone: DMA worker2 # [ 0.000000] rcu: Hierarchical RCU implementation. client # [ 0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker1 # [ 0.006015] CPU features: detected: Data independent timing control (DIT) worker2 # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.006017] CPU features: detected: E0PD lb # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker1 # [ 0.006020] CPU features: detected: Enhanced Counter Virtualization worker2 # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] allocated 3145728 bytes of page_ext worker1 # [ 0.006023] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker2 # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size adjusted to 1MB lb # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.006026] CPU features: detected: Enhanced Virtualization Traps client # [ 0.000000] software IO TLB: area num 1. lb # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker1 # [ 0.006029] CPU features: detected: Fine Grained Traps client # [ 0.000000] software IO TLB: SWIOTLB bounce buffer size roundup to 2MB lb # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.000000] rcu: RCU event tracing is enabled. worker1 # [ 0.006033] CPU features: detected: Generic authentication (architected QARMA5 algorithm) client # [ 0.000000] software IO TLB: mapped [mem 0x000000009c000000-0x000000009c200000] (2MB) worker2 # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. client # [ 0.000000] Fallback order for Node 0: 0 worker1 # [ 0.006037] CPU features: detected: RCpc load-acquire (LDAPR) lb # [ 0.000000] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.006040] CPU features: detected: LSE atomic instructions client # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 393216 lb # [ 0.000000] Rude variant of Tasks RCU enabled. client # [ 0.000000] Policy zone: DMA worker1 # [ 0.006043] CPU features: detected: Privileged Access Never worker2 # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.000000] Tracing variant of Tasks RCU enabled. worker1 # [ 0.006046] CPU features: detected: PMUv3 client # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. worker1 # [ 0.006049] CPU features: detected: RAS Extension Support worker2 # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 client # [ 0.000000] allocated 3145728 bytes of page_ext worker2 # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 lb # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] ftrace: allocating 74885 entries in 294 pages worker2 # [ 0.000000] GICv3: 0 Extended SPIs implemented lb # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] ftrace: allocated 294 pages with 4 groups worker2 # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] rcu: Hierarchical RCU implementation. worker2 # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI lb # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.000000] rcu: RCU event tracing is enabled. worker2 # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 client # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1. lb # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] Trampoline variant of Tasks RCU enabled. lb # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] client # [ 0.000000] Rude variant of Tasks RCU enabled. lb # [ 0.000000] GICv3: 256 SPIs implemented client # [ 0.000000] Tracing variant of Tasks RCU enabled. lb # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] Root IRQ handler: gic_handle_irq client # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. lb # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker2 # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 lb # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 client # [ 0.000000] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 lb # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker1 # [ 0.006051] CPU features: detected: RASv1p1 Extension Support worker2 # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.000000] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.006054] CPU features: detected: Random Number Generator lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) worker1 # [ 0.006057] CPU features: detected: Speculation barrier (SB) client # [ 0.000000] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.006060] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) client # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 worker2 # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). client # [ 0.000000] GICv3: 256 SPIs implemented worker1 # [ 0.006062] CPU features: detected: TLB range maintenance instructions lb # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 client # [ 0.000000] GICv3: 0 Extended SPIs implemented worker2 # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 client # [ 0.000000] Root IRQ handler: gic_handle_irq worker1 # [ 0.006066] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI worker1 # [ 0.006108] alternatives: applying system-wide alternatives lb # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker2 # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 worker2 # [ 0.000030] arm-pv: using stolen time PV worker1 # [ 0.009082] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 lb # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns client # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] worker2 # [ 0.000442] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker2 # [ 0.000607] Console: colour dummy device 80x25 worker1 # [ 0.009306] Memory: 1406756K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker1 # [ 0.009693] devtmpfs: initialized worker2 # [ 0.000614] printk: legacy console [tty0] enabled client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @449f0000 (indirect, esz 8, psz 64K, shr 1) lb # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker1 # [ 0.011566] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @44a00000 (flat, esz 8, psz 64K, shr 1) worker2 # [ 0.000823] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) lb # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns worker2 # [ 0.000829] pid_max: default: 32768 minimum: 301 lb # [ 0.000029] arm-pv: using stolen time PV client # [ 0.000000] GICv3: using LPI property table @0x0000000044a10000 worker1 # [ 0.011589] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.011767] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.000905] LSM: initializing lsm=capability,landlock,yama,bpf,ima client # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000044a20000 worker2 # [ 0.001032] landlock: Up and running. lb # [ 0.000394] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.011771] 0 pages in range for non-PLT usage worker2 # [ 0.001034] Yama: becoming mindful. client # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. worker1 # [ 0.011772] 508288 pages in range for PLT usage lb # [ 0.000581] Console: colour dummy device 80x25 worker2 # [ 0.001466] LSM support for eBPF active lb # [ 0.000589] printk: legacy console [tty0] enabled worker1 # [ 0.011881] pinctrl core: initialized pinctrl subsystem client # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns worker1 # [ 0.012638] DMI not present or invalid. worker2 # [ 0.001605] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). worker1 # [ 0.016925] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.000785] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker2 # [ 0.001637] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.000792] pid_max: default: 32768 minimum: 301 worker1 # [ 0.019178] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.002701] cacheinfo: Unable to detect cache hierarchy for CPU 0 client # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000867] LSM: initializing lsm=capability,landlock,yama,bpf,ima worker2 # [ 0.003365] rcu: Hierarchical SRCU implementation. worker1 # [ 0.019350] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations lb # [ 0.001011] landlock: Up and running. lb # [ 0.001014] Yama: becoming mindful. worker2 # [ 0.003370] rcu: Max phase no-delay instances is 1000. client # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns client # [ 0.000031] arm-pv: using stolen time PV lb # [ 0.001507] LSM support for eBPF active worker1 # [ 0.019550] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.004555] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.004644] EFI services will not be available. worker1 # [ 0.019570] audit: initializing netlink subsys (disabled) lb # [ 0.001661] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.004725] smp: Bringing up secondary CPUs ... client # [ 0.000414] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.020156] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.004733] smp: Brought up 1 node, 1 CPU client # [ 0.000543] Console: colour dummy device 80x25 lb # [ 0.001694] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.004736] SMP: Total of 1 processors activated. worker1 # [ 0.020158] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.000550] printk: legacy console [tty0] enabled lb # [ 0.002810] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker2 # [ 0.004772] CPU: All CPU(s) started at EL1 worker1 # [ 0.020162] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.003514] rcu: Hierarchical SRCU implementation. worker2 # [ 0.004782] CPU features: detected: Branch Target Identification client # [ 0.000743] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) worker1 # [ 0.020167] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.003518] rcu: Max phase no-delay instances is 1000. client # [ 0.000750] pid_max: default: 32768 minimum: 301 worker2 # [ 0.004787] CPU features: detected: ARMv8.4 Translation Table Level lb # [ 0.004717] fsl-mc MSI: its@8080000 domain created worker1 # [ 0.020170] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.000817] LSM: initializing lsm=capability,landlock,yama,bpf,ima lb # [ 0.004816] EFI services will not be available. client # [ 0.000954] landlock: Up and running. worker1 # [ 0.020193] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.004791] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.004885] smp: Bringing up secondary CPUs ... client # [ 0.000957] Yama: becoming mindful. worker1 # [ 0.020203] cpuidle: using governor ladder lb # [ 0.004893] smp: Brought up 1 node, 1 CPU client # [ 0.001428] LSM support for eBPF active worker1 # [ 0.020209] cpuidle: using governor menu worker2 # [ 0.004794] CPU features: detected: Data cache clean to the PoU not required for I/D coherence lb # [ 0.004896] SMP: Total of 1 processors activated. lb # [ 0.004901] CPU: All CPU(s) started at EL1 worker1 # [ 0.020410] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. worker2 # [ 0.004797] CPU features: detected: Common not Private translations client # [ 0.001602] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.004912] CPU features: detected: Branch Target Identification worker2 # [ 0.004800] CPU features: detected: CRC32 instructions worker1 # [ 0.020426] ASID allocator initialised with 65536 entries client # [ 0.001634] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.021736] Serial: AMBA PL011 UART driver lb # [ 0.004917] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.004803] CPU features: detected: Data cache clean to Point of Deep Persistence client # [ 0.002712] cacheinfo: Unable to detect cache hierarchy for CPU 0 worker1 # [ 0.027081] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.003439] rcu: Hierarchical SRCU implementation. worker2 # [ 0.004807] CPU features: detected: Data cache clean to Point of Persistence lb # [ 0.004920] CPU features: detected: Instruction cache invalidation not required for I/D coherence worker1 # [ 0.027201] printk: console [ttyAMA0] enabled client # [ 0.003443] rcu: Max phase no-delay instances is 1000. worker2 # [ 0.004811] CPU features: detected: Data independent timing control (DIT) lb # [ 0.004924] CPU features: detected: Data cache clean to the PoU not required for I/D coherence client # [ 0.004622] fsl-mc MSI: its@8080000 domain created worker2 # [ 0.004814] CPU features: detected: E0PD client # [ 0.004712] EFI services will not be available. worker1 # [ 0.149076] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.004928] CPU features: detected: Common not Private translations worker2 # [ 0.004816] CPU features: detected: Enhanced Counter Virtualization client # [ 0.004784] smp: Bringing up secondary CPUs ... lb # [ 0.004931] CPU features: detected: CRC32 instructions worker1 # [ 0.149093] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.004791] smp: Brought up 1 node, 1 CPU worker2 # [ 0.004819] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) client # [ 0.004794] SMP: Total of 1 processors activated. lb # [ 0.004934] CPU features: detected: Data cache clean to Point of Deep Persistence worker1 # [ 0.149098] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages worker2 # [ 0.004823] CPU features: detected: Enhanced Virtualization Traps client # [ 0.004799] CPU: All CPU(s) started at EL1 worker1 # [ 0.149103] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.004937] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.004826] CPU features: detected: Fine Grained Traps client # [ 0.004810] CPU features: detected: Branch Target Identification worker1 # [ 0.149107] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.004941] CPU features: detected: Data independent timing control (DIT) client # [ 0.004815] CPU features: detected: ARMv8.4 Translation Table Level worker2 # [ 0.004829] CPU features: detected: Generic authentication (architected QARMA5 algorithm) lb # [ 0.004943] CPU features: detected: E0PD worker1 # [ 0.149111] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.004833] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.004818] CPU features: detected: Instruction cache invalidation not required for I/D coherence lb # [ 0.004946] CPU features: detected: Enhanced Counter Virtualization worker1 # [ 0.149116] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages worker2 # [ 0.004836] CPU features: detected: LSE atomic instructions lb # [ 0.004949] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) worker1 # [ 0.149120] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.004840] CPU features: detected: Privileged Access Never client # [ 0.004822] CPU features: detected: Data cache clean to the PoU not required for I/D coherence worker2 # [ 0.004842] CPU features: detected: PMUv3 lb # [ 0.004952] CPU features: detected: Enhanced Virtualization Traps client # [ 0.004826] CPU features: detected: Common not Private translations worker2 # [ 0.004845] CPU features: detected: RAS Extension Support lb # [ 0.004955] CPU features: detected: Fine Grained Traps client # [ 0.004829] CPU features: detected: CRC32 instructions worker2 # [ 0.004848] CPU features: detected: RASv1p1 Extension Support lb # [ 0.004959] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.156319] fbcon: Taking over console client # [ 0.004832] CPU features: detected: Data cache clean to Point of Deep Persistence worker2 # [ 0.004850] CPU features: detected: Random Number Generator worker1 # [ 0.156331] ACPI: Interpreter disabled. lb # [ 0.004964] CPU features: detected: RCpc load-acquire (LDAPR) client # [ 0.004836] CPU features: detected: Data cache clean to Point of Persistence worker2 # [ 0.004853] CPU features: detected: Speculation barrier (SB) lb # [ 0.004967] CPU features: detected: LSE atomic instructions worker2 # [ 0.004855] CPU features: detected: Stage-2 Force Write-Back client # [ 0.004839] CPU features: detected: Data independent timing control (DIT) lb # [ 0.004970] CPU features: detected: Privileged Access Never client # [ 0.004842] CPU features: detected: E0PD worker2 # [ 0.004858] CPU features: detected: TLB range maintenance instructions lb # [ 0.004972] CPU features: detected: PMUv3 client # [ 0.004844] CPU features: detected: Enhanced Counter Virtualization lb # [ 0.004975] CPU features: detected: RAS Extension Support worker2 # [ 0.004863] CPU features: detected: Speculative Store Bypassing Safe (SSBS) client # [ 0.004847] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) lb # [ 0.004978] CPU features: detected: RASv1p1 Extension Support client # [ 0.004851] CPU features: detected: Enhanced Virtualization Traps lb # [ 0.004980] CPU features: detected: Random Number Generator client # [ 0.004854] CPU features: detected: Fine Grained Traps lb # [ 0.004983] CPU features: detected: Speculation barrier (SB) lb # [ 0.004986] CPU features: detected: Stage-2 Force Write-Back client # [ 0.004858] CPU features: detected: Generic authentication (architected QARMA5 algorithm) worker1 # [ 0.163348] iommu: Default domain type: Translated lb # [ 0.004989] CPU features: detected: TLB range maintenance instructions client # [ 0.004863] CPU features: detected: RCpc load-acquire (LDAPR) worker1 # [ 0.163357] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.004866] CPU features: detected: LSE atomic instructions lb # [ 0.004993] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.165013] SCSI subsystem initialized client # [ 0.004869] CPU features: detected: Privileged Access Never lb # [ 0.005031] alternatives: applying system-wide alternatives client # [ 0.004871] CPU features: detected: PMUv3 lb # [ 0.008028] CPU features: detected: BBM Level 2 without TLB conflict abort client # [ 0.004874] CPU features: detected: RAS Extension Support worker1 # [ 0.165656] usbcore: registered new interface driver usbfs client # [ 0.004877] CPU features: detected: RASv1p1 Extension Support worker1 # [ 0.165693] usbcore: registered new interface driver hub worker1 # [ 0.165711] usbcore: registered new device driver usb client # [ 0.004880] CPU features: detected: Random Number Generator lb # [ 0.008242] Memory: 1406504K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123764K reserved, 32768K cma-reserved) lb # [ 0.008678] devtmpfs: initialized worker1 # [ 0.165978] pps_core: LinuxPPS API ver. 1 registered client # [ 0.004882] CPU features: detected: Speculation barrier (SB) client # [ 0.004885] CPU features: detected: Stage-2 Force Write-Back lb # [ 0.010535] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.004899] alternatives: applying system-wide alternatives worker1 # [ 0.165984] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.004888] CPU features: detected: TLB range maintenance instructions worker1 # [ 0.165994] PTP clock support registered worker2 # [ 0.007769] CPU features: detected: BBM Level 2 without TLB conflict abort worker1 # [ 0.166043] EDAC MC: Ver: 3.0.0 client # [ 0.004893] CPU features: detected: Speculative Store Bypassing Safe (SSBS) worker1 # [ 0.170479] scmi_core: SCMI protocol bus registered worker2 # [ 0.008059] Memory: 1406528K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123772K reserved, 32768K cma-reserved) worker2 # [ 0.008418] devtmpfs: initialized worker1 # [ 0.171437] FPGA manager framework worker1 # [ 0.172384] vgaarb: loaded worker2 # [ 0.010292] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.172998] clocksource: Switched to clocksource arch_sys_counter worker2 # [ 0.010314] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.010488] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.010493] 0 pages in range for non-PLT usage worker2 # [ 0.010494] 508288 pages in range for PLT usage worker2 # [ 0.010578] pinctrl core: initialized pinctrl subsystem worker1 # [ 0.176057] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.011274] DMI not present or invalid. worker1 # [ 0.176092] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.014446] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.010558] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.016628] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.010757] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL worker2 # [ 0.016820] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.004929] alternatives: applying system-wide alternatives lb # [ 0.010762] 0 pages in range for non-PLT usage lb # [ 0.010763] 508288 pages in range for PLT usage worker1 # [ 0.179666] netfs: FS-Cache loaded client # [ 0.007990] CPU features: detected: BBM Level 2 without TLB conflict abort worker2 # [ 0.017017] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.179782] pnp: PnP ACPI: disabled lb # [ 0.010876] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.017037] audit: initializing netlink subsys (disabled) lb # [ 0.011633] DMI not present or invalid. worker2 # [ 0.017600] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.008187] Memory: 1406780K/1572864K available (24448K kernel code, 7090K rwdata, 26348K rodata, 4736K init, 1107K bss, 123784K reserved, 32768K cma-reserved) lb # [ 0.014925] NET: Registered PF_NETLINK/PF_ROUTE protocol family client # [ 0.008588] devtmpfs: initialized worker2 # [ 0.017602] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.017149] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.017606] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.010346] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.017338] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.017611] thermal_sys: Registered thermal governor 'user_space' client # [ 0.010368] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.017614] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.017548] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.010553] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL lb # [ 0.017569] audit: initializing netlink subsys (disabled) client # [ 0.010558] 0 pages in range for non-PLT usage worker2 # [ 0.017637] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 worker1 # [ 0.183643] NET: Registered PF_INET protocol family worker2 # [ 0.017647] cpuidle: using governor ladder client # [ 0.010559] 508288 pages in range for PLT usage lb # [ 0.018132] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.017653] cpuidle: using governor menu worker1 # [ 0.183892] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.010680] pinctrl core: initialized pinctrl subsystem lb # [ 0.018134] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.011434] DMI not present or invalid. worker2 # [ 0.017839] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. lb # [ 0.018138] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.014648] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.017854] ASID allocator initialised with 65536 entries lb # [ 0.018143] thermal_sys: Registered thermal governor 'user_space' worker2 # [ 0.019022] Serial: AMBA PL011 UART driver client # [ 0.016838] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.018145] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.024108] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.017029] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.024278] printk: console [ttyAMA0] enabled lb # [ 0.018169] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.018178] cpuidle: using governor ladder client # [ 0.017227] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.018183] cpuidle: using governor menu client # [ 0.017249] audit: initializing netlink subsys (disabled) worker2 # [ 0.144059] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.018362] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.017771] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.144076] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.018376] ASID allocator initialised with 65536 entries client # [ 0.017773] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.019491] Serial: AMBA PL011 UART driver worker2 # [ 0.144081] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.017777] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.144085] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.024711] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 client # [ 0.017782] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.024858] printk: console [ttyAMA0] enabled worker2 # [ 0.144089] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.017785] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.144093] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.017817] audit: type=2000 audit(0.016:1): state=initialized audit_enabled=0 res=1 lb # [ 0.145108] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.144098] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages client # [ 0.017825] cpuidle: using governor ladder client # [ 0.017831] cpuidle: using governor menu lb # [ 0.145127] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.144102] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page lb # [ 0.145132] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages client # [ 0.018013] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. client # [ 0.018027] ASID allocator initialised with 65536 entries lb # [ 0.145137] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page client # [ 0.019284] Serial: AMBA PL011 UART driver lb # [ 0.145141] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.151372] fbcon: Taking over console worker2 # [ 0.151386] ACPI: Interpreter disabled. client # [ 0.024403] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 lb # [ 0.145145] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.024522] printk: console [ttyAMA0] enabled lb # [ 0.145149] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.145154] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page client # [ 0.144260] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.144280] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.144285] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages lb # [ 0.152729] fbcon: Taking over console client # [ 0.144290] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page lb # [ 0.152743] ACPI: Interpreter disabled. client # [ 0.144294] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.154606] iommu: Default domain type: Translated worker2 # [ 0.158400] iommu: Default domain type: Translated client # [ 0.144299] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.154616] iommu: DMA domain TLB invalidation policy: strict mode worker2 # [ 0.158410] iommu: DMA domain TLB invalidation policy: strict mode client # [ 0.144303] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages lb # [ 0.156310] SCSI subsystem initialized worker2 # [ 0.160048] SCSI subsystem initialized client # [ 0.144308] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page worker2 # [ 0.160714] usbcore: registered new interface driver usbfs worker2 # [ 0.160765] usbcore: registered new interface driver hub client # [ 0.151821] fbcon: Taking over console worker2 # [ 0.160783] usbcore: registered new device driver usb client # [ 0.151836] ACPI: Interpreter disabled. worker2 # [ 0.161044] pps_core: LinuxPPS API ver. 1 registered worker2 # [ 0.161050] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti worker2 # [ 0.161060] PTP clock support registered worker2 # [ 0.161117] EDAC MC: Ver: 3.0.0 worker2 # [ 0.165700] scmi_core: SCMI protocol bus registered worker2 # [ 0.166671] FPGA manager framework lb # [ 0.163481] usbcore: registered new interface driver usbfs worker2 # [ 0.167670] vgaarb: loaded lb # [ 0.163513] usbcore: registered new interface driver hub client # [ 0.158031] iommu: Default domain type: Translated worker2 # [ 0.168297] clocksource: Switched to clocksource arch_sys_counter lb # [ 0.163531] usbcore: registered new device driver usb client # [ 0.158040] iommu: DMA domain TLB invalidation policy: strict mode lb # [ 0.163804] pps_core: LinuxPPS API ver. 1 registered client # [ 0.159704] SCSI subsystem initialized lb # [ 0.163810] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti lb # [ 0.163819] PTP clock support registered client # [ 0.160391] usbcore: registered new interface driver usbfs lb # [ 0.163865] EDAC MC: Ver: 3.0.0 worker2 # [ 0.171149] VFS: Disk quotas dquot_6.6.0 client # [ 0.160424] usbcore: registered new interface driver hub lb # [ 0.168483] scmi_core: SCMI protocol bus registered worker2 # [ 0.171182] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.160451] usbcore: registered new device driver usb client # [ 0.160717] pps_core: LinuxPPS API ver. 1 registered lb # [ 0.169426] FPGA manager framework lb # [ 0.170392] vgaarb: loaded client # [ 0.160723] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti client # [ 0.160734] PTP clock support registered lb # [ 0.171019] clocksource: Switched to clocksource arch_sys_counter client # [ 0.160783] EDAC MC: Ver: 3.0.0 worker2 # [ 0.174715] netfs: FS-Cache loaded worker2 # [ 0.174837] pnp: PnP ACPI: disabled worker1 # [ 0.212274] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) client # [ 0.165405] scmi_core: SCMI protocol bus registered lb # [ 0.172748] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.212316] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) client # [ 0.166393] FPGA manager framework lb # [ 0.172777] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.167373] vgaarb: loaded worker1 # [ 0.212345] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.212418] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) client # [ 0.168015] clocksource: Switched to clocksource arch_sys_counter worker1 # [ 0.212562] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.176422] netfs: FS-Cache loaded worker1 # [ 0.212640] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.176553] pnp: PnP ACPI: disabled worker2 # [ 0.178662] NET: Registered PF_INET protocol family worker1 # [ 0.212684] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.178916] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.212720] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.212813] NET: Registered PF_UNIX/PF_LOCAL protocol family worker1 # [ 0.212835] NET: Registered PF_XDP protocol family worker1 # [ 0.212852] PCI: CLS 0 bytes, default 64 client # [ 0.171809] VFS: Disk quotas dquot_6.6.0 worker1 # [ 0.213099] Trying to unpack rootfs image as initramfs... client # [ 0.171847] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.175434] netfs: FS-Cache loaded client # [ 0.175538] pnp: PnP ACPI: disabled lb # [ 0.180443] NET: Registered PF_INET protocol family lb # [ 0.180723] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.179448] NET: Registered PF_INET protocol family client # [ 0.179709] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.230681] kvm [1]: HYP mode not available worker2 # [ 0.207832] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.207877] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.207902] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker2 # [ 0.207974] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker2 # [ 0.208116] TCP: Hash tables configured (established 16384 bind 16384) worker2 # [ 0.208224] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker2 # [ 0.208260] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.214653] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.214752] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.214780] NET: Registered PF_XDP protocol family worker2 # [ 0.214799] PCI: CLS 0 bytes, default 64 lb # [ 0.209589] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker2 # [ 0.215026] Trying to unpack rootfs image as initramfs... lb # [ 0.209634] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.223585] kvm [1]: HYP mode not available lb # [ 0.209663] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.209738] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.209881] TCP: Hash tables configured (established 16384 bind 16384) client # [ 0.209706] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.209965] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.209762] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.210010] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.209794] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) lb # [ 0.210046] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.209881] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.210134] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.210025] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.210157] NET: Registered PF_XDP protocol family lb # [ 0.210175] PCI: CLS 0 bytes, default 64 client # [ 0.210112] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) lb # [ 0.210423] Trying to unpack rootfs image as initramfs... client # [ 0.210148] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.210184] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.210302] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.210330] NET: Registered PF_XDP protocol family client # [ 0.210350] PCI: CLS 0 bytes, default 64 client # [ 0.210602] Trying to unpack rootfs image as initramfs... lb # [ 0.228940] kvm [1]: HYP mode not available client # [ 0.225864] kvm [1]: HYP mode not available worker1 # [ 0.315757] Initialise system trusted keyrings worker1 # [ 0.325063] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.326481] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.327243] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.339811] Key type asymmetric registered worker1 # [ 0.339822] Asymmetric key parser 'x509' registered worker1 # [ 0.339868] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.349074] io scheduler mq-deadline registered worker1 # [ 0.349093] io scheduler kyber registered worker1 # [ 0.357159] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.316916] Initialise system trusted keyrings worker2 # [ 0.317706] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker2 # [ 0.318954] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker2 # [ 0.319729] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.365045] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.324289] Initialise system trusted keyrings worker1 # [ 0.365510] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: lb # [ 0.325042] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.365529] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 lb # [ 0.326305] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.365541] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 client # [ 0.321047] Initialise system trusted keyrings worker1 # [ 0.365549] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 client # [ 0.321805] workingset: timestamp_bits=42 max_order=19 bucket_order=0 worker1 # [ 0.365569] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits client # [ 0.323091] squashfs: version 4.0 (2009/01/31) Phillip Lougher worker1 # [ 0.365594] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.323875] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.365682] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 lb # [ 0.327149] 9p: Installing v9fs 9p2000 file system support worker1 # [ 0.365692] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.365697] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker1 # [ 0.365702] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.365707] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.365786] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.366225] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.366423] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.366439] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.366468] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.366484] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.366946] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.367130] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.367145] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.367174] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.367628] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.367809] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.367824] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.348377] Key type asymmetric registered worker1 # [ 0.367853] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.348403] Asymmetric key parser 'x509' registered worker1 # [ 0.368308] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.348469] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.368490] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.350589] io scheduler mq-deadline registered worker1 # [ 0.368506] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.350600] io scheduler kyber registered worker1 # [ 0.368538] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.368992] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.369189] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.369205] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.369234] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.369709] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.369891] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.369907] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.369935] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.355067] Key type asymmetric registered lb # [ 0.355094] Asymmetric key parser 'x509' registered worker1 # [ 0.370391] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.355164] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker1 # [ 0.370573] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.357321] io scheduler mq-deadline registered worker1 # [ 0.370589] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.357332] io scheduler kyber registered worker2 # [ 0.360442] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker1 # [ 0.370617] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.370633] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.352491] Key type asymmetric registered client # [ 0.352517] Asymmetric key parser 'x509' registered worker1 # [ 0.371100] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.371286] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.352597] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) worker2 # [ 0.361790] ledtrig-cpu: registered to indicate activity on CPUs client # [ 0.354697] io scheduler mq-deadline registered worker1 # [ 0.371315] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.354708] io scheduler kyber registered worker2 # [ 0.362174] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.371764] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.362190] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker1 # [ 0.371948] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.371977] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.362202] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker1 # [ 0.372367] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.362211] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.372548] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.362231] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.372791] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.362255] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] lb # [ 0.367155] pl061_gpio 9030000.pl061: PL061 GPIO chip registered worker2 # [ 0.362340] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker2 # [ 0.362350] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.362356] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] worker2 # [ 0.362361] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.368537] ledtrig-cpu: registered to indicate activity on CPUs worker2 # [ 0.362366] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.364129] pl061_gpio 9030000.pl061: PL061 GPIO chip registered lb # [ 0.368913] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker2 # [ 0.362423] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.368930] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.362853] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.363049] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.368942] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.363065] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.365462] ledtrig-cpu: registered to indicate activity on CPUs lb # [ 0.368950] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker2 # [ 0.363095] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.365859] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: worker1 # [ 0.421109] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.363112] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.368979] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker1 # [ 0.421136] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.365876] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 worker2 # [ 0.363562] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.421165] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.369002] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] client # [ 0.365889] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 worker2 # [ 0.363744] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.369081] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.421664] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.363759] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.365898] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 worker1 # [ 0.421849] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.369090] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.363789] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.421865] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.369096] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] client # [ 0.365917] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits worker2 # [ 0.364233] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.369101] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] worker1 # [ 0.421894] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.365942] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] worker2 # [ 0.384294] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.422518] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned lb # [ 0.369107] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] client # [ 0.366016] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 worker1 # [ 0.422530] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.369163] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint client # [ 0.366025] pci_bus 0000:00: root bus resource [bus 00-ff] worker1 # [ 0.422535] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.366031] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] lb # [ 0.369614] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.366036] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] lb # [ 0.369813] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.422581] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.369829] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.366042] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] worker1 # [ 0.422628] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned worker2 # [ 0.384923] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.369859] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.366098] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint worker1 # [ 0.422675] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.384955] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.369874] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.366550] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.422723] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker2 # [ 0.385421] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint lb # [ 0.370336] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.366752] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.385602] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] lb # [ 0.370523] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.422770] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.366778] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.385618] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.370539] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.422827] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.366807] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.385651] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.370569] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.366823] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.422875] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned worker2 # [ 0.386160] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.367298] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.386344] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.422925] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.367484] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.386360] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.389895] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.422971] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.367500] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.390087] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.386389] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.423066] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.367529] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.390102] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.386843] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.423112] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.390132] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.367990] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker2 # [ 0.387029] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker1 # [ 0.423134] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.387045] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.390597] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint client # [ 0.387586] pci 0000:00:03.0: BAR 0 [io 0x0000-0x003f] worker1 # [ 0.423155] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.390787] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.387075] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.387606] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.423179] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.390803] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.387531] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint client # [ 0.387635] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.423203] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned lb # [ 0.390835] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.387720] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.423225] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.387735] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.387765] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker1 # [ 0.423246] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.387781] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] worker1 # [ 0.423268] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.423290] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.388239] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker1 # [ 0.423311] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker1 # [ 0.423334] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker1 # [ 0.423357] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker1 # [ 0.423378] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker1 # [ 0.423398] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker1 # [ 0.423419] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned worker1 # [ 0.423440] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned worker1 # [ 0.423461] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned worker1 # [ 0.423482] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.396140] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.423505] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.396333] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.423526] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.396349] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.423548] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.396382] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.408458] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.423574] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] worker2 # [ 0.408495] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.396852] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.423583] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.397035] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] worker1 # [ 0.423588] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] worker2 # [ 0.408965] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.397051] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.403343] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint worker1 # [ 0.424760] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker2 # [ 0.409153] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.403535] pci 0000:00:05.0: BAR 0 [io 0x0000-0x001f] client # [ 0.397080] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.409182] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.403552] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.397537] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.409582] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.403582] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.397721] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] worker2 # [ 0.409763] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] client # [ 0.397736] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.404039] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.410011] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.404228] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] client # [ 0.397766] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.410261] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] lb # [ 0.404243] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.398226] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.410278] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.404273] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.398409] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.410307] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.398424] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.404754] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.410758] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.398453] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.404938] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.410939] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] client # [ 0.398469] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] lb # [ 0.404954] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.410955] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.404982] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.398931] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.410985] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.404998] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] client # [ 0.399122] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] worker1 # [ 0.469119] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 43323 usecs worker2 # [ 0.411556] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.399151] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.405461] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint worker2 # [ 0.411567] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.405655] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.399607] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.411573] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.405684] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.399795] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.411619] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned client # [ 0.399824] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] lb # [ 0.406140] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.411666] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.406330] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.406359] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.411715] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned lb # [ 0.406761] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint worker2 # [ 0.411763] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned lb # [ 0.406946] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] worker2 # [ 0.411810] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.407206] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.411858] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.407457] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.411905] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.407474] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.407504] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.411952] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.418245] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.407966] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.411999] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.418429] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] lb # [ 0.408161] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.412060] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.418675] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.408176] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] client # [ 0.418945] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] worker2 # [ 0.412106] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.408205] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] client # [ 0.418962] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] worker2 # [ 0.412127] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.408782] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned client # [ 0.418991] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.412149] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.408794] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned worker2 # [ 0.412171] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned client # [ 0.419474] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.408800] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned client # [ 0.419661] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] worker2 # [ 0.412195] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned client # [ 0.419677] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] lb # [ 0.408845] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned worker2 # [ 0.412218] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned client # [ 0.419706] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] worker2 # [ 0.412240] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.408892] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned client # [ 0.420298] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned worker2 # [ 0.412262] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned lb # [ 0.408938] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker2 # [ 0.412284] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned client # [ 0.420309] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned lb # [ 0.408984] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned client # [ 0.420315] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned lb # [ 0.409031] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned client # [ 0.420361] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned lb # [ 0.409078] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned client # [ 0.420407] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned lb # [ 0.409124] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned client # [ 0.420457] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned worker1 # [ 0.489037] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.409170] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned client # [ 0.420503] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned worker1 # [ 0.491210] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) lb # [ 0.409217] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned client # [ 0.420549] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned lb # [ 0.409280] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned client # [ 0.420595] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned lb # [ 0.409326] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned client # [ 0.420641] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned lb # [ 0.409347] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned worker2 # [ 0.448368] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned client # [ 0.420687] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned lb # [ 0.409369] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned worker2 # [ 0.448416] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned client # [ 0.420734] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned lb # [ 0.409390] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned worker2 # [ 0.448441] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned client # [ 0.420805] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned lb # [ 0.409413] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.448465] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned client # [ 0.420851] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned lb # [ 0.409435] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned worker2 # [ 0.448487] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned client # [ 0.420872] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned lb # [ 0.409457] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned worker2 # [ 0.448510] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.420893] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned lb # [ 0.409485] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker2 # [ 0.448532] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.420915] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned lb # [ 0.409507] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned worker2 # [ 0.448555] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.420939] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned worker2 # [ 0.448578] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.409530] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.448600] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.420961] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned lb # [ 0.409552] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.448623] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned worker1 # [ 0.501210] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.420983] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned lb # [ 0.409574] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned worker2 # [ 0.448646] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.421004] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned worker1 # [ 0.503530] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.409595] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned worker2 # [ 0.448680] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.421026] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned lb # [ 0.409617] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned worker2 # [ 0.448689] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] lb # [ 0.409638] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned client # [ 0.421048] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned worker2 # [ 0.448694] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] lb # [ 0.409659] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned client # [ 0.421070] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned worker2 # [ 0.449890] pci 0000:00:0a.0: enabling device (0000 -> 0002) lb # [ 0.409680] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned client # [ 0.421092] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned lb # [ 0.409701] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned client # [ 0.421113] pci 0000:00:06.0: BAR 0 [io 0x1000-0x107f]: assigned lb # [ 0.409723] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned client # [ 0.421133] pci 0000:00:03.0: BAR 0 [io 0x1080-0x10bf]: assigned lb # [ 0.409744] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.421154] pci 0000:00:0b.0: BAR 0 [io 0x10c0-0x10ff]: assigned lb # [ 0.409766] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.421175] pci 0000:00:01.0: BAR 0 [io 0x1100-0x111f]: assigned lb # [ 0.409793] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.421197] pci 0000:00:02.0: BAR 0 [io 0x1120-0x113f]: assigned lb # [ 0.409803] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.421218] pci 0000:00:04.0: BAR 0 [io 0x1140-0x115f]: assigned lb # [ 0.409807] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.421240] pci 0000:00:05.0: BAR 0 [io 0x1160-0x117f]: assigned lb # [ 0.410968] pci 0000:00:0a.0: enabling device (0000 -> 0002) client # [ 0.421261] pci 0000:00:07.0: BAR 0 [io 0x1180-0x119f]: assigned client # [ 0.421282] pci 0000:00:0c.0: BAR 0 [io 0x11a0-0x11bf]: assigned client # [ 0.421309] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] client # [ 0.421319] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] client # [ 0.421324] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] client # [ 0.422480] pci 0000:00:0a.0: enabling device (0000 -> 0002) worker1 # [ 0.513557] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.471160] pci 0000:00:0a.0: quirk_usb_early_handoff+0x0/0xa60 took 58784 usecs worker1 # [ 0.516113] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.518324] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker1 # [ 0.520460] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker1 # [ 0.530815] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker1 # [ 0.532589] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.486860] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) worker2 # [ 0.489871] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker2 # [ 0.491790] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.486232] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.491531] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) lb # [ 0.493746] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) worker1 # [ 0.543070] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker2 # [ 0.501691] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) worker2 # [ 0.503546] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.504948] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) client # [ 0.496265] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) client # [ 0.499906] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) worker1 # [ 0.555856] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker1 # [ 0.557477] msm_serial: driver initialized worker1 # [ 0.557606] SuperH (H)SCI(F) driver initialized worker2 # [ 0.515002] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) worker1 # [ 0.557658] STM32 USART driver initialized lb # [ 0.511306] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) lb # [ 0.513453] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) worker2 # [ 0.517889] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.520020] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.509314] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) client # [ 0.511795] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) lb # [ 0.523662] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.525902] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) worker2 # [ 0.530147] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) worker2 # [ 0.531901] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) client # [ 0.521456] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) lb # [ 0.537406] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) worker2 # [ 0.543174] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.591911] loop: module loaded worker1 # [ 0.592084] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.592809] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 0.532574] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) client # [ 0.534693] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) client # [ 0.536816] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) client # [ 0.538689] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.553545] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.556117] msm_serial: driver initialized worker2 # [ 0.556276] SuperH (H)SCI(F) driver initialized worker1 # [ 0.597635] megasas: 07.734.00.00-rc1 worker1 # [ 0.598340] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] lb # [ 0.547317] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) lb # [ 0.550709] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) worker2 # [ 0.557405] STM32 USART driver initialized lb # [ 0.553447] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) client # [ 0.549550] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) worker1 # [ 0.610094] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.610127] Intel/Sharp Extended Query Table at 0x0031 worker1 # [ 0.611706] Using buffer write method worker1 # [ 0.611768] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.571538] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled client # [ 0.566606] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.574305] msm_serial: driver initialized lb # [ 0.574511] SuperH (H)SCI(F) driver initialized lb # [ 0.574566] STM32 USART driver initialized client # [ 0.569145] msm_serial: driver initialized client # [ 0.569279] SuperH (H)SCI(F) driver initialized client # [ 0.569334] STM32 USART driver initialized worker1 # [ 0.626103] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker1 # [ 0.626132] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.588915] loop: module loaded worker2 # [ 0.589087] virtio_blk virtio5: 1/0/0 default/read/poll queues worker1 # [ 0.637542] Using buffer write method worker1 # [ 0.637574] Concatenating MTD devices: worker2 # [ 0.589871] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 0.637579] (0): "0.flash" worker1 # [ 0.637583] (1): "0.flash" worker1 # [ 0.637586] into device "0.flash" worker2 # [ 0.600919] megasas: 07.734.00.00-rc1 worker2 # [ 0.601631] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.598950] loop: module loaded lb # [ 0.605787] loop: module loaded worker2 # [ 0.603733] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.599133] virtio_blk virtio5: 1/0/0 default/read/poll queues lb # [ 0.605967] virtio_blk virtio5: 1/0/0 default/read/poll queues worker2 # [ 0.603757] Intel/Sharp Extended Query Table at 0x0031 worker2 # [ 0.605645] Using buffer write method client # [ 0.599920] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) lb # [ 0.606705] virtio_blk virtio5: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker2 # [ 0.605710] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] worker2 # [ 0.607403] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 worker2 # [ 0.607432] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.611617] megasas: 07.734.00.00-rc1 lb # [ 0.612308] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] worker2 # [ 0.625889] Using buffer write method worker2 # [ 0.625926] Concatenating MTD devices: worker2 # [ 0.625931] (0): "0.flash" worker2 # [ 0.625935] (1): "0.flash" worker2 # [ 0.625938] into device "0.flash" client # [ 0.612637] megasas: 07.734.00.00-rc1 client # [ 0.613375] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] client # [ 0.615594] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.615621] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.623076] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.617333] Using buffer write method lb # [ 0.623104] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.625908] Using buffer write method client # [ 0.617405] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] lb # [ 0.625988] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] client # [ 0.619224] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 lb # [ 0.627697] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 client # [ 0.619256] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.627721] Intel/Sharp Extended Query Table at 0x0031 lb # [ 0.629308] Using buffer write method lb # [ 0.629334] Concatenating MTD devices: lb # [ 0.629338] (0): "0.flash" lb # [ 0.629342] (1): "0.flash" lb # [ 0.629346] into device "0.flash" client # [ 0.637679] Using buffer write method client # [ 0.637716] Concatenating MTD devices: client # [ 0.637720] (0): "0.flash" client # [ 0.637724] (1): "0.flash" client # [ 0.637728] into device "0.flash" worker1 # [ 0.861279] Freeing initrd memory: 26148K worker1 # [ 0.867272] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.870945] thunder_xcv, ver 1.0 worker1 # [ 0.870988] thunder_bgx, ver 1.0 worker1 # [ 0.871011] nicpf, ver 1.0 worker1 # [ 0.871543] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.871550] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.871574] e1000e: Intel(R) PRO/1000 Network Driver worker1 # [ 0.871583] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker1 # [ 0.871611] igb: Intel(R) Gigabit Ethernet Network Driver worker1 # [ 0.871617] igb: Copyright (c) 2007-2014 Intel Corporation. worker1 # [ 0.871640] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.871646] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.871774] sky2: driver version 1.30 worker1 # [ 0.873732] ehci-pci 0000:00:0a.0: EHCI Host Controller worker1 # [ 0.873757] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 worker1 # [ 0.874002] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker1 # [ 0.883636] usbcore: registered new interface driver usb-storage worker1 # [ 0.883769] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.883783] usbserial: USB Serial support registered for generic worker1 # [ 0.884359] hv_vmbus: registering driver hyperv_keyboard worker1 # [ 0.887983] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker1 # [ 0.888303] hub 1-0:1.0: USB hub found worker1 # [ 0.888321] hub 1-0:1.0: 6 ports detected worker1 # [ 0.890618] rtc-pl031 9010000.pl031: registered as rtc0 worker1 # [ 0.890646] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T04:23:53 UTC (1789964633) worker1 # [ 0.890973] i2c_dev: i2c /dev entries driver worker2 # [ 0.847354] Freeing initrd memory: 26148K worker1 # [ 0.895815] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.895824] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.896081] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.896443] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.853209] tun: Universal TUN/TAP device driver, 1.6 worker1 # [ 0.900773] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 0.901663] usbcore: registered new interface driver usbhid worker1 # [ 0.901672] usbhid: USB HID core driver worker1 # [ 0.903870] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker1 # [ 0.906409] drop_monitor: Initializing network drop monitor service worker2 # [ 0.856726] thunder_xcv, ver 1.0 worker1 # [ 0.906547] NET: Registered PF_INET6 protocol family worker2 # [ 0.856776] thunder_bgx, ver 1.0 worker2 # [ 0.856799] nicpf, ver 1.0 worker2 # [ 0.857339] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.908684] Segment Routing with IPv6 worker1 # [ 0.908706] In-situ OAM (IOAM) with IPv6 worker2 # [ 0.857346] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.908739] NET: Registered PF_PACKET protocol family worker2 # [ 0.857375] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.857383] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.857420] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.857425] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.857448] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker1 # [ 0.910582] 9pnet: Installing 9P2000 support worker2 # [ 0.857453] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. worker1 # [ 0.912716] Key type dns_resolver registered worker2 # [ 0.857590] sky2: driver version 1.30 worker2 # [ 0.859163] usbcore: registered new interface driver usb-storage worker2 # [ 0.859245] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.859259] usbserial: USB Serial support registered for generic worker2 # [ 0.859844] hv_vmbus: registering driver hyperv_keyboard worker2 # [ 0.861076] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.861101] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 lb # [ 0.867731] Freeing initrd memory: 26140K worker2 # [ 0.861398] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 worker2 # [ 0.872781] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 worker2 # [ 0.873117] hub 1-0:1.0: USB hub found worker1 # [ 0.919560] registered taskstats version 1 worker2 # [ 0.873132] hub 1-0:1.0: 6 ports detected client # [ 0.863754] Freeing initrd memory: 26160K worker1 # [ 0.919712] Loading compiled-in X.509 certificates worker2 # [ 0.876136] rtc-pl031 9010000.pl031: registered as rtc0 lb # [ 0.873640] tun: Universal TUN/TAP device driver, 1.6 worker2 # [ 0.876163] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T04:23:53 UTC (1789964633) worker2 # [ 0.878226] i2c_dev: i2c /dev entries driver client # [ 0.869735] tun: Universal TUN/TAP device driver, 1.6 lb # [ 0.877194] thunder_xcv, ver 1.0 worker1 # [ 0.928111] Demotion targets for Node 0: null lb # [ 0.877237] thunder_bgx, ver 1.0 lb # [ 0.877259] nicpf, ver 1.0 worker1 # [ 0.928217] Key type .fscrypt registered lb # [ 0.877799] e1000: Intel(R) PRO/1000 Network Driver worker1 # [ 0.928223] Key type fscrypt-provisioning registered lb # [ 0.877807] e1000: Copyright (c) 1999-2006 Intel Corporation. worker1 # [ 0.928314] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.881443] sdhci: Secure Digital Host Controller Interface driver worker1 # [ 0.928333] ima: Allocated hash algorithm: sha1 lb # [ 0.877831] e1000e: Intel(R) PRO/1000 Network Driver worker2 # [ 0.881453] sdhci: Copyright(c) Pierre Ossman worker1 # [ 0.928352] ima: No architecture policies found lb # [ 0.877839] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. worker2 # [ 0.881718] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.877869] igb: Intel(R) Gigabit Ethernet Network Driver worker2 # [ 0.882088] sdhci-pltfm: SDHCI platform and OF driver helper worker1 # [ 0.932444] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.873392] thunder_xcv, ver 1.0 lb # [ 0.877875] igb: Copyright (c) 2007-2014 Intel Corporation. worker2 # [ 0.883735] hid: raw HID events driver (C) Jiri Kosina client # [ 0.873435] thunder_bgx, ver 1.0 client # [ 0.873459] nicpf, ver 1.0 worker2 # [ 0.883974] usbcore: registered new interface driver usbhid lb # [ 0.877898] igbvf: Intel(R) Gigabit Virtual Function Network Driver worker2 # [ 0.883981] usbhid: USB HID core driver client # [ 0.874014] e1000: Intel(R) PRO/1000 Network Driver lb # [ 0.877904] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.878034] sky2: driver version 1.30 client # [ 0.874021] e1000: Copyright (c) 1999-2006 Intel Corporation. client # [ 0.874045] e1000e: Intel(R) PRO/1000 Network Driver client # [ 0.874053] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. client # [ 0.874082] igb: Intel(R) Gigabit Ethernet Network Driver client # [ 0.874088] igb: Copyright (c) 2007-2014 Intel Corporation. lb # [ 0.886618] usbcore: registered new interface driver usb-storage worker2 # [ 0.889414] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available client # [ 0.874112] igbvf: Intel(R) Gigabit Virtual Function Network Driver lb # [ 0.886673] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.890917] drop_monitor: Initializing network drop monitor service client # [ 0.874118] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. lb # [ 0.886687] usbserial: USB Serial support registered for generic worker2 # [ 0.891054] NET: Registered PF_INET6 protocol family client # [ 0.874249] sky2: driver version 1.30 lb # [ 0.887711] ehci-pci 0000:00:0a.0: EHCI Host Controller client # [ 0.875815] usbcore: registered new interface driver usb-storage worker2 # [ 0.894028] Segment Routing with IPv6 worker2 # [ 0.894049] In-situ OAM (IOAM) with IPv6 lb # [ 0.887736] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.875863] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.894077] NET: Registered PF_PACKET protocol family lb # [ 0.888015] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 client # [ 0.875879] usbserial: USB Serial support registered for generic client # [ 0.876724] ehci-pci 0000:00:0a.0: EHCI Host Controller worker2 # [ 0.895668] 9pnet: Installing 9P2000 support lb # [ 0.892765] hv_vmbus: registering driver hyperv_keyboard client # [ 0.876751] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 client # [ 0.876909] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 lb # [ 0.894267] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.888519] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.894300] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T04:23:53 UTC (1789964633) client # [ 0.888866] hub 1-0:1.0: USB hub found lb # [ 0.894598] i2c_dev: i2c /dev entries driver client # [ 0.888881] hub 1-0:1.0: 6 ports detected worker2 # [ 0.898489] Key type dns_resolver registered client # [ 0.891417] hv_vmbus: registering driver hyperv_keyboard client # [ 0.892933] rtc-pl031 9010000.pl031: registered as rtc0 client # [ 0.892959] rtc-pl031 9010000.pl031: setting system clock to 2026-09-21T04:23:53 UTC (1789964633) client # [ 0.893265] i2c_dev: i2c /dev entries driver worker1 # [ 0.949703] clk: Disabling unused clocks worker1 # [ 0.949729] PM: genpd: Disabling unused power domains lb # [ 0.899521] sdhci: Secure Digital Host Controller Interface driver lb # [ 0.899532] sdhci: Copyright(c) Pierre Ossman lb # [ 0.899796] Synopsys Designware Multimedia Card Interface Driver worker1 # [ 0.953949] Freeing unused kernel memory: 4736K lb # [ 0.900160] sdhci-pltfm: SDHCI platform and OF driver helper worker2 # [ 0.904504] registered taskstats version 1 worker1 # [ 0.954152] Run /init as init process lb # [ 0.901810] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.904641] Loading compiled-in X.509 certificates lb # [ 0.902042] usbcore: registered new interface driver usbhid lb # [ 0.902048] usbhid: USB HID core driver client # [ 0.898155] sdhci: Secure Digital Host Controller Interface driver client # [ 0.898165] sdhci: Copyright(c) Pierre Ossman client # [ 0.898429] Synopsys Designware Multimedia Card Interface Driver lb # [ 0.907489] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 lb # [ 0.907804] hub 1-0:1.0: USB hub found client # [ 0.898806] sdhci-pltfm: SDHCI platform and OF driver helper lb # [ 0.907824] hub 1-0:1.0: 6 ports detected worker2 # [ 0.912951] Demotion targets for Node 0: null worker2 # [ 0.913051] Key type .fscrypt registered client # [ 0.903116] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 0.913058] Key type fscrypt-provisioning registered client # [ 0.903390] usbcore: registered new interface driver usbhid lb # [ 0.909899] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available worker2 # [ 0.913151] ima: No TPM chip found, activating TPM-bypass! client # [ 0.903396] usbhid: USB HID core driver worker2 # [ 0.913171] ima: Allocated hash algorithm: sha1 worker2 # [ 0.913191] ima: No architecture policies found lb # [ 0.912447] drop_monitor: Initializing network drop monitor service lb # [ 0.912579] NET: Registered PF_INET6 protocol family worker2 # [ 0.917060] input: gpio-keys as /devices/platform/gpio-keys/input/input0 lb # [ 0.914443] Segment Routing with IPv6 lb # [ 0.914465] In-situ OAM (IOAM) with IPv6 client # [ 0.906191] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available lb # [ 0.914493] NET: Registered PF_PACKET protocol family client # [ 0.907672] drop_monitor: Initializing network drop monitor service client # [ 0.907793] NET: Registered PF_INET6 protocol family client # [ 0.910946] Segment Routing with IPv6 client # [ 0.910964] In-situ OAM (IOAM) with IPv6 client # [ 0.910992] NET: Registered PF_PACKET protocol family lb # [ 0.916151] 9pnet: Installing 9P2000 support lb # [ 0.918282] Key type dns_resolver registered worker1 # [ 0.971115] systemd[1]: Successfully made /usr/ read-only. client # [ 0.912844] 9pnet: Installing 9P2000 support client # [ 0.914923] Key type dns_resolver registered lb # [ 0.924948] registered taskstats version 1 lb # [ 0.925105] Loading compiled-in X.509 certificates client # [ 0.921788] registered taskstats version 1 client # [ 0.921937] Loading compiled-in X.509 certificates worker2 # [ 0.934184] clk: Disabling unused clocks worker2 # [ 0.934204] PM: genpd: Disabling unused power domains lb # [ 0.933818] Demotion targets for Node 0: null lb # [ 0.933919] Key type .fscrypt registered lb # [ 0.933925] Key type fscrypt-provisioning registered worker2 # [ 0.938350] Freeing unused kernel memory: 4736K worker2 # [ 0.938547] Run /init as init process lb # [ 0.934026] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.934046] ima: Allocated hash algorithm: sha1 lb # [ 0.934067] ima: No architecture policies found client # [ 0.930464] Demotion targets for Node 0: null client # [ 0.930569] Key type .fscrypt registered lb # [ 0.937990] input: gpio-keys as /devices/platform/gpio-keys/input/input0 client # [ 0.930576] Key type fscrypt-provisioning registered client # [ 0.930668] ima: No TPM chip found, activating TPM-bypass! client # [ 0.930687] ima: Allocated hash algorithm: sha1 client # [ 0.930707] ima: No architecture policies found client # [ 0.934713] input: gpio-keys as /devices/platform/gpio-keys/input/input0 worker2 # [ 0.954490] systemd[1]: Successfully made /usr/ read-only. lb # [ 0.955882] clk: Disabling unused clocks lb # [ 0.955912] PM: genpd: Disabling unused power domains lb # [ 0.960145] Freeing unused kernel memory: 4736K lb # [ 0.960368] Run /init as init process client # [ 0.952919] clk: Disabling unused clocks client # [ 0.952946] PM: genpd: Disabling unused power domains client # [ 0.957173] Freeing unused kernel memory: 4736K client # [ 0.957364] Run /init as init process lb # [ 0.977180] systemd[1]: Successfully made /usr/ read-only. client # [ 0.974115] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.133077] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 1.120373] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 1.136101] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 1.155107] usb 1-1: new high-speed USB device number 2 using ehci-pci worker1 # [ 1.285392] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.305872] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.317072] systemd[1]: Detected virtualization qemu. worker1 # [ 1.318946] systemd[1]: Detected architecture arm64. worker2 # [ 1.270552] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker1 # [ 1.320773] systemd[1]: Running in initrd. worker1 # [ 1.323208] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.325839] systemd[1]: Hostname set to . worker2 # [ 1.289225] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.300437] systemd[1]: Detected virtualization qemu. client # [ 1.288150] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 worker2 # [ 1.302308] systemd[1]: Detected architecture arm64. worker2 # [ 1.304090] systemd[1]: Running in initrd. worker2 # [ 1.306553] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.309257] systemd[1]: Hostname set to . lb # [ 1.307323] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 lb # [ 1.312880] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.308926] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.373256] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.325024] systemd[1]: Detected virtualization qemu. client # [ 1.320893] systemd[1]: Detected virtualization qemu. lb # [ 1.325110] systemd[1]: Detected architecture arm64. client # [ 1.322877] systemd[1]: Detected architecture arm64. lb # [ 1.325134] systemd[1]: Running in initrd. client # [ 1.324830] systemd[1]: Running in initrd. lb # [ 1.326052] systemd[1]: Initializing machine ID from random generator. lb # [ 1.326326] systemd[1]: Hostname set to . client # [ 1.327371] systemd[1]: Initializing machine ID from random generator. client # [ 1.330341] systemd[1]: Hostname set to . worker2 # [ 1.352599] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 client # [ 1.376286] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 lb # [ 1.391294] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 worker1 # [ 1.493090] usb 1-2: new high-speed USB device number 3 using ehci-pci worker2 # [ 1.472374] usb 1-2: new high-speed USB device number 3 using ehci-pci client # [ 1.496090] usb 1-2: new high-speed USB device number 3 using ehci-pci lb # [ 1.511076] usb 1-2: new high-speed USB device number 3 using ehci-pci worker1 # [ 1.621500] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.653604] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker1 # [ 1.658676] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker2 # [ 1.630567] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 worker2 # [ 1.636112] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.636609] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.640776] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.630884] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 1.657229] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 client # [ 1.661491] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 lb # [ 1.674283] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 lb # [ 1.678994] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 worker1 # [ 1.737512] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.747493] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.748716] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.750171] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.751265] systemd[1]: Reached target Path Units. worker1 # [ 1.752111] systemd[1]: Reached target Slice Units. worker1 # [ 1.752966] systemd[1]: Reached target Swaps. worker1 # [ 1.753803] systemd[1]: Reached target Timer Units. worker1 # [ 1.754834] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.756088] systemd[1]: Listening on Journal Socket (/dev/log). worker1 # [ 1.757268] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.758278] systemd[1]: Listening on udev Control Socket. worker1 # [ 1.759428] systemd[1]: Listening on udev Kernel Socket. worker1 # [ 1.760366] systemd[1]: Reached target Socket Units. worker1 # [ 1.762883] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.773178] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 1.773265] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 1.733010] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.777642] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.742583] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.789210] systemd[1]: Starting Journal Service... worker2 # [ 1.743708] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.745029] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.746026] systemd[1]: Reached target Path Units. worker2 # [ 1.746793] systemd[1]: Reached target Slice Units. worker2 # [ 1.747573] systemd[1]: Reached target Swaps. worker2 # [ 1.748297] systemd[1]: Reached target Timer Units. worker2 # [ 1.749280] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.750514] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.751573] systemd[1]: Listening on Journal Sockets. client # [ 1.741665] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.752541] systemd[1]: Listening on udev Control Socket. worker2 # [ 1.752652] systemd[1]: Listening on udev Kernel Socket. worker2 # [ 1.752676] systemd[1]: Reached target Socket Units. lb # [ 1.752765] systemd[1]: Queued start job for default target Initrd Default Target. worker2 # [ 1.756601] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.750421] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.751714] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.764505] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.761423] systemd[1]: Created slice Slice /system/modprobe. client # [ 1.753285] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.811790] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.765604] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 1.762670] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 1.753324] systemd[1]: Reached target Path Units. worker1 # [ 1.812711] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.753346] systemd[1]: Reached target Slice Units. lb # [ 1.764082] systemd[1]: Expecting device /dev/disk/by-label/nixos... client # [ 1.753368] systemd[1]: Reached target Swaps. lb # [ 1.765178] systemd[1]: Reached target Path Units. client # [ 1.753388] systemd[1]: Reached target Timer Units. lb # [ 1.766036] systemd[1]: Reached target Slice Units. client # [ 1.753585] systemd[1]: Listening on D-Bus System Message Bus Socket. lb # [ 1.766904] systemd[1]: Reached target Swaps. client # [ 1.753747] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.767845] systemd[1]: Reached target Timer Units. client # [ 1.753895] systemd[1]: Listening on Journal Sockets. lb # [ 1.768895] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.772565] systemd[1]: Mounting Kernel Configuration File System... client # [ 1.754046] systemd[1]: Listening on udev Control Socket. lb # [ 1.770162] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.754165] systemd[1]: Listening on udev Kernel Socket. client # [ 1.754190] systemd[1]: Reached target Socket Units. client # [ 1.765880] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 1.771374] systemd[1]: Listening on Journal Sockets. lb # [ 1.771520] systemd[1]: Listening on udev Control Socket. lb # [ 1.771640] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.771664] systemd[1]: Reached target Socket Units. lb # [ 1.776701] systemd[1]: Starting Create List of Static Device Nodes... client # [ 1.772908] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 1.774145] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 1.833163] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 1.836389] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.787207] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 1.788391] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 1.784177] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 1.839400] systemd-journald[73]: Collecting audit messages is disabled. worker1 # [ 1.840232] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.791791] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 1.802760] systemd[1]: Starting Journal Service... client # [ 1.793465] systemd[1]: Starting Journal Service... worker1 # [ 1.853208] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 1.853552] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.809417] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.810303] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.857659] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.811540] systemd[1]: Starting Journal Service... worker2 # [ 1.816215] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.824713] systemd[1]: Starting Load Kernel Modules... lb # [ 1.825675] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.828812] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.829876] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 1.821328] systemd[1]: Starting Load Kernel Modules... client # [ 1.822238] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 1.838550] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.840556] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 1.840944] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 1.846152] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.893626] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.899755] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.844775] systemd[1]: Starting Coldplug All udev Devices... lb # [ 1.851369] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 1.852245] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 1.852533] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 1.852753] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.901807] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.855115] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.866137] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.863751] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 1.913103] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.860230] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.861172] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 1.927027] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.869711] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker1 # [ 1.927267] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.883896] systemd-journald[73]: Collecting audit messages is disabled. client # [ 1.873786] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 1.874133] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 1.927276] [drm] features: -context_init worker1 # [ 1.927987] [drm] number of scanouts: 1 worker1 # [ 1.928005] [drm] number of cap sets: 0 worker2 # [ 1.887447] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.938716] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker1 # [ 1.938738] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.896138] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 client # [ 1.884536] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.893656] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. worker2 # [ 1.900449] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.902913] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.902461] systemd-journald[73]: Collecting audit messages is disabled. worker2 # [ 1.912554] [drm] features: -virgl +edid -resource_blob -host_visible worker2 # [ 1.912572] [drm] features: -context_init worker2 # [ 1.913418] [drm] number of scanouts: 1 worker2 # [ 1.913436] [drm] number of cap sets: 0 client # [ 1.900437] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.911868] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.905140] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.961746] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.962116] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.905370] [drm] features: -virgl +edid -resource_blob -host_visible client # [ 1.905380] [drm] features: -context_init lb # [ 1.915099] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.962144] systemd[1]: Reached target Local File Systems. client # [ 1.906080] [drm] number of scanouts: 1 client # [ 1.906098] [drm] number of cap sets: 0 worker1 # [ 1.965953] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.917309] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 1.920765] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic worker2 # [ 1.920782] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.930816] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 worker1 # [ 1.977280] Console: switching to colour frame buffer device 160x50 client # [ 1.924646] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 1.926180] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.931709] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic client # [ 1.931731] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 lb # [ 1.947129] [drm] features: -virgl +edid -resource_blob -host_visible worker1 # [ 1.997621] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device lb # [ 1.947148] [drm] features: -context_init lb # [ 1.947905] [drm] number of scanouts: 1 lb # [ 1.947924] [drm] number of cap sets: 0 worker2 # [ 1.948601] Console: switching to colour frame buffer device 160x50 worker1 # [ 2.006416] systemd[1]: Finished Load Kernel Modules. lb # [ 1.950964] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic lb # [ 1.950982] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 worker2 # [ 1.964975] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 1.965149] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 1.965175] systemd[1]: Reached target Local File Systems. worker2 # [ 1.968985] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.960919] Console: switching to colour frame buffer device 160x50 worker1 # [ 2.021463] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.975630] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.975827] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.975854] systemd[1]: Reached target Local File Systems. worker2 # [ 1.983281] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 2.017860] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 1.983412] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 2.035984] systemd[1]: Started Journal Service. worker1 # [ 2.024266] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker1 # [ 2.025380] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 1.996550] systemd[1]: Finished Load Kernel Modules. worker1 # [ 2.026436] systemd-modules-load[74]: Inserted module 'virtio_gpu' worker1 # [ 2.027404] systemd-modules-load[74]: Module 'virtio_rng' is built in lb # [ 1.988362] Console: switching to colour frame buffer device 160x50 lb # [ 1.994846] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device client # [ 1.988644] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 1.989020] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 2.000635] systemd[1]: Starting Apply Kernel Variables... client # [ 1.989047] systemd[1]: Reached target Local File Systems. client # [ 1.993356] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device worker1 # [ 2.048506] systemd[1]: Starting Create System Files and Directories... lb # [ 2.019725] systemd[1]: Finished Load Kernel Modules. client # [ 2.012175] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 2.012704] systemd[1]: Finished Load Kernel Modules. client # [ 2.016749] systemd[1]: Starting Apply Kernel Variables... lb # [ 2.027438] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 2.064970] systemd-udevd[80]: Using default interface naming scheme 'v261'. worker1 # [ 2.077674] systemd[1]: Finished Apply Kernel Variables. client # [ 2.028916] systemd-modules-load[75]: Inserted module 'dm_mod' client # [ 2.046017] systemd[1]: Started Journal Service. worker2 # [ 2.056992] systemd[1]: Finished Apply Kernel Variables. client # [ 2.033195] systemd-modules-load[75]: Module 'virtio_balloon' is built in worker1 # [ 2.090114] systemd[1]: Finished Create System Files and Directories. worker2 # [ 2.066796] systemd[1]: Started Journal Service. client # [ 2.043345] systemd-modules-load[75]: Module 'virtio_console' is built in worker1 # [ 2.106134] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 2.052474] systemd-modules-load[75]: Inserted module 'virtio_gpu' client # [ 2.053502] systemd-modules-load[75]: Module 'virtio_rng' is built in client # [ 2.054536] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.064285] systemd-modules-load[74]: Inserted module 'dm_mod' worker2 # [ 2.066923] systemd-modules-load[74]: Module 'virtio_balloon' is built in worker2 # [ 2.068156] systemd-modules-load[74]: Module 'virtio_console' is built in worker2 # [ 2.071045] systemd-modules-load[74]: Inserted module 'virtio_gpu' lb # [ 2.082893] systemd[1]: Finished Apply Kernel Variables. client # [ 2.068315] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 2.080723] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.082423] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.083743] systemd-udevd[79]: Using default interface naming scheme 'v261'. lb # [ 2.095144] systemd[1]: Started Journal Service. lb # [ 2.088354] systemd-modules-load[74]: Inserted module 'dm_mod' lb # [ 2.089610] systemd-modules-load[74]: Module 'virtio_balloon' is built in lb # [ 2.090675] systemd-modules-load[74]: Module 'virtio_console' is built in lb # [ 2.091696] systemd-modules-load[74]: Inserted module 'virtio_gpu' client # [ 2.086256] systemd[1]: Finished Create System Files and Directories. lb # [ 2.097888] systemd-modules-load[74]: Module 'virtio_rng' is built in worker2 # [ 2.100198] systemd[1]: Finished Create System Files and Directories. lb # [ 2.106038] systemd-udevd[79]: Using default interface naming scheme 'v261'. client # [ 2.100426] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 2.108212] systemd[1]: Starting Create System Files and Directories... worker2 # [ 2.116758] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.164278] systemd[1]: Starting Virtual Console Setup... lb # [ 2.132237] systemd[1]: Finished Create System Files and Directories. client # [ 2.125374] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 2.145259] systemd[1]: Started Rule-based Manager for Device Events and Files. worker1 # [ 2.216448] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.172130] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.219868] systemd[1]: Finished Virtual Console Setup. client # [ 2.184804] systemd[1]: Starting Virtual Console Setup... lb # [ 2.203858] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.216459] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 2.219738] systemd[1]: Finished Virtual Console Setup. client # [ 2.240450] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.248435] systemd-vconsole-setup[103]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.243799] systemd[1]: Finished Virtual Console Setup. lb # [ 2.251837] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.801713] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 2.804178] systemd[1]: Reached target System Initialization. worker1 # [ 2.804997] systemd[1]: Reached target Basic System. worker2 # [ 2.817532] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 2.818475] systemd[1]: Reached target System Initialization. worker2 # [ 2.819254] systemd[1]: Reached target Basic System. client # [ 2.839254] systemd[1]: Finished Coldplug All udev Devices. client # [ 2.840469] systemd[1]: Reached target System Initialization. client # [ 2.844349] systemd[1]: Reached target Basic System. lb # [ 2.854120] systemd[1]: Finished Coldplug All udev Devices. lb # [ 2.855061] systemd[1]: Reached target System Initialization. lb # [ 2.855868] systemd[1]: Reached target Basic System. worker1 # [ 2.939467] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.976414] (udev-worker)[106]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.981074] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.936105] (udev-worker)[106]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.975894] (udev-worker)[94]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.036587] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.039367] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.997755] (udev-worker)[96]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 3.044163] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.004184] (udev-worker)[96]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.015202] (udev-worker)[99]: Network interface NamePolicy= disabled on kernel command line. client # [ 3.020454] (udev-worker)[101]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 3.024611] (udev-worker)[101]: Network interface NamePolicy= disabled on kernel command line. lb # [ 3.034285] (udev-worker)[92]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 3.040259] (udev-worker)[92]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 3.094683] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 3.052875] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.101116] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.059785] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.109271] systemd[1]: Mounting /sysroot... worker2 # [ 3.067887] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... client # [ 3.084834] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 3.087405] systemd[1]: Reached target Initrd Root Device. worker1 # [ 3.159987] EXT4-fs (vda): mounted filesystem a505a470-475f-4e3c-be79-dfe4ace5a1ec r/w with ordered data mode. Quota mode: none. client # [ 3.089787] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 3.149686] systemd[1]: Mounted /sysroot. worker1 # [ 3.151489] systemd[1]: Reached target Initrd Root File System. lb # [ 3.110251] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 3.160008] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.114126] systemd[1]: Reached target Initrd Root Device. worker2 # [ 3.117729] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.117843] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 3.124103] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.127306] systemd[1]: Mounting /sysroot... worker1 # [ 3.176363] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker1 # [ 3.183004] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker1 # [ 3.188813] systemd[1]: Reloading... client # [ 3.143825] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks lb # [ 3.157938] systemd-fsck[112]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 3.151256] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. worker2 # [ 3.179003] EXT4-fs (vda): mounted filesystem d99f2033-5ec8-4d15-85ec-bb532d39d4c9 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.167669] systemd[1]: Mounted /sysroot. lb # [ 3.166199] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 3.168133] systemd[1]: Mounting /sysroot... client # [ 3.162202] systemd[1]: Mounting /sysroot... worker2 # [ 3.172789] systemd[1]: Reached target Initrd Root File System. worker2 # [ 3.175495] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 3.200109] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 3.206365] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.212274] EXT4-fs (vda): mounted filesystem f76c1d46-0987-4c81-bfb2-08ffb764ef4b r/w with ordered data mode. Quota mode: none. lb # [ 3.221201] EXT4-fs (vda): mounted filesystem dc39a975-c708-411b-9408-140d620138b1 r/w with ordered data mode. Quota mode: none. worker2 # [ 3.210811] systemd[1]: Reloading... client # [ 3.201396] systemd[1]: Mounted /sysroot. client # [ 3.203394] systemd[1]: Reached target Initrd Root File System. lb # [ 3.212731] systemd[1]: Mounted /sysroot. client # [ 3.208145] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 3.216545] systemd[1]: Reached target Initrd Root File System. lb # [ 3.219342] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 3.231982] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. client # [ 3.237581] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... client # [ 3.240415] systemd[1]: Reloading... lb # [ 3.248364] systemd-sysroot-fstab-check[120]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 3.256106] systemd[1]: Reload requested from client PID 120 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 3.259830] systemd[1]: Reloading... worker1 # [ 3.397550] systemd[1]: Reloading finished in 210 ms. worker1 # [ 3.423662] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker1 # [ 3.427657] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... worker1 # [ 3.433179] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 3.436160] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 3.444205] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 3.445202] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.416116] systemd[1]: Reloading finished in 206 ms. worker1 # [ 3.465691] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 3.467149] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 3.448799] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.452438] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.446864] systemd[1]: Reloading finished in 206 ms. worker2 # [ 3.459102] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 3.464652] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 3.468605] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.466791] systemd[1]: Reloading finished in 210 ms. worker2 # [ 3.469692] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker2 # [ 3.489283] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.481199] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... worker2 # [ 3.491475] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 3.484921] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... lb # [ 3.497327] systemd-sysroot-fstab-check[120]: Requesting initrd-fs.target/start/replace... client # [ 3.490407] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.492828] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.500940] systemd-sysroot-fstab-check[120]: Requesting swap.target/start/replace... client # [ 3.497831] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.507114] systemd[1]: Starting Load Kernel Module 9pnet_virtio... client # [ 3.500817] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 3.512163] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 3.515957] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 3.519017] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 3.525319] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 3.527465] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 3.543485] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 3.544725] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 3.821348] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.832600] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.842260] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.852228] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.814115] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.830978] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.833092] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.882241] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.834372] systemd[1]: Mounting /sysroot/nix/.ro-store... worker2 # [ 3.850776] systemd[1]: Mounting /sysroot/run... lb # [ 3.852116] systemd[1]: Mounting /sysroot/nix/.rw-store... lb # [ 3.856083] systemd[1]: Mounting /sysroot/run... client # [ 3.852137] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.861911] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.857037] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.918889] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.879347] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.929675] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.886846] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.890450] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.896388] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.898321] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.891021] systemd[1]: Mounting /sysroot/tmp/shared... worker1 # [ 3.948290] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 3.952620] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.953339] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.902752] systemd[1]: Mounting /sysroot/tmp/xchg... lb # [ 3.910944] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.967521] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.934648] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.927590] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.983261] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.984446] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 3.937755] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.986245] systemd[1]: Mounting /sysroot/nix/store... client # [ 3.934893] systemd[1]: Mounted /sysroot/nix/.ro-store. worker2 # [ 3.949565] systemd[1]: Mounted /sysroot/run. client # [ 3.943274] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.958067] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.959695] systemd[1]: Mounted /sysroot/tmp/xchg. lb # [ 3.960673] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 3.963016] systemd[1]: Mounted /sysroot/nix/.ro-store. lb # [ 3.965444] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.975448] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.977243] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.025663] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.971113] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.027407] systemd[1]: Reached target Initrd File Systems. client # [ 3.973816] systemd[1]: Mounted /sysroot/tmp/shared. lb # [ 3.983263] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 4.032157] systemd[1]: Starting Find NixOS closure... lb # [ 3.990793] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 3.991849] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.986832] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 4.044962] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.008395] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 4.009778] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.077346] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.094091] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.095443] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.097652] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.126042] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.127913] systemd[1]: Stopped target Basic System. worker1 # [ 4.128917] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.132932] systemd[1]: Stopped target Path Units. worker1 # [ 4.134487] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.136588] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.139518] systemd[1]: Stopped target Slice Units. worker1 # [ 4.142790] systemd[1]: Stopped target Socket Units. worker1 # [ 4.148564] systemd[1]: Stopped target System Initialization. worker1 # [ 4.150552] systemd[1]: Stopped target Swaps. worker1 # [ 4.151224] systemd[1]: Stopped target Timer Units. worker1 # [ 4.152880] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.154251] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.163497] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.168289] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.169144] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 4.178248] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.180508] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 4.184499] systemd[1]: Stopped Apply Kernel Variables. worker1 # [ 4.185867] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.189743] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 4.192206] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.195961] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 4.200326] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.203680] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.206564] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.209932] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.211031] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.215320] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.216397] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.217415] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.218489] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.219211] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 4.228234] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 4.229161] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 4.230264] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.231248] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.232580] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.233388] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 4.234298] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.235249] systemd[1]: systemd-udevd.service: Consumed 1.120s CPU time over 2.273s wall clock time, 18.4M memory peak. worker1 # [ 4.240355] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker1 # [ 4.241385] systemd[1]: Closed udev Control Socket. worker1 # [ 4.244342] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.245277] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 4.248176] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 4.249073] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 4.252133] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 4.256128] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker1 # [ 4.257092] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 4.278122] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 4.279210] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.283877] systemd[1]: Reached target Switch Root. worker1 # [ 4.285215] systemd[1]: Starting NixOS Activation... worker2 # [ 4.313097] (udev-worker)[102]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker2 # [ 4.319867] (udev-worker)[102]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.341868] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 4.343323] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 4.348177] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 4.349120] systemd[1]: Starting Virtual Console Setup... lb # [ 4.354481] (udev-worker)[99]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory lb # [ 4.359928] (udev-worker)[99]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory worker2 # [ 4.372716] systemd-vconsole-setup[154]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 4.375193] systemd[1]: Finished Virtual Console Setup. lb # [ 4.385952] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.387143] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.390759] systemd[1]: Stopping Virtual Console Setup... lb # [ 4.392141] systemd[1]: Starting Virtual Console Setup... client # [ 4.389562] (udev-worker)[102]: mtd0ro: Failed to find and pin callout binary "/nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/mtd_probe": No such file or directory worker1 # [ 4.447038] initrd-nixos-activation-start[172]: booting system configuration /nix/store/5vbszsyzv004gnsrdf7b2mfaix2sa0dq-nixos-system-worker1-test lb # [ 4.400937] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.402723] systemd[1]: Stopped Virtual Console Setup. client # [ 4.395282] (udev-worker)[102]: mtd0ro: /nix/store/awq6qdiyxlvdp21km39qj020fcshgkia-systemd-261.2/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory lb # [ 4.408402] systemd[1]: Starting Virtual Console Setup... client # [ 4.410235] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.412133] systemd[1]: Stopped Virtual Console Setup. client # [ 4.416672] systemd[1]: Stopping Virtual Console Setup... client # [ 4.417935] systemd[1]: Starting Virtual Console Setup... lb # [ 4.436688] systemd-vconsole-setup[155]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 4.439118] systemd[1]: Finished Virtual Console Setup. client # [ 4.432371] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 4.433846] systemd[1]: Stopped Virtual Console Setup. client # [ 4.437326] systemd[1]: Starting Virtual Console Setup... worker1 # [ 4.511933] initrd-nixos-activation-start[172]: running activation script... client # [ 4.464675] systemd-vconsole-setup[156]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 4.467995] systemd[1]: Finished Virtual Console Setup. worker2 # [ 4.815492] systemd[1]: Mounting /sysroot/nix/store... lb # [ 4.836207] systemd[1]: Mounting /sysroot/nix/store... client # [ 4.835855] systemd[1]: Mounting /sysroot/nix/store... worker2 # [ 4.876856] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 4.880442] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.927059] initrd-nixos-activation-start[195]: setting up /etc... worker2 # [ 4.885412] systemd[1]: Starting Find NixOS closure... worker2 # [ 4.893348] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 4.897168] systemd[1]: Mounted /sysroot/nix/store. lb # [ 4.900883] systemd[1]: Reached target Initrd File Systems. lb # [ 4.906307] systemd[1]: Starting Find NixOS closure... client # [ 4.902421] systemd[1]: Mounted /sysroot/nix/store. client # [ 4.905661] systemd[1]: Reached target Initrd File Systems. client # [ 4.911007] systemd[1]: Starting Find NixOS closure... lb # [ 4.920421] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... client # [ 4.924938] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 4.937756] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 4.945362] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker2 # [ 4.956774] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.958698] systemd[1]: Reached target Initrd Default Target. worker2 # [ 4.962191] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.964328] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.968357] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. client # [ 4.967387] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 4.971985] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 4.982514] systemd[1]: Finished Find NixOS closure. lb # [ 4.985904] systemd[1]: Reached target Initrd Default Target. lb # [ 4.987545] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 4.985460] systemd[1]: Finished Find NixOS closure. worker2 # [ 4.995775] systemd[1]: Stopped target Initrd Default Target. worker2 # [ 4.997898] systemd[1]: Stopped target Basic System. client # [ 4.988231] systemd[1]: Reached target Initrd Default Target. worker2 # [ 5.000273] systemd[1]: Stopped target Initrd Root Device. client # [ 4.991109] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 5.002096] systemd[1]: Stopped target Path Units. worker2 # [ 5.004643] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker2 # [ 5.008072] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.011686] systemd[1]: Stopped target Slice Units. worker2 # [ 5.016241] systemd[1]: Stopped target Socket Units. worker2 # [ 5.017200] systemd[1]: Stopped target System Initialization. worker2 # [ 5.018190] systemd[1]: Stopped target Swaps. worker2 # [ 5.018969] systemd[1]: Stopped target Timer Units. worker2 # [ 5.019823] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 5.018881] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.020915] systemd[1]: Stopped target Basic System. worker2 # [ 5.024231] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 5.025257] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.024409] systemd[1]: Stopped target Initrd Root Device. worker2 # [ 5.027460] systemd[1]: Stopped Find NixOS closure. lb # [ 5.026198] systemd[1]: Stopped target Path Units. worker2 # [ 5.030479] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 5.028212] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 5.022944] systemd[1]: Stopped target Initrd Default Target. lb # [ 5.031246] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.034599] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.024871] systemd[1]: Stopped target Basic System. worker2 # [ 5.037190] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.028450] systemd[1]: Stopped target Initrd Root Device. lb # [ 5.036289] systemd[1]: Stopped target Slice Units. client # [ 5.029612] systemd[1]: Stopped target Path Units. client # [ 5.031124] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 5.040222] systemd[1]: Stopped target Socket Units. lb # [ 5.041148] systemd[1]: Stopped target System Initialization. lb # [ 5.042690] systemd[1]: Stopped target Swaps. client # [ 5.034487] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 5.046633] systemd[1]: Stopped target Timer Units. worker2 # [ 5.048925] systemd[1]: Stopped Apply Kernel Variables. lb # [ 5.047589] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.040165] systemd[1]: Stopped target Slice Units. worker2 # [ 5.050161] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 5.041137] systemd[1]: Stopped target Socket Units. lb # [ 5.048828] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.042048] systemd[1]: Stopped target System Initialization. client # [ 5.044254] systemd[1]: Stopped target Swaps. client # [ 5.045077] systemd[1]: Stopped target Timer Units. lb # [ 5.052306] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 5.054942] systemd[1]: Stopped Load Kernel Modules. client # [ 5.048153] systemd[1]: dbus.socket: Deactivated successfully. client # [ 5.049235] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 5.051169] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 5.061074] systemd[1]: Stopped Find NixOS closure. worker2 # [ 5.062911] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.055448] systemd[1]: Stopped Find NixOS closure. lb # [ 5.064465] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 5.067649] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 5.067558] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 5.060522] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 5.070180] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 5.061501] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 5.072143] systemd[1]: Stopped Create System Files and Directories. client # [ 5.062579] systemd[1]: systemd-sysctl.service: Deactivated successfully. client # [ 5.063581] systemd[1]: Stopped Apply Kernel Variables. worker2 # [ 5.073897] systemd[1]: Stopped target Local File Systems. worker2 # [ 5.076326] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 5.078260] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 5.080494] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.079237] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 5.084247] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 5.085319] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 5.086318] systemd[1]: Stopped Virtual Console Setup. lb # [ 5.084440] systemd[1]: Stopped Apply Kernel Variables. lb # [ 5.085272] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 5.087841] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 5.086446] systemd[1]: Stopped Load Kernel Modules. client # [ 5.078650] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 5.089061] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. lb # [ 5.087174] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 5.079769] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 5.089954] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker2 # [ 5.090926] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker2 # [ 5.091747] systemd[1]: systemd-udevd.service: Deactivated successfully. worker2 # [ 5.092786] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.083925] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker2 # [ 5.093756] systemd[1]: systemd-udevd.service: Consumed 1.368s CPU time over 3.117s wall clock time, 22.2M memory peak. worker2 # [ 5.095321] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 5.095264] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 5.087498] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 5.097420] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 5.099990] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 5.100891] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. worker2 # [ 5.101962] systemd[1]: Closed udev Control Socket. lb # [ 5.099985] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 5.102647] systemd[1]: Starting Cleanup udev Database... lb # [ 5.101621] systemd[1]: Stopped target Local File Systems. worker2 # [ 5.103395] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 5.094315] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 5.103834] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 5.105880] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 5.108271] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.099469] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 5.109173] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 5.108356] systemd[1]: Stopped Coldplug All udev Devices. client # [ 5.101634] systemd[1]: Stopped target Local File Systems. worker2 # [ 5.112195] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.103512] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 5.111472] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 5.112807] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 5.113807] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 5.116131] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.106505] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 5.114534] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 5.117101] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 5.115421] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.107756] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 5.116459] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.117441] systemd[1]: Finished Load Kernel Module 9pnet_virtio. lb # [ 5.118268] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.119176] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 5.112436] systemd[1]: Stopping Rule-based Manager for Device Events and Files... client # [ 5.113516] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 5.114528] systemd[1]: Stopped Virtual Console Setup. client # [ 5.115269] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 5.123866] systemd[1]: systemd-udevd.service: Consumed 1.382s CPU time over 3.126s wall clock time, 22.4M memory peak. client # [ 5.117354] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 5.118232] systemd[1]: initrd-cleanup.service: Deactivated successfully. client # [ 5.119182] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 5.120221] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 5.128213] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.121151] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 5.129350] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 5.122154] systemd[1]: systemd-udevd.service: Consumed 1.414s CPU time over 3.102s wall clock time, 22.4M memory peak. lb # [ 5.130289] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.123590] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 5.128215] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 5.136119] systemd[1]: Closed udev Control Socket. lb # [ 5.136878] systemd[1]: Starting Cleanup udev Database... client # [ 5.129094] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. client # [ 5.130351] systemd[1]: Closed udev Control Socket. lb # [ 5.137637] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.138846] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 5.132189] systemd[1]: Starting Cleanup udev Database... lb # [ 5.140138] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker1 # [ 5.187819] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 5.143215] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 5.190705] systemd[1]: Finished NixOS Activation. client # [ 5.136224] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 5.144432] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 5.192126] systemd[1]: Starting Switch Root... client # [ 5.137350] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 5.145425] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.138225] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 5.148224] systemd[1]: Finished Cleanup udev Database. lb # [ 5.146372] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 5.149009] systemd[1]: Reached target Switch Root. worker2 # [ 5.149690] systemd[1]: Starting NixOS Activation... client # [ 5.140115] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 5.144154] systemd[1]: kmod-static-nodes.service: Deactivated successfully. client # [ 5.145138] systemd[1]: Stopped Create List of Static Device Nodes. worker1 # [ 5.215407] systemd[1]: Switching root. lb # [ 5.170151] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 5.171271] systemd[1]: Finished Cleanup udev Database. lb # [ 5.176594] systemd[1]: Reached target Switch Root. lb # [ 5.177364] systemd[1]: Starting NixOS Activation... client # [ 5.172113] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 5.176474] systemd[1]: Finished Cleanup udev Database. client # [ 5.177309] systemd[1]: Reached target Switch Root. client # [ 5.178012] systemd[1]: Starting NixOS Activation... worker2 # [ 5.308367] initrd-nixos-activation-start[179]: booting system configuration /nix/store/6yvsrrlv2v3fnzjcmy4bw3slivzrwrqr-nixos-system-worker2-test worker1 # [ 5.400277] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 5.338528] initrd-nixos-activation-start[180]: booting system configuration /nix/store/7q1s737l14q4l5xb2660hk29x3d20j19-nixos-system-lb-test client # [ 5.338320] initrd-nixos-activation-start[181]: booting system configuration /nix/store/9b0ww2bi5z80fdwbhp6j472q7cahjy3h-nixos-system-client-test worker2 # [ 5.369863] initrd-nixos-activation-start[179]: running activation script... lb # [ 5.401889] initrd-nixos-activation-start[180]: running activation script... client # [ 5.401083] initrd-nixos-activation-start[181]: running activation script... worker2 # [ 5.774618] initrd-nixos-activation-start[202]: setting up /etc... lb # [ 5.813588] initrd-nixos-activation-start[203]: setting up /etc... client # [ 5.806315] initrd-nixos-activation-start[204]: setting up /etc... worker1 # [ 6.001332] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 6.013231] systemd[1]: Detected virtualization qemu. worker1 # [ 6.016163] systemd[1]: Detected architecture arm64. worker1 # [ 6.019932] systemd[1]: Detected first boot. worker1 # [ 6.027068] systemd[1]: Initializing machine ID from random generator. worker2 # [ 6.035591] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 6.038508] systemd[1]: Finished NixOS Activation. worker2 # [ 6.040101] systemd[1]: Starting Switch Root... worker2 # [ 6.062972] systemd[1]: Switching root. client # [ 6.071398] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.074220] systemd[1]: Finished NixOS Activation. lb # [ 6.082826] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 6.076101] systemd[1]: Starting Switch Root... lb # [ 6.085604] systemd[1]: Finished NixOS Activation. lb # [ 6.086824] systemd[1]: Starting Switch Root... lb # [ 6.107119] systemd[1]: Switching root. client # [ 6.099459] systemd[1]: Switching root. worker2 # [ 6.251240] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). client # [ 6.282246] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). lb # [ 6.289549] systemd-journald[73]: Received SIGTERM from PID 1 (systemd). worker1 # [ 6.347511] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 6.535697] systemd[1]: Applying preset policy. worker2 # [ 6.840797] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 6.853115] systemd[1]: Detected virtualization qemu. worker2 # [ 6.856090] systemd[1]: Detected architecture arm64. worker2 # [ 6.859930] systemd[1]: Detected first boot. worker2 # [ 6.866579] systemd[1]: Initializing machine ID from random generator. lb # [ 6.884363] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 6.898098] systemd[1]: Detected virtualization qemu. lb # [ 6.900992] systemd[1]: Detected architecture arm64. lb # [ 6.903202] systemd[1]: Detected first boot. client # [ 6.887398] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 6.899586] systemd[1]: Detected virtualization qemu. client # [ 6.902745] systemd[1]: Detected architecture arm64. lb # [ 6.910564] systemd[1]: Initializing machine ID from random generator. client # [ 6.905806] systemd[1]: Detected first boot. client # [ 6.913571] systemd[1]: Initializing machine ID from random generator. worker1 # [ 7.015468] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 7.192458] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 7.238842] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 7.236183] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 7.378176] systemd[1]: Applying preset policy. lb # [ 7.428670] systemd[1]: Applying preset policy. client # [ 7.422771] systemd[1]: Applying preset policy. worker1 # [ 7.518531] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker1 # [ 7.519874] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 7.523385] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 7.527223] systemd[1]: Created slice Slice /system/getty. worker1 # [ 7.528923] systemd[1]: Created slice User and Session Slice. worker1 # [ 7.530090] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 7.532999] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 7.534018] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 7.534674] systemd[1]: Expecting device /dev/ttyAMA0... worker1 # [ 7.535823] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 7.537578] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 7.539139] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 7.541858] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 7.543030] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 7.544730] systemd[1]: Reached target Path Units. worker1 # [ 7.546227] systemd[1]: Reached target Remote File Systems. worker1 # [ 7.548619] systemd[1]: Reached target Slice Units. worker1 # [ 7.549762] systemd[1]: Reached target Swaps. worker1 # [ 7.554308] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 7.559303] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 7.563222] systemd[1]: Listening on Credential Encryption/Decryption. worker1 # [ 7.567140] systemd[1]: Listening on Factory Reset Management. worker1 # [ 7.568367] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 7.574389] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 7.576544] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 7.582084] systemd[1]: Listening on Console Output Muting Service Socket. worker1 # [ 7.584510] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 7.586845] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.589305] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 7.599516] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 7.601788] systemd[1]: Listening on udev Control Socket. worker1 # [ 7.603874] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 7.608731] systemd[1]: Mounting Huge Pages File System... worker1 # [ 7.613941] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 7.625373] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 7.635520] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 7.648371] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 7.662246] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker1 # [ 7.665168] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 7.679105] systemd[1]: Mounting Kernel Configuration File System... worker1 # [ 7.679469] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 7.679729] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.696709] systemd[1]: Starting Load Kernel Module fuse... worker1 # [ 7.698299] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.757319] systemd[1]: Starting Journal Service... worker1 # [ 7.765854] systemd[1]: Starting Load Kernel Modules... worker1 # [ 7.777453] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 7.793135] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 7.796171] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.817496] systemd[1]: Starting Coldplug All udev Devices... worker1 # [ 7.820020] systemd[1]: Listening on Journal Log Access Socket. worker1 # [ 7.820418] systemd[1]: Mounted Huge Pages File System. worker1 # [ 7.820808] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 7.829320] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 7.831470] systemd[1]: Mounted Kernel Trace File System. worker1 # [ 7.834382] systemd[1]: Mounted Kernel Configuration File System. worker1 # [ 7.879930] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 7.886546] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 7.868812] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.936700] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. worker1 # [ 7.939424] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 7.957362] EXT4-fs (vda): re-mounted a505a470-475f-4e3c-be79-dfe4ace5a1ec. client # [ 7.904616] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.966166] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 7.968595] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 7.968952] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker1 # [ 7.978419] systemd[1]: Starting Load/Save OS Random Seed... worker1 # [ 7.978772] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 7.983438] systemd[1]: Finished Load Kernel Modules. lb # [ 7.936918] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 7.996329] systemd-journald[267]: Collecting audit messages is enabled. worker1 # [ 8.006791] systemd[1]: Starting Firewall... worker1 # [ 8.016223] fuse: init (API version 7.45) worker1 # [ 8.003429] systemd[1]: Queued start job for default target Multi-User System. worker1 # [ 8.029552] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 8.031711] systemd[1]: Started Journal Service. worker1 # [ 8.026050] systemd[1]: systemd-journald.service: Deactivated successfully. worker1 # [ 8.041242] systemd-modules-load[268]: Module 'atkbd' is built in worker1 # [ 8.045575] systemd-modules-load[268]: Module 'loop' is built in worker1 # [ 8.061515] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 8.077321] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker1 # [ 8.081011] systemd[1]: Finished Load Kernel Module fuse. worker1 # [ 8.097772] systemd-oomd[269]: No swap; memory pressure usage will be degraded worker1 # [ 8.109940] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 8.123614] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 8.129472] systemd[1]: Reached target First Boot Complete. worker1 # [ 8.155332] systemd-journald[267]: Received client request to flush runtime journal. worker1 # [ 8.215213] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 8.221283] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 8.224449] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 8.233511] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 8.322974] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 8.324002] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 8.326402] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 8.373866] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 8.375208] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.378538] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.382993] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.385341] systemd[1]: Created slice User and Session Slice. worker2 # [ 8.386632] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.388615] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 8.390268] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.391749] systemd[1]: Expecting device /dev/ttyAMA0... worker2 # [ 8.394149] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 8.395289] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 8.396886] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 8.398445] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 8.400937] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 8.402987] systemd[1]: Reached target Path Units. worker2 # [ 8.404922] systemd[1]: Reached target Remote File Systems. worker2 # [ 8.406715] systemd[1]: Reached target Slice Units. worker2 # [ 8.408462] systemd[1]: Reached target Swaps. client # [ 8.399216] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.400843] systemd[1]: Stopped initrd-switch-root.service. client # [ 8.402219] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker2 # [ 8.412571] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.406649] systemd[1]: Created slice Slice /system/getty. worker2 # [ 8.417554] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.408363] systemd[1]: Created slice User and Session Slice. client # [ 8.410588] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 8.421462] systemd[1]: Listening on Credential Encryption/Decryption. client # [ 8.413055] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 8.425417] systemd[1]: Listening on Factory Reset Management. client # [ 8.415250] systemd[1]: Expecting device /dev/hvc0... worker2 # [ 8.426712] systemd[1]: Listening on Hostname Service Socket. client # [ 8.417224] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.419126] systemd[1]: Reached target Local Encrypted Volumes. client # [ 8.421190] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 8.432966] systemd[1]: Starting Journal Log Access Socket... client # [ 8.423081] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 8.434711] systemd[1]: Listening on Journal Audit Socket. client # [ 8.425133] systemd[1]: Stopped target initrd-switch-root.target. client # [ 8.427132] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 8.438756] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 8.429311] systemd[1]: Reached target Path Units. worker2 # [ 8.440456] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.430302] systemd[1]: Reached target Remote File Systems. client # [ 8.432186] systemd[1]: Reached target Slice Units. worker2 # [ 8.442200] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.433172] systemd[1]: Reached target Swaps. worker2 # [ 8.443995] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 8.437366] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 8.442277] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.446182] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 8.456094] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 8.458409] systemd[1]: Listening on udev Control Socket. worker2 # [ 8.459662] systemd[1]: Listening on udev Varlink Socket. client # [ 8.450089] systemd[1]: Listening on Factory Reset Management. lb # [ 8.457502] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 8.451329] systemd[1]: Listening on Hostname Service Socket. lb # [ 8.458770] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 8.464582] systemd[1]: Mounting Huge Pages File System... lb # [ 8.462309] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 8.456951] systemd[1]: Starting Journal Log Access Socket... client # [ 8.459047] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 8.470092] systemd[1]: Mounting POSIX Message Queue File System... lb # [ 8.466540] systemd[1]: Created slice Slice /system/getty. lb # [ 8.469156] systemd[1]: Created slice User and Session Slice. client # [ 8.463436] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 8.471221] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 8.465866] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 8.473412] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 8.506623] systemd[1]: Mounting /run/wrappers... lb # [ 8.474429] systemd[1]: Expecting device /dev/hvc0... client # [ 8.467517] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.476112] systemd[1]: Expecting device /dev/ttyAMA0... client # [ 8.469486] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 8.477670] systemd[1]: Reached target Local Encrypted Volumes. worker2 # [ 8.482226] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.479400] systemd[1]: Stopped target initrd-fs.target. lb # [ 8.481754] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 8.483789] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 8.518494] systemd[1]: Mounting FUSE Control File System... lb # [ 8.485799] systemd[1]: Reached target Virtual Machines and Containers. client # [ 8.480860] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.487969] systemd[1]: Reached target Path Units. client # [ 8.482283] systemd[1]: Listening on udev Control Socket. lb # [ 8.488934] systemd[1]: Reached target Remote File Systems. client # [ 8.483969] systemd[1]: Listening on udev Varlink Socket. lb # [ 8.491428] systemd[1]: Reached target Slice Units. worker2 # [ 8.494185] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.492393] systemd[1]: Reached target Swaps. client # [ 8.488344] systemd[1]: Mounting Huge Pages File System... lb # [ 8.497342] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 8.503856] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.502318] systemd[1]: Listening on Process Core Dump Socket. client # [ 8.494447] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.499299] systemd[1]: Mounting Kernel Debug File System... lb # [ 8.506530] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 8.510822] systemd[1]: Listening on Factory Reset Management. worker2 # [ 8.511852] systemd[1]: Starting Load Kernel Module 9pnet_virtio... worker2 # [ 8.512223] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs lb # [ 8.512293] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 8.545485] systemd-udevd[307]: Using default interface naming scheme 'v261'. client # [ 8.508500] systemd[1]: Mounting Kernel Trace File System... lb # [ 8.518344] systemd[1]: Starting Journal Log Access Socket... lb # [ 8.520874] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 8.553628] systemd[1]: Mounted FUSE Control File System. worker2 # [ 8.525360] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.525588] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 8.525751] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 8.526022] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore lb # [ 8.528289] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 8.520973] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 8.530188] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.533174] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 8.542846] systemd[1]: Starting Load Kernel Module fuse... worker2 # [ 8.546786] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 lb # [ 8.545676] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 8.547387] systemd[1]: Listening on udev Control Socket. client # [ 8.540817] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.548945] systemd[1]: Listening on udev Varlink Socket. client # [ 8.545866] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 8.586336] systemd[1]: Mounted /run/wrappers. lb # [ 8.554070] systemd[1]: Mounting Huge Pages File System... worker1 # [ 8.590203] systemd[1]: Reached target Local File Systems. client # [ 8.553634] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.560948] systemd[1]: Mounting POSIX Message Queue File System... client # [ 8.555852] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 8.596557] systemd[1]: Listening on Boot Loader Control Service Socket. client # [ 8.557807] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 8.600860] systemd[1]: Starting register-nix-paths.service... lb # [ 8.571704] systemd[1]: Mounting Kernel Debug File System... worker1 # [ 8.608508] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 8.572411] systemd[1]: Starting Load Kernel Module fuse... client # [ 8.574575] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 8.617488] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 8.586535] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 8.631854] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 8.600596] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 8.636642] systemd[1]: Starting Create System Files and Directories... lb # [ 8.614851] systemd[1]: Starting Load Kernel Module 9pnet_virtio... lb # [ 8.617827] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker2 # [ 8.624913] systemd[1]: Starting Journal Service... worker2 # [ 8.637953] systemd[1]: Starting Load Kernel Modules... lb # [ 8.640934] systemd[1]: Mounting Kernel Configuration File System... lb # [ 8.649722] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 8.656978] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 8.655296] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 8.660262] systemd[1]: Starting Journal Service... worker2 # [ 8.670809] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 8.673366] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.710243] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 8.715106] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 8.686512] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 8.693295] systemd[1]: Listening on Journal Log Access Socket. worker2 # [ 8.698258] systemd[1]: Mounted Huge Pages File System. worker2 # [ 8.698754] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 8.699138] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.699518] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 8.699899] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.699288] systemd[1]: Starting Load Kernel Modules... lb # [ 8.713492] systemd[1]: Starting Load Kernel Module fuse... lb # [ 8.720461] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 8.724851] fuse: init (API version 7.45) client # [ 8.729123] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.753746] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.755767] systemd[1]: Starting Journal Service... worker2 # [ 8.761251] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 8.761354] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 8.764207] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 8.781597] systemd[1]: Starting Load Kernel Modules... lb # [ 8.790783] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 8.804654] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. client # [ 8.795577] systemd-journald[275]: Collecting audit messages is enabled. worker2 # [ 8.807477] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.801856] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 8.821544] EXT4-fs (vda): re-mounted d99f2033-5ec8-4d15-85ec-bb532d39d4c9. client # [ 8.801014] systemd[1]: Queued start job for default target Multi-User System. client # [ 8.805754] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 8.831418] systemd[1]: Finished Load Kernel Modules. lb # [ 8.828857] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 8.863130] systemd[1]: Finished Create System Files and Directories. lb # [ 8.829313] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 8.868413] systemd[1]: Starting Rebuild Journal Catalog... client # [ 8.828868] systemd[1]: Started Journal Service. worker2 # [ 8.839869] systemd[1]: Starting Firewall... lb # [ 8.840563] fuse: init (API version 7.45) worker1 # [ 8.873394] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 8.825716] systemd[1]: Listening on Journal Log Access Socket. client # [ 8.828121] systemd[1]: Mounted Huge Pages File System. client # [ 8.832231] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 8.854828] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 8.857754] fuse: init (API version 7.45) worker2 # [ 8.860456] systemd[1]: Starting Apply Kernel Variables... client # [ 8.840802] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 8.864456] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 8.865113] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 8.897847] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 8.865402] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 8.848379] systemd[1]: Mounted Kernel Trace File System. client # [ 8.850268] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 8.874612] systemd-journald[274]: Collecting audit messages is enabled. worker2 # [ 8.880192] systemd[1]: Starting Load/Save OS Random Seed... client # [ 8.857428] systemd-modules-load[276]: Module 'atkbd' is built in worker2 # [ 8.882697] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 8.858381] systemd-modules-load[276]: Module 'loop' is built in client # [ 8.859260] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.873040] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 8.894240] systemd-journald[273]: Collecting audit messages is enabled. lb # [ 8.891939] systemd[1]: Started Journal Service. lb # [ 8.879982] systemd[1]: systemd-journald.service: Deactivated successfully. client # [ 8.872704] systemd[1]: Finished Load Kernel Module 9pnet_virtio. client # [ 8.878118] systemd[1]: Mounted Kernel Configuration File System. lb # [ 8.888271] systemd[1]: Listening on Journal Log Access Socket. client # [ 8.880838] systemd[1]: modprobe@fuse.service: Deactivated successfully. lb # [ 8.893638] systemd[1]: Mounted Huge Pages File System. client # [ 8.886961] systemd[1]: Finished Load Kernel Module fuse. client # [ 8.887763] systemd[1]: Finished Load Kernel Modules. client # [ 8.904725] EXT4-fs (vda): re-mounted f76c1d46-0987-4c81-bfb2-08ffb764ef4b. worker2 # [ 8.915116] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 8.917734] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.903691] systemd[1]: Mounted POSIX Message Queue File System. lb # [ 8.908745] systemd[1]: Mounted Kernel Debug File System. client # [ 8.901460] systemd[1]: Mounting FUSE Control File System... client # [ 8.903137] systemd-oomd[277]: No swap; memory pressure usage will be degraded lb # [ 8.912515] systemd[1]: Mounted Kernel Trace File System. client # [ 8.908279] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 8.934837] systemd[1]: Started Journal Service. worker2 # [ 8.925914] systemd[1]: Queued start job for default target Multi-User System. lb # [ 8.919649] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 8.927191] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 8.927076] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. lb # [ 8.934692] systemd[1]: Finished Load Kernel Module 9pnet_virtio. worker1 # [ 8.982539] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 8.939003] systemd-modules-load[274]: Module 'atkbd' is built in lb # [ 8.940922] systemd[1]: Mounted Kernel Configuration File System. client # [ 8.933055] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 8.943010] systemd[1]: modprobe@fuse.service: Deactivated successfully. worker2 # [ 8.953207] systemd-modules-load[274]: Module 'loop' is built in lb # [ 8.951584] systemd[1]: Finished Load Kernel Module fuse. lb # [ 8.952987] systemd-modules-load[275]: Module 'atkbd' is built in client # [ 8.946621] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. lb # [ 8.954860] systemd-modules-load[275]: Module 'loop' is built in worker2 # [ 8.959258] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 8.956967] systemd[1]: Finished Load Kernel Modules. lb # [ 8.967780] systemd[1]: Mounting FUSE Control File System... client # [ 8.961086] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 8.987228] EXT4-fs (vda): re-mounted dc39a975-c708-411b-9408-140d620138b1. client # [ 8.973197] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 8.979566] systemd[1]: Starting Firewall... worker2 # [ 8.989122] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 8.996686] systemd[1]: Reached target First Boot Complete. lb # [ 8.999345] systemd[1]: Starting Apply Kernel Variables... client # [ 8.996226] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 9.005387] systemd-oomd[277]: No swap; memory pressure usage will be degraded client # [ 8.999072] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 9.004299] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 9.014054] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 9.016084] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 9.028354] systemd[1]: Finished Remount Root and Kernel File Systems. lb # [ 9.033867] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 9.026583] systemd-oomd[275]: No swap; memory pressure usage will be degraded worker2 # [ 9.042115] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 9.090437] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 9.061551] systemd-journald[273]: Received client request to flush runtime journal. worker1 # [ 9.095742] systemd[1]: Starting Update is Completed... lb # [ 9.050127] systemd[1]: Listening on Disk Image Download Service Socket. client # [ 9.051504] systemd[1]: Mounted FUSE Control File System. client # [ 9.065085] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.079961] systemd[1]: Starting Flush Journal to Persistent Storage... lb # [ 9.087027] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 9.107594] systemd-journald[275]: Received client request to flush runtime journal. lb # [ 9.099631] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 9.108537] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 9.120992] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 9.125555] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 9.127803] systemd[1]: Starting Create Static Device Nodes in /dev... worker2 # [ 9.132302] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 9.144546] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 9.152471] systemd[1]: Mounted FUSE Control File System. client # [ 9.145517] systemd[1]: Reached target First Boot Complete. client # [ 9.146296] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 9.147285] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 9.209071] systemd[1]: Finished Update is Completed. client # [ 9.164908] systemd[1]: Finished Flush Journal to Persistent Storage. lb # [ 9.189600] systemd[1]: Finished Apply Kernel Variables. lb # [ 9.211878] systemd-journald[274]: Received client request to flush runtime journal. worker2 # [ 9.215675] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 9.218670] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 9.221145] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.234341] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 9.235392] systemd[1]: Reached target Preparation for Local File Systems. client # [ 9.241645] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 9.271393] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 9.275177] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 9.281557] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 9.285134] systemd[1]: Reached target First Boot Complete. lb # [ 9.289564] systemd[1]: Finished Flush Journal to Persistent Storage. worker2 # [ 9.340954] systemd-udevd[315]: Using default interface naming scheme 'v261'. client # [ 9.346719] systemd-udevd[307]: Using default interface naming scheme 'v261'. lb # [ 9.363356] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 9.364283] systemd[1]: Mounting /run/wrappers... lb # [ 9.368285] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 9.370522] systemd[1]: Mounting FUSE Control File System... lb # [ 9.371182] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 9.386789] systemd[1]: Mounting /run/wrappers... worker2 # [ 9.416257] systemd[1]: Mounted FUSE Control File System. worker2 # [ 9.436611] systemd[1]: Mounted /run/wrappers. worker2 # [ 9.438037] systemd[1]: Reached target Local File Systems. worker2 # [ 9.441955] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 9.445154] systemd[1]: Starting register-nix-paths.service... client # [ 9.436088] systemd[1]: Mounted /run/wrappers. client # [ 9.442169] systemd[1]: Reached target Local File Systems. lb # [ 9.450951] systemd[1]: Mounting /run/wrappers... client # [ 9.446946] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 9.462468] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.454733] systemd[1]: Starting register-nix-paths.service... client # [ 9.457035] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 9.458428] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 9.463758] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 9.477590] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 9.482443] systemd[1]: Starting Create System Files and Directories... client # [ 9.473330] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 9.488685] systemd-udevd[317]: Using default interface naming scheme 'v261'. client # [ 9.493053] systemd[1]: Starting Create System Files and Directories... lb # [ 9.505094] systemd[1]: Mounted /run/wrappers. lb # [ 9.508738] systemd[1]: Reached target Local File Systems. lb # [ 9.512276] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 9.519727] systemd[1]: Starting register-nix-paths.service... lb # [ 9.524822] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 9.528530] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 9.535656] systemd[1]: Starting Save Transient machine-id to Disk... worker2 # [ 9.562962] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker2 # [ 9.574353] systemd[1]: Finished Save Transient machine-id to Disk. lb # [ 9.567419] systemd[1]: Starting Create System Files and Directories... client # [ 9.581374] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. client # [ 9.593837] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 9.634841] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 9.645231] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 9.651615] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 9.704677] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 9.710762] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 9.669107] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 9.686643] systemd[1]: Finished Create System Files and Directories. worker2 # [ 9.701635] systemd[1]: Finished Create System Files and Directories. client # [ 9.697655] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 9.710039] systemd[1]: Starting Rebuild Journal Catalog... worker2 # [ 9.716646] systemd[1]: Starting Record System Boot/Shutdown in UTMP... client # [ 9.707473] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker1 # [ 9.811515] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 9.773610] systemd[1]: Finished Create System Files and Directories. lb # [ 9.790831] systemd[1]: Starting Rebuild Journal Catalog... client # [ 9.797625] systemd[1]: Finished Record System Boot/Shutdown in UTMP. lb # [ 9.810071] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 9.818076] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 9.831187] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 9.852161] systemd[1]: Finished Rebuild Journal Catalog. client # [ 9.860846] systemd[1]: Starting Update is Completed... worker2 # [ 9.905195] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 9.909826] systemd[1]: Starting Update is Completed... client # [ 9.922003] systemd[1]: Finished Update is Completed. lb # [ 9.941651] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 9.997839] systemd[1]: Finished Update is Completed. lb # [ 10.000699] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 10.011387] systemd[1]: Starting Update is Completed... lb # [ 10.083265] systemd[1]: Finished Update is Completed. worker1 # [ 10.136870] systemd[1]: Finished Firewall. worker1 # [ 10.349601] systemd[1]: Finished Coldplug All udev Devices. client # [ 10.388238] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. client # [ 10.389464] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 10.429217] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 10.434472] systemd[1]: Finished Create SUID/SGID Wrappers. lb # [ 10.521135] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 10.523036] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 10.568885] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 10.679702] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.681733] systemd[1]: Reached target System Initialization. worker1 # [ 10.683641] systemd[1]: Started Discard unused filesystem blocks once a week. worker1 # [ 10.687192] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 10.688408] systemd[1]: Reached target Timer Units. client # [ 10.633579] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 10.692193] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 10.694217] systemd[1]: Listening on Nix Daemon Socket. worker1 # [ 10.698973] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 10.701828] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 10.712236] systemd[1]: Reached target Socket Units. worker1 # [ 10.715970] systemd[1]: Reached target Basic System. worker1 # [ 10.725531] systemd[1]: Starting Import lastlog data into lastlog2 database... worker1 # [ 10.735473] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 10.741509] systemd[1]: Starting Post-Boot Actions... worker1 # [ 10.750461] systemd[1]: Started Reset console on configuration changes. worker1 # [ 10.761520] systemd[1]: Starting resolvconf update... worker1 # [ 10.769047] systemd[1]: Starting D-Bus System Message Bus... worker1 # [ 10.837115] systemd[1]: Finished Post-Boot Actions. worker2 # [ 10.804202] systemd[1]: Finished Firewall. client # [ 10.827178] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 10.879691] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 10.886635] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 10.896609] nsncd[490]: Sep 21 04:24:03.507 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 10.904312] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 10.911080] systemd[1]: Starting User Login Management... worker1 # [ 10.925670] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 10.888219] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. lb # [ 10.917016] systemd[1]: Finished register-nix-paths.service. worker1 # [ 10.986065] dbus-broker-launch[494]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 11.009722] dbus-broker-launch[494]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.015214] dbus-broker-launch[494]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 11.058135] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 11.024174] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 11.083435] systemd-logind[511]: New seat seat0. worker1 # [ 11.093687] systemd[1]: Started User Login Management. worker1 # [ 11.099054] systemd[1]: Starting linger-users.service... worker2 # [ 11.073410] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs worker1 # [ 11.121412] dbus-broker-launch[494]: Ready lb # [ 11.086615] systemd[1]: Finished Coldplug All udev Devices. lb # [ 11.087819] systemd[1]: Reached target System Initialization. lb # [ 11.089223] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 11.093501] systemd[1]: Started niks3 garbage collection timer. lb # [ 11.096813] systemd[1]: Started Daily Cleanup of Temporary Directories. worker1 # [ 11.144215] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 11.097844] systemd[1]: Reached target Timer Units. lb # [ 11.100440] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 11.152946] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.106840] systemd[1]: Listening on niks3 server socket. lb # [ 11.108567] systemd[1]: Listening on Nix Daemon Socket. lb # [ 11.109495] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 11.111116] systemd[1]: Reached target Socket Units. worker1 # [ 11.162433] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 11.116454] systemd[1]: Reached target Basic System. lb # [ 11.121673] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.124479] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.175334] systemd[1]: Stopping User and Group Name Lookups... client # [ 11.121088] systemd[1]: Finished register-nix-paths.service. worker1 # [ 11.178866] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.124309] systemd[1]: Reached target System Initialization. lb # [ 11.132234] systemd[1]: Starting Post-Boot Actions... worker1 # [ 11.180516] systemd[1]: Starting Virtual Console Setup... client # [ 11.125892] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.129831] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.131345] systemd[1]: Reached target Timer Units. worker1 # [ 11.189499] systemd[1]: nscd.service: Deactivated successfully. client # [ 11.135692] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 11.137688] systemd[1]: Listening on Nix Daemon Socket. client # [ 11.141136] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 11.197604] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 11.144634] systemd[1]: Reached target Socket Units. worker1 # [ 11.201808] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.148196] systemd[1]: Reached target Basic System. client # [ 11.150101] systemd[1]: Started backdoor.service. client # [ 11.153171] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 11.161141] systemd[1]: Started Reset console on configuration changes. client # [ 11.162848] systemd[1]: Starting nftables firewall... worker1 # [ 11.227014] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 11.236472] systemd[1]: Stopped Virtual Console Setup. lb # [ 11.192340] systemd[1]: Starting resolvconf update... client # [ 11.184419] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.248898] systemd[1]: Starting Virtual Console Setup... lb # [ 11.203200] systemd[1]: Started rustfs.service. worker1 # [ 11.250745] systemd[1]: linger-users.service: Deactivated successfully. client # [ 11.198969] systemd[1]: Starting Post-Boot Actions... worker1 # [ 11.255387] systemd[1]: Finished linger-users.service. client # [ 11.210204] (udev-worker)[323]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 11.241063] systemd[1]: Starting rustfs-bucket.service... client # [ 11.233441] (udev-worker)[323]: Network interface NamePolicy= disabled on kernel command line. client # [ 11.243324] systemd[1]: Started Reset console on configuration changes. worker2 # [ 11.256427] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker1 # [ 11.303251] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.308502] nsncd[562]: Sep 21 04:24:03.929 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 11.317984] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 11.320706] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 11.324550] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 11.272119] systemd[1]: Starting resolvconf update... lb # [ 11.285839] nsncd[492]: Sep 21 04:24:03.905 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # connecting to host... lb # [ 11.295335] systemd[1]: Finished Post-Boot Actions. client # [ 11.295074] (udev-worker)[371]: Network interface NamePolicy= disabled on kernel command line. lb # [ 11.305255] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.355664] systemd[1]: Finished resolvconf update. lb # [ 11.312117] systemd[1]: Finished Firewall. worker1 # [ 11.360936] systemd[1]: Reached target Preparation for Network. worker1 # [ 11.368830] systemd[1]: Starting DHCP Client... worker2 # [ 11.325687] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker1 # [ 11.374086] systemd[1]: Starting Extra networking commands.... client # [ 11.336712] systemd[1]: Finished Post-Boot Actions. lb # [ 11.347789] systemd[1]: Reached target Host and Network Name Lookups. client: Guest shell says: b'Spawning backdoor root shell...\n' lb # [ 11.350611] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.360520] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 11.370100] systemd[1]: Finished register-nix-paths.service. lb # [ 11.363665] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs client # [ 11.371401] nsncd[398]: Sep 21 04:24:03.989 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.371695] systemd[1]: Reached target System Initialization. client # [ 11.381255] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.373809] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 11.413304] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 11.375803] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 11.417290] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.391260] systemd[1]: Starting User Login Management... client: connected to guest root shell worker2 # [ 11.380752] systemd[1]: Reached target Timer Units. lb # [ 11.397529] systemd[1]: Finished Import lastlog data into lastlog2 database. client # [ 11.419560] systemd[1]: Reached target User and Group Name Lookups. client: (connecting took 12.08 seconds) client # [ 11.427090] systemd[1]: Starting D-Bus System Message Bus... client: (finished: waiting for the VM to finish booting, in 12.08 seconds) client # [ 11.440507] systemd[1]: Starting User Login Management... worker2 # [ 11.382630] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 11.387390] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 11.396215] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 11.400627] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 11.408274] systemd[1]: Reached target Socket Units. worker2 # [ 11.412758] systemd[1]: Reached target Basic System. worker2 # [ 11.418865] systemd[1]: Started backdoor.service. worker2 # [ 11.426561] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 11.435449] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.445277] systemd[1]: Starting Post-Boot Actions... worker2 # [ 11.455186] systemd[1]: Started Reset console on configuration changes. worker2 # [ 11.464540] systemd[1]: Starting resolvconf update... worker2 # [ 11.477751] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 11.546542] systemd[1]: Finished Post-Boot Actions. worker2 # [ 11.587654] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 11.636450] dhcpcd[598]: dhcpcd-10.3.2 starting worker2 # [ 11.594006] nsncd[496]: Sep 21 04:24:04.227 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 11.591481] dbus-broker-launch[524]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 11.651711] dhcpcd[639]: dev: loaded udev worker2 # [ 11.605928] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.603183] dbus-broker-launch[524]: NSS returned no entry for 'systemd-timesync' worker1 # [ 11.659243] dhcpcd[639]: no valid interfaces found worker2 # connecting to host... lb # [ 11.611663] dbus-broker-launch[524]: Invalid user-name in /nix/store/kxmx3smba321l9v2dpmh9zahhsbc77yh-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 11.660983] dhcpcd[639]: no valid interfaces found worker2 # [ 11.615687] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 11.623138] systemd[1]: Starting User Login Management... worker1 # [ 11.680517] systemd[1]: Finished Extra networking commands.. worker1 # [ 11.684855] systemd[1]: Reached target Network. worker1 # [ 11.689762] systemd[1]: Starting Permit User Sessions... worker2 # [ 11.643566] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 11.650256] systemd[1]: Started D-Bus System Message Bus. lb # [ 11.658881] systemd-logind[527]: New seat seat0. lb # [ 11.667347] systemd[1]: Started User Login Management. lb # [ 11.680444] systemd[1]: Starting linger-users.service... worker1 # [ 11.737258] systemd[1]: Finished Permit User Sessions. worker1 # [ 11.742007] systemd[1]: Started Getty on tty1. worker1 # [ 11.743983] systemd[1]: Reached target Login Prompts. worker2 # [ 11.715423] dbus-broker-launch[501]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.720381] dbus-broker-launch[524]: Ready lb # [ 11.725936] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 11.705180] systemd-logind[430]: Watching system buttons on /dev/input/event0 (gpio-keys) client # [ 11.722147] systemd-logind[430]: New seat seat0. client # [ 11.722878] systemd[1]: Started User Login Management. lb # [ 11.732945] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 11.736235] dbus-broker-launch[501]: NSS returned no entry for 'systemd-timesync' client # [ 11.730793] dbus-broker-launch[429]: Looking up NSS user entry for 'systemd-timesync'... lb # [ 11.738478] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 11.744216] systemd[1]: Stopping User and Group Name Lookups... client # [ 11.738853] systemd[1]: Starting linger-users.service... worker2 # [ 11.739736] dbus-broker-launch[501]: Invalid user-name in /nix/store/a9ijqx61hpssavy5d9lh27li51m8hnl7-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.753229] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... lb # [ 11.763514] systemd[1]: nscd.service: Deactivated successfully. lb # [ 11.771425] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 11.769244] dbus-broker-launch[429]: NSS returned no entry for 'systemd-timesync' worker2 # [ 11.781720] systemd[1]: Started D-Bus System Message Bus. client # [ 11.772587] dbus-broker-launch[429]: Invalid user-name in /nix/store/ydh4ywywm30g15n5m6x5vfz42682s2cc-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 11.796648] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 11.790648] systemd[1]: Stopped target Host and Network Name Lookups. client # [ 11.791703] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 11.809920] systemd-logind[510]: New seat seat0. client # [ 11.799020] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 11.858192] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 11.804349] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 11.814081] systemd[1]: Started User Login Management. client # [ 11.810108] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 11.825944] systemd[1]: Starting linger-users.service... client # [ 11.816360] systemd[1]: nscd.service: Deactivated successfully. client # [ 11.820392] systemd[1]: Stopped Name Service Cache Daemon (nsncd). lb # [ 11.830746] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.834983] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 11.835950] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 11.835851] systemd[1]: Finished linger-users.service. client # [ 11.834123] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 11.845008] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 11.853711] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 11.904153] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. worker2 # [ 11.860235] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 11.853769] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 11.910169] systemd[1]: Started backdoor.service. worker2 # [ 11.869398] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 11.870292] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 11.860956] systemd[1]: linger-users.service: Deactivated successfully. client # [ 11.864578] systemd[1]: Finished linger-users.service. worker2 # [ 11.875394] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 11.882547] dbus-broker-launch[501]: Ready client # [ 11.889720] dbus-broker-launch[429]: Ready lb # [ 11.895902] nsncd[586]: Sep 21 04:24:04.516 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.890450] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 11.946878] systemd-vconsole-setup[570]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 11.954416] systemd-logind[511]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 11.958035] systemd[1]: Finished Virtual Console Setup. lb # [ 11.907250] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 11.913832] systemd[1]: Finished resolvconf update. lb # [ 11.914565] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 11.915532] systemd[1]: Reached target Preparation for Network. lb # [ 11.922166] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 11.925685] systemd[1]: Reached target User and Group Name Lookups. lb # [ 11.929497] systemd[1]: Starting DHCP Client... worker2 # [ 11.933391] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 11.934382] systemd[1]: Finished linger-users.service. lb # [ 11.933747] systemd[1]: Starting Extra networking commands.... worker2 # [ 11.943216] (udev-worker)[379]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 11.953658] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 11.954612] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 11.955519] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 12.019779] 8021q: 802.1Q VLAN Support v1.8 client # [ 11.953553] nsncd[495]: Sep 21 04:24:04.575 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 11.963645] nsncd[567]: Sep 21 04:24:04.597 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 11.961140] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 11.965200] systemd[1]: Reached target Host and Network Name Lookups. client # [ 11.969477] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 12.028300] (udev-worker)[649]: Network interface NamePolicy= disabled on kernel command line. worker1 # connecting to host... client # [ 11.992643] mousedev: PS/2 mouse device common for all mice worker2 # [ 12.005335] systemd[1]: Finished resolvconf update. worker2 # [ 12.006188] systemd[1]: Reached target Preparation for Network. client # [ 12.000288] systemd[1]: Finished resolvconf update. worker2 # [ 12.010407] (udev-worker)[374]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 12.059489] (udev-worker)[653]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 12.011491] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. client # [ 12.010749] systemd[1]: Starting DHCP Client... lb # [ 12.022804] systemd[1]: Started backdoor.service. worker2 # [ 12.025279] (udev-worker)[374]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 12.073046] (udev-worker)[653]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 12.032480] systemd[1]: Starting DHCP Client... worker2 # [ 12.033306] systemd[1]: Starting Extra networking commands.... worker1 # [ 12.117497] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.151210] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 12.151718] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 12.156737] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.096274] systemd-logind[510]: Watching system buttons on /dev/input/event0 (gpio-keys) worker1 # [ 12.157105] cfg80211: failed to load regulatory.db lb # connecting to host... worker1 # [ 12.245809] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 12.253435] systemd[1]: Starting Address configuration of eth1... client # [ 12.229228] dhcpcd[534]: dhcpcd-10.3.2 starting client # [ 12.245972] dhcpcd[544]: dev: loaded udev worker2 # [ 12.267690] dhcpcd[603]: dhcpcd-10.3.2 starting client # [ 12.265850] systemd[1]: Finished nftables firewall. client # [ 12.269003] systemd[1]: Reached target Preparation for Network. worker1 # [ 12.346040] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 12.284885] dhcpcd[618]: dhcpcd-10.3.2 starting worker1 # [ 12.333124] dhcpcd[639]: eth0: waiting for carrier worker2 # [ 12.287413] dhcpcd[643]: dev: loaded udev client # [ 12.279566] systemd[1]: Starting Address configuration of eth1... worker1 # [ 12.336153] dhcpcd[639]: eth0: carrier acquired client # [ 12.286486] systemd[1]: Starting Extra networking commands.... lb # [ 12.304425] dhcpcd[659]: dev: loaded udev worker1 # [ 12.353618] dhcpcd[639]: DUID 00:01:00:01:32:43:6d:e4:52:54:00:12:34:56 worker1 # [ 12.355806] dhcpcd[639]: eth0: IAID 00:12:34:56 client # [ 12.317092] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 12.358377] dhcpcd[639]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 12.304297] systemd-logind[430]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) worker2 # [ 12.339456] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 12.386341] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 12.340178] systemd[1]: Finished Extra networking commands.. worker1 # [ 12.390832] network-addresses-eth1-start[680]: adding address 192.168.1.3/24... done worker2 # [ 12.345718] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 12.346874] systemd[1]: Reached target Network. worker2 # [ 12.350835] systemd[1]: Starting Address configuration of eth1... lb # [ 12.367130] 8021q: 802.1Q VLAN Support v1.8 worker2 # [ 12.357680] systemd[1]: Starting Permit User Sessions... worker1 # [ 12.406327] network-addresses-eth1-start[680]: adding address 2001:db8:1::3/64... done worker1 # [ 12.410941] systemd-logind[511]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 12.381804] systemd[1]: Finished Extra networking commands.. worker1 # [ 12.430126] systemd[1]: Finished Address configuration of eth1. lb # [ 12.385651] systemd[1]: Reached target Network. lb # [ 12.395701] systemd[1]: Starting PostgreSQL Server... lb # [ 12.410748] systemd[1]: Starting Permit User Sessions... worker2 # [ 12.433801] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 12.489151] mousedev: PS/2 mouse device common for all mice client # [ 12.438241] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 12.455144] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 12.471492] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 12.472010] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.476965] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 12.477290] cfg80211: failed to load regulatory.db worker2 # [ 12.468890] systemd[1]: Finished Permit User Sessions. client # [ 12.460427] network-addresses-eth1-start[548]: adding address 192.168.1.1/24... done worker2 # [ 12.474476] systemd[1]: Started Getty on tty1. worker2 # [ 12.475235] systemd[1]: Reached target Login Prompts. client # [ 12.481324] network-addresses-eth1-start[548]: adding address 2001:db8:1::1/64... done client # [ 12.506657] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 12.507202] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' client # [ 12.513104] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 client # [ 12.513456] cfg80211: failed to load regulatory.db client # [ 12.518059] systemd[1]: Finished Address configuration of eth1. worker2 # [ 12.544944] 8021q: adding VLAN 0 to HW filter on device eth1 worker1 # [ 12.581067] systemd-logind[511]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) lb # [ 12.548565] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 12.545776] systemd[1]: Finished Permit User Sessions. worker2 # [ 12.550983] network-addresses-eth1-start[657]: adding address 192.168.1.4/24... done lb # [ 12.561819] systemd[1]: Started Getty on tty1. worker1 # [ 12.613597] dhcpcd[639]: eth0: soliciting a DHCP lease lb # [ 12.566154] systemd[1]: Reached target Login Prompts. worker2 # [ 12.584532] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 12.570910] dhcpcd[643]: eth0: waiting for carrier worker1 # [ 12.620732] dhcpcd[639]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 12.576265] dhcpcd[643]: eth0: waiting for carrier worker2 # [ 12.577116] dhcpcd[643]: eth0: carrier acquired worker2 # [ 12.579275] network-addresses-eth1-start[657]: adding address 2001:db8:1::4/64... done worker1 # [ 12.628268] dhcpcd[639]: eth0: probing address 10.0.2.15/24 worker2 # [ 12.597420] dhcpcd[643]: DUID 00:01:00:01:32:43:6d:e5:52:54:00:12:34:56 lb # [ 12.591681] (udev-worker)[360]: Network interface NamePolicy= disabled on kernel command line. client # [ 12.588515] dhcpcd[600]: /nix/store/grcr27glg0bai58hwyh3zxlj5sf30hhx-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (551) - Operation not permitted client # [ 12.590384] dhcpcd[600]: .resolvconf-wrapped: clearing stale lock pid 551 worker2 # [ 12.601169] dhcpcd[643]: eth0: IAID 00:12:34:56 worker2 # [ 12.601952] dhcpcd[643]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 12.615369] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' lb # [ 12.615862] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 12.606218] systemd[1]: Finished Address configuration of eth1. lb # [ 12.620643] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 12.620966] cfg80211: failed to load regulatory.db lb # [ 12.615425] (udev-worker)[370]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 12.623352] (udev-worker)[370]: Network interface NamePolicy= disabled on kernel command line. client # [ 12.633737] systemd[1]: Finished Extra networking commands.. client # [ 12.637476] systemd[1]: Reached target Network. worker2 # [ 12.668027] mousedev: PS/2 mouse device common for all mice client # [ 12.644380] systemd[1]: Starting Permit User Sessions... client # [ 12.662818] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 12.649458] dhcpcd[544]: eth0: waiting for carrier client # [ 12.653439] dhcpcd[544]: libudev: received NULL device client # [ 12.657430] dhcpcd[544]: libudev: received NULL device client # [ 12.658328] dhcpcd[544]: eth0: carrier acquired worker2 # [ 12.682519] systemd-logind[510]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 12.673310] dhcpcd[544]: DUID 00:01:00:01:32:43:6d:e5:52:54:00:12:34:56 client # [ 12.674289] dhcpcd[544]: eth0: IAID 00:12:34:56 client # [ 12.674954] dhcpcd[544]: eth0: adding address fe80::5054:ff:fe12:3456 client # [ 12.708112] systemd[1]: Finished Permit User Sessions. client # [ 12.716299] systemd[1]: Started Getty on tty1. client # [ 12.718855] systemd[1]: Reached target Login Prompts. lb # [ 12.752969] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 12.741084] dhcpcd[659]: eth0: waiting for carrier lb # [ 12.743246] dhcpcd[659]: eth0: carrier acquired lb # [ 12.759145] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 12.768542] dhcpcd[659]: DUID 00:01:00:01:32:43:6d:e5:52:54:00:12:34:56 lb # [ 12.772720] systemd[1]: Starting Address configuration of eth1... lb # [ 12.777301] dhcpcd[659]: eth0: IAID 00:12:34:56 lb # [ 12.781855] dhcpcd[659]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 12.782775] dhcpcd[659]: eth0: IAID 00:12:34:56 client: (finished: waiting for unit network-addresses-eth1.service, in 13.49 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 12.918943] 8021q: adding VLAN 0 to HW filter on device eth1 client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 12.921994] postgresql-pre-start[703]: The files belonging to this database system will be owned by user "postgres". lb # [ 12.923468] postgresql-pre-start[703]: This user must also own the server process. lb # [ 12.946264] network-addresses-eth1-start[712]: adding address 192.168.1.2/24... done lb # [ 12.947380] postgresql-pre-start[703]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 12.958171] postgresql-pre-start[703]: The default database encoding has accordingly been set to "UTF8". lb # [ 12.967487] postgresql-pre-start[703]: The default text search configuration will be set to "english". lb # [ 12.973647] postgresql-pre-start[703]: Data page checksums are enabled. lb # [ 12.979539] postgresql-pre-start[703]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 12.987812] postgresql-pre-start[703]: creating subdirectories ... ok lb # [ 12.992791] postgresql-pre-start[703]: selecting dynamic shared memory implementation ... posix lb # [ 12.999988] network-addresses-eth1-start[712]: adding address 2001:db8:1::2/64... done lb # [ 13.021267] systemd[1]: Finished Address configuration of eth1. lb: (finished: waiting for unit network-addresses-eth1.service, in 0.17 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.09 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 13.199497] systemd-logind[527]: Watching system buttons on /dev/input/event0 (gpio-keys) lb # [ 13.206242] postgresql-pre-start[703]: selecting default "max_connections" ... 100 worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) client # [ 13.339737] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 worker2 # [ 13.360020] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 lb # [ 13.387844] postgresql-pre-start[703]: selecting default "shared_buffers" ... 128MB client # [ 13.390698] dhcpcd[544]: eth0: soliciting a DHCP lease client # [ 13.396538] dhcpcd[544]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 13.404215] dhcpcd[544]: eth0: probing address 10.0.2.15/24 worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.11 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } lb # [ 13.463530] mousedev: PS/2 mouse device common for all mice worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.05 seconds) lb: waiting for unit niks3.service worker1 # [ 13.561353] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 13.520720] dhcpcd[643]: eth0: soliciting a DHCP lease worker1 # [ 13.571082] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.572860] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.528454] dhcpcd[643]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 13.577528] systemd[1]: Stopping Virtual Console Setup... worker2 # [ 13.536171] dhcpcd[643]: eth0: probing address 10.0.2.15/24 worker1 # [ 13.584599] systemd[1]: Starting Virtual Console Setup... worker1 # [ 13.596354] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 13.597405] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 13.601900] systemd[1]: Starting Virtual Console Setup... client # [ 13.650678] systemd[1]: Starting Virtual Console Setup... lb # [ 13.684181] systemd-logind[527]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) client # [ 13.683371] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 13.690610] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 13.691682] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 13.705688] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. client # [ 13.701269] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.720772] systemd[1]: Starting Virtual Console Setup... lb # [ 13.726467] dhcpcd[659]: eth0: soliciting a DHCP lease lb # [ 13.732493] dhcpcd[659]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 13.740242] dhcpcd[659]: eth0: probing address 10.0.2.15/24 worker2 # [ 13.744453] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 13.747732] systemd[1]: Stopped Virtual Console Setup. client # [ 13.739031] systemd-logind[430]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker2 # [ 13.750082] systemd[1]: Starting Virtual Console Setup... worker2 # [ 13.810615] systemd-logind[510]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) worker1 # [ 13.913518] systemd-vconsole-setup[712]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 13.917643] systemd[1]: Finished Virtual Console Setup. worker2 # [ 13.985212] dhcpcd[643]: eth0: soliciting an IPv6 router worker2 # [ 13.986047] dhcpcd[643]: eth0: Router Advertisement from fe80::2 worker2 # [ 13.987277] dhcpcd[643]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 13.988577] dhcpcd[643]: eth0: adding route to fec0::/64 worker2 # [ 13.989547] dhcpcd[643]: eth0: adding default route via fe80::2 client # [ 14.115789] systemd-vconsole-setup[651]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 14.120051] systemd[1]: Finished Virtual Console Setup. worker2 # [ 14.166168] systemd-vconsole-setup[708]: Configuration of first virtual console was skipped, ignoring remaining ones. worker2 # [ 14.171142] systemd[1]: Finished Virtual Console Setup. lb # [ 14.332955] dhcpcd[659]: eth0: soliciting an IPv6 router lb # [ 14.334593] dhcpcd[659]: eth0: Router Advertisement from fe80::2 lb # [ 14.336845] dhcpcd[659]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 14.338966] dhcpcd[659]: eth0: adding route to fec0::/64 lb # [ 14.340751] dhcpcd[659]: eth0: adding default route via fe80::2 worker1 # [ 14.429366] dhcpcd[639]: eth0: soliciting an IPv6 router worker1 # [ 14.432932] dhcpcd[639]: eth0: Router Advertisement from fe80::2 worker1 # [ 14.435452] dhcpcd[639]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 14.438385] dhcpcd[639]: eth0: adding route to fec0::/64 worker1 # [ 14.440683] dhcpcd[639]: eth0: adding default route via fe80::2 lb # [ 14.556473] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 client # [ 14.798495] dhcpcd[544]: eth0: soliciting an IPv6 router client # [ 14.801952] dhcpcd[544]: eth0: Router Advertisement from fe80::2 client # [ 14.806445] dhcpcd[544]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 14.809261] dhcpcd[544]: eth0: adding route to fec0::/64 client # [ 14.811526] dhcpcd[544]: eth0: adding default route via fe80::2 lb # [ 15.027839] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 15.041468] systemd[1]: Starting Virtual Console Setup... lb # [ 15.061272] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 15.066365] systemd[1]: Stopped Virtual Console Setup. lb # [ 15.083848] systemd[1]: Starting Virtual Console Setup... lb # [ 15.150172] systemd-logind[527]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) lb # [ 15.535729] systemd-vconsole-setup[774]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 15.539398] systemd[1]: Finished Virtual Console Setup. lb # [ 15.920676] postgresql-pre-start[703]: selecting default time zone ... UTC lb # [ 15.924519] postgresql-pre-start[703]: creating configuration files ... ok lb # [ 16.179624] postgresql-pre-start[703]: running bootstrap script ... ok lb # [ 16.791898] postgresql-pre-start[703]: performing post-bootstrap initialization ... ok lb # [ 16.973842] postgresql-pre-start[703]: syncing data to disk ... ok lb # [ 16.975759] postgresql-pre-start[703]: initdb: warning: enabling "trust" authentication for local connections lb # [ 16.977278] postgresql-pre-start[703]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 16.979345] postgresql-pre-start[703]: Success. You can now start the database server using: lb # [ 16.980586] postgresql-pre-start[703]: pg_ctl -D /var/lib/postgresql/18 -l logfile start worker1 # [ 17.084784] dhcpcd[639]: eth0: leased 10.0.2.15 for 86400 seconds worker1 # [ 17.088185] dhcpcd[639]: eth0: adding route to 10.0.2.0/24 worker1 # [ 17.091201] dhcpcd[639]: eth0: adding default route via 10.0.2.2 lb # [ 17.101197] postgres[808]: [808] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 17.105327] postgres[808]: [808] LOG: listening on IPv6 address "::1", port 5432 lb # [ 17.106479] postgres[808]: [808] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 17.108390] postgres[808]: [808] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 17.121662] postgres[817]: [817] LOG: database system was shut down at 2026-09-21 04:24:09 GMT lb # [ 17.126594] postgres[808]: [808] LOG: database system is ready to accept connections lb # [ 17.132067] systemd[1]: Started PostgreSQL Server. lb # [ 17.140073] systemd[1]: Starting PostgreSQL Setup Scripts... worker1 # [ 17.245750] systemd[1]: Started DHCP Client. worker1 # [ 17.247618] systemd[1]: Reached target Multi-User System. worker1 # [ 17.248848] systemd[1]: Startup finished in 941ms (kernel) + 4.565s (initrd) + 11.739s (userspace) = 17.247s. lb # [ 17.356666] postgresql-setup-start[828]: CREATE DATABASE lb # [ 17.407768] postgresql-setup-start[833]: CREATE ROLE lb # [ 17.430424] postgresql-setup-start[835]: ALTER DATABASE lb # [ 17.436321] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 17.438029] systemd[1]: Reached target PostgreSQL. lb # [ 18.041367] dhcpcd[659]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 18.041612] dhcpcd[659]: eth0: adding route to 10.0.2.0/24 lb # [ 18.041701] dhcpcd[659]: eth0: adding default route via 10.0.2.2 lb # [ 18.178035] systemd[1]: Started DHCP Client. lb # [ 18.179561] systemd[1]: Reached target Network is Online. lb # [ 18.184503] systemd[1]: Started Envoy reverse proxy. lb # [ 18.188887] systemd[1]: Started mock-oidc.service. lb # [ 18.288358] mock-oidc-server[903]: Mock OIDC Server running lb # [ 18.289505] mock-oidc-server[903]: OIDC Address: 192.168.1.2:8080 lb # [ 18.290857] mock-oidc-server[903]: Issue Address: 0.0.0.0:8081 lb # [ 18.292269] mock-oidc-server[903]: Issuer: http://192.168.1.2:8080/oidc lb # [ 18.293519] mock-oidc-server[903]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 18.295254] mock-oidc-server[903]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 18.297378] mock-oidc-server[903]: Issue tokens: http://0.0.0.0:8081/issue?sub=... worker2 # [ 18.510460] dhcpcd[643]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 18.514693] dhcpcd[643]: eth0: adding route to 10.0.2.0/24 worker2 # [ 18.517921] dhcpcd[643]: eth0: adding default route via 10.0.2.2 worker2 # [ 18.675091] systemd[1]: Started DHCP Client. worker2 # [ 18.677349] systemd[1]: Reached target Multi-User System. worker2 # [ 18.678308] systemd[1]: Startup finished in 926ms (kernel) + 5.430s (initrd) + 12.320s (userspace) = 18.677s. client # [ 18.710998] dhcpcd[544]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 18.849678] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.120) lb # [ 18.851568] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:469] statically linked extensions: lb # [ 18.853131] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 18.855105] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 18.857823] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 18.860612] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 18.863198] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 18.866816] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params client # [ 18.714410] dhcpcd[544]: eth0: adding route to 10.0.2.0/24 client # [ 18.714566] dhcpcd[544]: eth0: adding default route via 10.0.2.2 client # [ 18.872666] systemd[1]: Started DHCP Client. client # [ 18.876786] systemd[1]: Reached target Multi-User System. client # [ 18.877711] systemd[1]: Startup finished in 945ms (kernel) + 5.445s (initrd) + 12.484s (userspace) = 18.876s. lb # [ 18.887802] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua lb # [ 18.889871] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 18.897326] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 18.899491] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 18.902404] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 18.908170] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 18.911210] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 18.915998] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 18.919801] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 18.922792] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 18.927545] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 18.929986] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 18.933022] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 18.934860] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 18.940256] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 18.956397] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 18.958131] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 18.961337] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 18.964446] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation lb # [ 18.966502] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 18.969652] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 18.971720] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json lb # [ 18.973700] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 18.977346] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 18.979336] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 18.981399] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default lb # [ 18.983118] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 18.986921] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 18.992522] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid lb # [ 18.994110] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 18.997725] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal lb # [ 18.999515] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 19.002416] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 19.004602] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 19.006671] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 19.008673] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 19.011426] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 19.021395] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 19.023493] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 19.025686] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based lb # [ 19.027440] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 19.030239] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 19.034009] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 19.036602] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 19.039836] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher lb # [ 19.042832] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 19.047695] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action lb # [ 19.050032] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 19.052632] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default lb # [ 19.054533] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 19.056946] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 19.059267] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 19.062227] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 19.066046] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 19.068706] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift lb # [ 19.074115] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 19.077704] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 19.079973] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 19.087369] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo lb # [ 19.089446] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 19.095300] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default lb # [ 19.097863] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 19.102908] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 19.109551] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 19.142005] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 19.144231] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 19.147813] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 19.150782] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 19.159868] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 19.165102] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 19.169748] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 19.171919] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 19.174414] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name lb # [ 19.178443] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 19.187478] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 19.197246] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 19.202770] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 19.208291] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 19.215239] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 19.219672] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 19.224549] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 19.231287] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 19.234193] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 19.236892] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default lb # [ 19.238961] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 19.241700] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 19.252327] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 19.262311] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 19.266822] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 19.278437] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr worker2 # [ 19.292826] systemd[1]: Reached target Network is Online. lb # [ 19.289623] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 19.296876] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default worker1 # [ 19.344901] systemd[1]: Starting Nix worker-protocol over gRPC... lb # [ 19.299840] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso worker2 # [ 19.302704] systemd[1]: Starting scheduler-token.service... lb # [ 19.304667] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 19.308762] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 19.316339] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 19.319054] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 19.329115] envoy[902]: [2026-09-21 04:24:11.469][902][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 19.332907] envoy[902]: [2026-09-21 04:24:11.506][902][info][main] [source/server/server.cc:531] HTTP header map info: lb # [ 19.334613] envoy[902]: [2026-09-21 04:24:11.508][902][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 19.352407] envoy[902]: [2026-09-21 04:24:11.508][902][info][main] [source/server/server.cc:534] request trailer map: 120 bytes: lb # [ 19.354189] envoy[902]: [2026-09-21 04:24:11.508][902][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 19.363767] envoy[902]: [2026-09-21 04:24:11.510][902][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status lb # [ 19.366342] envoy[902]: [2026-09-21 04:24:11.729][902][info][main] [source/server/server.cc:968] runtime: {} lb # [ 19.368206] envoy[902]: [2026-09-21 04:24:11.767][902][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288. lb # [ 19.370194] envoy[902]: [2026-09-21 04:24:11.767][902][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 19.372178] envoy[902]: [2026-09-21 04:24:11.768][902][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 19.373902] envoy[902]: [2026-09-21 04:24:11.775][902][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 19.375694] envoy[902]: [2026-09-21 04:24:11.775][902][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 19.379037] envoy[902]: [2026-09-21 04:24:11.775][902][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 19.381125] envoy[902]: [2026-09-21 04:24:11.908][902][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 19.383117] envoy[902]: [2026-09-21 04:24:11.945][902][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 19.385353] envoy[902]: [2026-09-21 04:24:11.946][902][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 19.389037] envoy[902]: [2026-09-21 04:24:11.946][902][info][main] [source/server/server.cc:1077] starting main dispatch loop worker2 # [ 19.413081] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 19.416878] systemd[1]: Finished scheduler-token.service. worker2 # [ 19.418363] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 113ms wall clock time, 2.9M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 19.427362] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 19.589098] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 19.600999] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 19.603454] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 19.648073] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 19.652260] systemd[1]: Started Nix worker-protocol over gRPC. lb # [ 19.641626] envoy[902]: [2026-09-21 04:24:12.261][902][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization worker2 # [ 19.647035] nix-grpc-daemon[776]: ts=2026-09-21T04:24:12Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" lb # [ 19.648522] envoy[902]: [2026-09-21 04:24:12.261][902][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized worker2 # [ 19.658857] nix-grpc-daemon[776]: ts=2026-09-21T04:24:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 19.661195] nix-grpc-daemon[776]: ts=2026-09-21T04:24:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 lb # [ 19.659246] envoy[902]: [2026-09-21 04:24:12.261][902][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager worker1 # [ 19.715425] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=scheduler_connected addr=lb:50051 lb # [ 19.666708] envoy[902]: [2026-09-21 04:24:12.261][902][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers worker1 # [ 19.725040] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.710482] nix-grpc-daemon[776]: ts=2026-09-21T04:24:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 19.723658] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 19.773914] nix-grpc-daemon[776]: ts=2026-09-21T04:24:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.775663] nix-grpc-daemon[776]: ts=2026-09-21T04:24:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 19.926356] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 19.931595] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 19.977285] nix-grpc-daemon[776]: ts=2026-09-21T04:24:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 19.982423] nix-grpc-daemon[776]: ts=2026-09-21T04:24:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.132404] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.137123] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.183625] nix-grpc-daemon[776]: ts=2026-09-21T04:24:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.188825] nix-grpc-daemon[776]: ts=2026-09-21T04:24:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.338136] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.343148] nix-grpc-daemon[777]: ts=2026-09-21T04:24:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.390050] nix-grpc-daemon[776]: ts=2026-09-21T04:24:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.395202] nix-grpc-daemon[776]: ts=2026-09-21T04:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.543945] nix-grpc-daemon[777]: ts=2026-09-21T04:24:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.549104] nix-grpc-daemon[777]: ts=2026-09-21T04:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.596477] nix-grpc-daemon[776]: ts=2026-09-21T04:24:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.601451] nix-grpc-daemon[776]: ts=2026-09-21T04:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.751685] nix-grpc-daemon[777]: ts=2026-09-21T04:24:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.755839] nix-grpc-daemon[777]: ts=2026-09-21T04:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 20.804209] nix-grpc-daemon[776]: ts=2026-09-21T04:24:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 20.808195] nix-grpc-daemon[776]: ts=2026-09-21T04:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 20.952317] nix-grpc-daemon[777]: ts=2026-09-21T04:24:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 20.957292] nix-grpc-daemon[777]: ts=2026-09-21T04:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.004922] nix-grpc-daemon[776]: ts=2026-09-21T04:24:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.009886] nix-grpc-daemon[776]: ts=2026-09-21T04:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.158173] nix-grpc-daemon[777]: ts=2026-09-21T04:24:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.163246] nix-grpc-daemon[777]: ts=2026-09-21T04:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.211127] nix-grpc-daemon[776]: ts=2026-09-21T04:24:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.216353] nix-grpc-daemon[776]: ts=2026-09-21T04:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.364118] nix-grpc-daemon[777]: ts=2026-09-21T04:24:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.369196] nix-grpc-daemon[777]: ts=2026-09-21T04:24:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.417496] nix-grpc-daemon[776]: ts=2026-09-21T04:24:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.422811] nix-grpc-daemon[776]: ts=2026-09-21T04:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.570165] nix-grpc-daemon[777]: ts=2026-09-21T04:24:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.575209] nix-grpc-daemon[777]: ts=2026-09-21T04:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.624137] nix-grpc-daemon[776]: ts=2026-09-21T04:24:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.629433] nix-grpc-daemon[776]: ts=2026-09-21T04:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.777679] nix-grpc-daemon[777]: ts=2026-09-21T04:24:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.781764] nix-grpc-daemon[777]: ts=2026-09-21T04:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 21.832322] nix-grpc-daemon[776]: ts=2026-09-21T04:24:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 21.836261] nix-grpc-daemon[776]: ts=2026-09-21T04:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 21.978371] nix-grpc-daemon[777]: ts=2026-09-21T04:24:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 21.983912] nix-grpc-daemon[777]: ts=2026-09-21T04:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.033035] nix-grpc-daemon[776]: ts=2026-09-21T04:24:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.038164] nix-grpc-daemon[776]: ts=2026-09-21T04:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.184780] nix-grpc-daemon[777]: ts=2026-09-21T04:24:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.189832] nix-grpc-daemon[777]: ts=2026-09-21T04:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.239321] nix-grpc-daemon[776]: ts=2026-09-21T04:24:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.244803] nix-grpc-daemon[776]: ts=2026-09-21T04:24:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.390565] nix-grpc-daemon[777]: ts=2026-09-21T04:24:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.395382] nix-grpc-daemon[777]: ts=2026-09-21T04:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.446016] nix-grpc-daemon[776]: ts=2026-09-21T04:24:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.451355] nix-grpc-daemon[776]: ts=2026-09-21T04:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.596185] nix-grpc-daemon[777]: ts=2026-09-21T04:24:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.600902] nix-grpc-daemon[777]: ts=2026-09-21T04:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.652703] nix-grpc-daemon[776]: ts=2026-09-21T04:24:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.657819] nix-grpc-daemon[776]: ts=2026-09-21T04:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 22.803464] nix-grpc-daemon[777]: ts=2026-09-21T04:24:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 22.807629] nix-grpc-daemon[777]: ts=2026-09-21T04:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 22.860675] nix-grpc-daemon[776]: ts=2026-09-21T04:24:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 22.864792] nix-grpc-daemon[776]: ts=2026-09-21T04:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.003572] nix-grpc-daemon[777]: ts=2026-09-21T04:24:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.008867] nix-grpc-daemon[777]: ts=2026-09-21T04:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.061541] nix-grpc-daemon[776]: ts=2026-09-21T04:24:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.066869] nix-grpc-daemon[776]: ts=2026-09-21T04:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.210084] nix-grpc-daemon[777]: ts=2026-09-21T04:24:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.215478] nix-grpc-daemon[777]: ts=2026-09-21T04:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.268958] nix-grpc-daemon[776]: ts=2026-09-21T04:24:15Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.275011] nix-grpc-daemon[776]: ts=2026-09-21T04:24:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.417176] nix-grpc-daemon[777]: ts=2026-09-21T04:24:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.422766] nix-grpc-daemon[777]: ts=2026-09-21T04:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.476273] nix-grpc-daemon[776]: ts=2026-09-21T04:24:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.481739] nix-grpc-daemon[776]: ts=2026-09-21T04:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.623770] nix-grpc-daemon[777]: ts=2026-09-21T04:24:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.629348] nix-grpc-daemon[777]: ts=2026-09-21T04:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.684450] nix-grpc-daemon[776]: ts=2026-09-21T04:24:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.690605] nix-grpc-daemon[776]: ts=2026-09-21T04:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 23.832562] nix-grpc-daemon[777]: ts=2026-09-21T04:24:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 23.838000] nix-grpc-daemon[777]: ts=2026-09-21T04:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 23.896214] nix-grpc-daemon[776]: ts=2026-09-21T04:24:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 23.900577] nix-grpc-daemon[776]: ts=2026-09-21T04:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.039811] nix-grpc-daemon[777]: ts=2026-09-21T04:24:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.045738] nix-grpc-daemon[777]: ts=2026-09-21T04:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.096971] nix-grpc-daemon[776]: ts=2026-09-21T04:24:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.102870] nix-grpc-daemon[776]: ts=2026-09-21T04:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.246916] nix-grpc-daemon[777]: ts=2026-09-21T04:24:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.253916] nix-grpc-daemon[777]: ts=2026-09-21T04:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.304789] nix-grpc-daemon[776]: ts=2026-09-21T04:24:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.310414] nix-grpc-daemon[776]: ts=2026-09-21T04:24:16Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.455151] nix-grpc-daemon[777]: ts=2026-09-21T04:24:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.461376] nix-grpc-daemon[777]: ts=2026-09-21T04:24:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.511807] nix-grpc-daemon[776]: ts=2026-09-21T04:24:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.518423] nix-grpc-daemon[776]: ts=2026-09-21T04:24:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.662990] nix-grpc-daemon[777]: ts=2026-09-21T04:24:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.669343] nix-grpc-daemon[777]: ts=2026-09-21T04:24:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.720368] nix-grpc-daemon[776]: ts=2026-09-21T04:24:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.726242] nix-grpc-daemon[776]: ts=2026-09-21T04:24:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 24.875481] nix-grpc-daemon[777]: ts=2026-09-21T04:24:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 24.880188] nix-grpc-daemon[777]: ts=2026-09-21T04:24:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 24.932853] nix-grpc-daemon[776]: ts=2026-09-21T04:24:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 24.937111] nix-grpc-daemon[776]: ts=2026-09-21T04:24:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.074998] nix-grpc-daemon[777]: ts=2026-09-21T04:24:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.081144] nix-grpc-daemon[777]: ts=2026-09-21T04:24:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.134085] nix-grpc-daemon[776]: ts=2026-09-21T04:24:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.140258] nix-grpc-daemon[776]: ts=2026-09-21T04:24:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.282821] nix-grpc-daemon[777]: ts=2026-09-21T04:24:17Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.288798] nix-grpc-daemon[777]: ts=2026-09-21T04:24:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.342267] nix-grpc-daemon[776]: ts=2026-09-21T04:24:17Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.348605] nix-grpc-daemon[776]: ts=2026-09-21T04:24:17Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.489913] nix-grpc-daemon[777]: ts=2026-09-21T04:24:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.494139] nix-grpc-daemon[777]: ts=2026-09-21T04:24:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.550348] nix-grpc-daemon[776]: ts=2026-09-21T04:24:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.556383] nix-grpc-daemon[776]: ts=2026-09-21T04:24:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.695982] nix-grpc-daemon[777]: ts=2026-09-21T04:24:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.701535] nix-grpc-daemon[777]: ts=2026-09-21T04:24:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.757999] nix-grpc-daemon[776]: ts=2026-09-21T04:24:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.767467] nix-grpc-daemon[776]: ts=2026-09-21T04:24:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 25.905096] nix-grpc-daemon[777]: ts=2026-09-21T04:24:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 25.910695] nix-grpc-daemon[777]: ts=2026-09-21T04:24:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 25.965885] nix-grpc-daemon[776]: ts=2026-09-21T04:24:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 25.968449] nix-grpc-daemon[776]: ts=2026-09-21T04:24:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.112115] nix-grpc-daemon[777]: ts=2026-09-21T04:24:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.117778] nix-grpc-daemon[777]: ts=2026-09-21T04:24:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.172373] nix-grpc-daemon[776]: ts=2026-09-21T04:24:18Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.176838] nix-grpc-daemon[776]: ts=2026-09-21T04:24:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.319267] nix-grpc-daemon[777]: ts=2026-09-21T04:24:18Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.325264] nix-grpc-daemon[777]: ts=2026-09-21T04:24:18Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.373528] nix-grpc-daemon[776]: ts=2026-09-21T04:24:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.378171] nix-grpc-daemon[776]: ts=2026-09-21T04:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.527021] nix-grpc-daemon[777]: ts=2026-09-21T04:24:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.533435] nix-grpc-daemon[777]: ts=2026-09-21T04:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.579816] nix-grpc-daemon[776]: ts=2026-09-21T04:24:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.585554] nix-grpc-daemon[776]: ts=2026-09-21T04:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.734429] nix-grpc-daemon[777]: ts=2026-09-21T04:24:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.740332] nix-grpc-daemon[777]: ts=2026-09-21T04:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.786787] nix-grpc-daemon[776]: ts=2026-09-21T04:24:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 26.792614] nix-grpc-daemon[776]: ts=2026-09-21T04:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 26.946224] nix-grpc-daemon[777]: ts=2026-09-21T04:24:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 26.950599] nix-grpc-daemon[777]: ts=2026-09-21T04:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 26.995696] nix-grpc-daemon[776]: ts=2026-09-21T04:24:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.001201] nix-grpc-daemon[776]: ts=2026-09-21T04:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.146613] nix-grpc-daemon[777]: ts=2026-09-21T04:24:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.152754] nix-grpc-daemon[777]: ts=2026-09-21T04:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.202934] nix-grpc-daemon[776]: ts=2026-09-21T04:24:19Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.209486] nix-grpc-daemon[776]: ts=2026-09-21T04:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.354237] nix-grpc-daemon[777]: ts=2026-09-21T04:24:19Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.359784] nix-grpc-daemon[777]: ts=2026-09-21T04:24:19Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.411926] nix-grpc-daemon[776]: ts=2026-09-21T04:24:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.417525] nix-grpc-daemon[776]: ts=2026-09-21T04:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.561590] nix-grpc-daemon[777]: ts=2026-09-21T04:24:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.568549] nix-grpc-daemon[777]: ts=2026-09-21T04:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.618872] nix-grpc-daemon[776]: ts=2026-09-21T04:24:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.624563] nix-grpc-daemon[776]: ts=2026-09-21T04:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.768644] nix-grpc-daemon[777]: ts=2026-09-21T04:24:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.774488] nix-grpc-daemon[777]: ts=2026-09-21T04:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 27.826066] nix-grpc-daemon[776]: ts=2026-09-21T04:24:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 27.831728] nix-grpc-daemon[776]: ts=2026-09-21T04:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 27.979063] nix-grpc-daemon[777]: ts=2026-09-21T04:24:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 27.983547] nix-grpc-daemon[777]: ts=2026-09-21T04:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.036466] nix-grpc-daemon[776]: ts=2026-09-21T04:24:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.040797] nix-grpc-daemon[776]: ts=2026-09-21T04:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.182100] nix-grpc-daemon[777]: ts=2026-09-21T04:24:20Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.186552] nix-grpc-daemon[777]: ts=2026-09-21T04:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.238972] nix-grpc-daemon[776]: ts=2026-09-21T04:24:20Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.244966] nix-grpc-daemon[776]: ts=2026-09-21T04:24:20Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.383782] nix-grpc-daemon[777]: ts=2026-09-21T04:24:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.389996] nix-grpc-daemon[777]: ts=2026-09-21T04:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.445946] nix-grpc-daemon[776]: ts=2026-09-21T04:24:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.448795] nix-grpc-daemon[776]: ts=2026-09-21T04:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.592000] nix-grpc-daemon[777]: ts=2026-09-21T04:24:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.597643] nix-grpc-daemon[777]: ts=2026-09-21T04:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.650640] nix-grpc-daemon[776]: ts=2026-09-21T04:24:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.656406] nix-grpc-daemon[776]: ts=2026-09-21T04:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 28.798087] nix-grpc-daemon[777]: ts=2026-09-21T04:24:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 28.800744] nix-grpc-daemon[777]: ts=2026-09-21T04:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 28.857288] nix-grpc-daemon[776]: ts=2026-09-21T04:24:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 28.862336] nix-grpc-daemon[776]: ts=2026-09-21T04:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.003718] nix-grpc-daemon[777]: ts=2026-09-21T04:24:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.007914] nix-grpc-daemon[777]: ts=2026-09-21T04:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.064911] nix-grpc-daemon[776]: ts=2026-09-21T04:24:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.069574] nix-grpc-daemon[776]: ts=2026-09-21T04:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.204162] nix-grpc-daemon[777]: ts=2026-09-21T04:24:21Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.209259] nix-grpc-daemon[777]: ts=2026-09-21T04:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.270237] nix-grpc-daemon[776]: ts=2026-09-21T04:24:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.273195] nix-grpc-daemon[776]: ts=2026-09-21T04:24:21Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.410204] nix-grpc-daemon[777]: ts=2026-09-21T04:24:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.415357] nix-grpc-daemon[777]: ts=2026-09-21T04:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.474364] nix-grpc-daemon[776]: ts=2026-09-21T04:24:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.479459] nix-grpc-daemon[776]: ts=2026-09-21T04:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.616254] nix-grpc-daemon[777]: ts=2026-09-21T04:24:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.621432] nix-grpc-daemon[777]: ts=2026-09-21T04:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.680216] nix-grpc-daemon[776]: ts=2026-09-21T04:24:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.683190] nix-grpc-daemon[776]: ts=2026-09-21T04:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 29.822238] nix-grpc-daemon[777]: ts=2026-09-21T04:24:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 29.827448] nix-grpc-daemon[777]: ts=2026-09-21T04:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 29.884303] nix-grpc-daemon[776]: ts=2026-09-21T04:24:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 29.889391] nix-grpc-daemon[776]: ts=2026-09-21T04:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.030109] nix-grpc-daemon[777]: ts=2026-09-21T04:24:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.034210] nix-grpc-daemon[777]: ts=2026-09-21T04:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.092272] nix-grpc-daemon[776]: ts=2026-09-21T04:24:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.096358] nix-grpc-daemon[776]: ts=2026-09-21T04:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.230602] nix-grpc-daemon[777]: ts=2026-09-21T04:24:22Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.235729] nix-grpc-daemon[777]: ts=2026-09-21T04:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.292767] nix-grpc-daemon[776]: ts=2026-09-21T04:24:22Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.297712] nix-grpc-daemon[776]: ts=2026-09-21T04:24:22Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.436580] nix-grpc-daemon[777]: ts=2026-09-21T04:24:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.441749] nix-grpc-daemon[777]: ts=2026-09-21T04:24:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.498793] nix-grpc-daemon[776]: ts=2026-09-21T04:24:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.503810] nix-grpc-daemon[776]: ts=2026-09-21T04:24:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.642551] nix-grpc-daemon[777]: ts=2026-09-21T04:24:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.647590] nix-grpc-daemon[777]: ts=2026-09-21T04:24:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.704976] nix-grpc-daemon[776]: ts=2026-09-21T04:24:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.709901] nix-grpc-daemon[776]: ts=2026-09-21T04:24:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 30.848876] nix-grpc-daemon[777]: ts=2026-09-21T04:24:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 30.853502] nix-grpc-daemon[777]: ts=2026-09-21T04:24:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 30.910796] nix-grpc-daemon[776]: ts=2026-09-21T04:24:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 30.915893] nix-grpc-daemon[776]: ts=2026-09-21T04:24:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.052533] nix-grpc-daemon[777]: ts=2026-09-21T04:24:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.056552] nix-grpc-daemon[777]: ts=2026-09-21T04:24:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.118876] nix-grpc-daemon[776]: ts=2026-09-21T04:24:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.122979] nix-grpc-daemon[776]: ts=2026-09-21T04:24:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.252982] nix-grpc-daemon[777]: ts=2026-09-21T04:24:23Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.258000] nix-grpc-daemon[777]: ts=2026-09-21T04:24:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.319539] nix-grpc-daemon[776]: ts=2026-09-21T04:24:23Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.324649] nix-grpc-daemon[776]: ts=2026-09-21T04:24:23Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.458902] nix-grpc-daemon[777]: ts=2026-09-21T04:24:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.464173] nix-grpc-daemon[777]: ts=2026-09-21T04:24:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.525634] nix-grpc-daemon[776]: ts=2026-09-21T04:24:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.530609] nix-grpc-daemon[776]: ts=2026-09-21T04:24:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 31.664921] nix-grpc-daemon[777]: ts=2026-09-21T04:24:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.669960] nix-grpc-daemon[777]: ts=2026-09-21T04:24:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 31.731709] nix-grpc-daemon[776]: ts=2026-09-21T04:24:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.737006] nix-grpc-daemon[776]: ts=2026-09-21T04:24:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.823416] rustfs-bucket-start[1021]: mb s3://farm worker1 # [ 31.870752] nix-grpc-daemon[777]: ts=2026-09-21T04:24:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 31.875845] nix-grpc-daemon[777]: ts=2026-09-21T04:24:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 31.832961] systemd[1]: Finished rustfs-bucket.service. lb # [ 31.844576] systemd[1]: Starting niks3 server... worker2 # [ 31.938151] nix-grpc-daemon[776]: ts=2026-09-21T04:24:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 31.943437] nix-grpc-daemon[776]: ts=2026-09-21T04:24:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.077755] nix-grpc-daemon[777]: ts=2026-09-21T04:24:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.080444] nix-grpc-daemon[777]: ts=2026-09-21T04:24:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 32.054244] postgres[1046]: [1046] ERROR: relation "goose_db_version" does not exist at character 36 lb # [ 32.055564] postgres[1046]: [1046] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC lb # [ 32.090895] niks3-server[1038]: 2026/09/21 04:24:24 OK 20241026095416_initial_model.sql (21.32ms) lb # [ 32.094676] niks3-server[1038]: 2026/09/21 04:24:24 OK 20251210153512_drop_unused_gin_index.sql (2.31ms) lb # [ 32.100120] niks3-server[1038]: 2026/09/21 04:24:24 OK 20251218171726_add_pins.sql (5.37ms) lb # [ 32.104881] niks3-server[1038]: 2026/09/21 04:24:24 OK 20260628120000_add_object_size_and_stats.sql (4.72ms) lb # [ 32.110289] niks3-server[1038]: 2026/09/21 04:24:24 OK 20260905000000_add_claims.sql (5.38ms) lb # [ 32.114661] niks3-server[1038]: 2026/09/21 04:24:24 OK 20260920000000_drop_claims.sql (4.26ms) lb # [ 32.116644] niks3-server[1038]: 2026/09/21 04:24:24 goose: successfully migrated database to version: 20260920000000 lb # [ 32.121433] niks3-server[1038]: 2026/09/21 04:24:24 OK 1_commit_pending_closure.sql (6.74ms) lb # [ 32.123967] niks3-server[1038]: 2026/09/21 04:24:24 OK 2_object_stats_trigger.sql (2.41ms) lb # [ 32.125359] niks3-server[1038]: 2026/09/21 04:24:24 goose: up to current file version: 2 lb # [ 32.129414] niks3-server[1038]: 2026/09/21 04:24:24 INFO Loaded signing key name=farm-test-1 path=/nix/store/8lzz3wcf17v05vfdp1zcfaa9hipw3f70-key worker2 # [ 32.146600] nix-grpc-daemon[776]: ts=2026-09-21T04:24:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.150660] nix-grpc-daemon[776]: ts=2026-09-21T04:24:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb # [ 32.174385] niks3-server[1038]: 2026/09/21 04:24:24 INFO Read proxy enabled — serving cache objects from S3 lb # [ 32.176419] niks3-server[1038]: 2026/09/21 04:24:24 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 32.180182] niks3-server[1038]: 2026/09/21 04:24:24 INFO systemd watchdog enabled interval=15s lb # [ 32.183737] systemd[1]: Started niks3 server. lb # [ 32.186585] niks3-server[1038]: 2026/09/21 04:24:24 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 32.187790] systemd[1]: Reached target Multi-User System. lb # [ 32.192750] systemd[1]: Startup finished in 949ms (kernel) + 5.446s (initrd) + 25.786s (userspace) = 32.183s. lb # [ 32.194065] niks3-server[1038]: 2026/09/21 04:24:24 INFO lead: acquired remote=192.168.1.4:36410 worker2 # [ 32.203137] nix-grpc-daemon[776]: ts=2026-09-21T04:24:24Z level=info event=scheduler_take_over worker1 # [ 32.278658] nix-grpc-daemon[777]: ts=2026-09-21T04:24:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.283784] nix-grpc-daemon[777]: ts=2026-09-21T04:24:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.347318] nix-grpc-daemon[776]: ts=2026-09-21T04:24:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.352856] nix-grpc-daemon[776]: ts=2026-09-21T04:24:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.484492] nix-grpc-daemon[777]: ts=2026-09-21T04:24:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.489490] nix-grpc-daemon[777]: ts=2026-09-21T04:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.553740] nix-grpc-daemon[776]: ts=2026-09-21T04:24:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.560514] nix-grpc-daemon[776]: ts=2026-09-21T04:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.690302] nix-grpc-daemon[777]: ts=2026-09-21T04:24:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 32.695426] nix-grpc-daemon[777]: ts=2026-09-21T04:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 32.758963] nix-grpc-daemon[776]: ts=2026-09-21T04:24:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.764180] nix-grpc-daemon[776]: ts=2026-09-21T04:24:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 32.896166] nix-grpc-daemon[777]: ts=2026-09-21T04:24:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.860296] nix-grpc-daemon[776]: ts=2026-09-21T04:24:25Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:58850 worker2 # [ 32.866488] nix-grpc-daemon[776]: ts=2026-09-21T04:24:25Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 32.965188] nix-grpc-daemon[776]: ts=2026-09-21T04:24:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 32.987089] nix-grpc-daemon[776]: ts=2026-09-21T04:24:25Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 32.991247] nix-grpc-daemon[776]: ts=2026-09-21T04:24:25Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:58850 lb: (finished: waiting for unit niks3.service, in 19.53 seconds) lb: waiting for TCP port 5751 on localhost worker2 # [ 32.996781] nix-grpc-daemon[776]: ts=2026-09-21T04:24:25Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.09 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.06 seconds) lb: waiting for TCP port 50051 on localhost lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 33.185247] envoy[902]: conn peer=[::1]:57830 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=3 lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds) worker2 # [ 33.375926] systemd[1]: Starting scheduler-token.service... worker2 # [ 33.465258] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 33.468309] systemd[1]: Finished scheduler-token.service. worker2 # [ 33.469206] systemd[1]: scheduler-token.service: Consumed 40ms CPU time over 92ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 0.10 seconds) subtest: one node schedules and both builders hold a WorkerSession on it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open' worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds) (finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.87 seconds) subtest: balancer auth: client cert, bearer token, nothing, unknown CN worker1 # [ 34.897712] nix-grpc-daemon[777]: ts=2026-09-21T04:24:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 34.917217] systemd[1]: Started Nix Daemon. worker1 # [ 35.222147] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 35.247140] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 1/5) worker1 # [ 35.293303] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 2/5) worker1 # [ 35.334060] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 169 ms (attempt 3/5) worker1 # [ 35.507743] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 220 ms (attempt 4/5) worker1 # [ 35.729931] nix-grpc-daemon[777]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 35.736929] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 35.734096] nix-grpc-daemon[776]: ts=2026-09-21T04:24:28Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 35.747667] systemd[1]: Started Nix Daemon. worker2 # [ 36.055210] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 36.077627] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 8 ms (attempt 1/5) worker2 # [ 36.088206] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 2/5) worker2 # [ 36.122726] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 170 ms (attempt 3/5) worker2 # [ 36.296965] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 264 ms (attempt 4/5) worker2 # [ 36.570433] nix-grpc-daemon[776]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 36.575920] nix-grpc-daemon[776]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 36.588679] nix-grpc-daemon[776]: ts=2026-09-21T04:24:29Z level=debug event=path_info_miss path=9b0ww2bi5z80fdwbhp6j472q7cahjy3h-nixos-system-client-test error="error: path '/nix/store/9b0ww2bi5z80fdwbhp6j472q7cahjy3h-nixos-system-client-test' is required, but there is no substituter that can build it" worker2 # [ 36.601720] nix-grpc-daemon[776]: ts=2026-09-21T04:24:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 36.614248] nix-grpc-daemon[776]: ts=2026-09-21T04:24:29Z level=debug event=path_info_miss path=9b0ww2bi5z80fdwbhp6j472q7cahjy3h-nixos-system-client-test error="error: path '/nix/store/9b0ww2bi5z80fdwbhp6j472q7cahjy3h-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.10 seconds) client: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key client: (finished: must succeed: install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.05 seconds) worker1 # [ 37.101250] nix-grpc-daemon[777]: ts=2026-09-21T04:24:29Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 37.107223] nix-grpc-daemon[777]: ts=2026-09-21T04:24:29Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:58042 worker2 # [ 37.078788] nix-grpc-daemon[776]: ts=2026-09-21T04:24:29Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:58864 worker1 # [ 37.139751] nix-grpc-daemon[777]: ts=2026-09-21T04:24:29Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:58042 worker2 # [ 37.090374] nix-grpc-daemon[776]: ts=2026-09-21T04:24:29Z level=debug event=path_info_miss path=9b0ww2bi5z80fdwbhp6j472q7cahjy3h-nixos-system-client-test error="error: path '/nix/store/9b0ww2bi5z80fdwbhp6j472q7cahjy3h-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 37.154604] nix-grpc-daemon[777]: ts=2026-09-21T04:24:29Z level=debug event=path_info_miss path=9b0ww2bi5z80fdwbhp6j472q7cahjy3h-nixos-system-client-test error="error: path '/nix/store/9b0ww2bi5z80fdwbhp6j472q7cahjy3h-nixos-system-client-test' is required, but there is no substituter that can build it" client: must succeed: rm -r /var/lib/nix-grpc-store client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.08 seconds) lb # [ 39.290280] envoy[902]: conn peer=[2001:db8:1::1]:35576 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=1819 lb # [ 39.293648] envoy[902]: conn peer=[2001:db8:1::1]:35586 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=85 worker2 # [ 39.494317] nix-grpc-daemon[776]: ts=2026-09-21T04:24:32Z level=info event=denied method=QueryMissing cn=- role=none worker2 # [ 39.757602] nix-grpc-daemon[776]: ts=2026-09-21T04:24:32Z level=info event=denied method=QueryMissing cn=stranger role=none (finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.33 seconds) subtest: DAG build is scheduled across workers and lands in the cache client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker2 # [ 40.011659] nix-grpc-daemon[776]: ts=2026-09-21T04:24:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58864 client # don't know how to build these paths: client # /nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker2 # [ 40.025998] nix-grpc-daemon[776]: ts=2026-09-21T04:24:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 40.064133] nix-grpc-daemon[776]: ts=2026-09-21T04:24:32Z level=debug event=want client=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv cached=0 worker2 # [ 40.070053] nix-grpc-daemon[776]: ts=2026-09-21T04:24:32Z level=debug event=assigned drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 40.163617] nix-grpc-daemon[777]: ts=2026-09-21T04:24:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 40.181858] nix-grpc-daemon[777]: ts=2026-09-21T04:24:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58042 client # copying 1 paths to 'lb:50051'... worker1 # [ 40.196665] nix-grpc-daemon[777]: ts=2026-09-21T04:24:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 client # copying path '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' to 'lb:50051'... worker1 # [ 40.226078] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 40.260169] nix-grpc-daemon[777]: ts=2026-09-21T04:24:32Z level=info event=niks3_push_started pid=852 worker1 # [ 40.550189] nix-grpc-daemon[852]: time=2026-09-21T04:24:33.174Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 40.741504] nix-daemon[838]: accepted connection from pid 865, user nix-grpc-daemon (trusted) worker1 # [ 40.761517] nix-daemon[838]: reaped child process 868, status = succeeded worker1 # [ 40.933716] nix-daemon[838]: accepted connection from pid 870, user nix-grpc-daemon (trusted) worker1 # [ 40.949181] nix-daemon[838]: reaped child process 873, status = succeeded lb # [ 40.914782] niks3-server[1038]: 2026/09/21 04:24:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 40.989448] nix-grpc-daemon[852]: time=2026-09-21T04:24:33.615Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 40.992681] nix-grpc-daemon[852]: time=2026-09-21T04:24:33.617Z level=INFO msg="Uploading 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv (504B)" lb # [ 40.986052] niks3-server[1038]: 2026/09/21 04:24:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign lb # [ 40.998954] niks3-server[1038]: 2026/09/21 04:24:33 INFO Registered completed upload object_key=nar/1il50j4vra11xfnqgjhjgrjn1753frlhxnss6mh1dmp5ww3is34w.nar.zst lb # [ 41.040124] niks3-server[1038]: 2026/09/21 04:24:33 INFO Signed narinfos id=1 count=1 worker1 # [ 41.090819] nix-grpc-daemon[852]: time=2026-09-21T04:24:33.716Z level=INFO msg="Uploading 1 narinfos" lb # [ 41.053149] niks3-server[1038]: 2026/09/21 04:24:33 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.ls lb # [ 41.059031] niks3-server[1038]: 2026/09/21 04:24:33 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete lb # [ 41.073374] niks3-server[1038]: 2026/09/21 04:24:33 INFO Completed upload id=1 worker1 # [ 41.121280] nix-grpc-daemon[852]: time=2026-09-21T04:24:33.747Z level=INFO msg="Upload complete. (563ms)" lb # [ 41.081234] niks3-server[1038]: 2026/09/21 04:24:33 INFO Registered completed upload object_key=619ccx60pfv52kv4hhgqpj1ivdmfcr5r.narinfo worker1 # [ 41.134067] nix-grpc-daemon[777]: ts=2026-09-21T04:24:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=0 paths=1 nar_bytes_in=504 worker1 # [ 41.151060] nix-grpc-daemon[777]: ts=2026-09-21T04:24:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 41.163823] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 41.167873] nix-daemon[838]: reaped child process 850, status = succeeded client # building '/nix/store/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv' on lb:50051... client # farm-a> node-a: building 619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv worker1 # [ 41.182334] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-t1 worker1 # [ 42.015113] nix-daemon[838]: reaped child process 877, status = succeeded worker1 # [ 42.170241] nix-daemon[838]: accepted connection from pid 893, user nix-grpc-daemon (trusted) worker1 # [ 42.186378] nix-daemon[838]: reaped child process 897, status = succeeded lb # [ 42.151853] niks3-server[1038]: 2026/09/21 04:24:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.215622] nix-grpc-daemon[852]: time=2026-09-21T04:24:34.840Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 42.217816] nix-grpc-daemon[852]: time=2026-09-21T04:24:34.840Z level=INFO msg="Uploading dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a (128B)" lb # [ 42.213753] niks3-server[1038]: 2026/09/21 04:24:34 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst worker1 # [ 42.273283] nix-grpc-daemon[852]: time=2026-09-21T04:24:34.898Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.227757] niks3-server[1038]: 2026/09/21 04:24:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign lb # [ 42.238042] niks3-server[1038]: 2026/09/21 04:24:34 INFO Signed narinfos id=2 count=1 lb # [ 42.242692] niks3-server[1038]: 2026/09/21 04:24:34 INFO Registered completed upload object_key=log/619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv lb # [ 42.251458] niks3-server[1038]: 2026/09/21 04:24:34 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.ls worker1 # [ 42.302890] nix-grpc-daemon[852]: time=2026-09-21T04:24:34.929Z level=INFO msg="Upload complete. (306ms)" lb # [ 42.255774] niks3-server[1038]: 2026/09/21 04:24:34 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete lb # [ 42.259977] niks3-server[1038]: 2026/09/21 04:24:34 INFO Completed upload id=2 lb # [ 42.263564] niks3-server[1038]: 2026/09/21 04:24:34 INFO Registered completed upload object_key=dg404zlvxfrspnxl6cc1qkc6i83m5a3a.narinfo worker1 # [ 42.313051] nix-grpc-daemon[777]: ts=2026-09-21T04:24:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=1 drv=619ccx60pfv52kv4hhgqpj1ivdmfcr5r-farm-a.drv assign_id=1 outputs=1 worker2 # [ 42.280765] nix-grpc-daemon[776]: ts=2026-09-21T04:24:34Z level=debug event=want client=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv cached=0 worker1 # [ 42.330649] nix-daemon[838]: reaped child process 875, status = succeeded worker2 # [ 42.286021] nix-grpc-daemon[776]: ts=2026-09-21T04:24:34Z level=debug event=assigned drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 42.373281] nix-grpc-daemon[777]: ts=2026-09-21T04:24:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 42.387184] nix-grpc-daemon[777]: ts=2026-09-21T04:24:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 42.402648] nix-grpc-daemon[852]: time=2026-09-21T04:24:35.028Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 42.412476] nix-grpc-daemon[777]: ts=2026-09-21T04:24:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 client # copying path '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' to 'lb:50051'... worker1 # [ 42.434321] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 42.644182] nix-daemon[838]: accepted connection from pid 901, user nix-grpc-daemon (trusted) worker1 # [ 42.661346] nix-daemon[838]: reaped child process 904, status = succeeded worker1 # [ 42.833515] nix-daemon[838]: accepted connection from pid 906, user nix-grpc-daemon (trusted) worker1 # [ 42.848904] nix-daemon[838]: reaped child process 909, status = succeeded lb # [ 42.812669] niks3-server[1038]: 2026/09/21 04:24:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 42.871022] nix-grpc-daemon[852]: time=2026-09-21T04:24:35.496Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 42.872543] nix-grpc-daemon[852]: time=2026-09-21T04:24:35.496Z level=INFO msg="Uploading 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv (624B)" lb # [ 42.843016] niks3-server[1038]: 2026/09/21 04:24:35 INFO Registered completed upload object_key=nar/1xk4kbz8l387hfrqq2xi6as79has336h62f2ra95472yqjclksjg.nar.zst worker1 # [ 42.902290] nix-grpc-daemon[852]: time=2026-09-21T04:24:35.528Z level=INFO msg="Uploading 1 narinfos" lb # [ 42.859538] niks3-server[1038]: 2026/09/21 04:24:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign lb # [ 42.869929] niks3-server[1038]: 2026/09/21 04:24:35 INFO Signed narinfos id=3 count=1 lb # [ 42.882423] niks3-server[1038]: 2026/09/21 04:24:35 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.ls lb # [ 42.886809] niks3-server[1038]: 2026/09/21 04:24:35 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete worker1 # [ 42.939249] nix-grpc-daemon[852]: time=2026-09-21T04:24:35.565Z level=INFO msg="Upload complete. (487ms)" lb # [ 42.892418] niks3-server[1038]: 2026/09/21 04:24:35 INFO Completed upload id=3 lb # [ 42.894774] niks3-server[1038]: 2026/09/21 04:24:35 INFO Registered completed upload object_key=79z38hfi82zcmb9yq1gcmfviimgf6z2l.narinfo worker1 # [ 42.948250] nix-grpc-daemon[777]: ts=2026-09-21T04:24:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 42.956482] nix-grpc-daemon[777]: ts=2026-09-21T04:24:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 42.964728] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 42.969584] nix-daemon[838]: reaped child process 899, status = succeeded client # building '/nix/store/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv' on lb:50051... client # farm-b> node-a: building 79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv worker1 # [ 42.982578] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-t1 worker1 # [ 44.209254] nix-daemon[838]: reaped child process 913, status = succeeded worker1 # [ 44.370451] nix-daemon[838]: accepted connection from pid 929, user nix-grpc-daemon (trusted) worker1 # [ 44.386935] nix-daemon[838]: reaped child process 932, status = succeeded lb # [ 44.357011] niks3-server[1038]: 2026/09/21 04:24:36 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 44.417507] nix-grpc-daemon[852]: time=2026-09-21T04:24:37.042Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 44.418956] nix-grpc-daemon[852]: time=2026-09-21T04:24:37.042Z level=INFO msg="Uploading 8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b (176B)" lb # [ 44.398005] niks3-server[1038]: 2026/09/21 04:24:37 INFO Registered completed upload object_key=nar/1mx8h9irf9ykfzxs6q3lwxbzxwv5d2s9mh2x0sky7448mlc1qxrx.nar.zst worker1 # [ 44.462550] nix-grpc-daemon[852]: time=2026-09-21T04:24:37.088Z level=INFO msg="Uploading 1 narinfos" lb # [ 44.414604] niks3-server[1038]: 2026/09/21 04:24:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign lb # [ 44.422470] niks3-server[1038]: 2026/09/21 04:24:37 INFO Signed narinfos id=4 count=1 lb # [ 44.428160] niks3-server[1038]: 2026/09/21 04:24:37 INFO Registered completed upload object_key=log/79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv lb # [ 44.431986] niks3-server[1038]: 2026/09/21 04:24:37 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.ls lb # [ 44.442288] niks3-server[1038]: 2026/09/21 04:24:37 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete worker1 # [ 44.489898] nix-grpc-daemon[852]: time=2026-09-21T04:24:37.116Z level=INFO msg="Upload complete. (297ms)" lb # [ 44.448830] niks3-server[1038]: 2026/09/21 04:24:37 INFO Completed upload id=4 lb # [ 44.451683] niks3-server[1038]: 2026/09/21 04:24:37 INFO Registered completed upload object_key=8n9g36vw9957r150a7wg1k6yj9fbqm8r.narinfo worker1 # [ 44.500979] nix-grpc-daemon[777]: ts=2026-09-21T04:24:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=1 drv=79z38hfi82zcmb9yq1gcmfviimgf6z2l-farm-b.drv assign_id=2 outputs=1 worker2 # [ 44.462542] nix-grpc-daemon[776]: ts=2026-09-21T04:24:37Z level=debug event=want client=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=0 worker1 # [ 44.517304] nix-daemon[838]: reaped child process 911, status = succeeded worker2 # [ 44.468544] nix-grpc-daemon[776]: ts=2026-09-21T04:24:37Z level=debug event=assigned drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 44.551115] nix-grpc-daemon[777]: ts=2026-09-21T04:24:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 44.566883] nix-grpc-daemon[777]: ts=2026-09-21T04:24:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 44.581958] nix-grpc-daemon[852]: time=2026-09-21T04:24:37.208Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' to 'lb:50051'... worker1 # [ 44.592071] nix-grpc-daemon[777]: ts=2026-09-21T04:24:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 44.609862] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 44.811985] nix-daemon[838]: accepted connection from pid 936, user nix-grpc-daemon (trusted) worker1 # [ 44.831803] nix-daemon[838]: reaped child process 939, status = succeeded worker1 # [ 45.005356] nix-daemon[838]: accepted connection from pid 941, user nix-grpc-daemon (trusted) worker1 # [ 45.022667] nix-daemon[838]: reaped child process 944, status = succeeded lb # [ 44.991436] niks3-server[1038]: 2026/09/21 04:24:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 45.049289] nix-grpc-daemon[852]: time=2026-09-21T04:24:37.675Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 45.050873] nix-grpc-daemon[852]: time=2026-09-21T04:24:37.675Z level=INFO msg="Uploading czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv (752B)" lb # [ 45.019686] niks3-server[1038]: 2026/09/21 04:24:37 INFO Registered completed upload object_key=nar/02rh0zwkcxgd7rc74r5h676rr0m8dbayk3glb776b2mdlirxh9lv.nar.zst worker1 # [ 45.080163] nix-grpc-daemon[852]: time=2026-09-21T04:24:37.706Z level=INFO msg="Uploading 1 narinfos" lb # [ 45.036974] niks3-server[1038]: 2026/09/21 04:24:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign lb # [ 45.047238] niks3-server[1038]: 2026/09/21 04:24:37 INFO Signed narinfos id=5 count=1 lb # [ 45.052556] niks3-server[1038]: 2026/09/21 04:24:37 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.ls lb # [ 45.063109] niks3-server[1038]: 2026/09/21 04:24:37 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete lb # [ 45.068335] niks3-server[1038]: 2026/09/21 04:24:37 INFO Completed upload id=5 worker1 # [ 45.115942] nix-grpc-daemon[852]: time=2026-09-21T04:24:37.742Z level=INFO msg="Upload complete. (488ms)" lb # [ 45.071352] niks3-server[1038]: 2026/09/21 04:24:37 INFO Registered completed upload object_key=czd6ljynjaw3bl3w8iz1nx68whkdis8f.narinfo worker1 # [ 45.124341] nix-grpc-daemon[777]: ts=2026-09-21T04:24:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 45.133055] nix-grpc-daemon[777]: ts=2026-09-21T04:24:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 45.142864] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 45.148411] nix-daemon[838]: reaped child process 934, status = succeeded client # building '/nix/store/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv' on lb:50051... worker1 # [ 45.160813] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-top> node-a: building czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1 worker1 # [ 45.994298] nix-daemon[838]: reaped child process 948, status = succeeded worker1 # [ 46.170600] nix-daemon[838]: accepted connection from pid 965, user nix-grpc-daemon (trusted) worker1 # [ 46.188215] nix-daemon[838]: reaped child process 968, status = succeeded lb # [ 46.157837] niks3-server[1038]: 2026/09/21 04:24:38 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 46.215670] nix-grpc-daemon[852]: time=2026-09-21T04:24:38.840Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 46.217306] nix-grpc-daemon[852]: time=2026-09-21T04:24:38.840Z level=INFO msg="Uploading nblg066ygaz2avzlmix3rnngr62hld8f-farm-top (232B)" lb # [ 46.186366] niks3-server[1038]: 2026/09/21 04:24:38 INFO Registered completed upload object_key=log/czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv lb # [ 46.202362] niks3-server[1038]: 2026/09/21 04:24:38 INFO Registered completed upload object_key=nar/1wplyx8g7zja504cjvqmxis1q6laml9bidgiq4ya0i9p2pvqb9qp.nar.zst worker1 # [ 46.267673] nix-grpc-daemon[852]: time=2026-09-21T04:24:38.893Z level=INFO msg="Uploading 1 narinfos" lb # [ 46.214597] niks3-server[1038]: 2026/09/21 04:24:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign lb # [ 46.223728] niks3-server[1038]: 2026/09/21 04:24:38 INFO Signed narinfos id=6 count=1 lb # [ 46.229301] niks3-server[1038]: 2026/09/21 04:24:38 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.ls lb # [ 46.240315] niks3-server[1038]: 2026/09/21 04:24:38 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete lb # [ 46.243730] niks3-server[1038]: 2026/09/21 04:24:38 INFO Registered completed upload object_key=nblg066ygaz2avzlmix3rnngr62hld8f.narinfo lb # [ 46.247701] niks3-server[1038]: 2026/09/21 04:24:38 INFO Completed upload id=6 worker1 # [ 46.295254] nix-grpc-daemon[852]: time=2026-09-21T04:24:38.921Z level=INFO msg="Upload complete. (325ms)" worker1 # [ 46.305068] nix-grpc-daemon[777]: ts=2026-09-21T04:24:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=1 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv assign_id=3 outputs=1 worker1 # [ 46.322190] nix-daemon[838]: reaped child process 946, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 6.53 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.23 seconds) client: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client: (finished: must fail: test -e /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.03 seconds) client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top client # copying 3 paths... client # copying path '/nix/store/dg404zlvxfrspnxl6cc1qkc6i83m5a3a-farm-a' from 'http://lb:5751'... client # copying path '/nix/store/8n9g36vw9957r150a7wg1k6yj9fbqm8r-farm-b' from 'http://lb:5751'... client # copying path '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' from 'http://lb:5751'... client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top && grep farm-top-t1 /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.29 seconds) (finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.18 seconds) subtest: repeat is answered Cached by the scheduler without building worker1: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker1 # finding garbage collector roots... worker1 # deleting specified paths... worker1 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker1 # deleting unused links... worker1 # note: hard linking is currently saving 0.0 KiB worker1: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.27 seconds) worker2: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # finding garbage collector roots... worker2 # deleting specified paths... worker2 # deleting '/nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top' worker2 # deleting unused links... worker2 # note: hard linking is currently saving 0.0 KiB worker2: (finished: must succeed: nix-store --delete /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top, in 0.28 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2 worker1 # [ 47.822553] nix-grpc-daemon[777]: ts=2026-09-21T04:24:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58042 client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked): client # /nix/store/nblg066ygaz2avzlmix3rnngr62hld8f-farm-top worker2 # [ 47.797952] nix-grpc-daemon[776]: ts=2026-09-21T04:24:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 47.828932] nix-grpc-daemon[776]: ts=2026-09-21T04:24:40Z level=debug event=want client=2 drv=czd6ljynjaw3bl3w8iz1nx68whkdis8f-farm-top.drv cached=1 client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 >&2, in 0.35 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 outPath, in 0.21 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: repeat is answered Cached by the scheduler without building, in 1.43 seconds) subtest: inputs already in the cache are not sent to the scheduler lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.06 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2 worker2 # [ 48.846434] nix-grpc-daemon[776]: ts=2026-09-21T04:24:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58864 client # don't know how to build these paths: client # /nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker1 # [ 48.905273] nix-grpc-daemon[777]: ts=2026-09-21T04:24:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 48.918135] nix-grpc-daemon[852]: time=2026-09-21T04:24:41.543Z level=INFO msg="All 2 paths already cached" worker2 # [ 48.888799] nix-grpc-daemon[776]: ts=2026-09-21T04:24:41Z level=debug event=want client=3 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv cached=0 worker2 # [ 48.894803] nix-grpc-daemon[776]: ts=2026-09-21T04:24:41Z level=debug event=assigned drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 48.980478] nix-grpc-daemon[777]: ts=2026-09-21T04:24:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 48.995722] nix-grpc-daemon[777]: ts=2026-09-21T04:24:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 49.010305] nix-grpc-daemon[852]: time=2026-09-21T04:24:41.636Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker1 # [ 49.020118] nix-grpc-daemon[777]: ts=2026-09-21T04:24:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 client # copying path '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' to 'lb:50051'... worker1 # [ 49.039015] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 49.249171] nix-daemon[838]: accepted connection from pid 985, user nix-grpc-daemon (trusted) worker1 # [ 49.267675] nix-daemon[838]: reaped child process 988, status = succeeded lb # [ 49.289911] envoy[902]: conn peer=[2001:db8:1::1]:35602 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=13 lb # [ 49.294660] envoy[902]: conn peer=[2001:db8:1::1]:35614 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=15 lb # [ 49.299505] envoy[902]: conn peer=[2001:db8:1::1]:35620 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9510 tx=4092 ms=6269 lb # [ 49.304394] envoy[902]: conn peer=[2001:db8:1::1]:37038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=993 tx=480 ms=72 worker1 # [ 49.437118] nix-daemon[838]: accepted connection from pid 990, user nix-grpc-daemon (trusted) worker1 # [ 49.453597] nix-daemon[838]: reaped child process 993, status = succeeded lb # [ 49.418556] niks3-server[1038]: 2026/09/21 04:24:42 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 49.475413] nix-grpc-daemon[852]: time=2026-09-21T04:24:42.101Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 49.477015] nix-grpc-daemon[852]: time=2026-09-21T04:24:42.101Z level=INFO msg="Uploading blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv (752B)" lb # [ 49.445084] niks3-server[1038]: 2026/09/21 04:24:42 INFO Registered completed upload object_key=nar/1vy3ds565pni9mnkldcs6alimlb6bg39cimm60s4swkk5yjhwlqf.nar.zst worker1 # [ 49.505673] nix-grpc-daemon[852]: time=2026-09-21T04:24:42.131Z level=INFO msg="Uploading 1 narinfos" lb # [ 49.461534] niks3-server[1038]: 2026/09/21 04:24:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign lb # [ 49.471980] niks3-server[1038]: 2026/09/21 04:24:42 INFO Signed narinfos id=7 count=1 lb # [ 49.477115] niks3-server[1038]: 2026/09/21 04:24:42 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.ls lb # [ 49.486868] niks3-server[1038]: 2026/09/21 04:24:42 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete lb # [ 49.492966] niks3-server[1038]: 2026/09/21 04:24:42 INFO Registered completed upload object_key=blgxcsidls7na1m5da3m0bja1prb87vl.narinfo lb # [ 49.497468] niks3-server[1038]: 2026/09/21 04:24:42 INFO Completed upload id=7 worker1 # [ 49.544725] nix-grpc-daemon[852]: time=2026-09-21T04:24:42.170Z level=INFO msg="Upload complete. (487ms)" worker1 # [ 49.552708] nix-grpc-daemon[777]: ts=2026-09-21T04:24:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 49.565394] nix-grpc-daemon[777]: ts=2026-09-21T04:24:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 49.571514] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 49.575975] nix-daemon[838]: reaped child process 983, status = succeeded client # building '/nix/store/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv' on lb:50051... worker1 # [ 49.588236] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # farm-top> node-a: building blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-t1b worker1 # [ 50.433695] nix-daemon[838]: reaped child process 997, status = succeeded worker1 # [ 50.607258] nix-daemon[838]: accepted connection from pid 1013, user nix-grpc-daemon (trusted) worker1 # [ 50.624432] nix-daemon[838]: reaped child process 1016, status = succeeded lb # [ 50.593869] niks3-server[1038]: 2026/09/21 04:24:43 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 50.651944] nix-grpc-daemon[852]: time=2026-09-21T04:24:43.275Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 50.653600] nix-grpc-daemon[852]: time=2026-09-21T04:24:43.275Z level=INFO msg="Uploading 0xnysbbdbmapgf23wb2dbsfhgh18yxvp-farm-top (232B)" lb # [ 50.629137] niks3-server[1038]: 2026/09/21 04:24:43 INFO Registered completed upload object_key=nar/1f6pjd04v1xmbxqqjhczkkfk4ns9qg6ssnspdalp41q9hkxf9yfr.nar.zst lb # [ 50.641569] niks3-server[1038]: 2026/09/21 04:24:43 INFO Registered completed upload object_key=log/blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv lb # [ 50.648435] niks3-server[1038]: 2026/09/21 04:24:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign worker1 # [ 50.700984] nix-grpc-daemon[852]: time=2026-09-21T04:24:43.326Z level=INFO msg="Uploading 1 narinfos" lb # [ 50.656374] niks3-server[1038]: 2026/09/21 04:24:43 INFO Signed narinfos id=8 count=1 lb # [ 50.664074] niks3-server[1038]: 2026/09/21 04:24:43 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.ls lb # [ 50.673032] niks3-server[1038]: 2026/09/21 04:24:43 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete lb # [ 50.680934] niks3-server[1038]: 2026/09/21 04:24:43 INFO Completed upload id=8 lb # [ 50.684226] niks3-server[1038]: 2026/09/21 04:24:43 INFO Registered completed upload object_key=0xnysbbdbmapgf23wb2dbsfhgh18yxvp.narinfo worker1 # [ 50.728623] nix-grpc-daemon[852]: time=2026-09-21T04:24:43.354Z level=INFO msg="Upload complete. (330ms)" worker1 # [ 50.741324] nix-grpc-daemon[777]: ts=2026-09-21T04:24:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=1 drv=blgxcsidls7na1m5da3m0bja1prb87vl-farm-top.drv assign_id=4 outputs=1 worker1 # [ 50.758871] nix-daemon[838]: reaped child process 995, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.15 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.23 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.07 seconds) (finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.76 seconds) subtest: two clients wanting the same drv build it once client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup client # [ 51.237429] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 0.10 seconds) client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup worker1 # [ 51.558121] nix-grpc-daemon[777]: ts=2026-09-21T04:24:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58042 client # Running as unit: dedup1.service; invocation ID: b0ca76e0e37f401991b26265a02e44ae client # [ 51.511092] nix[888]: don't know how to build these paths: client # [ 51.513090] nix[888]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker2 # [ 51.533657] nix-grpc-daemon[776]: ts=2026-09-21T04:24:44Z level=debug event=want client=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 51.534053] nix-grpc-daemon[776]: ts=2026-09-21T04:24:44Z level=debug event=assigned drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 51.547186] nix-grpc-daemon[776]: ts=2026-09-21T04:24:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 51.565753] nix-grpc-daemon[776]: ts=2026-09-21T04:24:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58864 client # [ 51.569777] nix[888]: copying 1 paths to 'lb:50051'... client # [ 51.571564] nix[888]: copying path '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' to 'lb:50051'... worker2 # [ 51.580047] nix-grpc-daemon[776]: ts=2026-09-21T04:24:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 51.595427] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 51.622561] nix-grpc-daemon[776]: ts=2026-09-21T04:24:44Z level=info event=niks3_push_started pid=911 worker2 # [ 51.883585] nix-grpc-daemon[911]: time=2026-09-21T04:24:44.522Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 52.075422] nix-daemon[857]: accepted connection from pid 924, user nix-grpc-daemon (trusted) worker2 # [ 52.091792] nix-daemon[857]: reaped child process 927, status = succeeded worker2 # [ 52.265269] nix-daemon[857]: accepted connection from pid 929, user nix-grpc-daemon (trusted) worker2 # [ 52.283245] nix-daemon[857]: reaped child process 932, status = succeeded lb # [ 52.293639] niks3-server[1038]: 2026/09/21 04:24:44 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 52.306487] nix-grpc-daemon[911]: time=2026-09-21T04:24:44.946Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 52.309791] nix-grpc-daemon[911]: time=2026-09-21T04:24:44.948Z level=INFO msg="Uploading cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv (432B)" lb # [ 52.327759] niks3-server[1038]: 2026/09/21 04:24:44 INFO Registered completed upload object_key=nar/0l7vpaziqxpw0srrsgimqvaa0dyxa9glicn3ilkwk06l64hn837w.nar.zst lb # [ 52.341369] niks3-server[1038]: 2026/09/21 04:24:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign worker2 # [ 52.350140] nix-grpc-daemon[911]: time=2026-09-21T04:24:44.989Z level=INFO msg="Uploading 1 narinfos" lb # [ 52.353847] niks3-server[1038]: 2026/09/21 04:24:44 INFO Signed narinfos id=9 count=1 lb # [ 52.360800] niks3-server[1038]: 2026/09/21 04:24:44 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.ls lb # [ 52.370632] niks3-server[1038]: 2026/09/21 04:24:44 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete client # [ 52.357608] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup. worker2 # [ 52.380823] nix-grpc-daemon[911]: time=2026-09-21T04:24:45.020Z level=INFO msg="Upload complete. (488ms)" lb # [ 52.378558] niks3-server[1038]: 2026/09/21 04:24:44 INFO Completed upload id=9 client # Running as unit: dedup2.service; invocation ID: 1841a1945e854f3e97fdbd2f59408c42 lb # [ 52.381388] niks3-server[1038]: 2026/09/21 04:24:45 INFO Registered completed upload object_key=cp23830c44gs2dw4xy80s5wqyjm7vw84.narinfo worker2 # [ 52.388270] nix-grpc-daemon[776]: ts=2026-09-21T04:24:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=0 paths=1 nar_bytes_in=432 worker2 # [ 52.397011] nix-grpc-daemon[776]: ts=2026-09-21T04:24:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58864 client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag dedup, in 1.14 seconds) worker2 # [ 52.406247] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 52.410544] nix-daemon[857]: reaped child process 909, status = succeeded client # [ 52.410393] nix[888]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... worker2 # [ 52.423287] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client: must succeed: sleep 2 client # [ 54.765057] nix[904]: don't know how to build these paths: client # [ 54.765246] nix[904]: /nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv worker1 # [ 54.818816] nix-grpc-daemon[777]: ts=2026-09-21T04:24:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58042 worker2 # [ 54.780949] nix-grpc-daemon[776]: ts=2026-09-21T04:24:47Z level=debug event=want client=5 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv cached=0 worker2 # [ 54.785918] nix-grpc-daemon[776]: ts=2026-09-21T04:24:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58864 client # [ 54.780477] nix[904]: building '/nix/store/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv' on lb:50051... client: (finished: must succeed: sleep 2, in 2.92 seconds) client: waiting for success: ! systemctl is-active dedup1 dedup2 worker2 # [ 56.846724] nix-daemon[857]: reaped child process 936, status = succeeded worker2 # [ 57.002530] nix-daemon[857]: accepted connection from pid 968, user nix-grpc-daemon (trusted) worker2 # [ 57.020655] nix-daemon[857]: reaped child process 971, status = succeeded lb # [ 57.031309] niks3-server[1038]: 2026/09/21 04:24:49 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 57.044654] nix-grpc-daemon[911]: time=2026-09-21T04:24:49.683Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 57.046434] nix-grpc-daemon[911]: time=2026-09-21T04:24:49.683Z level=INFO msg="Uploading vamz940my4dma9a2daklr9pw9x9pp9hp-slow-dedup (120B)" lb # [ 57.078157] niks3-server[1038]: 2026/09/21 04:24:49 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst worker2 # [ 57.094937] nix-grpc-daemon[911]: time=2026-09-21T04:24:49.733Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.091765] niks3-server[1038]: 2026/09/21 04:24:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign lb # [ 57.103066] niks3-server[1038]: 2026/09/21 04:24:49 INFO Signed narinfos id=10 count=1 lb # [ 57.110195] niks3-server[1038]: 2026/09/21 04:24:49 INFO Registered completed upload object_key=log/cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv lb # [ 57.118082] niks3-server[1038]: 2026/09/21 04:24:49 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.ls lb # [ 57.125768] niks3-server[1038]: 2026/09/21 04:24:49 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete lb # [ 57.132121] niks3-server[1038]: 2026/09/21 04:24:49 INFO Completed upload id=10 worker2 # [ 57.133671] nix-grpc-daemon[911]: time=2026-09-21T04:24:49.773Z level=INFO msg="Upload complete. (298ms)" lb # [ 57.135379] niks3-server[1038]: 2026/09/21 04:24:49 INFO Registered completed upload object_key=vamz940my4dma9a2daklr9pw9x9pp9hp.narinfo worker2 # [ 57.147056] nix-grpc-daemon[776]: ts=2026-09-21T04:24:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=4 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 57.160380] nix-grpc-daemon[776]: ts=2026-09-21T04:24:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=2 drv=cp23830c44gs2dw4xy80s5wqyjm7vw84-slow-dedup.drv assign_id=5 outputs=1 worker2 # [ 57.166249] nix-daemon[857]: reaped child process 934, status = succeeded client # [ 57.201262] systemd[1]: dedup1.service: Deactivated successfully. client # [ 57.205692] systemd[1]: dedup1.service: Consumed 172ms CPU time over 5.969s wall clock time, 41.4M memory peak, 7.1K incoming IP traffic, 8.4K outgoing IP traffic. client # [ 57.216432] systemd[1]: dedup2.service: Deactivated successfully. client # [ 57.218448] systemd[1]: dedup2.service: Consumed 232ms CPU time over 4.856s wall clock time, 33.4M memory peak, 5.9K incoming IP traffic, 5.6K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.14 seconds) client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; } client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.07 seconds) worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.07 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: two clients wanting the same drv build it once, in 7.15 seconds) subtest: build hook: nix-daemon with builders = grpc://lb client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log client # [ 58.523665] systemd[1]: Started Nix Daemon. client # [ 58.715818] nix-daemon[946]: accepted connection from pid 943, user root (trusted) worker1 # [ 58.992649] nix-grpc-daemon[777]: ts=2026-09-21T04:24:51Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:58042 worker2 # [ 58.951486] nix-grpc-daemon[776]: ts=2026-09-21T04:24:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 58.970911] nix-grpc-daemon[776]: ts=2026-09-21T04:24:51Z level=debug event=want client=6 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv cached=0 worker2 # [ 58.976989] nix-grpc-daemon[776]: ts=2026-09-21T04:24:51Z level=debug event=assigned drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 59.063279] nix-grpc-daemon[777]: ts=2026-09-21T04:24:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 59.079066] nix-grpc-daemon[777]: ts=2026-09-21T04:24:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 59.094271] nix-grpc-daemon[777]: ts=2026-09-21T04:24:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 59.109065] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 59.314127] nix-daemon[838]: accepted connection from pid 1041, user nix-grpc-daemon (trusted) worker1 # [ 59.333155] nix-daemon[838]: reaped child process 1044, status = succeeded lb # [ 59.291758] envoy[902]: conn peer=[2001:db8:1::1]:37052 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4172 tx=1783 ms=1860 lb # [ 59.296922] envoy[902]: conn peer=[2001:db8:1::1]:57992 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1430 tx=1085 ms=2391 lb # [ 59.301764] envoy[902]: conn peer=[2001:db8:1::1]:57990 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3018 tx=1453 ms=5650 worker1 # [ 59.504759] nix-daemon[838]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker1 # [ 59.519952] nix-daemon[838]: reaped child process 1049, status = succeeded lb # [ 59.485290] niks3-server[1038]: 2026/09/21 04:24:52 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 59.542081] nix-grpc-daemon[852]: time=2026-09-21T04:24:52.167Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 59.543518] nix-grpc-daemon[852]: time=2026-09-21T04:24:52.167Z level=INFO msg="Uploading xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv (512B)" lb # [ 59.514398] niks3-server[1038]: 2026/09/21 04:24:52 INFO Registered completed upload object_key=nar/1f1i5kab3qhx7pg1k0ma5r1m7ipfazkfkfb944dm7qcjr466pwij.nar.zst lb # [ 59.526597] niks3-server[1038]: 2026/09/21 04:24:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign worker1 # [ 59.582282] nix-grpc-daemon[852]: time=2026-09-21T04:24:52.208Z level=INFO msg="Uploading 1 narinfos" lb # [ 59.536705] niks3-server[1038]: 2026/09/21 04:24:52 INFO Signed narinfos id=11 count=1 lb # [ 59.543753] niks3-server[1038]: 2026/09/21 04:24:52 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.ls lb # [ 59.552395] niks3-server[1038]: 2026/09/21 04:24:52 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete lb # [ 59.561370] niks3-server[1038]: 2026/09/21 04:24:52 INFO Completed upload id=11 worker1 # [ 59.608339] nix-grpc-daemon[852]: time=2026-09-21T04:24:52.234Z level=INFO msg="Upload complete. (482ms)" lb # [ 59.563775] niks3-server[1038]: 2026/09/21 04:24:52 INFO Registered completed upload object_key=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv.narinfo worker1 # [ 59.615621] nix-grpc-daemon[777]: ts=2026-09-21T04:24:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 59.629960] nix-grpc-daemon[777]: ts=2026-09-21T04:24:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 59.639032] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 59.641470] nix-daemon[838]: reaped child process 1039, status = succeeded worker1 # [ 59.654332] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 60.698046] nix-daemon[838]: reaped child process 1053, status = succeeded worker1 # [ 60.879000] nix-daemon[838]: accepted connection from pid 1069, user nix-grpc-daemon (trusted) worker1 # [ 60.895683] nix-daemon[838]: reaped child process 1072, status = succeeded lb # [ 60.861164] niks3-server[1038]: 2026/09/21 04:24:53 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 60.920758] nix-grpc-daemon[852]: time=2026-09-21T04:24:53.544Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 60.927270] nix-grpc-daemon[852]: time=2026-09-21T04:24:53.544Z level=INFO msg="Uploading yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a (128B)" lb # [ 60.903723] niks3-server[1038]: 2026/09/21 04:24:53 INFO Registered completed upload object_key=log/xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv lb # [ 60.915854] niks3-server[1038]: 2026/09/21 04:24:53 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 60.925571] niks3-server[1038]: 2026/09/21 04:24:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign worker1 # [ 60.978127] nix-grpc-daemon[852]: time=2026-09-21T04:24:53.603Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.935197] niks3-server[1038]: 2026/09/21 04:24:53 INFO Signed narinfos id=12 count=1 lb # [ 60.940116] niks3-server[1038]: 2026/09/21 04:24:53 INFO Registered completed upload object_key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.ls lb # [ 60.946497] niks3-server[1038]: 2026/09/21 04:24:53 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete lb # [ 60.950833] niks3-server[1038]: 2026/09/21 04:24:53 INFO Completed upload id=12 worker1 # [ 60.997956] nix-grpc-daemon[852]: time=2026-09-21T04:24:53.624Z level=INFO msg="Upload complete. (334ms)" worker1 # [ 61.008467] nix-grpc-daemon[852]: time=2026-09-21T04:24:53.629Z level=WARN msg="Failed to register uploaded object" key=yfs64sxmsg77fnzczdvc3g3yfdwh9fks.narinfo error="server returned 404: object is not pending upload\n" worker1 # [ 61.029437] nix-grpc-daemon[777]: ts=2026-09-21T04:24:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=1 drv=xs7jpxrx1nnx7zbhs6p2v76pjq3964kv-farm-a.drv assign_id=6 outputs=1 worker1 # [ 61.036619] nix-grpc-daemon[777]: ts=2026-09-21T04:24:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 61.041027] nix-daemon[838]: reaped child process 1051, status = succeeded worker2 # [ 61.001300] nix-grpc-daemon[776]: ts=2026-09-21T04:24:53Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 61.024890] nix-grpc-daemon[776]: copying path '/nix/store/yfs64sxmsg77fnzczdvc3g3yfdwh9fks-farm-a' from 'http://lb:5751'... worker2 # [ 61.046767] nix-grpc-daemon[776]: ts=2026-09-21T04:24:53Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=0 paths=1 nar_bytes_out=128 worker2 # [ 61.372179] nix-grpc-daemon[776]: ts=2026-09-21T04:24:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:58864 worker1 # [ 61.425162] nix-grpc-daemon[777]: ts=2026-09-21T04:24:54Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 61.437925] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 61.464506] nix-grpc-daemon[776]: ts=2026-09-21T04:24:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 61.475096] nix-grpc-daemon[911]: time=2026-09-21T04:24:54.114Z level=INFO msg="All 1 paths already cached" worker2 # [ 61.496845] nix-grpc-daemon[776]: ts=2026-09-21T04:24:54Z level=debug event=want client=7 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv cached=0 worker2 # [ 61.502914] nix-grpc-daemon[776]: ts=2026-09-21T04:24:54Z level=debug event=assigned drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 61.551897] nix-grpc-daemon[777]: ts=2026-09-21T04:24:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 61.568890] nix-grpc-daemon[777]: ts=2026-09-21T04:24:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 61.583479] nix-grpc-daemon[852]: time=2026-09-21T04:24:54.209Z level=INFO msg="All 1 paths already cached" worker1 # [ 61.593297] nix-grpc-daemon[777]: ts=2026-09-21T04:24:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 61.611782] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 61.827753] nix-daemon[838]: accepted connection from pid 1080, user nix-grpc-daemon (trusted) worker1 # [ 61.845723] nix-daemon[838]: reaped child process 1083, status = succeeded worker1 # [ 62.018542] nix-daemon[838]: accepted connection from pid 1085, user nix-grpc-daemon (trusted) worker1 # [ 62.034033] nix-daemon[838]: reaped child process 1088, status = succeeded lb # [ 61.998933] niks3-server[1038]: 2026/09/21 04:24:54 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 62.056309] nix-grpc-daemon[852]: time=2026-09-21T04:24:54.681Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 62.057739] nix-grpc-daemon[852]: time=2026-09-21T04:24:54.682Z level=INFO msg="Uploading r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv (624B)" lb # [ 62.028768] niks3-server[1038]: 2026/09/21 04:24:54 INFO Registered completed upload object_key=nar/15k66v3mh3v6p5vymv4pv3v3sfl56i2b1ia2rf093c37w6bhc04m.nar.zst worker1 # [ 62.089575] nix-grpc-daemon[852]: time=2026-09-21T04:24:54.715Z level=INFO msg="Uploading 1 narinfos" lb # [ 62.045321] niks3-server[1038]: 2026/09/21 04:24:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign lb # [ 62.057059] niks3-server[1038]: 2026/09/21 04:24:54 INFO Signed narinfos id=13 count=1 lb # [ 62.059802] niks3-server[1038]: 2026/09/21 04:24:54 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.ls lb # [ 62.067511] niks3-server[1038]: 2026/09/21 04:24:54 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete lb # [ 62.074171] niks3-server[1038]: 2026/09/21 04:24:54 INFO Completed upload id=13 worker1 # [ 62.121798] nix-grpc-daemon[852]: time=2026-09-21T04:24:54.748Z level=INFO msg="Upload complete. (491ms)" lb # [ 62.077229] niks3-server[1038]: 2026/09/21 04:24:54 INFO Registered completed upload object_key=r1jsr4b2g1qwly395z6idx3z2362ih8i.narinfo worker1 # [ 62.133639] nix-grpc-daemon[777]: ts=2026-09-21T04:24:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 62.143557] nix-grpc-daemon[777]: ts=2026-09-21T04:24:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 62.154251] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 62.157365] nix-daemon[838]: reaped child process 1078, status = succeeded worker1 # [ 62.171014] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 63.491311] nix-daemon[838]: reaped child process 1092, status = succeeded worker1 # [ 63.771595] nix-daemon[838]: accepted connection from pid 1108, user nix-grpc-daemon (trusted) worker1 # [ 63.795788] nix-daemon[838]: reaped child process 1111, status = succeeded lb # [ 63.766621] niks3-server[1038]: 2026/09/21 04:24:56 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 63.832765] nix-grpc-daemon[852]: time=2026-09-21T04:24:56.457Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 63.839717] nix-grpc-daemon[852]: time=2026-09-21T04:24:56.457Z level=INFO msg="Uploading la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b (176B)" lb # [ 63.859253] niks3-server[1038]: 2026/09/21 04:24:56 INFO Registered completed upload object_key=nar/069d0xnyw2q345iqzx6agxc5fxifc6q36bkkklw2aa4qwanxdd1g.nar.zst lb # [ 63.882261] niks3-server[1038]: 2026/09/21 04:24:56 INFO Registered completed upload object_key=log/r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv worker1 # [ 63.944425] nix-grpc-daemon[852]: time=2026-09-21T04:24:56.569Z level=INFO msg="Uploading 1 narinfos" lb # [ 63.898526] niks3-server[1038]: 2026/09/21 04:24:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign lb # [ 63.908844] niks3-server[1038]: 2026/09/21 04:24:56 INFO Signed narinfos id=14 count=1 lb # [ 63.914388] niks3-server[1038]: 2026/09/21 04:24:56 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.ls lb # [ 63.923866] niks3-server[1038]: 2026/09/21 04:24:56 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete worker1 # [ 63.971414] nix-grpc-daemon[852]: time=2026-09-21T04:24:56.597Z level=INFO msg="Upload complete. (585ms)" lb # [ 63.928863] niks3-server[1038]: 2026/09/21 04:24:56 INFO Completed upload id=14 lb # [ 63.932443] niks3-server[1038]: 2026/09/21 04:24:56 INFO Registered completed upload object_key=la6ryzsihag4zpxgxls54fsg34dvlalk.narinfo worker1 # [ 63.985590] nix-grpc-daemon[777]: ts=2026-09-21T04:24:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=1 drv=r1jsr4b2g1qwly395z6idx3z2362ih8i-farm-b.drv assign_id=7 outputs=1 worker1 # [ 64.003059] nix-daemon[838]: reaped child process 1090, status = succeeded worker2 # [ 63.986537] nix-grpc-daemon[776]: ts=2026-09-21T04:24:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 64.002324] nix-grpc-daemon[776]: copying path '/nix/store/la6ryzsihag4zpxgxls54fsg34dvlalk-farm-b' from 'http://lb:5751'... worker2 # [ 64.049817] nix-grpc-daemon[776]: ts=2026-09-21T04:24:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 64.054834] nix-grpc-daemon[776]: ts=2026-09-21T04:24:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 64.159029] nix-grpc-daemon[777]: ts=2026-09-21T04:24:56Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=2 bytes_in=312 bytes_out=200 worker1 # [ 64.166331] nix-daemon[838]: reaped child process 1075, status = succeeded worker2 # [ 64.381239] nix-grpc-daemon[776]: ts=2026-09-21T04:24:57Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:58864 worker1 # [ 64.431243] nix-grpc-daemon[777]: ts=2026-09-21T04:24:57Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 64.444908] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 64.513677] nix-grpc-daemon[777]: ts=2026-09-21T04:24:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 64.523879] nix-grpc-daemon[852]: time=2026-09-21T04:24:57.150Z level=INFO msg="All 2 paths already cached" worker2 # [ 64.501125] nix-grpc-daemon[776]: ts=2026-09-21T04:24:57Z level=debug event=want client=8 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv cached=0 worker1 # [ 64.551060] nix-grpc-daemon[777]: ts=2026-09-21T04:24:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker2 # [ 64.506925] nix-grpc-daemon[776]: ts=2026-09-21T04:24:57Z level=debug event=assigned drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 64.567006] nix-grpc-daemon[777]: ts=2026-09-21T04:24:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 64.581043] nix-grpc-daemon[852]: time=2026-09-21T04:24:57.207Z level=INFO msg="All 2 paths already cached" worker1 # [ 64.590073] nix-grpc-daemon[777]: ts=2026-09-21T04:24:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 64.605501] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 64.809299] nix-daemon[838]: accepted connection from pid 1119, user nix-grpc-daemon (trusted) worker1 # [ 64.826949] nix-daemon[838]: reaped child process 1122, status = succeeded worker1 # [ 64.998837] nix-daemon[838]: accepted connection from pid 1124, user nix-grpc-daemon (trusted) worker1 # [ 65.015032] nix-daemon[838]: reaped child process 1127, status = succeeded lb # [ 64.982110] niks3-server[1038]: 2026/09/21 04:24:57 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 65.037536] nix-grpc-daemon[852]: time=2026-09-21T04:24:57.663Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 65.039049] nix-grpc-daemon[852]: time=2026-09-21T04:24:57.663Z level=INFO msg="Uploading aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv (752B)" lb # [ 65.007010] niks3-server[1038]: 2026/09/21 04:24:57 INFO Registered completed upload object_key=nar/1ahq7sp1sl2scxqzfjd8gqimpqfkjbyi9ivxdhdwx0jzh2gbv74b.nar.zst lb # [ 65.020787] niks3-server[1038]: 2026/09/21 04:24:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign worker1 # [ 65.074213] nix-grpc-daemon[852]: time=2026-09-21T04:24:57.700Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.031133] niks3-server[1038]: 2026/09/21 04:24:57 INFO Signed narinfos id=15 count=1 lb # [ 65.037834] niks3-server[1038]: 2026/09/21 04:24:57 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.ls lb # [ 65.047238] niks3-server[1038]: 2026/09/21 04:24:57 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete lb # [ 65.052617] niks3-server[1038]: 2026/09/21 04:24:57 INFO Completed upload id=15 worker1 # [ 65.100282] nix-grpc-daemon[852]: time=2026-09-21T04:24:57.726Z level=INFO msg="Upload complete. (477ms)" lb # [ 65.055430] niks3-server[1038]: 2026/09/21 04:24:57 INFO Registered completed upload object_key=aa4abikjj4w30bfx1p8hxmq0916qbz1c.narinfo worker1 # [ 65.108838] nix-grpc-daemon[777]: ts=2026-09-21T04:24:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 65.120925] nix-grpc-daemon[777]: ts=2026-09-21T04:24:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 65.129122] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 65.131927] nix-daemon[838]: reaped child process 1117, status = succeeded worker1 # [ 65.145531] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 66.776272] nix-daemon[838]: reaped child process 1131, status = succeeded worker1 # [ 66.937948] nix-daemon[838]: accepted connection from pid 1147, user nix-grpc-daemon (trusted) worker1 # [ 66.954663] nix-daemon[838]: reaped child process 1150, status = succeeded lb # [ 66.925583] niks3-server[1038]: 2026/09/21 04:24:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 66.984379] nix-grpc-daemon[852]: time=2026-09-21T04:24:59.607Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 66.985849] nix-grpc-daemon[852]: time=2026-09-21T04:24:59.607Z level=INFO msg="Uploading 39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top (232B)" lb # [ 66.965027] niks3-server[1038]: 2026/09/21 04:24:59 INFO Registered completed upload object_key=log/aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv lb # [ 66.977889] niks3-server[1038]: 2026/09/21 04:24:59 INFO Registered completed upload object_key=nar/0vq3rhfhhbqyx5pbvaa9ddj9wbw9arph334y3bp3idfrikwnjc92.nar.zst worker1 # [ 67.037512] nix-grpc-daemon[852]: time=2026-09-21T04:24:59.663Z level=INFO msg="Uploading 1 narinfos" lb # [ 66.989701] niks3-server[1038]: 2026/09/21 04:24:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign lb # [ 66.994960] niks3-server[1038]: 2026/09/21 04:24:59 INFO Signed narinfos id=16 count=1 lb # [ 66.999942] niks3-server[1038]: 2026/09/21 04:24:59 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.ls lb # [ 67.011076] niks3-server[1038]: 2026/09/21 04:24:59 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete lb # [ 67.016615] niks3-server[1038]: 2026/09/21 04:24:59 INFO Completed upload id=16 worker1 # [ 67.063345] nix-grpc-daemon[852]: time=2026-09-21T04:24:59.689Z level=INFO msg="Upload complete. (307ms)" lb # [ 67.019432] niks3-server[1038]: 2026/09/21 04:24:59 INFO Registered completed upload object_key=39qxwzy2zkij70y9zvbr59pb0df38w5h.narinfo worker2 # [ 67.034468] nix-grpc-daemon[776]: ts=2026-09-21T04:24:59Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:58864 worker1 # [ 67.072984] nix-grpc-daemon[777]: ts=2026-09-21T04:24:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=1 drv=aa4abikjj4w30bfx1p8hxmq0916qbz1c-farm-top.drv assign_id=8 outputs=1 worker1 # [ 67.089022] nix-daemon[838]: reaped child process 1129, status = succeeded worker2 # [ 67.046921] nix-grpc-daemon[776]: copying path '/nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top' from 'http://lb:5751'... worker1 # [ 67.136131] nix-grpc-daemon[777]: ts=2026-09-21T04:24:59Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 67.141971] nix-grpc-daemon[777]: ts=2026-09-21T04:24:59Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=0 paths=1 nar_bytes_out=232 worker1 # [ 67.164061] nix-grpc-daemon[777]: ts=2026-09-21T04:24:59Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=2 bytes_in=376 bytes_out=200 worker1 # [ 67.169849] nix-daemon[838]: reaped child process 1114, status = succeeded client # [ 67.181487] nix-daemon[946]: reaped child process 948, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --print-out-paths --no-link -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag hook 2>/tmp/hook.log, in 8.90 seconds) client: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top client: (finished: must succeed: grep farm-top-hook /nix/store/39qxwzy2zkij70y9zvbr59pb0df38w5h-farm-top, in 0.04 seconds) client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.05 seconds) client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; } client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds) (finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 9.03 seconds) subtest: an input only one worker has still reaches the builder client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only client # this derivation will be built: client # /nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv client # building '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag w1only, in 0.43 seconds) client: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure client: (finished: must succeed: nix-store --export /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only > /tmp/shared/inp.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/inp.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.24 seconds) worker2: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only worker2: (finished: must fail: test -e /nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only, in 0.04 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2 client # [ 68.467985] nix-daemon[946]: accepted connection from pid 1032, user root (trusted) client # this derivation will be built: client # /nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 68.689835] nix-grpc-daemon[776]: ts=2026-09-21T04:25:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:58864 worker1 # [ 68.739832] nix-grpc-daemon[777]: ts=2026-09-21T04:25:01Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 68.754181] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 68.776472] nix-grpc-daemon[776]: ts=2026-09-21T04:25:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58864 client # copying 1 paths... client # copying path '/nix/store/dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only' to 'grpc://lb:50051'... worker2 # [ 68.794019] nix-grpc-daemon[776]: ts=2026-09-21T04:25:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 68.810439] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 69.025270] nix-daemon[857]: accepted connection from pid 996, user nix-grpc-daemon (trusted) worker2 # [ 69.046056] nix-daemon[857]: reaped child process 999, status = succeeded lb # [ 69.055642] niks3-server[1038]: 2026/09/21 04:25:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 69.066323] nix-grpc-daemon[911]: time=2026-09-21T04:25:01.706Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 69.068602] nix-grpc-daemon[911]: time=2026-09-21T04:25:01.708Z level=INFO msg="Uploading dymj0d1vj8q0ns6p096qk7fii766dap6-local-input-w1only (120B)" lb # [ 69.083894] niks3-server[1038]: 2026/09/21 04:25:01 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 69.098608] niks3-server[1038]: 2026/09/21 04:25:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign worker2 # [ 69.107269] nix-grpc-daemon[911]: time=2026-09-21T04:25:01.746Z level=INFO msg="Uploading 1 narinfos" lb # [ 69.111331] niks3-server[1038]: 2026/09/21 04:25:01 INFO Signed narinfos id=17 count=1 lb # [ 69.118042] niks3-server[1038]: 2026/09/21 04:25:01 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.ls lb # [ 69.125112] niks3-server[1038]: 2026/09/21 04:25:01 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete worker2 # [ 69.136208] nix-grpc-daemon[911]: time=2026-09-21T04:25:01.776Z level=INFO msg="Upload complete. (309ms)" lb # [ 69.135379] niks3-server[1038]: 2026/09/21 04:25:01 INFO Completed upload id=17 lb # [ 69.138372] niks3-server[1038]: 2026/09/21 04:25:01 INFO Registered completed upload object_key=dymj0d1vj8q0ns6p096qk7fii766dap6.narinfo worker2 # [ 69.148146] nix-grpc-daemon[776]: ts=2026-09-21T04:25:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=0 paths=1 nar_bytes_in=120 worker2 # [ 69.163399] nix-daemon[857]: reaped child process 994, status = succeeded worker2 # [ 69.168167] nix-grpc-daemon[776]: ts=2026-09-21T04:25:01Z level=debug event=want client=9 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv cached=0 worker2 # [ 69.172719] nix-grpc-daemon[776]: ts=2026-09-21T04:25:01Z level=debug event=assigned drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 69.218349] nix-grpc-daemon[776]: ts=2026-09-21T04:25:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 69.234003] nix-grpc-daemon[776]: ts=2026-09-21T04:25:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58864 client # copying 2 paths to 'lb:50051'... worker2 # [ 69.252622] nix-grpc-daemon[776]: ts=2026-09-21T04:25:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58864 client # copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' to 'lb:50051'... client # copying path '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' to 'lb:50051'... worker2 # [ 69.266311] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) lb # [ 69.291938] envoy[902]: conn peer=[2001:db8:1::1]:58008 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3401 tx=1718 ms=2160 lb # [ 69.300671] envoy[902]: conn peer=[2001:db8:1::1]:50432 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=436 tx=334 ms=110 lb # [ 69.306521] envoy[902]: conn peer=[2001:db8:1::1]:50456 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=410 tx=375 ms=64 lb # [ 69.312292] envoy[902]: conn peer=[2001:db8:1::1]:50446 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4502 tx=2380 ms=2737 lb # [ 69.317326] envoy[902]: conn peer=[2001:db8:1::1]:50474 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=438 tx=406 ms=29 lb # [ 69.322441] envoy[902]: conn peer=[2001:db8:1::1]:50462 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4956 tx=2596 ms=2732 worker2 # [ 69.462189] nix-daemon[857]: accepted connection from pid 1005, user nix-grpc-daemon (trusted) worker2 # [ 69.481240] nix-daemon[857]: reaped child process 1008, status = succeeded worker2 # [ 69.649449] nix-daemon[857]: accepted connection from pid 1010, user nix-grpc-daemon (trusted) worker2 # [ 69.667468] nix-daemon[857]: reaped child process 1013, status = succeeded lb # [ 69.676753] niks3-server[1038]: 2026/09/21 04:25:02 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 69.686670] niks3-server[1038]: 2026/09/21 04:25:02 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 69.698172] nix-grpc-daemon[911]: time=2026-09-21T04:25:02.337Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 69.699630] nix-grpc-daemon[911]: time=2026-09-21T04:25:02.337Z level=INFO msg="Uploading 4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv (416B)" worker2 # [ 69.701458] nix-grpc-daemon[911]: time=2026-09-21T04:25:02.337Z level=INFO msg="Uploading 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv (568B)" lb # [ 69.722783] niks3-server[1038]: 2026/09/21 04:25:02 INFO Registered completed upload object_key=nar/0p6zgq1gdngshl62q0hv3lslqwv90s7fmflwc7wgnycf4ka6ik69.nar.zst lb # [ 69.740238] niks3-server[1038]: 2026/09/21 04:25:02 INFO Registered completed upload object_key=nar/0i2vbprwp0wxa61nkss61gzivqmmjh6klkgv0rlfnxk46rcaba1v.nar.zst lb # [ 69.755429] niks3-server[1038]: 2026/09/21 04:25:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign worker2 # [ 69.764469] nix-grpc-daemon[911]: time=2026-09-21T04:25:02.403Z level=INFO msg="Uploading 3 narinfos" lb # [ 69.764870] niks3-server[1038]: 2026/09/21 04:25:02 INFO Signed narinfos id=18 count=1 lb # [ 69.771170] niks3-server[1038]: 2026/09/21 04:25:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign lb # [ 69.778522] niks3-server[1038]: 2026/09/21 04:25:02 INFO Signed narinfos id=19 count=2 lb # [ 69.782697] niks3-server[1038]: 2026/09/21 04:25:02 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.ls lb # [ 69.789865] niks3-server[1038]: 2026/09/21 04:25:02 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.ls lb # [ 69.802736] niks3-server[1038]: 2026/09/21 04:25:02 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 69.810742] niks3-server[1038]: 2026/09/21 04:25:02 INFO Registered completed upload object_key=4llc9br53475v1z1bdqrjyfi2sjvwnvr.narinfo lb # [ 69.818314] niks3-server[1038]: 2026/09/21 04:25:02 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete lb # [ 69.822504] niks3-server[1038]: 2026/09/21 04:25:02 INFO Completed upload id=18 lb # [ 69.824684] niks3-server[1038]: 2026/09/21 04:25:02 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete worker2 # [ 69.826885] nix-grpc-daemon[911]: time=2026-09-21T04:25:02.466Z level=INFO msg="Upload complete. (541ms)" lb # [ 69.827928] niks3-server[1038]: 2026/09/21 04:25:02 INFO Registered completed upload object_key=71l2x9mybp0i90r6pdnglwjnayj4xpl8.narinfo lb # [ 69.835889] niks3-server[1038]: 2026/09/21 04:25:02 INFO Completed upload id=19 worker2 # [ 69.838931] nix-grpc-daemon[776]: ts=2026-09-21T04:25:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=0 paths=2 nar_bytes_in=984 worker2 # [ 69.859354] nix-grpc-daemon[776]: ts=2026-09-21T04:25:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 69.870863] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 69.880492] nix-daemon[857]: reaped child process 1003, status = succeeded client # building '/nix/store/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv' on lb:50051... worker2 # [ 69.890298] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # uses-input-w1onlya> worker2: building 71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv client # uses-input-w1onlya> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 71.314883] nix-daemon[857]: reaped child process 1017, status = succeeded worker2 # [ 71.470808] nix-daemon[857]: accepted connection from pid 1033, user nix-grpc-daemon (trusted) worker2 # [ 71.487330] nix-daemon[857]: reaped child process 1036, status = succeeded lb # [ 71.501167] niks3-server[1038]: 2026/09/21 04:25:04 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 71.512410] nix-grpc-daemon[911]: time=2026-09-21T04:25:04.151Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 71.530563] niks3-server[1038]: 2026/09/21 04:25:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign worker2 # [ 71.542860] nix-grpc-daemon[911]: time=2026-09-21T04:25:04.182Z level=INFO msg="Uploading 1 narinfos" lb # [ 71.545096] niks3-server[1038]: 2026/09/21 04:25:04 INFO Signed narinfos id=20 count=1 lb # [ 71.551506] niks3-server[1038]: 2026/09/21 04:25:04 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.ls lb # [ 71.558506] niks3-server[1038]: 2026/09/21 04:25:04 INFO Registered completed upload object_key=log/71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv worker2 # [ 71.570942] nix-grpc-daemon[911]: time=2026-09-21T04:25:04.210Z level=INFO msg="Upload complete. (267ms)" lb # [ 71.569271] niks3-server[1038]: 2026/09/21 04:25:04 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete lb # [ 71.576165] niks3-server[1038]: 2026/09/21 04:25:04 INFO Completed upload id=20 client # copying 1 paths... worker2 # [ 71.580308] nix-grpc-daemon[776]: ts=2026-09-21T04:25:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=1 drv=71l2x9mybp0i90r6pdnglwjnayj4xpl8-uses-input-w1onlya.drv assign_id=9 outputs=1 lb # [ 71.579095] niks3-server[1038]: 2026/09/21 04:25:04 INFO Registered completed upload object_key=2i7aa0cdpp60vpdm180r56gqfh25m7hc.narinfo client # copying path '/nix/store/2i7aa0cdpp60vpdm180r56gqfh25m7hc-uses-input-w1onlya' from 'grpc://lb:50051'... worker2 # [ 71.590788] nix-grpc-daemon[776]: ts=2026-09-21T04:25:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 71.593956] nix-daemon[857]: reaped child process 1015, status = succeeded worker2 # [ 71.614171] nix-grpc-daemon[776]: ts=2026-09-21T04:25:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 71.618426] nix-grpc-daemon[776]: ts=2026-09-21T04:25:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=0 paths=1 nar_bytes_out=120 worker1 # [ 71.731148] nix-grpc-daemon[777]: ts=2026-09-21T04:25:04Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=2 bytes_in=320 bytes_out=200 worker1 # [ 71.738919] nix-daemon[838]: reaped child process 1158, status = succeeded client # [ 71.740616] nix-daemon[946]: reaped child process 1035, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.51 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2 client # [ 71.958615] nix-daemon[946]: accepted connection from pid 1056, user root (trusted) client # this derivation will be built: client # /nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker1 # [ 72.226854] nix-grpc-daemon[777]: ts=2026-09-21T04:25:04Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:58042 client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker2 # [ 72.186989] nix-grpc-daemon[776]: ts=2026-09-21T04:25:04Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 72.200507] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker1 # [ 72.313678] nix-grpc-daemon[777]: ts=2026-09-21T04:25:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 72.325867] nix-grpc-daemon[852]: time=2026-09-21T04:25:04.951Z level=INFO msg="All 1 paths already cached" worker2 # [ 72.302123] nix-grpc-daemon[776]: ts=2026-09-21T04:25:04Z level=debug event=want client=10 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv cached=0 worker2 # [ 72.308837] nix-grpc-daemon[776]: ts=2026-09-21T04:25:04Z level=debug event=assigned drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 72.358045] nix-grpc-daemon[777]: ts=2026-09-21T04:25:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 72.373565] nix-grpc-daemon[777]: ts=2026-09-21T04:25:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58042 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' to 'lb:50051'... worker1 # [ 72.395472] nix-grpc-daemon[777]: ts=2026-09-21T04:25:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 72.409641] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 72.432356] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5) worker1 # [ 72.490590] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 157 ms (attempt 2/5) worker1 # [ 72.655062] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 58 ms (attempt 3/5) worker1 # [ 72.720587] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 584 ms (attempt 4/5) worker1 # [ 73.313783] nix-grpc-daemon[777]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 73.321310] nix-grpc-daemon[777]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 73.330136] nix-grpc-daemon[777]: copying path '/nix/store/4llc9br53475v1z1bdqrjyfi2sjvwnvr-local-input-w1only.drv' from 'http://lb:5751'... worker1 # [ 73.549196] nix-daemon[838]: accepted connection from pid 1167, user nix-grpc-daemon (trusted) worker1 # [ 73.566377] nix-daemon[838]: reaped child process 1170, status = succeeded worker1 # [ 73.737093] nix-daemon[838]: accepted connection from pid 1172, user nix-grpc-daemon (trusted) worker1 # [ 73.752586] nix-daemon[838]: reaped child process 1175, status = succeeded lb # [ 73.717742] niks3-server[1038]: 2026/09/21 04:25:06 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 73.775415] nix-grpc-daemon[852]: time=2026-09-21T04:25:06.401Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 73.777068] nix-grpc-daemon[852]: time=2026-09-21T04:25:06.401Z level=INFO msg="Uploading 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv (568B)" lb # [ 73.751726] niks3-server[1038]: 2026/09/21 04:25:06 INFO Registered completed upload object_key=nar/14jznd749vfl63s1gv7i29r5z6jcai2byp2nz83dr5gib6z2cyaz.nar.zst lb # [ 73.766275] niks3-server[1038]: 2026/09/21 04:25:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign worker1 # [ 73.821248] nix-grpc-daemon[852]: time=2026-09-21T04:25:06.447Z level=INFO msg="Uploading 1 narinfos" lb # [ 73.778098] niks3-server[1038]: 2026/09/21 04:25:06 INFO Signed narinfos id=21 count=1 lb # [ 73.785355] niks3-server[1038]: 2026/09/21 04:25:06 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.ls worker1 # [ 73.844865] nix-grpc-daemon[852]: time=2026-09-21T04:25:06.471Z level=INFO msg="Upload complete. (497ms)" lb # [ 73.797653] niks3-server[1038]: 2026/09/21 04:25:06 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete lb # [ 73.802595] niks3-server[1038]: 2026/09/21 04:25:06 INFO Completed upload id=21 lb # [ 73.805711] niks3-server[1038]: 2026/09/21 04:25:06 INFO Registered completed upload object_key=12ialcyr3l4m98rzfgk6apzimy55z3j8.narinfo worker1 # [ 73.852135] nix-grpc-daemon[777]: ts=2026-09-21T04:25:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=1 paths=1 nar_bytes_in=568 worker1 # [ 73.863972] nix-grpc-daemon[777]: ts=2026-09-21T04:25:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 73.875909] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker1 # [ 73.881592] nix-daemon[838]: reaped child process 1160, status = succeeded client # building '/nix/store/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv' on lb:50051... worker1 # [ 73.895221] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) client # uses-input-w1onlyb> node-a: building 12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv client # uses-input-w1onlyb> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 75.330205] nix-daemon[838]: reaped child process 1179, status = succeeded worker1 # [ 75.503323] nix-daemon[838]: accepted connection from pid 1195, user nix-grpc-daemon (trusted) worker1 # [ 75.520431] nix-daemon[838]: reaped child process 1198, status = succeeded lb # [ 75.487395] niks3-server[1038]: 2026/09/21 04:25:08 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 75.546733] nix-grpc-daemon[852]: time=2026-09-21T04:25:08.171Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 75.516540] niks3-server[1038]: 2026/09/21 04:25:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign worker1 # [ 75.571603] nix-grpc-daemon[852]: time=2026-09-21T04:25:08.197Z level=INFO msg="Uploading 1 narinfos" lb # [ 75.529160] niks3-server[1038]: 2026/09/21 04:25:08 INFO Signed narinfos id=22 count=1 lb # [ 75.536672] niks3-server[1038]: 2026/09/21 04:25:08 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.ls lb # [ 75.549308] niks3-server[1038]: 2026/09/21 04:25:08 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete worker1 # [ 75.601719] nix-grpc-daemon[852]: time=2026-09-21T04:25:08.227Z level=INFO msg="Upload complete. (296ms)" lb # [ 75.554752] niks3-server[1038]: 2026/09/21 04:25:08 INFO Registered completed upload object_key=log/12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv lb # [ 75.559737] niks3-server[1038]: 2026/09/21 04:25:08 INFO Completed upload id=22 lb # [ 75.562469] niks3-server[1038]: 2026/09/21 04:25:08 INFO Registered completed upload object_key=jfy62nvxcd0b9rkhly152q21ddbrcn28.narinfo worker1 # [ 75.613207] nix-grpc-daemon[777]: ts=2026-09-21T04:25:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=1 drv=12ialcyr3l4m98rzfgk6apzimy55z3j8-uses-input-w1onlyb.drv assign_id=10 outputs=1 worker1 # [ 75.626202] nix-daemon[838]: reaped child process 1177, status = succeeded client # copying 1 paths... worker1 # [ 75.657433] nix-grpc-daemon[777]: ts=2026-09-21T04:25:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:58042 client # copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'grpc://lb:50051'... worker2 # [ 75.639829] nix-grpc-daemon[776]: ts=2026-09-21T04:25:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 75.653886] nix-grpc-daemon[776]: copying path '/nix/store/jfy62nvxcd0b9rkhly152q21ddbrcn28-uses-input-w1onlyb' from 'http://lb:5751'... worker2 # [ 75.670653] nix-grpc-daemon[776]: ts=2026-09-21T04:25:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=0 paths=1 nar_bytes_out=120 worker2 # [ 75.736474] nix-grpc-daemon[776]: ts=2026-09-21T04:25:08Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=3 bytes_in=320 bytes_out=200 worker2 # [ 75.745398] nix-daemon[857]: reaped child process 1039, status = succeeded client # [ 75.791959] nix-daemon[946]: reaped child process 1059, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt b >&2, in 4.05 seconds) client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2 client # [ 76.007823] nix-daemon[946]: accepted connection from pid 1080, user root (trusted) client # this derivation will be built: client # /nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker1 # [ 76.273162] nix-grpc-daemon[777]: ts=2026-09-21T04:25:08Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:58042 client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux'... worker1 # [ 76.288926] nix-grpc-daemon[777]: ts=2026-09-21T04:25:08Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:58042 worker1 # [ 76.304114] nix-daemon[838]: accepted connection from pid 777, user nix-grpc-daemon (trusted) worker2 # [ 76.271965] nix-grpc-daemon[776]: ts=2026-09-21T04:25:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 76.282893] nix-grpc-daemon[911]: time=2026-09-21T04:25:08.922Z level=INFO msg="All 1 paths already cached" worker2 # [ 76.302145] nix-grpc-daemon[776]: ts=2026-09-21T04:25:08Z level=debug event=want client=11 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv cached=0 worker2 # [ 76.311374] nix-grpc-daemon[776]: ts=2026-09-21T04:25:08Z level=debug event=assigned drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 76.320302] nix-grpc-daemon[776]: ts=2026-09-21T04:25:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 76.328136] nix-grpc-daemon[776]: ts=2026-09-21T04:25:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 76.338861] nix-grpc-daemon[911]: time=2026-09-21T04:25:08.978Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' to 'lb:50051'... worker2 # [ 76.348802] nix-grpc-daemon[776]: ts=2026-09-21T04:25:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 76.362953] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 76.569524] nix-daemon[857]: accepted connection from pid 1049, user nix-grpc-daemon (trusted) worker2 # [ 76.586923] nix-daemon[857]: reaped child process 1052, status = succeeded worker2 # [ 76.758149] nix-daemon[857]: accepted connection from pid 1054, user nix-grpc-daemon (trusted) worker2 # [ 76.774331] nix-daemon[857]: reaped child process 1057, status = succeeded lb # [ 76.784890] niks3-server[1038]: 2026/09/21 04:25:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 76.797333] nix-grpc-daemon[911]: time=2026-09-21T04:25:09.437Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 76.798812] nix-grpc-daemon[911]: time=2026-09-21T04:25:09.437Z level=INFO msg="Uploading n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv (568B)" lb # [ 76.816218] niks3-server[1038]: 2026/09/21 04:25:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign worker2 # [ 76.826259] nix-grpc-daemon[911]: time=2026-09-21T04:25:09.466Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.829899] niks3-server[1038]: 2026/09/21 04:25:09 INFO Signed narinfos id=23 count=1 lb # [ 76.836215] niks3-server[1038]: 2026/09/21 04:25:09 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.ls lb # [ 76.842320] niks3-server[1038]: 2026/09/21 04:25:09 INFO Registered completed upload object_key=nar/1qd3ps964395j2cc3rlqd58m21s7f6na9s0k2z5kclx0c3l4sl40.nar.zst worker2 # [ 76.852536] nix-grpc-daemon[911]: time=2026-09-21T04:25:09.492Z level=INFO msg="Upload complete. (473ms)" lb # [ 76.851079] niks3-server[1038]: 2026/09/21 04:25:09 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete lb # [ 76.856818] niks3-server[1038]: 2026/09/21 04:25:09 INFO Completed upload id=23 worker2 # [ 76.860661] nix-grpc-daemon[776]: ts=2026-09-21T04:25:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=0 paths=1 nar_bytes_in=568 lb # [ 76.859765] niks3-server[1038]: 2026/09/21 04:25:09 INFO Registered completed upload object_key=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr.narinfo worker2 # [ 76.868880] nix-grpc-daemon[776]: ts=2026-09-21T04:25:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 76.880148] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) worker2 # [ 76.882947] nix-daemon[857]: reaped child process 1047, status = succeeded client # building '/nix/store/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv' on lb:50051... worker2 # [ 76.895342] nix-daemon[857]: accepted connection from pid 776, user nix-grpc-daemon (trusted) client # uses-input-w1onlyc> worker2: building n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv client # uses-input-w1onlyc> disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 78.541009] nix-daemon[857]: reaped child process 1061, status = succeeded worker2 # [ 78.723076] nix-daemon[857]: accepted connection from pid 1077, user nix-grpc-daemon (trusted) worker2 # [ 78.739407] nix-daemon[857]: reaped child process 1080, status = succeeded lb # [ 78.750584] niks3-server[1038]: 2026/09/21 04:25:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 78.764391] nix-grpc-daemon[911]: time=2026-09-21T04:25:11.402Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 78.781956] niks3-server[1038]: 2026/09/21 04:25:11 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.ls worker2 # [ 78.793677] nix-grpc-daemon[911]: time=2026-09-21T04:25:11.433Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.792556] niks3-server[1038]: 2026/09/21 04:25:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign lb # [ 78.803566] niks3-server[1038]: 2026/09/21 04:25:11 INFO Signed narinfos id=24 count=1 lb # [ 78.808898] niks3-server[1038]: 2026/09/21 04:25:11 INFO Registered completed upload object_key=log/n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv lb # [ 78.817828] niks3-server[1038]: 2026/09/21 04:25:11 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete lb # [ 78.822782] niks3-server[1038]: 2026/09/21 04:25:11 INFO Completed upload id=24 worker2 # [ 78.824447] nix-grpc-daemon[911]: time=2026-09-21T04:25:11.464Z level=INFO msg="Upload complete. (318ms)" lb # [ 78.825818] niks3-server[1038]: 2026/09/21 04:25:11 INFO Registered completed upload object_key=13r5ipj38sk1irdi724wm1mbl9lw720b.narinfo client # copying 1 paths... worker2 # [ 78.836288] nix-grpc-daemon[776]: ts=2026-09-21T04:25:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=1 drv=n7pcsnwv1a8b1wwcq715iprr5f6c4mcr-uses-input-w1onlyc.drv assign_id=11 outputs=1 client # copying path '/nix/store/13r5ipj38sk1irdi724wm1mbl9lw720b-uses-input-w1onlyc' from 'grpc://lb:50051'... worker2 # [ 78.850286] nix-grpc-daemon[776]: ts=2026-09-21T04:25:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 78.854205] nix-daemon[857]: reaped child process 1059, status = succeeded worker2 # [ 78.874004] nix-grpc-daemon[776]: ts=2026-09-21T04:25:11Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58864 worker2 # [ 78.879023] nix-grpc-daemon[776]: ts=2026-09-21T04:25:11Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58864 duration_s=0 paths=1 nar_bytes_out=120 worker1 # [ 78.984271] nix-grpc-daemon[777]: ts=2026-09-21T04:25:11Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:58042 duration_s=2 bytes_in=320 bytes_out=200 worker1 # [ 78.991465] nix-daemon[838]: reaped child process 1201, status = succeeded client # [ 78.989632] nix-daemon[946]: reaped child process 1083, status = succeeded client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&system=aarch64-linux aarch64-linux - 4' --no-link -f /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix job --argstr tag w1only --argstr salt c >&2, in 3.20 seconds) (finished: subtest: an input only one worker has still reaches the builder, in 11.67 seconds) subtest: upload whose reference the worker lacks is completed from the cache client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache client # this derivation will be built: client # /nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv lb # [ 79.292844] envoy[902]: conn peer=[2001:db8:1::1]:45152 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=67 lb # [ 79.297793] envoy[902]: conn peer=[2001:db8:1::1]:50484 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4798 tx=2167 ms=2992 lb # [ 79.302584] envoy[902]: conn peer=[2001:db8:1::1]:45182 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=329 ms=94 lb # [ 79.307920] envoy[902]: conn peer=[2001:db8:1::1]:45168 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4306 tx=2193 ms=3550 lb # [ 79.312794] envoy[902]: conn peer=[2001:db8:1::1]:45192 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=328 ms=61 lb # [ 79.317374] envoy[902]: conn peer=[2001:db8:1::1]:45190 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4333 tx=2172 ms=2703 client # building '/nix/store/x1rrnjihpa1xvpyxxxdrjzp3c8z8nayq-local-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A input --argstr tag viacache, in 0.44 seconds) client: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache client # this derivation will be built: client # /nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv client # building '/nix/store/1m587dk4visgyryf6n0mgp2rlp7pbjd1-refers-to-input-viacache.drv'... client: (finished: must succeed: nix-build --no-out-link /nix/store/d2v6gfscfnwmpkifqgfkvs9vxxfraw1i-dep.nix -A referrer --argstr tag viacache, in 0.42 seconds) client: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure client: (finished: must succeed: nix-store --export /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache > /tmp/shared/ref.closure, in 0.20 seconds) worker1: must succeed: nix-store --import < /tmp/shared/ref.closure worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.23 seconds) worker2 # [ 80.378074] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 80.746989] nix-grpc-daemon[776]: ts=2026-09-21T04:25:13Z level=info event=signal_exit worker2 # [ 80.991586] nix-grpc-daemon[776]: ts=2026-09-21T04:25:13Z level=info event=scheduler_yield worker2 # [ 80.998026] nix-grpc-daemon[776]: ts=2026-09-21T04:25:13Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 81.045533] nix-grpc-daemon[777]: ts=2026-09-21T04:25:13Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 81.000271] niks3-server[1038]: 2026/09/21 04:25:13 INFO lead: released remote=192.168.1.4:36410 worker2 # [ 81.002288] nix-grpc-daemon[776]: ts=2026-09-21T04:25:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:58850 worker2 # [ 81.008536] nix-grpc-daemon[776]: ts=2026-09-21T04:25:13Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 81.012582] nix-grpc-daemon[776]: ts=2026-09-21T04:25:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:58850 worker2 # [ 81.016930] nix-grpc-daemon[776]: ts=2026-09-21T04:25:13Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 81.198304] nix-grpc-daemon[776]: ts=2026-09-21T04:25:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.245610] nix-grpc-daemon[777]: ts=2026-09-21T04:25:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.203586] nix-grpc-daemon[776]: ts=2026-09-21T04:25:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.250861] nix-grpc-daemon[777]: ts=2026-09-21T04:25:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.404672] nix-grpc-daemon[776]: ts=2026-09-21T04:25:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.451508] nix-grpc-daemon[777]: ts=2026-09-21T04:25:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.409746] nix-grpc-daemon[776]: ts=2026-09-21T04:25:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.456725] nix-grpc-daemon[777]: ts=2026-09-21T04:25:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.610853] nix-grpc-daemon[776]: ts=2026-09-21T04:25:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 81.657464] nix-grpc-daemon[777]: ts=2026-09-21T04:25:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.616093] nix-grpc-daemon[776]: ts=2026-09-21T04:25:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.662559] nix-grpc-daemon[777]: ts=2026-09-21T04:25:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.863300] nix-grpc-daemon[777]: ts=2026-09-21T04:25:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.818717] nix-grpc-daemon[776]: ts=2026-09-21T04:25:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 81.822912] nix-grpc-daemon[776]: ts=2026-09-21T04:25:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 81.868410] nix-grpc-daemon[777]: ts=2026-09-21T04:25:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 81.997678] nix-grpc-daemon[776]: ts=2026-09-21T04:25:14Z level=info event=scheduler_restarting worker1 # [ 82.070956] nix-grpc-daemon[777]: ts=2026-09-21T04:25:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.075093] nix-grpc-daemon[777]: ts=2026-09-21T04:25:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.041819] nix-grpc-daemon[776]: ts=2026-09-21T04:25:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 82.058372] nix-daemon[857]: reaped child process 860, status = succeeded worker1 # [ 82.234045] nix-grpc-daemon[777]: ts=2026-09-21T04:25:14Z level=info event=scheduler_take_over lb # [ 82.187131] niks3-server[1038]: 2026/09/21 04:25:14 INFO lead: acquired remote=192.168.1.3:40176 worker1 # [ 82.271438] nix-grpc-daemon[777]: ts=2026-09-21T04:25:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.276637] nix-grpc-daemon[777]: ts=2026-09-21T04:25:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 82.381222] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 82.387012] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 82.394889] systemd[1]: nix-grpc-daemon.service: Consumed 1.952s CPU time over 1min 2.947s wall clock time, 55.8M memory peak, 62.2K incoming IP traffic, 173.8K outgoing IP traffic. worker2 # [ 82.406904] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 82.410284] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 82.411866] systemd[1]: nix-grpc-daemon.socket: Consumed 573us CPU time over 1min 11.032s wall clock time, 256K memory peak, 78.9K incoming IP traffic, 68.4K outgoing IP traffic. lb: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 82.477504] nix-grpc-daemon[777]: ts=2026-09-21T04:25:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.482552] nix-grpc-daemon[777]: ts=2026-09-21T04:25:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker2'] endpoints of aarch64-linux are unhealthy, in 0.09 seconds) client: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2 worker1 # [ 82.683317] nix-grpc-daemon[777]: ts=2026-09-21T04:25:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.689064] nix-grpc-daemon[777]: ts=2026-09-21T04:25:15Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 82.802602] nix-grpc-daemon[777]: ts=2026-09-21T04:25:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58042 client # /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker1 # [ 82.811046] nix-grpc-daemon[777]: ts=2026-09-21T04:25:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:58042 client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache >&2, in 0.29 seconds) worker2: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache worker2: (finished: must fail: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache, in 0.03 seconds) worker1 # [ 82.889732] nix-grpc-daemon[777]: ts=2026-09-21T04:25:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 82.908265] nix-grpc-daemon[777]: ts=2026-09-21T04:25:15Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:45914 worker1 # [ 82.913993] nix-grpc-daemon[777]: ts=2026-09-21T04:25:15Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 82.893735] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 83.013883] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1 # [ 83.689777] nix-grpc-daemon[777]: ts=2026-09-21T04:25:16Z level=info event=signal_exit worker2 # [ 83.879175] systemd[1]: Starting scheduler-token.service... worker1 # [ 83.940178] nix-grpc-daemon[777]: ts=2026-09-21T04:25:16Z level=info event=scheduler_yield worker1 # [ 83.949220] nix-grpc-daemon[777]: ts=2026-09-21T04:25:16Z level=info event=scheduler_restarting addr=lb:50051 lb # [ 83.902129] niks3-server[1038]: 2026/09/21 04:25:16 INFO lead: released remote=192.168.1.3:40176 worker1 # [ 83.954856] nix-grpc-daemon[777]: ts=2026-09-21T04:25:16Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:45914 worker1 # [ 83.959127] nix-grpc-daemon[777]: ts=2026-09-21T04:25:16Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 83.981543] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 83.988358] systemd[1]: Finished scheduler-token.service. worker2 # [ 83.991733] systemd[1]: scheduler-token.service: Consumed 50ms CPU time over 103ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 83.997701] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 84.154450] nix-grpc-daemon[777]: ts=2026-09-21T04:25:16Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.164496] nix-grpc-daemon[777]: ts=2026-09-21T04:25:16Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves" worker2 # [ 84.176431] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:16Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 84.178502] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 84.182676] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 84.190836] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 84.199824] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 84.205672] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:16Z level=info event=scheduler_take_over lb # [ 84.203779] niks3-server[1038]: 2026/09/21 04:25:16 INFO lead: acquired remote=192.168.1.4:42402 worker2 # [ 84.235124] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.242572] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:16Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 84.243861] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:16Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:57414 worker2 # [ 84.245823] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:16Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker1 # [ 84.365487] nix-grpc-daemon[777]: ts=2026-09-21T04:25:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 84.321611] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:16Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57414 worker2 # [ 84.325881] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 84.908138] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:17Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57414 worker2 # [ 84.908552] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:17Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 84.953095] nix-grpc-daemon[777]: ts=2026-09-21T04:25:17Z level=info event=scheduler_restarting worker1 # [ 84.989619] nix-grpc-daemon[777]: ts=2026-09-21T04:25:17Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 85.008965] nix-daemon[838]: reaped child process 840, status = succeeded worker1 # [ 85.802488] nix-grpc-daemon[777]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 85.802893] nix-grpc-daemon[777]: E0000 00:00:1789964718.428426 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true worker1 # [ 85.835500] nix-grpc-daemon[777]: E0000 00:00:1789964718.461628 820 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 86.349586] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 86.360342] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 86.362920] systemd[1]: nix-grpc-daemon.service: Consumed 3.673s CPU time over 1min 7.005s wall clock time, 64M memory peak, 90K incoming IP traffic, 164.7K outgoing IP traffic. worker1 # [ 86.380259] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker1 # [ 86.383322] systemd[1]: Closed Nix worker-protocol over gRPC. worker1 # [ 86.386423] systemd[1]: nix-grpc-daemon.socket: Consumed 560us CPU time over 1min 15.694s wall clock time, 256K memory peak, 90.3K incoming IP traffic, 74.2K outgoing IP traffic. lb: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly ['worker1'] endpoints of aarch64-linux are unhealthy, in 0.08 seconds) client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2 worker2 # [ 86.695597] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:19Z level=debug event=rpc_start method=Connect cn=ci-1 peer=ipv4:192.168.1.2:57430 worker2 # [ 86.711843] nix-daemon[857]: accepted connection from pid 1104, user nix-grpc-daemon (trusted) worker2 # [ 86.780617] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:57430 worker2 # [ 86.794759] nix-daemon[857]: accepted connection from pid 1104, user nix-grpc-daemon (trusted) worker2 # [ 86.821830] nix-grpc-daemon[1104]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 1/5) worker2 # [ 86.919338] nix-grpc-daemon[1104]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 158 ms (attempt 2/5) worker2 # [ 87.084977] nix-grpc-daemon[1104]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 287 ms (attempt 3/5) worker2 # [ 87.379750] nix-grpc-daemon[1104]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 533 ms (attempt 4/5) worker2 # [ 87.922218] nix-grpc-daemon[1104]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 87.928201] nix-grpc-daemon[1104]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org client # copying 2 paths... client # copying path '/nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache' to 'grpc://lb:50051'... worker2 # [ 87.950262] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57430 client # copying path '/nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache' to 'grpc://lb:50051'... worker2 # [ 87.970117] nix-daemon[857]: accepted connection from pid 1104, user nix-grpc-daemon (trusted) worker2 # [ 87.998879] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:20Z level=info event=niks3_push_started pid=1165 worker2 # [ 88.219352] nix-grpc-daemon[1165]: time=2026-09-21T04:25:20.858Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 88.391232] nix-daemon[857]: accepted connection from pid 1178, user nix-grpc-daemon (trusted) worker2 # [ 88.407788] nix-daemon[857]: reaped child process 1181, status = succeeded lb # [ 88.419244] niks3-server[1038]: 2026/09/21 04:25:21 INFO Received uploads request method=POST path=/api/pending_closures lb # [ 88.430017] niks3-server[1038]: 2026/09/21 04:25:21 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 88.443218] nix-grpc-daemon[1165]: time=2026-09-21T04:25:21.081Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 88.445768] nix-grpc-daemon[1165]: time=2026-09-21T04:25:21.081Z level=INFO msg="Uploading syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache (128B)" worker2 # [ 88.447622] nix-grpc-daemon[1165]: time=2026-09-21T04:25:21.081Z level=INFO msg="Uploading 4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache (184B)" lb # [ 88.476423] niks3-server[1038]: 2026/09/21 04:25:21 INFO Registered completed upload object_key=nar/1rf1rg73pvnaa9kk6sy9r1ydj24b4g0kb0wnx0z5hxl1nvkmlavq.nar.zst lb # [ 88.498772] niks3-server[1038]: 2026/09/21 04:25:21 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.ls lb # [ 88.506488] niks3-server[1038]: 2026/09/21 04:25:21 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst worker2 # [ 88.520153] nix-grpc-daemon[1165]: time=2026-09-21T04:25:21.158Z level=INFO msg="Uploading 3 narinfos" lb # [ 88.520846] niks3-server[1038]: 2026/09/21 04:25:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign lb # [ 88.532853] niks3-server[1038]: 2026/09/21 04:25:21 INFO Signed narinfos id=26 count=2 lb # [ 88.535150] niks3-server[1038]: 2026/09/21 04:25:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign lb # [ 88.549797] niks3-server[1038]: 2026/09/21 04:25:21 INFO Signed narinfos id=25 count=1 lb # [ 88.566435] niks3-server[1038]: 2026/09/21 04:25:21 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.ls lb # [ 88.579207] niks3-server[1038]: 2026/09/21 04:25:21 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete lb # [ 88.584670] niks3-server[1038]: 2026/09/21 04:25:21 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo lb # [ 88.593168] niks3-server[1038]: 2026/09/21 04:25:21 INFO Completed upload id=25 lb # [ 88.596925] niks3-server[1038]: 2026/09/21 04:25:21 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete worker2 # [ 88.598421] nix-grpc-daemon[1165]: time=2026-09-21T04:25:21.238Z level=INFO msg="Upload complete. (374ms)" lb # [ 88.600304] niks3-server[1038]: 2026/09/21 04:25:21 INFO Registered completed upload object_key=4rig83zwv4xj1zajs08ima13w0yh676v.narinfo lb # [ 88.603550] niks3-server[1038]: 2026/09/21 04:25:21 INFO Completed upload id=26 lb # [ 88.610008] niks3-server[1038]: 2026/09/21 04:25:21 INFO Registered completed upload object_key=syvivri0wisb7fd33rxcg9kz63kc2bv7.narinfo worker2 # [ 88.610737] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57430 duration_s=0 paths=2 nar_bytes_in=312 worker2 # [ 88.636981] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:21Z level=info event=rpc method=Connect cn=ci-1 peer=ipv4:192.168.1.2:57430 duration_s=1 bytes_in=400 bytes_out=200 client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache >&2, in 2.22 seconds) worker2 # [ 88.646966] nix-daemon[857]: reaped child process 1163, status = succeeded worker2: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache worker2 # [ 88.649394] nix-daemon[857]: reaped child process 1154, status = succeeded worker2: (finished: must succeed: test -e /nix/store/syvivri0wisb7fd33rxcg9kz63kc2bv7-local-input-viacache && test -e /nix/store/4rig83zwv4xj1zajs08ima13w0yh676v-refers-to-input-viacache, in 0.03 seconds) worker1 # [ 88.809088] systemd[1]: Listening on Nix worker-protocol over gRPC. worker1 # [ 88.815545] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 89.012461] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:21Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 89.015224] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:21Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 89.019317] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:21Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 89.027567] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:21Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 89.033879] systemd[1]: Started Nix worker-protocol over gRPC. lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 89.073794] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:21Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 89.032312] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:21Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:57414 worker2 # [ 89.037129] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:21Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) lb # [ 89.295840] envoy[902]: conn peer=[2001:db8:1::4]:51832 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=53490 tx=2737 ms=62256 lb # [ 89.305082] envoy[902]: conn peer=[2001:db8:1::1]:43976 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=20 lb # [ 89.310266] envoy[902]: conn peer=[2001:db8:1::3]:42854 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=12220 tx=3401 ms=65256 lb # [ 89.315749] envoy[902]: conn peer=[2001:db8:1::1]:43986 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1632 tx=617 ms=1930 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.18 seconds) (finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.17 seconds) subtest: scheduler down: the other node takes the lock and keeps it lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds) worker2 # [ 90.450281] systemd[1]: Stopping Nix worker-protocol over gRPC... worker2 # [ 91.203120] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:23Z level=info event=signal_exit worker2 # [ 91.413337] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=scheduler_yield lb # [ 91.413260] niks3-server[1038]: 2026/09/21 04:25:24 INFO lead: released remote=192.168.1.4:42402 worker1 # [ 91.463573] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:24Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 91.427581] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57414 worker2 # [ 91.434583] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=worker_gone addr=192.168.1.3:50051 worker2 # [ 91.438545] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 91.442266] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:57414 worker2 # [ 91.446378] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 91.663632] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.669149] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.635074] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.640379] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 91.869883] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 91.875349] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 91.841457] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 91.846345] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.076234] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.081329] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.047390] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.052612] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.282261] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:24Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.287476] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.255209] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.259380] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:24Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.418339] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:25Z level=info event=scheduler_restarting worker1 # [ 92.489964] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:25Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 92.447836] nix-daemon[857]: reaped child process 1157, status = succeeded worker1 # [ 92.494208] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 92.475148] nix-grpc-daemon[1104]: ts=2026-09-21T04:25:25Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 92.690368] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.695469] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 92.896343] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 92.901273] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.102174] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.107275] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 93.222530] nix-grpc-daemon[1104]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker2 # [ 93.222879] nix-grpc-daemon[1104]: E0000 00:00:1789964725.862218 1147 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker2 # [ 93.234381] nix-grpc-daemon[1104]: E0000 00:00:1789964725.874284 1147 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 93.308112] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:25Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.313282] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:25Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.515763] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.520098] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.716387] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.721453] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 93.922266] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 93.927448] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 94.039760] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:26Z level=info event=scheduler_take_over lb # [ 93.993092] niks3-server[1038]: 2026/09/21 04:25:26 INFO lead: acquired remote=192.168.1.3:59214 worker1 # [ 94.128310] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.133341] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 94.235360] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 94.239166] systemd[1]: Stopped Nix worker-protocol over gRPC. worker2 # [ 94.244854] systemd[1]: nix-grpc-daemon.service: Consumed 471ms CPU time over 10.235s wall clock time, 34.7M memory peak, 19.7K incoming IP traffic, 26.1K outgoing IP traffic. worker2 # [ 94.259868] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully. worker2 # [ 94.265282] systemd[1]: Closed Nix worker-protocol over gRPC. worker2 # [ 94.268202] systemd[1]: nix-grpc-daemon.socket: Consumed 712us CPU time over 11.373s wall clock time, 256K memory peak, 22.2K incoming IP traffic, 16.9K outgoing IP traffic. worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over worker1 # [ 94.334581] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:26Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.342652] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:26Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.10 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds) worker1 # [ 94.543108] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:27Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 94.551254] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:27Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:58436 worker1 # [ 94.556592] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:27Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2 worker1 # [ 95.809120] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:28Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 95.823574] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) client # don't know how to build these paths: client # /nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker1 # [ 95.844292] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 95.866859] nix-grpc-daemon[1224]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 1/5) worker1 # [ 95.920503] nix-grpc-daemon[1224]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 198 ms (attempt 2/5) worker1 # [ 96.118696] nix-grpc-daemon[1224]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 134 ms (attempt 3/5) worker1 # [ 96.260315] nix-grpc-daemon[1224]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 366 ms (attempt 4/5) worker1 # [ 96.627046] nix-grpc-daemon[1224]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 96.633252] nix-grpc-daemon[1224]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 96.663380] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:29Z level=debug event=want client=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv cached=0 worker1 # [ 96.670417] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:29Z level=debug event=assigned drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 96.708217] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 96.723363] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58440 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' to 'lb:50051'... worker1 # [ 96.737558] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 96.751492] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) worker1 # [ 96.779177] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:29Z level=info event=niks3_push_started pid=1295 worker1 # [ 97.006431] nix-grpc-daemon[1295]: time=2026-09-21T04:25:29.631Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 97.186957] nix-daemon[838]: accepted connection from pid 1308, user nix-grpc-daemon (trusted) worker1 # [ 97.205205] nix-daemon[838]: reaped child process 1311, status = succeeded worker1 # [ 97.386530] nix-daemon[838]: accepted connection from pid 1313, user nix-grpc-daemon (trusted) worker1 # [ 97.405311] nix-daemon[838]: reaped child process 1316, status = succeeded lb # [ 97.370604] niks3-server[1038]: 2026/09/21 04:25:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 97.431368] nix-grpc-daemon[1295]: time=2026-09-21T04:25:30.056Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 97.433256] nix-grpc-daemon[1295]: time=2026-09-21T04:25:30.056Z level=INFO msg="Uploading adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv (520B)" lb # [ 97.418731] niks3-server[1038]: 2026/09/21 04:25:30 INFO Registered completed upload object_key=nar/0scd0jwin78ibwq92wkajw2zj7adk8bih7yhx8bxz1706hh53507.nar.zst lb # [ 97.431886] niks3-server[1038]: 2026/09/21 04:25:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign worker1 # [ 97.484513] nix-grpc-daemon[1295]: time=2026-09-21T04:25:30.110Z level=INFO msg="Uploading 1 narinfos" lb # [ 97.442549] niks3-server[1038]: 2026/09/21 04:25:30 INFO Signed narinfos id=27 count=1 lb # [ 97.447760] niks3-server[1038]: 2026/09/21 04:25:30 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.ls lb # [ 97.459076] niks3-server[1038]: 2026/09/21 04:25:30 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete worker1 # [ 97.514546] nix-grpc-daemon[1295]: time=2026-09-21T04:25:30.140Z level=INFO msg="Upload complete. (504ms)" lb # [ 97.468298] niks3-server[1038]: 2026/09/21 04:25:30 INFO Completed upload id=27 lb # [ 97.472518] niks3-server[1038]: 2026/09/21 04:25:30 INFO Registered completed upload object_key=adj3g5w8jh83wl959p7daq6igl0gaay3.narinfo worker1 # [ 97.526645] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58440 duration_s=0 paths=1 nar_bytes_in=520 worker1 # [ 97.540185] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 97.549187] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) worker1 # [ 97.551889] nix-daemon[838]: reaped child process 1293, status = succeeded client # building '/nix/store/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv' on lb:50051... client # farm-a> node-a: building adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv worker1 # [ 97.565191] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-on-standby worker1 # [ 98.410637] nix-daemon[838]: reaped child process 1320, status = succeeded worker1 # [ 98.585385] nix-daemon[838]: accepted connection from pid 1336, user nix-grpc-daemon (trusted) worker1 # [ 98.603855] nix-daemon[838]: reaped child process 1339, status = succeeded lb # [ 98.568939] niks3-server[1038]: 2026/09/21 04:25:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 98.630321] nix-grpc-daemon[1295]: time=2026-09-21T04:25:31.256Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 98.638429] nix-grpc-daemon[1295]: time=2026-09-21T04:25:31.256Z level=INFO msg="Uploading 7qyaw17jjsjxkkgb1kfm3wxvczk56aan-farm-a (136B)" lb # [ 98.609012] niks3-server[1038]: 2026/09/21 04:25:31 INFO Registered completed upload object_key=log/adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv lb # [ 98.629132] niks3-server[1038]: 2026/09/21 04:25:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign worker1 # [ 98.684248] nix-grpc-daemon[1295]: time=2026-09-21T04:25:31.309Z level=INFO msg="Uploading 1 narinfos" lb # [ 98.644956] niks3-server[1038]: 2026/09/21 04:25:31 INFO Signed narinfos id=28 count=1 lb # [ 98.652250] niks3-server[1038]: 2026/09/21 04:25:31 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst lb # [ 98.659536] niks3-server[1038]: 2026/09/21 04:25:31 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.ls lb # [ 98.668319] niks3-server[1038]: 2026/09/21 04:25:31 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete lb # [ 98.673043] niks3-server[1038]: 2026/09/21 04:25:31 INFO Completed upload id=28 worker1 # [ 98.720797] nix-grpc-daemon[1295]: time=2026-09-21T04:25:31.346Z level=INFO msg="Upload complete. (344ms)" lb # [ 98.676878] niks3-server[1038]: 2026/09/21 04:25:31 INFO Registered completed upload object_key=7qyaw17jjsjxkkgb1kfm3wxvczk56aan.narinfo worker1 # [ 98.748805] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 duration_s=1 drv=adj3g5w8jh83wl959p7daq6igl0gaay3-farm-a.drv assign_id=1 outputs=1 worker1 # [ 98.760327] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:31Z level=debug event=want client=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv cached=0 worker1 # [ 98.763959] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:31Z level=debug event=assigned drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 98.769575] nix-daemon[838]: reaped child process 1318, status = succeeded worker1 # [ 98.787434] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 98.802435] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 98.817530] nix-grpc-daemon[1295]: time=2026-09-21T04:25:31.443Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' to 'lb:50051'... worker1 # [ 98.827524] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 98.841318] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) worker1 # [ 99.042078] nix-daemon[838]: accepted connection from pid 1345, user nix-grpc-daemon (trusted) worker1 # [ 99.058312] nix-daemon[838]: reaped child process 1348, status = succeeded worker1 # [ 99.227811] nix-daemon[838]: accepted connection from pid 1350, user nix-grpc-daemon (trusted) worker1 # [ 99.242297] nix-daemon[838]: reaped child process 1353, status = succeeded lb # [ 99.209991] niks3-server[1038]: 2026/09/21 04:25:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 99.268559] nix-grpc-daemon[1295]: time=2026-09-21T04:25:31.894Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 99.270045] nix-grpc-daemon[1295]: time=2026-09-21T04:25:31.894Z level=INFO msg="Uploading s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv (640B)" lb # [ 99.241912] niks3-server[1038]: 2026/09/21 04:25:31 INFO Registered completed upload object_key=nar/0g5yl4v9pymang94vyp5ib5wi5jwf0bpp184y8qjavkpag12wmlv.nar.zst lb # [ 99.253301] niks3-server[1038]: 2026/09/21 04:25:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign worker1 # [ 99.308254] nix-grpc-daemon[1295]: time=2026-09-21T04:25:31.934Z level=INFO msg="Uploading 1 narinfos" lb # [ 99.263798] niks3-server[1038]: 2026/09/21 04:25:31 INFO Signed narinfos id=29 count=1 lb # [ 99.270156] niks3-server[1038]: 2026/09/21 04:25:31 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.ls lb # [ 99.277559] niks3-server[1038]: 2026/09/21 04:25:31 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete lb # [ 99.283812] niks3-server[1038]: 2026/09/21 04:25:31 INFO Registered completed upload object_key=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g.narinfo lb # [ 99.289078] niks3-server[1038]: 2026/09/21 04:25:31 INFO Completed upload id=29 worker1 # [ 99.336678] nix-grpc-daemon[1295]: time=2026-09-21T04:25:31.962Z level=INFO msg="Upload complete. (479ms)" lb # [ 99.292529] envoy[902]: conn peer=[2001:db8:1::4]:44802 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=4158 tx=349 ms=8229 worker1 # [ 99.344274] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58440 duration_s=0 paths=1 nar_bytes_in=640 worker1 # [ 99.357732] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 99.363971] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) worker1 # [ 99.369214] nix-daemon[838]: reaped child process 1343, status = succeeded client # building '/nix/store/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv' on lb:50051... client # farm-b> node-a: building s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv worker1 # [ 99.383155] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-on-standby worker1 # [ 100.434224] nix-daemon[838]: reaped child process 1357, status = succeeded worker1 # [ 100.615108] nix-daemon[838]: accepted connection from pid 1373, user nix-grpc-daemon (trusted) worker1 # [ 100.632323] nix-daemon[838]: reaped child process 1376, status = succeeded lb # [ 100.597321] niks3-server[1038]: 2026/09/21 04:25:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 100.655513] nix-grpc-daemon[1295]: time=2026-09-21T04:25:33.281Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 100.657614] nix-grpc-daemon[1295]: time=2026-09-21T04:25:33.281Z level=INFO msg="Uploading 6hsxxv65wr2jz8cgv2v66iq16niq1gsv-farm-b (184B)" lb # [ 100.633730] niks3-server[1038]: 2026/09/21 04:25:33 INFO Registered completed upload object_key=nar/1grn64wcl2mc78k1jvrz5mcrk1ld70lhf8b9jpiqy8mvs6gfzq0v.nar.zst lb # [ 100.646376] niks3-server[1038]: 2026/09/21 04:25:33 INFO Registered completed upload object_key=log/s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv lb # [ 100.655665] niks3-server[1038]: 2026/09/21 04:25:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign worker1 # [ 100.708616] nix-grpc-daemon[1295]: time=2026-09-21T04:25:33.334Z level=INFO msg="Uploading 1 narinfos" lb # [ 100.662843] niks3-server[1038]: 2026/09/21 04:25:33 INFO Signed narinfos id=30 count=1 lb # [ 100.668265] niks3-server[1038]: 2026/09/21 04:25:33 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.ls lb # [ 100.674418] niks3-server[1038]: 2026/09/21 04:25:33 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete lb # [ 100.682765] niks3-server[1038]: 2026/09/21 04:25:33 INFO Registered completed upload object_key=6hsxxv65wr2jz8cgv2v66iq16niq1gsv.narinfo lb # [ 100.686402] niks3-server[1038]: 2026/09/21 04:25:33 INFO Completed upload id=30 worker1 # [ 100.734116] nix-grpc-daemon[1295]: time=2026-09-21T04:25:33.360Z level=INFO msg="Upload complete. (340ms)" worker1 # [ 100.752876] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 duration_s=1 drv=s5xf4hr9bjv2jdhhqy1ih0c1ld822d2g-farm-b.drv assign_id=2 outputs=1 worker1 # [ 100.767436] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:33Z level=debug event=want client=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv cached=0 worker1 # [ 100.771428] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:33Z level=debug event=assigned drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 100.775474] nix-daemon[838]: reaped child process 1355, status = succeeded worker1 # [ 100.796844] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 100.811556] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 100.825400] nix-grpc-daemon[1295]: time=2026-09-21T04:25:33.451Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' to 'lb:50051'... worker1 # [ 100.833961] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 100.847865] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) worker1 # [ 101.054697] nix-daemon[838]: accepted connection from pid 1382, user nix-grpc-daemon (trusted) worker1 # [ 101.072252] nix-daemon[838]: reaped child process 1385, status = succeeded worker1 # [ 101.243628] nix-daemon[838]: accepted connection from pid 1387, user nix-grpc-daemon (trusted) worker1 # [ 101.259706] nix-daemon[838]: reaped child process 1390, status = succeeded lb # [ 101.223529] niks3-server[1038]: 2026/09/21 04:25:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 101.280032] nix-grpc-daemon[1295]: time=2026-09-21T04:25:33.905Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 101.281540] nix-grpc-daemon[1295]: time=2026-09-21T04:25:33.906Z level=INFO msg="Uploading 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv (768B)" lb # [ 101.255506] niks3-server[1038]: 2026/09/21 04:25:33 INFO Registered completed upload object_key=nar/1zyx46mv29cfygdhc5ai40qr4vl88lkr1lilm0h72j23w6wakgmc.nar.zst worker1 # [ 101.310318] nix-grpc-daemon[1295]: time=2026-09-21T04:25:33.936Z level=INFO msg="Uploading 1 narinfos" lb # [ 101.269613] niks3-server[1038]: 2026/09/21 04:25:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign lb # [ 101.279139] niks3-server[1038]: 2026/09/21 04:25:33 INFO Signed narinfos id=31 count=1 lb # [ 101.287909] niks3-server[1038]: 2026/09/21 04:25:33 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.ls worker1 # [ 101.341328] nix-grpc-daemon[1295]: time=2026-09-21T04:25:33.967Z level=INFO msg="Upload complete. (477ms)" lb # [ 101.294350] niks3-server[1038]: 2026/09/21 04:25:33 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete lb # [ 101.300197] niks3-server[1038]: 2026/09/21 04:25:33 INFO Completed upload id=31 lb # [ 101.303614] niks3-server[1038]: 2026/09/21 04:25:33 INFO Registered completed upload object_key=7s5szig4ffga53df6rls98r9lhxsrsc5.narinfo worker1 # [ 101.351759] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58440 duration_s=0 paths=1 nar_bytes_in=768 worker1 # [ 101.360253] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 101.368569] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) worker1 # [ 101.370992] nix-daemon[838]: reaped child process 1380, status = succeeded client # building '/nix/store/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv' on lb:50051... worker1 # [ 101.382788] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) client # farm-top> node-a: building 7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-on-standby worker1 # [ 102.404933] nix-daemon[838]: reaped child process 1394, status = succeeded worker1 # [ 102.560718] nix-daemon[838]: accepted connection from pid 1410, user nix-grpc-daemon (trusted) worker1 # [ 102.578671] nix-daemon[838]: reaped child process 1413, status = succeeded lb # [ 102.543947] niks3-server[1038]: 2026/09/21 04:25:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 102.602666] nix-grpc-daemon[1295]: time=2026-09-21T04:25:35.227Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 102.604234] nix-grpc-daemon[1295]: time=2026-09-21T04:25:35.227Z level=INFO msg="Uploading 1ini8mfd1rzqyp8jgqihp4k889588mpx-farm-top (240B)" lb # [ 102.574056] niks3-server[1038]: 2026/09/21 04:25:35 INFO Registered completed upload object_key=log/7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv lb # [ 102.591425] niks3-server[1038]: 2026/09/21 04:25:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign worker1 # [ 102.644488] nix-grpc-daemon[1295]: time=2026-09-21T04:25:35.270Z level=INFO msg="Uploading 1 narinfos" lb # [ 102.604294] niks3-server[1038]: 2026/09/21 04:25:35 INFO Signed narinfos id=32 count=1 lb # [ 102.606831] niks3-server[1038]: 2026/09/21 04:25:35 INFO Registered completed upload object_key=nar/1mncazpqn39nifc2fwbx80la5i264r8xc1lj8fnlbx006znc1925.nar.zst lb # [ 102.618894] niks3-server[1038]: 2026/09/21 04:25:35 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.ls lb # [ 102.622540] niks3-server[1038]: 2026/09/21 04:25:35 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete worker1 # [ 102.666152] nix-grpc-daemon[1295]: time=2026-09-21T04:25:35.292Z level=INFO msg="Upload complete. (274ms)" lb # [ 102.627797] niks3-server[1038]: 2026/09/21 04:25:35 INFO Completed upload id=32 lb # [ 102.629716] niks3-server[1038]: 2026/09/21 04:25:35 INFO Registered completed upload object_key=1ini8mfd1rzqyp8jgqihp4k889588mpx.narinfo worker1 # [ 102.674852] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 duration_s=1 drv=7s5szig4ffga53df6rls98r9lhxsrsc5-farm-top.drv assign_id=3 outputs=1 worker1 # [ 102.689539] nix-daemon[838]: reaped child process 1392, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby >&2, in 7.19 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag on-standby outPath, in 0.24 seconds) worker2 # [ 103.019723] systemd[1]: Listening on Nix worker-protocol over gRPC. worker2 # [ 103.029362] systemd[1]: Starting scheduler-token.service... worker2 # [ 103.128937] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 103.135794] systemd[1]: Finished scheduler-token.service. worker2 # [ 103.139053] systemd[1]: scheduler-token.service: Consumed 40ms CPU time over 103ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 103.145718] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 103.325747] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 103.328403] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 103.332507] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 103.340100] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 103.352248] systemd[1]: Started Nix worker-protocol over gRPC. lb: must succeed: curl -sf localhost:9901/clusters worker2 # [ 103.393651] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:36Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 103.452185] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:36Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 103.457933] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:36Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:58436 worker1 # [ 103.463305] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:36Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.10 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) (finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.56 seconds) subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs client # [ 103.804500] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs. client # Running as unit: rs.service; invocation ID: 5ad6c5a3e2b345bcaa63e182b4e34f7e client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag rs, in 0.09 seconds) worker2 # [ 104.079929] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:36Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37120 worker2 # [ 104.095646] nix-daemon[857]: accepted connection from pid 1205, user nix-grpc-daemon (trusted) client # [ 104.102933] nix[1188]: don't know how to build these paths: client # [ 104.104053] nix[1188]: /nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker1 # [ 104.172368] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:36Z level=debug event=want client=2 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv cached=0 worker1 # [ 104.172643] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:36Z level=debug event=assigned drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 104.216113] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 104.231653] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:58440 client # [ 104.188325] nix[1188]: copying 1 paths to 'lb:50051'... client # [ 104.195123] nix[1188]: copying path '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' to 'lb:50051'... worker1 # [ 104.248411] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 104.263415] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) worker1 # [ 104.468233] nix-daemon[838]: accepted connection from pid 1426, user nix-grpc-daemon (trusted) worker1 # [ 104.485808] nix-daemon[838]: reaped child process 1429, status = succeeded worker1 # [ 104.664256] nix-daemon[838]: accepted connection from pid 1431, user nix-grpc-daemon (trusted) worker1 # [ 104.679300] nix-daemon[838]: reaped child process 1434, status = succeeded lb # [ 104.647396] niks3-server[1038]: 2026/09/21 04:25:37 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 104.705434] nix-grpc-daemon[1295]: time=2026-09-21T04:25:37.331Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 104.706871] nix-grpc-daemon[1295]: time=2026-09-21T04:25:37.331Z level=INFO msg="Uploading ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv (416B)" lb # [ 104.678165] niks3-server[1038]: 2026/09/21 04:25:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign worker1 # [ 104.734142] nix-grpc-daemon[1295]: time=2026-09-21T04:25:37.360Z level=INFO msg="Uploading 1 narinfos" lb # [ 104.690466] niks3-server[1038]: 2026/09/21 04:25:37 INFO Signed narinfos id=33 count=1 lb # [ 104.699329] niks3-server[1038]: 2026/09/21 04:25:37 INFO Registered completed upload object_key=nar/0lynldv3n40qnhi1516wgiry3i3pja3sanwyyd8q4nslr915d7r1.nar.zst worker1 # [ 104.761747] nix-grpc-daemon[1295]: time=2026-09-21T04:25:37.387Z level=INFO msg="Upload complete. (481ms)" lb # [ 104.709566] niks3-server[1038]: 2026/09/21 04:25:37 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.ls lb # [ 104.721183] niks3-server[1038]: 2026/09/21 04:25:37 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete lb # [ 104.726676] niks3-server[1038]: 2026/09/21 04:25:37 INFO Completed upload id=33 lb # [ 104.729285] niks3-server[1038]: 2026/09/21 04:25:37 INFO Registered completed upload object_key=ajji8m1zd5q5wi64gp7vclb5dd8hr19m.narinfo worker1 # [ 104.768446] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58440 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 104.781857] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 worker1 # [ 104.788501] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) worker1 # [ 104.793390] nix-daemon[838]: reaped child process 1424, status = succeeded client # [ 104.747301] nix[1188]: building '/nix/store/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv' on lb:50051... worker1 # [ 104.805621] nix-daemon[838]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true worker2 # [ 106.762944] systemd-journald[273]: Received client request to rotate journal, rotating. worker2 # [ 106.783564] systemd-journald[273]: Vacuuming done, freed 0B of archived journals from /var/log/journal/5e232d78feb34bd5ac3ee60ea479abf5. worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.10 seconds) worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service worker1 # [ 106.890288] systemd[1]: Stopping Nix worker-protocol over gRPC... worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.06 seconds) client: must succeed: sleep 5.0 worker1 # [ 107.040212] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:39Z level=info event=draining lb # [ 109.292684] envoy[902]: conn peer=[2001:db8:1::1]:60208 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9623 tx=4144 ms=6898 client: (finished: must succeed: sleep 5.0, in 5.06 seconds) worker1 # [ 112.234691] nix-daemon[838]: reaped child process 1438, status = succeeded worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=' worker1 # [ 112.397750] nix-daemon[838]: accepted connection from pid 1479, user nix-grpc-daemon (trusted) worker1 # [ 112.415840] nix-daemon[838]: reaped child process 1482, status = succeeded lb # [ 112.381614] niks3-server[1038]: 2026/09/21 04:25:45 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 112.440391] nix-grpc-daemon[1295]: time=2026-09-21T04:25:45.065Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 112.443554] nix-grpc-daemon[1295]: time=2026-09-21T04:25:45.065Z level=INFO msg="Uploading k48d52qj0czpjmzj15yq3fd14zfw5iq6-slow-rs (120B)" lb # [ 112.420891] niks3-server[1038]: 2026/09/21 04:25:45 INFO Registered completed upload object_key=log/ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv lb # [ 112.432299] niks3-server[1038]: 2026/09/21 04:25:45 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst worker1 # [ 112.492305] nix-grpc-daemon[1295]: time=2026-09-21T04:25:45.118Z level=INFO msg="Uploading 1 narinfos" lb # [ 112.444700] niks3-server[1038]: 2026/09/21 04:25:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign lb # [ 112.453226] niks3-server[1038]: 2026/09/21 04:25:45 INFO Signed narinfos id=34 count=1 lb # [ 112.458831] niks3-server[1038]: 2026/09/21 04:25:45 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.ls lb # [ 112.465181] niks3-server[1038]: 2026/09/21 04:25:45 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete lb # [ 112.473123] niks3-server[1038]: 2026/09/21 04:25:45 INFO Completed upload id=34 worker1 # [ 112.519620] nix-grpc-daemon[1295]: time=2026-09-21T04:25:45.145Z level=INFO msg="Upload complete. (295ms)" lb # [ 112.475610] niks3-server[1038]: 2026/09/21 04:25:45 INFO Registered completed upload object_key=k48d52qj0czpjmzj15yq3fd14zfw5iq6.narinfo worker1 # [ 112.532987] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58440 duration_s=7 drv=ajji8m1zd5q5wi64gp7vclb5dd8hr19m-slow-rs.drv assign_id=4 outputs=1 worker1 # [ 112.546931] nix-daemon[838]: reaped child process 1436, status = succeeded client # [ 112.520301] systemd[1]: rs.service: Deactivated successfully. client # [ 112.524878] systemd[1]: rs.service: Consumed 181ms CPU time over 8.719s wall clock time, 41.2M memory peak, 7K incoming IP traffic, 8.4K outgoing IP traffic. worker1 # [ 113.042134] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:45Z level=info event=signal_exit worker1 # [ 113.264125] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:45Z level=info event=scheduler_yield lb # [ 113.218123] niks3-server[1038]: 2026/09/21 04:25:45 INFO lead: released remote=192.168.1.3:59214 worker1 # [ 113.272973] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:45Z level=info event=scheduler_restarting addr=lb:50051 worker2 # [ 113.229456] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:45Z level=info event=scheduler_restarting addr=lb:50051 worker1 # [ 113.278474] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:58436 worker1 # [ 113.283244] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:45Z level=info event=worker_gone addr=192.168.1.4:50051 worker1 # [ 113.287293] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:58436 worker1 # [ 113.291730] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:45Z level=info event=worker_gone addr=192.168.1.3:50051 worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.13 seconds) client: waiting for success: ! systemctl is-active rs lb # [ 113.352143] niks3-server[1038]: 2026/09/21 04:25:45 INFO lead: acquired remote=192.168.1.4:60896 worker2 # [ 113.358766] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:45Z level=info event=scheduler_take_over client: (finished: waiting for success: ! systemctl is-active rs, in 0.07 seconds) client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; } worker1 # [ 113.473898] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.429191] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.479270] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.434338] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.05 seconds) client: must fail: journalctl -u rs | grep -q 'reconnecting' client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.04 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 113.635679] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.681317] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.640448] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 113.686076] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.09 seconds) worker1 # [ 113.882933] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 113.841373] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 113.888288] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 113.846717] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.088926] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.048003] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:46Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 114.093956] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 114.053482] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.270257] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:46Z level=info event=scheduler_restarting worker2 # [ 114.256646] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:46Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.260798] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:46Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 114.323236] nix-grpc-daemon[1224]: ts=2026-09-21T04:25:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 114.328828] nix-daemon[838]: reaped child process 1285, status = succeeded worker1 # [ 114.422180] nix-grpc-daemon[1224]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 114.427358] nix-grpc-daemon[1224]: E0000 00:00:1789964747.048257 1267 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true worker1 # [ 114.434178] nix-grpc-daemon[1224]: E0000 00:00:1789964747.053419 1267 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker2 # [ 114.457244] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:47Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 114.474818] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:47Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 114.479405] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:47Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:34228 worker2 # [ 114.484824] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) worker1 # [ 115.645555] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 115.651360] systemd[1]: Stopped Nix worker-protocol over gRPC. worker1 # [ 115.655288] systemd[1]: nix-grpc-daemon.service: Consumed 1.800s CPU time over 26.828s wall clock time, 37.1M memory peak, 48.6K incoming IP traffic, 90.9K outgoing IP traffic. worker1 # [ 115.671656] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 115.862361] nix-grpc-daemon[1489]: ts=2026-09-21T04:25:48Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 115.864923] nix-grpc-daemon[1489]: ts=2026-09-21T04:25:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 115.868995] nix-grpc-daemon[1489]: ts=2026-09-21T04:25:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 115.876686] nix-grpc-daemon[1489]: ts=2026-09-21T04:25:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 115.878449] systemd[1]: Started Nix worker-protocol over gRPC. worker1 # [ 115.916182] nix-grpc-daemon[1489]: ts=2026-09-21T04:25:48Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 115.874229] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:48Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:34228 worker2 # [ 115.879632] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:48Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.25 seconds) subtest: scheduler restart mid-build: build finishes, no double build client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid client # [ 116.050483] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid. client # Running as unit: mid.service; invocation ID: 62d5d94176b64c24acd4ffb680b0d2c3 client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag mid, in 0.09 seconds) worker2 # [ 116.311138] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:48Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:37120 client # [ 116.309313] nix[1224]: don't know how to build these paths: client # [ 116.310323] nix[1224]: /nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker2 # [ 116.330941] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:48Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 116.338080] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:48Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 116.378325] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37120 worker2 # [ 116.398958] nix-grpc-daemon[1205]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 1/5) worker2 # [ 116.500660] nix-grpc-daemon[1205]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 2/5) worker2 # [ 116.520985] nix-grpc-daemon[1205]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 344 ms (attempt 3/5) worker2 # [ 116.872506] nix-grpc-daemon[1205]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 4/5) worker2 # [ 117.037315] nix-grpc-daemon[1205]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 117.042744] nix-grpc-daemon[1205]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 117.062008] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:37120 client # [ 117.067550] nix[1224]: copying 1 paths to 'lb:50051'... worker2 # [ 117.077034] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37120 client # [ 117.067950] nix[1224]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' to 'lb:50051'... worker2 # [ 117.092439] nix-daemon[857]: accepted connection from pid 1205, user nix-grpc-daemon (trusted) worker2 # [ 117.120088] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:49Z level=info event=niks3_push_started pid=1321 worker2 # [ 117.329093] nix-grpc-daemon[1321]: time=2026-09-21T04:25:49.967Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 117.515382] nix-daemon[857]: accepted connection from pid 1338, user nix-grpc-daemon (trusted) worker2 # [ 117.531190] nix-daemon[857]: reaped child process 1341, status = succeeded worker2 # [ 117.709727] nix-daemon[857]: accepted connection from pid 1343, user nix-grpc-daemon (trusted) worker2 # [ 117.725559] nix-daemon[857]: reaped child process 1346, status = succeeded lb # [ 117.735588] niks3-server[1038]: 2026/09/21 04:25:50 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 117.747721] nix-grpc-daemon[1321]: time=2026-09-21T04:25:50.386Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 117.749462] nix-grpc-daemon[1321]: time=2026-09-21T04:25:50.386Z level=INFO msg="Uploading chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv (424B)" lb # [ 117.767604] niks3-server[1038]: 2026/09/21 04:25:50 INFO Registered completed upload object_key=nar/14lxjrdcxwbhc1kgg39y29gnbx5cz80j4852d1i4w3rvq7g4b04g.nar.zst worker2 # [ 117.788689] nix-grpc-daemon[1321]: time=2026-09-21T04:25:50.428Z level=INFO msg="Uploading 1 narinfos" lb # [ 117.779948] niks3-server[1038]: 2026/09/21 04:25:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign lb # [ 117.792341] niks3-server[1038]: 2026/09/21 04:25:50 INFO Signed narinfos id=35 count=1 lb # [ 117.802941] niks3-server[1038]: 2026/09/21 04:25:50 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete worker2 # [ 117.813628] nix-grpc-daemon[1321]: time=2026-09-21T04:25:50.453Z level=INFO msg="Upload complete. (481ms)" lb # [ 117.818447] niks3-server[1038]: 2026/09/21 04:25:50 INFO Completed upload id=35 worker2 # [ 117.820115] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37120 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 117.827846] nix-grpc-daemon[1205]: ts=2026-09-21T04:25:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37120 worker2 # [ 117.838014] nix-daemon[857]: accepted connection from pid 1205, user nix-grpc-daemon (trusted) worker2 # [ 117.842632] nix-daemon[857]: reaped child process 1319, status = succeeded lb # [ 117.842732] niks3-server[1038]: 2026/09/21 04:25:50 INFO Registered completed upload object_key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.ls worker2 # [ 117.848232] nix-grpc-daemon[1321]: time=2026-09-21T04:25:50.480Z level=WARN msg="Failed to register uploaded object" key=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc.narinfo error="server returned 404: object is not pending upload\n" worker2 # [ 117.858522] nix-daemon[857]: accepted connection from pid 1205, user nix-grpc-daemon (trusted) client # [ 117.847061] nix[1224]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... lb # [ 119.290457] envoy[902]: conn peer=[2001:db8:1::1]:44568 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2979 tx=1429 ms=8422 lb: must succeed: curl -sf localhost:9901/clusters lb # [ 119.295446] envoy[902]: conn peer=[2001:db8:1::3]:34616 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3890 tx=1213 ms=25238 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds) worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service worker2 # [ 120.029585] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1205 (nix-grpc-daemon) on client request. worker2 # [ 120.031107] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request. lb # [ 120.048788] niks3-server[1038]: 2026/09/21 04:25:52 INFO lead: released remote=192.168.1.4:60896 worker2 # [ 120.061448] systemd[1]: Starting scheduler-token.service... client # [ 120.049127] nix[1224]: chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again worker1 # [ 120.104168] nix-grpc-daemon[1489]: ts=2026-09-21T04:25:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination" client # [ 120.055530] nix[1224]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting worker2 # [ 120.081868] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL worker2 # [ 120.084347] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'. worker2 # [ 120.088777] systemd[1]: nix-grpc-daemon.service: Consumed 552ms CPU time over 16.933s wall clock time, 34.4M memory peak, 16.8K incoming IP traffic, 31.4K outgoing IP traffic. worker2 # [ 120.107706] nix-daemon[857]: reaped child process 1348, status = succeeded worker2 # [ 120.109798] nix-daemon[857]: reaped child process 1261, status = succeeded worker2 # [ 120.116528] nix-daemon[1350]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 120.122499] nix-daemon[857]: reaped child process 1350, status = failed with exit code 1 worker2 # [ 120.167576] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 120.169053] systemd[1]: Finished scheduler-token.service. worker2 # [ 120.171055] systemd[1]: scheduler-token.service: Consumed 24ms CPU time over 103ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 120.173726] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 120.175501] systemd[1]: Starting scheduler-token.service... worker2 # [ 120.248156] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 120.249137] systemd[1]: Finished scheduler-token.service. worker2 # [ 120.249854] systemd[1]: scheduler-token.service: Consumed 22ms CPU time over 75ms wall clock time, 2.2M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 120.254218] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 120.304356] nix-grpc-daemon[1489]: ts=2026-09-21T04:25:52Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 120.420466] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 120.423115] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 120.427146] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 120.434905] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket lb # [ 120.446717] niks3-server[1038]: 2026/09/21 04:25:53 INFO lead: acquired remote=192.168.1.4:49212 worker2 # [ 120.459041] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 120.459881] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=info event=scheduler_take_over worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.49 seconds) worker2 # [ 120.471194] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:34236 client: must succeed: sleep 5.0 worker2 # [ 120.473930] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 120.487210] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 120.493158] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 120.494421] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:34236 worker2 # [ 120.496258] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=info event=worker_hello addr=192.168.1.4:50051 systems=aarch64-linux max_jobs=1 running=0 worker2 # [ 120.576423] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=debug event=want client=1 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv cached=0 worker2 # [ 120.580613] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:53Z level=debug event=assigned drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 120.682401] nix-grpc-daemon[1489]: ts=2026-09-21T04:25:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39240 worker1 # [ 120.695955] nix-daemon[838]: accepted connection from pid 1489, user nix-grpc-daemon (trusted) worker1 # [ 120.720268] nix-grpc-daemon[1489]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 1/5) worker1 # [ 120.749224] nix-grpc-daemon[1489]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 2/5) worker1 # [ 120.846710] nix-grpc-daemon[1489]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 3/5) worker1 # [ 120.911191] nix-grpc-daemon[1489]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 392 ms (attempt 4/5) worker1 # [ 121.311734] nix-grpc-daemon[1489]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 121.317636] nix-grpc-daemon[1489]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker1 # [ 121.334021] nix-grpc-daemon[1489]: copying path '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' from 'http://lb:5751'... worker1 # [ 121.360316] nix-daemon[838]: accepted connection from pid 1489, user nix-grpc-daemon (trusted) client # [ 121.321936] nix[1224]: building '/nix/store/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv' on lb:50051... worker1 # [ 121.377603] nix-daemon[838]: accepted connection from pid 1489, user nix-grpc-daemon (trusted) client: (finished: must succeed: sleep 5.0, in 5.06 seconds) client: waiting for success: ! systemctl is-active mid worker1 # [ 126.005168] nix-grpc-daemon[1489]: ts=2026-09-21T04:25:58Z level=info event=niks3_push_started pid=1592 worker1 # [ 126.053474] nix-daemon[838]: reaped child process 1567, status = succeeded worker1 # [ 126.241648] nix-grpc-daemon[1592]: time=2026-09-21T04:25:58.867Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 126.416531] nix-daemon[838]: accepted connection from pid 1605, user nix-grpc-daemon (trusted) worker1 # [ 126.433962] nix-daemon[838]: reaped child process 1608, status = succeeded lb # [ 126.401017] niks3-server[1038]: 2026/09/21 04:25:59 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 126.463816] nix-grpc-daemon[1592]: time=2026-09-21T04:25:59.088Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 126.466597] nix-grpc-daemon[1592]: time=2026-09-21T04:25:59.088Z level=INFO msg="Uploading fk2vdwmn2msb3ja19s2jwak35ignz889-slow-mid (120B)" lb # [ 126.465872] niks3-server[1038]: 2026/09/21 04:25:59 INFO Registered completed upload object_key=log/chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv worker1 # [ 126.523350] nix-grpc-daemon[1592]: time=2026-09-21T04:25:59.148Z level=INFO msg="Uploading 1 narinfos" lb # [ 126.479540] niks3-server[1038]: 2026/09/21 04:25:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign lb # [ 126.489579] niks3-server[1038]: 2026/09/21 04:25:59 INFO Signed narinfos id=36 count=1 lb # [ 126.495004] niks3-server[1038]: 2026/09/21 04:25:59 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst lb # [ 126.508173] niks3-server[1038]: 2026/09/21 04:25:59 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.ls worker1 # [ 126.560612] nix-grpc-daemon[1592]: time=2026-09-21T04:25:59.186Z level=INFO msg="Upload complete. (315ms)" lb # [ 126.513020] niks3-server[1038]: 2026/09/21 04:25:59 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete lb # [ 126.517315] niks3-server[1038]: 2026/09/21 04:25:59 INFO Registered completed upload object_key=fk2vdwmn2msb3ja19s2jwak35ignz889.narinfo lb # [ 126.523559] niks3-server[1038]: 2026/09/21 04:25:59 INFO Completed upload id=36 worker1 # [ 126.572369] nix-grpc-daemon[1489]: ts=2026-09-21T04:25:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39240 duration_s=5 drv=chbb3scb8b4b0sd5wk0a0vcrl8x07pdc-slow-mid.drv assign_id=1 outputs=1 worker1 # [ 126.590349] nix-daemon[838]: reaped child process 1565, status = succeeded client # [ 126.566870] systemd[1]: mid.service: Deactivated successfully. client # [ 126.571185] systemd[1]: mid.service: Consumed 182ms CPU time over 10.519s wall clock time, 43.2M memory peak, 8.6K incoming IP traffic, 10.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active mid, in 1.14 seconds) client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; } client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.05 seconds) (finished: subtest: scheduler restart mid-build: build finishes, no double build, in 11.04 seconds) subtest: interrupting the client stops the build on the worker client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr client # [ 127.060779] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr. client # Running as unit: intr.service; invocation ID: 067a4c0df3ce438cb7560d35e5b2c90d client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag intr, in 0.05 seconds) worker2 # [ 127.325743] nix-grpc-daemon[1393]: ts=2026-09-21T04:25:59Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 127.338929] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) client # [ 127.347437] nix[1259]: don't know how to build these paths: client # [ 127.349028] nix[1259]: /nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker2 # [ 127.365377] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:00Z level=debug event=want client=2 drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv cached=0 worker2 # [ 127.371995] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:00Z level=debug event=assigned drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 127.418207] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 127.435443] nix-grpc-daemon[1393]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 1/5) worker2 # [ 127.463745] nix-grpc-daemon[1393]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 2/5) worker2 # [ 127.655656] nix-grpc-daemon[1393]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 3/5) worker2 # [ 127.751339] nix-grpc-daemon[1393]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 172 ms (attempt 4/5) worker2 # [ 127.924233] nix-grpc-daemon[1393]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 127.929932] nix-grpc-daemon[1393]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 127.948932] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34034 client # [ 127.952139] nix[1259]: copying 1 paths to 'lb:50051'... worker2 # [ 127.963590] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 client # [ 127.957241] nix[1259]: copying path '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' to 'lb:50051'... worker2 # [ 127.978334] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 128.005802] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:00Z level=info event=niks3_push_started pid=1466 worker2 # [ 128.221573] nix-grpc-daemon[1466]: time=2026-09-21T04:26:00.861Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker2.key ca="" worker2 # [ 128.412425] nix-daemon[857]: accepted connection from pid 1479, user nix-grpc-daemon (trusted) worker2 # [ 128.435841] nix-daemon[857]: reaped child process 1486, status = succeeded worker2 # [ 128.608775] nix-daemon[857]: accepted connection from pid 1488, user nix-grpc-daemon (trusted) worker2 # [ 128.626877] nix-daemon[857]: reaped child process 1491, status = succeeded lb # [ 128.638479] niks3-server[1038]: 2026/09/21 04:26:01 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 128.651476] nix-grpc-daemon[1466]: time=2026-09-21T04:26:01.290Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 128.653488] nix-grpc-daemon[1466]: time=2026-09-21T04:26:01.290Z level=INFO msg="Uploading 85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv (424B)" lb # [ 128.671715] niks3-server[1038]: 2026/09/21 04:26:01 INFO Registered completed upload object_key=nar/0h460h76prjyvhqhyxlhz1xrmh3s520jbd19gaagy4hp4vc92r1p.nar.zst lb # [ 128.685486] niks3-server[1038]: 2026/09/21 04:26:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign worker2 # [ 128.695747] nix-grpc-daemon[1466]: time=2026-09-21T04:26:01.335Z level=INFO msg="Uploading 1 narinfos" lb # [ 128.698419] niks3-server[1038]: 2026/09/21 04:26:01 INFO Signed narinfos id=37 count=1 lb # [ 128.705074] niks3-server[1038]: 2026/09/21 04:26:01 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.ls lb # [ 128.717085] niks3-server[1038]: 2026/09/21 04:26:01 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete worker2 # [ 128.725237] nix-grpc-daemon[1466]: time=2026-09-21T04:26:01.365Z level=INFO msg="Upload complete. (499ms)" lb # [ 128.723468] niks3-server[1038]: 2026/09/21 04:26:01 INFO Completed upload id=37 lb # [ 128.726405] niks3-server[1038]: 2026/09/21 04:26:01 INFO Registered completed upload object_key=85wa5czf6m5ng93xyq44r1affb74csh8.narinfo worker2 # [ 128.732754] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=0 paths=1 nar_bytes_in=424 worker2 # [ 128.747729] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 128.754679] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 128.759496] nix-daemon[857]: reaped child process 1464, status = succeeded client # [ 128.760291] nix[1259]: building '/nix/store/85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv' on lb:50051... worker2 # [ 128.772585] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) lb # [ 129.293354] envoy[902]: conn peer=[2001:db8:1::4]:33704 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=5723 tx=511 ms=16677 lb # [ 129.298265] envoy[902]: conn peer=[2001:db8:1::1]:44412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3940 tx=1853 ms=10230 client: must succeed: systemctl kill -s INT intr worker2 # [ 129.644150] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:02Z level=info event=revoked_running drv=85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv client # [ 129.631825] systemd[1]: intr.service: Sent signal SIGINT to main process 1259 (nix) on client request. client # [ 129.638848] nix[1259]: shutting down85wa5czf6m5ng93xyq44r1affb74csh8-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED) client: (finished: must succeed: systemctl kill -s INT intr, in 0.07 seconds) client # [ 129.648479] nix[1259]: error: interrupted by the user client # [ 129.689549] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE client # [ 129.695170] systemd[1]: intr.service: Failed with result 'exit-code'. client # [ 129.697776] systemd[1]: intr.service: Consumed 162ms CPU time over 2.632s wall clock time, 41.4M memory peak, 6.5K incoming IP traffic, 8.3K outgoing IP traffic. worker2 # [ 129.805871] nix-daemon[1495]: unexpected Nix daemon error: error: interrupted by the user worker2 # [ 129.817357] nix-daemon[857]: reaped child process 1493, status = succeeded worker2 # [ 129.818527] nix-daemon[857]: reaped child process 1495, status = failed with exit code 1 (finished: subtest: interrupting the client stops the build on the worker, in 3.95 seconds) subtest: a deploy mid-build drains: the build finishes, the new generation takes over client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw client # [ 131.038145] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key" --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw. client # Running as unit: sw.service; invocation ID: 84bc1d983f0c4ae9a67cef8e9cfce21b client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/mpvagzcaddzb5j0jgpk1hnp5dkckqbn5-slow.nix --argstr tag sw, in 0.09 seconds) client # [ 131.306352] nix[1279]: don't know how to build these paths: client # [ 131.307367] nix[1279]: /nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker2 # [ 131.315631] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 131.329454] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:03Z level=debug event=want client=3 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv cached=0 worker2 # [ 131.335541] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:03Z level=debug event=assigned drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 131.421155] nix-grpc-daemon[1489]: ts=2026-09-21T04:26:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39240 worker1 # [ 131.438000] nix-grpc-daemon[1489]: ts=2026-09-21T04:26:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39240 client # [ 131.394791] nix[1279]: copying 1 paths to 'lb:50051'... client # [ 131.400360] nix[1279]: copying path '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' to 'lb:50051'... worker1 # [ 131.454869] nix-grpc-daemon[1489]: ts=2026-09-21T04:26:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39240 worker1 # [ 131.469765] nix-daemon[838]: accepted connection from pid 1489, user nix-grpc-daemon (trusted) worker1 # [ 131.672595] nix-daemon[838]: accepted connection from pid 1636, user nix-grpc-daemon (trusted) worker1 # [ 131.691200] nix-daemon[838]: reaped child process 1639, status = succeeded worker1 # [ 131.863739] nix-daemon[838]: accepted connection from pid 1641, user nix-grpc-daemon (trusted) worker1 # [ 131.881301] nix-daemon[838]: reaped child process 1644, status = succeeded lb # [ 131.846218] niks3-server[1038]: 2026/09/21 04:26:04 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 131.905732] nix-grpc-daemon[1592]: time=2026-09-21T04:26:04.531Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 131.907242] nix-grpc-daemon[1592]: time=2026-09-21T04:26:04.531Z level=INFO msg="Uploading x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv (416B)" lb # [ 131.885189] niks3-server[1038]: 2026/09/21 04:26:04 INFO Registered completed upload object_key=nar/0jczp45bkr8vp1ymznxf6da1iv8dzh42pnl36wiprbzwhpi2ddia.nar.zst worker1 # [ 131.945854] nix-grpc-daemon[1592]: time=2026-09-21T04:26:04.571Z level=INFO msg="Uploading 1 narinfos" lb # [ 131.901133] niks3-server[1038]: 2026/09/21 04:26:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign lb # [ 131.912191] niks3-server[1038]: 2026/09/21 04:26:04 INFO Signed narinfos id=38 count=1 lb # [ 131.917921] niks3-server[1038]: 2026/09/21 04:26:04 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.ls lb # [ 131.924963] niks3-server[1038]: 2026/09/21 04:26:04 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete lb # [ 131.931386] niks3-server[1038]: 2026/09/21 04:26:04 INFO Registered completed upload object_key=x0m4asg5xx7vgj4dip2crwn6zhxqngvs.narinfo lb # [ 131.935308] niks3-server[1038]: 2026/09/21 04:26:04 INFO Completed upload id=38 worker1 # [ 131.983001] nix-grpc-daemon[1592]: time=2026-09-21T04:26:04.609Z level=INFO msg="Upload complete. (497ms)" worker1 # [ 131.992264] nix-grpc-daemon[1489]: ts=2026-09-21T04:26:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39240 duration_s=0 paths=1 nar_bytes_in=416 worker1 # [ 132.004662] nix-grpc-daemon[1489]: ts=2026-09-21T04:26:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39240 worker1 # [ 132.013847] nix-daemon[838]: accepted connection from pid 1489, user nix-grpc-daemon (trusted) worker1 # [ 132.023274] nix-daemon[838]: reaped child process 1634, status = succeeded client # [ 131.972578] nix[1279]: building '/nix/store/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv' on lb:50051... worker1 # [ 132.030812] nix-daemon[838]: accepted connection from pid 1489, user nix-grpc-daemon (trusted) worker1: must succeed: systemctl reload nix-grpc-daemon.service worker1 # [ 133.775813] systemd[1]: Reloading Nix worker-protocol over gRPC... worker1 # [ 133.824893] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.10 seconds) worker1: must succeed: pgrep -f 'read -t [9]0 x' worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2 worker1 # [ 133.886340] nix-grpc-daemon[1489]: ts=2026-09-21T04:26:06Z level=info event=draining worker2 # [ 134.096610] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34034 client # don't know how to build these paths: client # /nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker1 # [ 134.150905] nix-grpc-daemon[1489]: ts=2026-09-21T04:26:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:39240 worker2 # [ 134.128241] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:06Z level=debug event=want client=4 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv cached=0 worker2 # [ 134.135087] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:06Z level=debug event=assigned drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 134.174354] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 134.189335] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34034 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' to 'lb:50051'... worker2 # [ 134.205355] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 134.220279] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 134.431669] nix-daemon[857]: accepted connection from pid 1546, user nix-grpc-daemon (trusted) worker2 # [ 134.449047] nix-daemon[857]: reaped child process 1549, status = succeeded worker2 # [ 134.622501] nix-daemon[857]: accepted connection from pid 1551, user nix-grpc-daemon (trusted) worker2 # [ 134.638607] nix-daemon[857]: reaped child process 1554, status = succeeded lb # [ 134.649609] niks3-server[1038]: 2026/09/21 04:26:07 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 134.661684] nix-grpc-daemon[1466]: time=2026-09-21T04:26:07.301Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 134.663107] nix-grpc-daemon[1466]: time=2026-09-21T04:26:07.301Z level=INFO msg="Uploading k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv (528B)" worker2 # [ 134.686085] nix-grpc-daemon[1466]: time=2026-09-21T04:26:07.325Z level=INFO msg="Uploading 1 narinfos" lb # [ 134.683344] niks3-server[1038]: 2026/09/21 04:26:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign lb # [ 134.697894] niks3-server[1038]: 2026/09/21 04:26:07 INFO Signed narinfos id=39 count=1 lb # [ 134.705955] niks3-server[1038]: 2026/09/21 04:26:07 INFO Registered completed upload object_key=nar/1h3fzlmfdwdiqr732wwrq7jnpw7n6p8f9qx1089c6g6x2i4csv75.nar.zst lb # [ 134.727221] niks3-server[1038]: 2026/09/21 04:26:07 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete lb # [ 134.736104] niks3-server[1038]: 2026/09/21 04:26:07 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.ls lb # [ 134.743040] niks3-server[1038]: 2026/09/21 04:26:07 INFO Registered completed upload object_key=k3l35rf796jrnjns08398p1l8fcx178a.narinfo lb # [ 134.759820] niks3-server[1038]: 2026/09/21 04:26:07 INFO Completed upload id=39 worker2 # [ 134.762137] nix-grpc-daemon[1466]: time=2026-09-21T04:26:07.402Z level=INFO msg="Upload complete. (525ms)" worker2 # [ 134.772316] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=0 paths=1 nar_bytes_in=528 worker2 # [ 134.788391] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 134.795890] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 134.802009] nix-daemon[857]: reaped child process 1544, status = succeeded client # building '/nix/store/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv' on lb:50051... worker2 # [ 134.814740] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) client # farm-a> worker2: building k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-during-drain worker2 # [ 135.842889] nix-daemon[857]: reaped child process 1558, status = succeeded worker2 # [ 136.000318] nix-daemon[857]: accepted connection from pid 1574, user nix-grpc-daemon (trusted) worker2 # [ 136.017904] nix-daemon[857]: reaped child process 1577, status = succeeded lb # [ 136.027781] niks3-server[1038]: 2026/09/21 04:26:08 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 136.044384] nix-grpc-daemon[1466]: time=2026-09-21T04:26:08.682Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 136.045809] nix-grpc-daemon[1466]: time=2026-09-21T04:26:08.683Z level=INFO msg="Uploading 42c24pndjip9nvdj8j25mkv0650griqf-farm-a (136B)" lb # [ 136.078004] niks3-server[1038]: 2026/09/21 04:26:08 INFO Registered completed upload object_key=log/k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv lb # [ 136.087172] niks3-server[1038]: 2026/09/21 04:26:08 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 136.097433] niks3-server[1038]: 2026/09/21 04:26:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign worker2 # [ 136.106583] nix-grpc-daemon[1466]: time=2026-09-21T04:26:08.745Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.103399] niks3-server[1038]: 2026/09/21 04:26:08 INFO Signed narinfos id=40 count=1 lb # [ 136.108337] niks3-server[1038]: 2026/09/21 04:26:08 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.ls lb # [ 136.120293] niks3-server[1038]: 2026/09/21 04:26:08 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete lb # [ 136.127573] niks3-server[1038]: 2026/09/21 04:26:08 INFO Completed upload id=40 worker2 # [ 136.129937] nix-grpc-daemon[1466]: time=2026-09-21T04:26:08.769Z level=INFO msg="Upload complete. (301ms)" lb # [ 136.130851] niks3-server[1038]: 2026/09/21 04:26:08 INFO Registered completed upload object_key=42c24pndjip9nvdj8j25mkv0650griqf.narinfo worker2 # [ 136.147207] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=1 drv=k3l35rf796jrnjns08398p1l8fcx178a-farm-a.drv assign_id=4 outputs=1 worker2 # [ 136.163286] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:08Z level=debug event=want client=4 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv cached=0 worker2 # [ 136.166812] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:08Z level=debug event=assigned drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 136.170408] nix-daemon[857]: reaped child process 1556, status = succeeded worker2 # [ 136.196993] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 136.212395] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 136.226989] nix-grpc-daemon[1466]: time=2026-09-21T04:26:08.866Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 136.237059] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 client # copying path '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' to 'lb:50051'... worker2 # [ 136.266159] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 136.477928] nix-daemon[857]: accepted connection from pid 1583, user nix-grpc-daemon (trusted) worker2 # [ 136.494839] nix-daemon[857]: reaped child process 1586, status = succeeded worker2 # [ 136.667687] nix-daemon[857]: accepted connection from pid 1588, user nix-grpc-daemon (trusted) worker2 # [ 136.685017] nix-daemon[857]: reaped child process 1591, status = succeeded lb # [ 136.694237] niks3-server[1038]: 2026/09/21 04:26:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 136.706215] nix-grpc-daemon[1466]: time=2026-09-21T04:26:09.345Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 136.707681] nix-grpc-daemon[1466]: time=2026-09-21T04:26:09.345Z level=INFO msg="Uploading im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv (640B)" lb # [ 136.720206] niks3-server[1038]: 2026/09/21 04:26:09 INFO Registered completed upload object_key=nar/0rxmdnq61ka29n0b2as2hdbz91wi2ap17db890js8r5plhpg436g.nar.zst lb # [ 136.734416] niks3-server[1038]: 2026/09/21 04:26:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign worker2 # [ 136.742795] nix-grpc-daemon[1466]: time=2026-09-21T04:26:09.382Z level=INFO msg="Uploading 1 narinfos" lb # [ 136.747332] niks3-server[1038]: 2026/09/21 04:26:09 INFO Signed narinfos id=41 count=1 lb # [ 136.752728] niks3-server[1038]: 2026/09/21 04:26:09 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.ls lb # [ 136.761322] niks3-server[1038]: 2026/09/21 04:26:09 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete worker2 # [ 136.767293] nix-grpc-daemon[1466]: time=2026-09-21T04:26:09.407Z level=INFO msg="Upload complete. (483ms)" lb # [ 136.765841] niks3-server[1038]: 2026/09/21 04:26:09 INFO Completed upload id=41 lb # [ 136.769119] niks3-server[1038]: 2026/09/21 04:26:09 INFO Registered completed upload object_key=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l.narinfo worker2 # [ 136.775692] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=0 paths=1 nar_bytes_in=640 worker2 # [ 136.784959] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 136.790065] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 136.794455] nix-daemon[857]: reaped child process 1581, status = succeeded client # building '/nix/store/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv' on lb:50051... client # farm-b> worker2: building im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv worker2 # [ 136.806977] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-during-drain worker2 # [ 138.029110] nix-daemon[857]: reaped child process 1595, status = succeeded worker2 # [ 138.182966] nix-daemon[857]: accepted connection from pid 1611, user nix-grpc-daemon (trusted) worker2 # [ 138.199893] nix-daemon[857]: reaped child process 1614, status = succeeded lb # [ 138.212826] niks3-server[1038]: 2026/09/21 04:26:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 138.224478] nix-grpc-daemon[1466]: time=2026-09-21T04:26:10.864Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 138.227065] nix-grpc-daemon[1466]: time=2026-09-21T04:26:10.866Z level=INFO msg="Uploading daks7y2c761g04qpzsjx25629wigr8js-farm-b (184B)" lb # [ 138.244833] niks3-server[1038]: 2026/09/21 04:26:10 INFO Registered completed upload object_key=log/im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv lb # [ 138.261837] niks3-server[1038]: 2026/09/21 04:26:10 INFO Registered completed upload object_key=nar/0lnpxl34nrzp147jy5bafczkvxcl00hcf69qjhsljmv2ip9jisfh.nar.zst lb # [ 138.276818] niks3-server[1038]: 2026/09/21 04:26:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign worker2 # [ 138.285663] nix-grpc-daemon[1466]: time=2026-09-21T04:26:10.925Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.289645] niks3-server[1038]: 2026/09/21 04:26:10 INFO Signed narinfos id=42 count=1 lb # [ 138.295161] niks3-server[1038]: 2026/09/21 04:26:10 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.ls lb # [ 138.302105] niks3-server[1038]: 2026/09/21 04:26:10 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete lb # [ 138.309387] niks3-server[1038]: 2026/09/21 04:26:10 INFO Completed upload id=42 worker2 # [ 138.311139] nix-grpc-daemon[1466]: time=2026-09-21T04:26:10.951Z level=INFO msg="Upload complete. (295ms)" lb # [ 138.311853] niks3-server[1038]: 2026/09/21 04:26:10 INFO Registered completed upload object_key=daks7y2c761g04qpzsjx25629wigr8js.narinfo worker2 # [ 138.328639] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=1 drv=im7gh7nqqi41f48wvwjqkgv3nm7w5b4l-farm-b.drv assign_id=5 outputs=1 worker2 # [ 138.343360] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:10Z level=debug event=want client=4 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv cached=0 worker2 # [ 138.347613] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:10Z level=debug event=assigned drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 138.351900] nix-daemon[857]: reaped child process 1593, status = succeeded worker2 # [ 138.370284] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 138.385001] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 138.399309] nix-grpc-daemon[1466]: time=2026-09-21T04:26:11.039Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... worker2 # [ 138.409601] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 client # copying path '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' to 'lb:50051'... worker2 # [ 138.424312] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 138.623912] nix-daemon[857]: accepted connection from pid 1620, user nix-grpc-daemon (trusted) worker2 # [ 138.639492] nix-daemon[857]: reaped child process 1623, status = succeeded worker2 # [ 138.811119] nix-daemon[857]: accepted connection from pid 1625, user nix-grpc-daemon (trusted) worker2 # [ 138.826732] nix-daemon[857]: reaped child process 1628, status = succeeded lb # [ 138.835860] niks3-server[1038]: 2026/09/21 04:26:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 138.847074] nix-grpc-daemon[1466]: time=2026-09-21T04:26:11.486Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 138.848657] nix-grpc-daemon[1466]: time=2026-09-21T04:26:11.486Z level=INFO msg="Uploading lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv (768B)" lb # [ 138.862510] niks3-server[1038]: 2026/09/21 04:26:11 INFO Registered completed upload object_key=nar/066jhl91shf8ar6h3cqqb855j5cswl7170wrg5lzf3fhpka0xywn.nar.zst worker2 # [ 138.877317] nix-grpc-daemon[1466]: time=2026-09-21T04:26:11.517Z level=INFO msg="Uploading 1 narinfos" lb # [ 138.879846] niks3-server[1038]: 2026/09/21 04:26:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign lb # [ 138.890741] niks3-server[1038]: 2026/09/21 04:26:11 INFO Signed narinfos id=43 count=1 lb # [ 138.894862] niks3-server[1038]: 2026/09/21 04:26:11 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.ls lb # [ 138.904357] niks3-server[1038]: 2026/09/21 04:26:11 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete worker2 # [ 138.910782] nix-grpc-daemon[1466]: time=2026-09-21T04:26:11.550Z level=INFO msg="Upload complete. (466ms)" lb # [ 138.909159] niks3-server[1038]: 2026/09/21 04:26:11 INFO Completed upload id=43 lb # [ 138.912905] niks3-server[1038]: 2026/09/21 04:26:11 INFO Registered completed upload object_key=lbk8wy49c881163x07gb8z669j2fg1ff.narinfo worker2 # [ 138.920494] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=0 paths=1 nar_bytes_in=768 worker2 # [ 138.929107] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 138.935692] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 138.940176] nix-daemon[857]: reaped child process 1618, status = succeeded client # building '/nix/store/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv' on lb:50051... worker2 # [ 138.952485] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) client # farm-top> worker2: building lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 139.292106] envoy[902]: conn peer=[2001:db8:1::1]:41820 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2987 tx=853 ms=2364 client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-during-drain worker2 # [ 139.995195] nix-daemon[857]: reaped child process 1632, status = succeeded worker2 # [ 140.175078] nix-daemon[857]: accepted connection from pid 1648, user nix-grpc-daemon (trusted) worker2 # [ 140.193104] nix-daemon[857]: reaped child process 1651, status = succeeded lb # [ 140.205510] niks3-server[1038]: 2026/09/21 04:26:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 140.218529] nix-grpc-daemon[1466]: time=2026-09-21T04:26:12.856Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 140.220301] nix-grpc-daemon[1466]: time=2026-09-21T04:26:12.856Z level=INFO msg="Uploading xdwmx2f4n5n8bggglniz2n35any0xz4w-farm-top (240B)" lb # [ 140.244231] niks3-server[1038]: 2026/09/21 04:26:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign worker2 # [ 140.257246] nix-grpc-daemon[1466]: time=2026-09-21T04:26:12.896Z level=INFO msg="Uploading 1 narinfos" lb # [ 140.259217] niks3-server[1038]: 2026/09/21 04:26:12 INFO Signed narinfos id=44 count=1 lb # [ 140.268659] niks3-server[1038]: 2026/09/21 04:26:12 INFO Registered completed upload object_key=log/lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv lb # [ 140.277457] niks3-server[1038]: 2026/09/21 04:26:12 INFO Registered completed upload object_key=nar/1bpy9ga4n2446pary6msidbs8mnil1a34jn8p8yl2scvdg691mz2.nar.zst lb # [ 140.285366] niks3-server[1038]: 2026/09/21 04:26:12 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.ls worker2 # [ 140.292849] nix-grpc-daemon[1466]: time=2026-09-21T04:26:12.932Z level=INFO msg="Upload complete. (330ms)" lb # [ 140.291079] niks3-server[1038]: 2026/09/21 04:26:12 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete lb # [ 140.295864] niks3-server[1038]: 2026/09/21 04:26:12 INFO Completed upload id=44 lb # [ 140.299573] niks3-server[1038]: 2026/09/21 04:26:12 INFO Registered completed upload object_key=xdwmx2f4n5n8bggglniz2n35any0xz4w.narinfo worker2 # [ 140.305044] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=1 drv=lbk8wy49c881163x07gb8z669j2fg1ff-farm-top.drv assign_id=6 outputs=1 worker2 # [ 140.322919] nix-daemon[857]: reaped child process 1630, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain >&2, in 6.53 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag during-drain outPath, in 0.23 seconds) worker1: must succeed: pkill -f 'read -t [9]0 x' worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds) client: waiting for success: ! systemctl is-active sw worker1 # [ 140.880486] nix-daemon[838]: reaped child process 1648, status = succeeded worker1 # [ 141.061488] nix-daemon[838]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker1 # [ 141.079513] nix-daemon[838]: reaped child process 1693, status = succeeded lb # [ 141.044050] niks3-server[1038]: 2026/09/21 04:26:13 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 141.100981] nix-grpc-daemon[1592]: time=2026-09-21T04:26:13.726Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 141.103728] nix-grpc-daemon[1592]: time=2026-09-21T04:26:13.729Z level=INFO msg="Uploading qr8vyl2zl3nxnin3vw41c6z35vj7087f-slow-sw (120B)" lb # [ 141.076668] niks3-server[1038]: 2026/09/21 04:26:13 INFO Registered completed upload object_key=log/x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv lb # [ 141.095139] niks3-server[1038]: 2026/09/21 04:26:13 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 141.104201] niks3-server[1038]: 2026/09/21 04:26:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign lb # [ 141.110105] niks3-server[1038]: 2026/09/21 04:26:13 INFO Signed narinfos id=45 count=1 worker1 # [ 141.158162] nix-grpc-daemon[1592]: time=2026-09-21T04:26:13.782Z level=INFO msg="Uploading 1 narinfos" lb # [ 141.114190] niks3-server[1038]: 2026/09/21 04:26:13 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.ls lb # [ 141.124448] niks3-server[1038]: 2026/09/21 04:26:13 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete lb # [ 141.132952] niks3-server[1038]: 2026/09/21 04:26:13 INFO Completed upload id=45 lb # [ 141.136687] niks3-server[1038]: 2026/09/21 04:26:13 INFO Registered completed upload object_key=qr8vyl2zl3nxnin3vw41c6z35vj7087f.narinfo worker1 # [ 141.180587] nix-grpc-daemon[1592]: time=2026-09-21T04:26:13.806Z level=INFO msg="Upload complete. (330ms)" worker1 # [ 141.193395] nix-grpc-daemon[1489]: ts=2026-09-21T04:26:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39240 duration_s=9 drv=x0m4asg5xx7vgj4dip2crwn6zhxqngvs-slow-sw.drv assign_id=3 outputs=1 worker1 # [ 141.212197] nix-daemon[838]: reaped child process 1646, status = succeeded client # [ 141.179538] systemd[1]: sw.service: Deactivated successfully. client # [ 141.185015] systemd[1]: sw.service: Consumed 182ms CPU time over 10.144s wall clock time, 43.2M memory peak, 7.2K incoming IP traffic, 8.4K outgoing IP traffic. client: (finished: waiting for success: ! systemctl is-active sw, in 1.12 seconds) client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; } client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.05 seconds) worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service worker1 # [ 141.889392] nix-grpc-daemon[1489]: ts=2026-09-21T04:26:14Z level=info event=signal_exit worker1 # [ 143.125039] nix-grpc-daemon[1489]: ts=2026-09-21T04:26:15Z level=info event=scheduler_restarting worker2 # [ 143.078593] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:15Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:34236 worker2 # [ 143.078936] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:15Z level=info event=worker_gone addr=192.168.1.3:50051 worker1 # [ 143.151196] nix-grpc-daemon[1489]: ts=2026-09-21T04:26:15Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker1 # [ 143.174412] nix-daemon[838]: reaped child process 1558, status = succeeded worker1 # [ 143.672997] nix-grpc-daemon[1489]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR worker1 # [ 143.677978] nix-grpc-daemon[1489]: E0000 00:00:1789964776.299047 1532 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true worker1 # [ 143.684325] nix-grpc-daemon[1489]: E0000 00:00:1789964776.304122 1532 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true worker1 # [ 143.935738] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker1 # [ 143.942889] systemd[1]: nix-grpc-daemon.service: Consumed 873ms CPU time over 28.261s wall clock time, 33.3M memory peak, 21K incoming IP traffic, 27.5K outgoing IP traffic. worker1 # [ 143.960116] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 144.158589] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:16Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 144.160581] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:16Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 144.164352] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:16Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 144.172060] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:16Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 144.178981] systemd[1]: Started Nix worker-protocol over gRPC. worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.32 seconds) lb: waiting until exactly no endpoints of aarch64-linux are unhealthy lb: must succeed: curl -sf localhost:9901/clusters worker1 # [ 144.215791] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:16Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 144.173133] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:16Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:34236 worker2 # [ 144.173345] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:16Z level=info event=worker_hello addr=192.168.1.3:50051 systems=aarch64-linux max_jobs=1 running=0 lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: (finished: waiting until exactly no endpoints of aarch64-linux are unhealthy, in 1.17 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.48 seconds) subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1 worker1 # [ 145.777018] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 145.792487] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 145.812094] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 145.827670] nix-grpc-daemon[1707]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 1/5) worker1 # [ 145.908300] nix-grpc-daemon[1707]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 134 ms (attempt 2/5) worker1 # [ 146.049924] nix-grpc-daemon[1707]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 299 ms (attempt 3/5) worker1 # [ 146.349590] nix-grpc-daemon[1707]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 16 ms (attempt 4/5) worker1 # [ 146.366145] nix-grpc-daemon[1707]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 146.370293] nix-grpc-daemon[1707]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org worker2 # [ 146.375521] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:19Z level=debug event=want client=5 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv cached=0 worker2 # [ 146.381480] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:19Z level=debug event=assigned drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 146.387394] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:19Z level=debug event=want client=5 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv cached=0 worker2 # [ 146.392830] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:19Z level=debug event=want client=5 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv cached=0 worker1 # [ 146.468560] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 146.483202] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 146.497428] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 146.511614] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 146.539079] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:19Z level=info event=niks3_push_started pid=1764 worker1 # [ 146.753456] nix-grpc-daemon[1764]: time=2026-09-21T04:26:19.379Z level=INFO msg="Configuring client TLS" cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.pem key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/worker1.key ca="" worker1 # [ 146.924328] nix-daemon[838]: accepted connection from pid 1777, user nix-grpc-daemon (trusted) worker1 # [ 146.941325] nix-daemon[838]: reaped child process 1780, status = succeeded worker1 # [ 147.121341] nix-daemon[838]: accepted connection from pid 1782, user nix-grpc-daemon (trusted) worker1 # [ 147.137888] nix-daemon[838]: reaped child process 1785, status = succeeded lb # [ 147.102863] niks3-server[1038]: 2026/09/21 04:26:19 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 147.160062] nix-grpc-daemon[1764]: time=2026-09-21T04:26:19.785Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 147.161546] nix-grpc-daemon[1764]: time=2026-09-21T04:26:19.785Z level=INFO msg="Uploading 3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv (512B)" lb # [ 147.134814] niks3-server[1038]: 2026/09/21 04:26:19 INFO Registered completed upload object_key=nar/0zxfsmqijfc2dkglls3yp1x3w0w1na7vx39fxc124zddjzpaygd8.nar.zst lb # [ 147.151275] niks3-server[1038]: 2026/09/21 04:26:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign worker1 # [ 147.205555] nix-grpc-daemon[1764]: time=2026-09-21T04:26:19.831Z level=INFO msg="Uploading 1 narinfos" lb # [ 147.163486] niks3-server[1038]: 2026/09/21 04:26:19 INFO Signed narinfos id=46 count=1 lb # [ 147.171183] niks3-server[1038]: 2026/09/21 04:26:19 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.ls lb # [ 147.181699] niks3-server[1038]: 2026/09/21 04:26:19 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete lb # [ 147.189402] niks3-server[1038]: 2026/09/21 04:26:19 INFO Completed upload id=46 worker1 # [ 147.237060] nix-grpc-daemon[1764]: time=2026-09-21T04:26:19.863Z level=INFO msg="Upload complete. (478ms)" lb # [ 147.192234] niks3-server[1038]: 2026/09/21 04:26:19 INFO Registered completed upload object_key=3223c4sl4ncpldbvw558vqwddijwzfpd.narinfo worker1 # [ 147.244909] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 147.260353] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 147.269600] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 147.272331] nix-daemon[838]: reaped child process 1762, status = succeeded worker1 # [ 147.285444] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 147.905806] nix-daemon[838]: reaped child process 1789, status = succeeded worker1 # [ 148.072420] nix-daemon[838]: accepted connection from pid 1805, user nix-grpc-daemon (trusted) worker1 # [ 148.090426] nix-daemon[838]: reaped child process 1808, status = succeeded lb # [ 148.053860] niks3-server[1038]: 2026/09/21 04:26:20 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.112391] nix-grpc-daemon[1764]: time=2026-09-21T04:26:20.736Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 148.113891] nix-grpc-daemon[1764]: time=2026-09-21T04:26:20.736Z level=INFO msg="Uploading dla3w0zf02z5jhccwa27i85bbgzrrsvb-farm-a (128B)" lb # [ 148.096521] niks3-server[1038]: 2026/09/21 04:26:20 INFO Registered completed upload object_key=log/3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv lb # [ 148.110413] niks3-server[1038]: 2026/09/21 04:26:20 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst lb # [ 148.119159] niks3-server[1038]: 2026/09/21 04:26:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign worker1 # [ 148.173195] nix-grpc-daemon[1764]: time=2026-09-21T04:26:20.798Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.125268] niks3-server[1038]: 2026/09/21 04:26:20 INFO Signed narinfos id=47 count=1 lb # [ 148.131652] niks3-server[1038]: 2026/09/21 04:26:20 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.ls lb # [ 148.142838] niks3-server[1038]: 2026/09/21 04:26:20 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete lb # [ 148.149693] niks3-server[1038]: 2026/09/21 04:26:20 INFO Completed upload id=47 worker1 # [ 148.197284] nix-grpc-daemon[1764]: time=2026-09-21T04:26:20.823Z level=INFO msg="Upload complete. (302ms)" lb # [ 148.152817] niks3-server[1038]: 2026/09/21 04:26:20 INFO Registered completed upload object_key=dla3w0zf02z5jhccwa27i85bbgzrrsvb.narinfo worker2 # [ 148.161799] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:20Z level=debug event=assigned drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 148.208310] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 drv=3223c4sl4ncpldbvw558vqwddijwzfpd-farm-a.drv assign_id=7 outputs=1 worker2 # [ 148.173760] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:20Z level=debug event=want client=5 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv cached=0 worker1 # [ 148.224145] nix-daemon[838]: reaped child process 1787, status = succeeded worker1 # [ 148.260699] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 148.276309] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 148.289928] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 148.303493] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 148.499793] nix-daemon[838]: accepted connection from pid 1812, user nix-grpc-daemon (trusted) worker1 # [ 148.518234] nix-daemon[838]: reaped child process 1815, status = succeeded worker1 # [ 148.692841] nix-daemon[838]: accepted connection from pid 1817, user nix-grpc-daemon (trusted) worker1 # [ 148.708626] nix-daemon[838]: reaped child process 1820, status = succeeded lb # [ 148.674523] niks3-server[1038]: 2026/09/21 04:26:21 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 148.730948] nix-grpc-daemon[1764]: time=2026-09-21T04:26:21.356Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 148.732580] nix-grpc-daemon[1764]: time=2026-09-21T04:26:21.356Z level=INFO msg="Uploading pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv (512B)" lb # [ 148.700051] niks3-server[1038]: 2026/09/21 04:26:21 INFO Registered completed upload object_key=nar/0g5bxr683biqh358mkd9xrclwllan4cgnv4pzijas586xj68wwx0.nar.zst lb # [ 148.713295] niks3-server[1038]: 2026/09/21 04:26:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign worker1 # [ 148.768120] nix-grpc-daemon[1764]: time=2026-09-21T04:26:21.394Z level=INFO msg="Uploading 1 narinfos" lb # [ 148.726252] niks3-server[1038]: 2026/09/21 04:26:21 INFO Signed narinfos id=48 count=1 lb # [ 148.732269] niks3-server[1038]: 2026/09/21 04:26:21 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.ls lb # [ 148.739999] niks3-server[1038]: 2026/09/21 04:26:21 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete lb # [ 148.744946] niks3-server[1038]: 2026/09/21 04:26:21 INFO Registered completed upload object_key=pplpzcnjfn295nm16cg0iihpfc9iffry.narinfo lb # [ 148.749122] niks3-server[1038]: 2026/09/21 04:26:21 INFO Completed upload id=48 worker1 # [ 148.796736] nix-grpc-daemon[1764]: time=2026-09-21T04:26:21.422Z level=INFO msg="Upload complete. (479ms)" worker1 # [ 148.803584] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:21Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 148.815247] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 148.821614] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 148.826243] nix-daemon[838]: reaped child process 1810, status = succeeded worker1 # [ 148.839663] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) lb # [ 149.291773] envoy[902]: conn peer=[2001:db8:1::1]:46326 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9595 tx=4104 ms=6235 lb # [ 149.296973] envoy[902]: conn peer=[2001:db8:1::1]:46316 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2978 tx=1429 ms=9846 lb # [ 149.302711] envoy[902]: conn peer=[2001:db8:1::3]:40380 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=986 tx=448 ms=27235 worker1 # [ 149.681401] nix-daemon[838]: reaped child process 1824, status = succeeded worker1 # [ 149.855185] nix-daemon[838]: accepted connection from pid 1840, user nix-grpc-daemon (trusted) worker1 # [ 149.872116] nix-daemon[838]: reaped child process 1843, status = succeeded lb # [ 149.840574] niks3-server[1038]: 2026/09/21 04:26:22 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 149.897347] nix-grpc-daemon[1764]: time=2026-09-21T04:26:22.522Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 149.898815] nix-grpc-daemon[1764]: time=2026-09-21T04:26:22.522Z level=INFO msg="Uploading fhc1zkcygpzppf0bj5fr2k85lf7p87v9-farm-a (128B)" lb # [ 149.872092] niks3-server[1038]: 2026/09/21 04:26:22 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst worker1 # [ 149.942253] nix-grpc-daemon[1764]: time=2026-09-21T04:26:22.567Z level=INFO msg="Uploading 1 narinfos" lb # [ 149.887547] niks3-server[1038]: 2026/09/21 04:26:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign lb # [ 149.902701] niks3-server[1038]: 2026/09/21 04:26:22 INFO Signed narinfos id=49 count=1 lb # [ 149.909935] niks3-server[1038]: 2026/09/21 04:26:22 INFO Registered completed upload object_key=log/pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv lb # [ 149.923303] niks3-server[1038]: 2026/09/21 04:26:22 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.ls worker1 # [ 149.976364] nix-grpc-daemon[1764]: time=2026-09-21T04:26:22.602Z level=INFO msg="Upload complete. (326ms)" lb # [ 149.928818] niks3-server[1038]: 2026/09/21 04:26:22 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete lb # [ 149.934969] niks3-server[1038]: 2026/09/21 04:26:22 INFO Completed upload id=49 lb # [ 149.938326] niks3-server[1038]: 2026/09/21 04:26:22 INFO Registered completed upload object_key=fhc1zkcygpzppf0bj5fr2k85lf7p87v9.narinfo worker2 # [ 149.938521] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:22Z level=debug event=assigned drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 149.987141] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:22Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=1 drv=pplpzcnjfn295nm16cg0iihpfc9iffry-farm-a.drv assign_id=8 outputs=1 worker2 # [ 149.950685] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:22Z level=debug event=want client=5 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv cached=0 worker1 # [ 150.007584] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 150.013617] nix-daemon[838]: reaped child process 1822, status = succeeded worker1 # [ 150.021348] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 150.033860] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 150.046288] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 150.243065] nix-daemon[838]: accepted connection from pid 1847, user nix-grpc-daemon (trusted) worker1 # [ 150.259907] nix-daemon[838]: reaped child process 1850, status = succeeded worker1 # [ 150.433818] nix-daemon[838]: accepted connection from pid 1852, user nix-grpc-daemon (trusted) worker1 # [ 150.450182] nix-daemon[838]: reaped child process 1855, status = succeeded lb # [ 150.413806] niks3-server[1038]: 2026/09/21 04:26:23 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 150.469930] nix-grpc-daemon[1764]: time=2026-09-21T04:26:23.095Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 150.471450] nix-grpc-daemon[1764]: time=2026-09-21T04:26:23.095Z level=INFO msg="Uploading sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv (512B)" lb # [ 150.439512] niks3-server[1038]: 2026/09/21 04:26:23 INFO Registered completed upload object_key=nar/1fxz200fmpbckafrn03b2snx9knqpbwf8rwqlbvg68356qj7aj5w.nar.zst worker1 # [ 150.500717] nix-grpc-daemon[1764]: time=2026-09-21T04:26:23.126Z level=INFO msg="Uploading 1 narinfos" lb # [ 150.457046] niks3-server[1038]: 2026/09/21 04:26:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign lb # [ 150.466908] niks3-server[1038]: 2026/09/21 04:26:23 INFO Signed narinfos id=50 count=1 lb # [ 150.475496] niks3-server[1038]: 2026/09/21 04:26:23 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.ls worker1 # [ 150.528325] nix-grpc-daemon[1764]: time=2026-09-21T04:26:23.154Z level=INFO msg="Upload complete. (469ms)" lb # [ 150.481262] niks3-server[1038]: 2026/09/21 04:26:23 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete lb # [ 150.486137] niks3-server[1038]: 2026/09/21 04:26:23 INFO Completed upload id=50 worker1 # [ 150.533478] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 paths=1 nar_bytes_in=512 lb # [ 150.488960] niks3-server[1038]: 2026/09/21 04:26:23 INFO Registered completed upload object_key=sy43wp9v52pni1wms6q0p3qybpc2pwad.narinfo worker1 # [ 150.544631] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 150.550718] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 150.554765] nix-daemon[838]: reaped child process 1845, status = succeeded worker1 # [ 150.564771] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 151.611458] nix-daemon[838]: reaped child process 1859, status = succeeded worker1 # [ 151.788935] nix-daemon[838]: accepted connection from pid 1875, user nix-grpc-daemon (trusted) worker1 # [ 151.804603] nix-daemon[838]: reaped child process 1878, status = succeeded lb # [ 151.773797] niks3-server[1038]: 2026/09/21 04:26:24 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 151.832415] nix-grpc-daemon[1764]: time=2026-09-21T04:26:24.457Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 151.833900] nix-grpc-daemon[1764]: time=2026-09-21T04:26:24.457Z level=INFO msg="Uploading g5laypvfk2469p8binw3mksk2hv7zhnh-farm-a (128B)" lb # [ 151.807983] niks3-server[1038]: 2026/09/21 04:26:24 INFO Registered completed upload object_key=log/sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv lb # [ 151.819889] niks3-server[1038]: 2026/09/21 04:26:24 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst lb # [ 151.830610] niks3-server[1038]: 2026/09/21 04:26:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign worker1 # [ 151.883603] nix-grpc-daemon[1764]: time=2026-09-21T04:26:24.509Z level=INFO msg="Uploading 1 narinfos" lb # [ 151.838648] niks3-server[1038]: 2026/09/21 04:26:24 INFO Signed narinfos id=51 count=1 lb # [ 151.843883] niks3-server[1038]: 2026/09/21 04:26:24 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.ls lb # [ 151.852619] niks3-server[1038]: 2026/09/21 04:26:24 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete lb # [ 151.858209] niks3-server[1038]: 2026/09/21 04:26:24 INFO Completed upload id=51 worker1 # [ 151.905868] nix-grpc-daemon[1764]: time=2026-09-21T04:26:24.532Z level=INFO msg="Upload complete. (329ms)" lb # [ 151.861611] niks3-server[1038]: 2026/09/21 04:26:24 INFO Registered completed upload object_key=g5laypvfk2469p8binw3mksk2hv7zhnh.narinfo worker2 # [ 151.870005] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:24Z level=debug event=assigned drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 151.883024] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:24Z level=debug event=want client=5 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv cached=0 worker1 # [ 151.917149] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=1 drv=sy43wp9v52pni1wms6q0p3qybpc2pwad-farm-a.drv assign_id=9 outputs=1 worker1 # [ 151.935105] nix-daemon[838]: reaped child process 1857, status = succeeded worker1 # [ 151.967987] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 151.983544] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 151.998596] nix-grpc-daemon[1764]: time=2026-09-21T04:26:24.624Z level=INFO msg="All 1 paths already cached" worker1 # [ 152.007445] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 152.021334] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 152.221566] nix-daemon[838]: accepted connection from pid 1882, user nix-grpc-daemon (trusted) worker1 # [ 152.238599] nix-daemon[838]: reaped child process 1885, status = succeeded worker1 # [ 152.410678] nix-daemon[838]: accepted connection from pid 1887, user nix-grpc-daemon (trusted) worker1 # [ 152.426742] nix-daemon[838]: reaped child process 1890, status = succeeded lb # [ 152.391194] niks3-server[1038]: 2026/09/21 04:26:25 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 152.447846] nix-grpc-daemon[1764]: time=2026-09-21T04:26:25.073Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 152.449562] nix-grpc-daemon[1764]: time=2026-09-21T04:26:25.073Z level=INFO msg="Uploading cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv (624B)" lb # [ 152.424397] niks3-server[1038]: 2026/09/21 04:26:25 INFO Registered completed upload object_key=nar/1w4sykcjji9zlw0a5xibxycy6x3jyb4drd29x2k9g7x5whfwwpsq.nar.zst worker1 # [ 152.484489] nix-grpc-daemon[1764]: time=2026-09-21T04:26:25.110Z level=INFO msg="Uploading 1 narinfos" lb # [ 152.439032] niks3-server[1038]: 2026/09/21 04:26:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign lb # [ 152.448219] niks3-server[1038]: 2026/09/21 04:26:25 INFO Signed narinfos id=52 count=1 lb # [ 152.450569] niks3-server[1038]: 2026/09/21 04:26:25 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.ls worker1 # [ 152.506752] nix-grpc-daemon[1764]: time=2026-09-21T04:26:25.133Z level=INFO msg="Upload complete. (469ms)" lb # [ 152.459490] niks3-server[1038]: 2026/09/21 04:26:25 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete lb # [ 152.463999] niks3-server[1038]: 2026/09/21 04:26:25 INFO Completed upload id=52 lb # [ 152.466487] niks3-server[1038]: 2026/09/21 04:26:25 INFO Registered completed upload object_key=cnf7j5vjqyj799isbg26wgjnrlk208gi.narinfo worker1 # [ 152.514586] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 152.526006] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 152.531533] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 152.535562] nix-daemon[838]: reaped child process 1880, status = succeeded worker1 # [ 152.545778] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 153.787426] nix-daemon[838]: reaped child process 1894, status = succeeded worker1 # [ 153.955609] nix-daemon[838]: accepted connection from pid 1910, user nix-grpc-daemon (trusted) worker1 # [ 153.974270] nix-daemon[838]: reaped child process 1913, status = succeeded lb # [ 153.938834] niks3-server[1038]: 2026/09/21 04:26:26 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 153.996421] nix-grpc-daemon[1764]: time=2026-09-21T04:26:26.621Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 153.997905] nix-grpc-daemon[1764]: time=2026-09-21T04:26:26.621Z level=INFO msg="Uploading p1334cl91hzsgv8bmiqzkwvhbwq24vn1-farm-b (176B)" lb # [ 153.978210] niks3-server[1038]: 2026/09/21 04:26:26 INFO Registered completed upload object_key=log/cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv lb # [ 153.988296] niks3-server[1038]: 2026/09/21 04:26:26 INFO Registered completed upload object_key=nar/0pa7j07n0n5p9wcfihhx3357xrxs4h8s57kncplymh51lvzvz2kh.nar.zst lb # [ 154.001432] niks3-server[1038]: 2026/09/21 04:26:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign worker1 # [ 154.053914] nix-grpc-daemon[1764]: time=2026-09-21T04:26:26.679Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.010609] niks3-server[1038]: 2026/09/21 04:26:26 INFO Signed narinfos id=53 count=1 lb # [ 154.016449] niks3-server[1038]: 2026/09/21 04:26:26 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.ls lb # [ 154.024095] niks3-server[1038]: 2026/09/21 04:26:26 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete lb # [ 154.030936] niks3-server[1038]: 2026/09/21 04:26:26 INFO Completed upload id=53 worker1 # [ 154.078625] nix-grpc-daemon[1764]: time=2026-09-21T04:26:26.704Z level=INFO msg="Upload complete. (321ms)" lb # [ 154.034055] niks3-server[1038]: 2026/09/21 04:26:26 INFO Registered completed upload object_key=p1334cl91hzsgv8bmiqzkwvhbwq24vn1.narinfo worker2 # [ 154.043271] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:26Z level=debug event=assigned drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 154.093145] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=1 drv=cnf7j5vjqyj799isbg26wgjnrlk208gi-farm-b.drv assign_id=10 outputs=1 worker2 # [ 154.056446] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:26Z level=debug event=want client=5 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv cached=0 worker1 # [ 154.108645] nix-daemon[838]: reaped child process 1892, status = succeeded worker1 # [ 154.143877] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 154.159138] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 154.173261] nix-grpc-daemon[1764]: time=2026-09-21T04:26:26.799Z level=INFO msg="All 1 paths already cached" worker1 # [ 154.182625] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 154.196539] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 154.395519] nix-daemon[838]: accepted connection from pid 1917, user nix-grpc-daemon (trusted) worker1 # [ 154.415362] nix-daemon[838]: reaped child process 1920, status = succeeded worker1 # [ 154.586712] nix-daemon[838]: accepted connection from pid 1922, user nix-grpc-daemon (trusted) worker1 # [ 154.602756] nix-daemon[838]: reaped child process 1925, status = succeeded lb # [ 154.566071] niks3-server[1038]: 2026/09/21 04:26:27 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 154.622481] nix-grpc-daemon[1764]: time=2026-09-21T04:26:27.248Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 154.623980] nix-grpc-daemon[1764]: time=2026-09-21T04:26:27.248Z level=INFO msg="Uploading 7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv (624B)" lb # [ 154.594279] niks3-server[1038]: 2026/09/21 04:26:27 INFO Registered completed upload object_key=nar/0l0zss9ls4bhz18slrrmz7l1j93xz7424q7314p64rpgrpqf6b7k.nar.zst worker1 # [ 154.660237] nix-grpc-daemon[1764]: time=2026-09-21T04:26:27.286Z level=INFO msg="Uploading 1 narinfos" lb # [ 154.605481] niks3-server[1038]: 2026/09/21 04:26:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign lb # [ 154.617692] niks3-server[1038]: 2026/09/21 04:26:27 INFO Signed narinfos id=54 count=1 lb # [ 154.624359] niks3-server[1038]: 2026/09/21 04:26:27 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.ls worker1 # [ 154.682574] nix-grpc-daemon[1764]: time=2026-09-21T04:26:27.308Z level=INFO msg="Upload complete. (469ms)" lb # [ 154.636633] niks3-server[1038]: 2026/09/21 04:26:27 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete lb # [ 154.642061] niks3-server[1038]: 2026/09/21 04:26:27 INFO Completed upload id=54 worker1 # [ 154.689487] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 paths=1 nar_bytes_in=624 lb # [ 154.645381] niks3-server[1038]: 2026/09/21 04:26:27 INFO Registered completed upload object_key=7vjzkx8444zm2h7882vsj6bmj73zqjq3.narinfo worker1 # [ 154.702406] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 154.711864] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 154.714628] nix-daemon[838]: reaped child process 1915, status = succeeded worker1 # [ 154.726783] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 155.967517] nix-daemon[838]: reaped child process 1929, status = succeeded worker1 # [ 156.143117] nix-daemon[838]: accepted connection from pid 1945, user nix-grpc-daemon (trusted) worker1 # [ 156.160491] nix-daemon[838]: reaped child process 1948, status = succeeded lb # [ 156.130066] niks3-server[1038]: 2026/09/21 04:26:28 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.187517] nix-grpc-daemon[1764]: time=2026-09-21T04:26:28.811Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 156.190221] nix-grpc-daemon[1764]: time=2026-09-21T04:26:28.811Z level=INFO msg="Uploading nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8-farm-b (176B)" lb # [ 156.165054] niks3-server[1038]: 2026/09/21 04:26:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign worker1 # [ 156.220526] nix-grpc-daemon[1764]: time=2026-09-21T04:26:28.846Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.182257] niks3-server[1038]: 2026/09/21 04:26:28 INFO Signed narinfos id=55 count=1 lb # [ 156.190947] niks3-server[1038]: 2026/09/21 04:26:28 INFO Registered completed upload object_key=log/7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv lb # [ 156.198212] niks3-server[1038]: 2026/09/21 04:26:28 INFO Registered completed upload object_key=nar/0kqa5m59sp6aj1ixqj6q54wwqxkcn98fw1rc9hfkcdk460wjdl0l.nar.zst lb # [ 156.206912] niks3-server[1038]: 2026/09/21 04:26:28 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.ls worker1 # [ 156.258657] nix-grpc-daemon[1764]: time=2026-09-21T04:26:28.884Z level=INFO msg="Upload complete. (322ms)" lb # [ 156.211543] niks3-server[1038]: 2026/09/21 04:26:28 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete lb # [ 156.216269] niks3-server[1038]: 2026/09/21 04:26:28 INFO Completed upload id=55 lb # [ 156.219767] niks3-server[1038]: 2026/09/21 04:26:28 INFO Registered completed upload object_key=nrnwwsxw1z9dz81vri9gl1dkhkrc6vh8.narinfo worker2 # [ 156.224275] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:28Z level=debug event=assigned drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 156.273231] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=1 drv=7vjzkx8444zm2h7882vsj6bmj73zqjq3-farm-b.drv assign_id=11 outputs=1 worker2 # [ 156.238720] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:28Z level=debug event=want client=5 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv cached=0 worker1 # [ 156.292152] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 156.298986] nix-daemon[838]: reaped child process 1927, status = succeeded worker1 # [ 156.303457] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 156.312007] nix-grpc-daemon[1764]: time=2026-09-21T04:26:28.938Z level=INFO msg="All 1 paths already cached" worker1 # [ 156.318149] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 156.329186] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 156.517318] nix-daemon[838]: accepted connection from pid 1952, user nix-grpc-daemon (trusted) worker1 # [ 156.536139] nix-daemon[838]: reaped child process 1955, status = succeeded worker1 # [ 156.708353] nix-daemon[838]: accepted connection from pid 1957, user nix-grpc-daemon (trusted) worker1 # [ 156.725196] nix-daemon[838]: reaped child process 1960, status = succeeded lb # [ 156.688564] niks3-server[1038]: 2026/09/21 04:26:29 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 156.744581] nix-grpc-daemon[1764]: time=2026-09-21T04:26:29.370Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 156.746047] nix-grpc-daemon[1764]: time=2026-09-21T04:26:29.370Z level=INFO msg="Uploading cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv (624B)" lb # [ 156.714257] niks3-server[1038]: 2026/09/21 04:26:29 INFO Registered completed upload object_key=nar/0f6g0vggy0qbqsj64l1nivyqdh6q12kh8620ysnf210ani0727vf.nar.zst lb # [ 156.728367] niks3-server[1038]: 2026/09/21 04:26:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign worker1 # [ 156.781868] nix-grpc-daemon[1764]: time=2026-09-21T04:26:29.407Z level=INFO msg="Uploading 1 narinfos" lb # [ 156.741186] niks3-server[1038]: 2026/09/21 04:26:29 INFO Signed narinfos id=56 count=1 lb # [ 156.746550] niks3-server[1038]: 2026/09/21 04:26:29 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.ls lb # [ 156.754469] niks3-server[1038]: 2026/09/21 04:26:29 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete worker1 # [ 156.806605] nix-grpc-daemon[1764]: time=2026-09-21T04:26:29.432Z level=INFO msg="Upload complete. (463ms)" lb # [ 156.759679] niks3-server[1038]: 2026/09/21 04:26:29 INFO Completed upload id=56 lb # [ 156.763538] niks3-server[1038]: 2026/09/21 04:26:29 INFO Registered completed upload object_key=cgwyij19i3fl7sqlyz54vzfr4zajg077.narinfo worker1 # [ 156.816864] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 156.825340] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 156.830774] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 156.835124] nix-daemon[838]: reaped child process 1950, status = succeeded worker1 # [ 156.845728] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 157.676639] nix-daemon[838]: reaped child process 1964, status = succeeded worker1 # [ 157.838337] nix-daemon[838]: accepted connection from pid 1980, user nix-grpc-daemon (trusted) worker1 # [ 157.858994] nix-daemon[838]: reaped child process 1983, status = succeeded lb # [ 157.824789] niks3-server[1038]: 2026/09/21 04:26:30 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 157.884463] nix-grpc-daemon[1764]: time=2026-09-21T04:26:30.509Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 157.885964] nix-grpc-daemon[1764]: time=2026-09-21T04:26:30.509Z level=INFO msg="Uploading hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5-farm-b (176B)" lb # [ 157.862424] niks3-server[1038]: 2026/09/21 04:26:30 INFO Registered completed upload object_key=nar/0x964sxcxsdh3nfjarc1ib52kr50kl8zxl7h34jq5ydx763drras.nar.zst lb # [ 157.880214] niks3-server[1038]: 2026/09/21 04:26:30 INFO Registered completed upload object_key=log/cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv lb # [ 157.888546] niks3-server[1038]: 2026/09/21 04:26:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign worker1 # [ 157.941533] nix-grpc-daemon[1764]: time=2026-09-21T04:26:30.567Z level=INFO msg="Uploading 1 narinfos" lb # [ 157.896898] niks3-server[1038]: 2026/09/21 04:26:30 INFO Signed narinfos id=57 count=1 lb # [ 157.902617] niks3-server[1038]: 2026/09/21 04:26:30 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.ls lb # [ 157.910410] niks3-server[1038]: 2026/09/21 04:26:30 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete lb # [ 157.918656] niks3-server[1038]: 2026/09/21 04:26:30 INFO Completed upload id=57 worker1 # [ 157.966384] nix-grpc-daemon[1764]: time=2026-09-21T04:26:30.592Z level=INFO msg="Upload complete. (310ms)" lb # [ 157.922069] niks3-server[1038]: 2026/09/21 04:26:30 INFO Registered completed upload object_key=hfsg1k13f2w2fjgkzxk1qi2fh35fdlk5.narinfo worker2 # [ 157.930986] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:30Z level=debug event=assigned drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 157.981236] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=1 drv=cgwyij19i3fl7sqlyz54vzfr4zajg077-farm-b.drv assign_id=12 outputs=1 worker1 # [ 157.997326] nix-daemon[838]: reaped child process 1962, status = succeeded worker1 # [ 158.021974] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker2 # [ 157.979935] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:30Z level=debug event=want client=5 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv cached=0 worker1 # [ 158.037954] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 158.053125] nix-grpc-daemon[1764]: time=2026-09-21T04:26:30.678Z level=INFO msg="All 2 paths already cached" worker1 # [ 158.062011] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 158.075575] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 158.271477] nix-daemon[838]: accepted connection from pid 1987, user nix-grpc-daemon (trusted) worker1 # [ 158.291441] nix-daemon[838]: reaped child process 1990, status = succeeded worker1 # [ 158.466643] nix-daemon[838]: accepted connection from pid 1992, user nix-grpc-daemon (trusted) worker1 # [ 158.483944] nix-daemon[838]: reaped child process 1995, status = succeeded lb # [ 158.447813] niks3-server[1038]: 2026/09/21 04:26:31 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 158.504110] nix-grpc-daemon[1764]: time=2026-09-21T04:26:31.130Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 158.505821] nix-grpc-daemon[1764]: time=2026-09-21T04:26:31.130Z level=INFO msg="Uploading dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv (752B)" lb # [ 158.477565] niks3-server[1038]: 2026/09/21 04:26:31 INFO Registered completed upload object_key=nar/0s7ff7rwqx5p9mdzddqgzd9bbd5j8njfc62k07mgnpy19810bs86.nar.zst lb # [ 158.491681] niks3-server[1038]: 2026/09/21 04:26:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign worker1 # [ 158.547398] nix-grpc-daemon[1764]: time=2026-09-21T04:26:31.173Z level=INFO msg="Uploading 1 narinfos" lb # [ 158.499960] niks3-server[1038]: 2026/09/21 04:26:31 INFO Signed narinfos id=58 count=1 lb # [ 158.508644] niks3-server[1038]: 2026/09/21 04:26:31 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.ls lb # [ 158.517483] niks3-server[1038]: 2026/09/21 04:26:31 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete lb # [ 158.523339] niks3-server[1038]: 2026/09/21 04:26:31 INFO Registered completed upload object_key=dca2k4dvnk52m7gijqfq8q99ih3ni8ny.narinfo lb # [ 158.528422] niks3-server[1038]: 2026/09/21 04:26:31 INFO Completed upload id=58 worker1 # [ 158.576158] nix-grpc-daemon[1764]: time=2026-09-21T04:26:31.202Z level=INFO msg="Upload complete. (486ms)" worker1 # [ 158.584604] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 158.599847] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 158.606189] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 158.611024] nix-daemon[838]: reaped child process 1985, status = succeeded worker1 # [ 158.625680] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 159.247763] nix-daemon[838]: reaped child process 1999, status = succeeded worker1 # [ 159.403979] nix-daemon[838]: accepted connection from pid 2015, user nix-grpc-daemon (trusted) worker1 # [ 159.422095] nix-daemon[838]: reaped child process 2018, status = succeeded lb # [ 159.387336] niks3-server[1038]: 2026/09/21 04:26:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.448302] nix-grpc-daemon[1764]: time=2026-09-21T04:26:32.071Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 159.449742] nix-grpc-daemon[1764]: time=2026-09-21T04:26:32.071Z level=INFO msg="Uploading d88xgckxx0s0n5ly2d0jw1qy1641z8pq-farm-top (232B)" lb # [ 159.425400] niks3-server[1038]: 2026/09/21 04:26:32 INFO Registered completed upload object_key=log/dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv lb # [ 159.437022] niks3-server[1038]: 2026/09/21 04:26:32 INFO Registered completed upload object_key=nar/0knxhkhz3x04vk8as5wv5ar2d0h02prv7q5f42qm1xjgr70ancd0.nar.zst worker1 # [ 159.494173] nix-grpc-daemon[1764]: time=2026-09-21T04:26:32.120Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.450624] niks3-server[1038]: 2026/09/21 04:26:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign lb # [ 159.457692] niks3-server[1038]: 2026/09/21 04:26:32 INFO Signed narinfos id=59 count=1 lb # [ 159.459838] niks3-server[1038]: 2026/09/21 04:26:32 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.ls lb # [ 159.466736] niks3-server[1038]: 2026/09/21 04:26:32 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete lb # [ 159.470945] niks3-server[1038]: 2026/09/21 04:26:32 INFO Completed upload id=59 worker1 # [ 159.518048] nix-grpc-daemon[1764]: time=2026-09-21T04:26:32.144Z level=INFO msg="Upload complete. (283ms)" lb # [ 159.473383] niks3-server[1038]: 2026/09/21 04:26:32 INFO Registered completed upload object_key=d88xgckxx0s0n5ly2d0jw1qy1641z8pq.narinfo worker2 # [ 159.481358] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:32Z level=debug event=assigned drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 159.527513] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 drv=dca2k4dvnk52m7gijqfq8q99ih3ni8ny-farm-top.drv assign_id=13 outputs=1 worker1 # [ 159.540729] nix-daemon[838]: reaped child process 1997, status = succeeded worker1 # [ 159.545302] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 159.554437] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 159.565484] nix-grpc-daemon[1764]: time=2026-09-21T04:26:32.191Z level=INFO msg="All 2 paths already cached" worker1 # [ 159.573470] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 159.584182] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 159.769697] nix-daemon[838]: accepted connection from pid 2022, user nix-grpc-daemon (trusted) worker1 # [ 159.786149] nix-daemon[838]: reaped child process 2025, status = succeeded worker1 # [ 159.958238] nix-daemon[838]: accepted connection from pid 2027, user nix-grpc-daemon (trusted) worker1 # [ 159.974108] nix-daemon[838]: reaped child process 2030, status = succeeded lb # [ 159.938580] niks3-server[1038]: 2026/09/21 04:26:32 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 159.994807] nix-grpc-daemon[1764]: time=2026-09-21T04:26:32.620Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 159.996398] nix-grpc-daemon[1764]: time=2026-09-21T04:26:32.620Z level=INFO msg="Uploading 2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv (752B)" lb # [ 159.969284] niks3-server[1038]: 2026/09/21 04:26:32 INFO Registered completed upload object_key=nar/0cpiyiv7frlhngqhhc703bglz5q2cpg4n8sgds4sfg7nvw0fcdn5.nar.zst lb # [ 159.980411] niks3-server[1038]: 2026/09/21 04:26:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign worker1 # [ 160.034321] nix-grpc-daemon[1764]: time=2026-09-21T04:26:32.660Z level=INFO msg="Uploading 1 narinfos" lb # [ 159.991238] niks3-server[1038]: 2026/09/21 04:26:32 INFO Signed narinfos id=60 count=1 lb # [ 159.998685] niks3-server[1038]: 2026/09/21 04:26:32 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.ls lb # [ 160.007761] niks3-server[1038]: 2026/09/21 04:26:32 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete lb # [ 160.013476] niks3-server[1038]: 2026/09/21 04:26:32 INFO Registered completed upload object_key=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9.narinfo lb # [ 160.017813] niks3-server[1038]: 2026/09/21 04:26:32 INFO Completed upload id=60 worker1 # [ 160.065414] nix-grpc-daemon[1764]: time=2026-09-21T04:26:32.691Z level=INFO msg="Upload complete. (468ms)" worker1 # [ 160.072679] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 160.085666] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 160.092581] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 160.097553] nix-daemon[838]: reaped child process 2020, status = succeeded worker1 # [ 160.110980] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 160.931264] nix-daemon[838]: reaped child process 2034, status = succeeded worker1 # [ 161.083286] nix-daemon[838]: accepted connection from pid 2050, user nix-grpc-daemon (trusted) worker1 # [ 161.099993] nix-daemon[838]: reaped child process 2053, status = succeeded lb # [ 161.066714] niks3-server[1038]: 2026/09/21 04:26:33 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.124328] nix-grpc-daemon[1764]: time=2026-09-21T04:26:33.749Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.125777] nix-grpc-daemon[1764]: time=2026-09-21T04:26:33.749Z level=INFO msg="Uploading vz84kyfcw804d0iyx7nj61j47ms9zxmn-farm-top (232B)" lb # [ 161.103300] niks3-server[1038]: 2026/09/21 04:26:33 INFO Registered completed upload object_key=log/2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv lb # [ 161.114332] niks3-server[1038]: 2026/09/21 04:26:33 INFO Registered completed upload object_key=nar/0aaz4iim7fa45zws98gbhp73l23kbm0fvp4anssnxa96v666ljhs.nar.zst lb # [ 161.124625] niks3-server[1038]: 2026/09/21 04:26:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign worker1 # [ 161.177734] nix-grpc-daemon[1764]: time=2026-09-21T04:26:33.803Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.130025] niks3-server[1038]: 2026/09/21 04:26:33 INFO Signed narinfos id=61 count=1 lb # [ 161.134795] niks3-server[1038]: 2026/09/21 04:26:33 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.ls lb # [ 161.143815] niks3-server[1038]: 2026/09/21 04:26:33 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete lb # [ 161.152136] niks3-server[1038]: 2026/09/21 04:26:33 INFO Completed upload id=61 worker1 # [ 161.199826] nix-grpc-daemon[1764]: time=2026-09-21T04:26:33.825Z level=INFO msg="Upload complete. (280ms)" lb # [ 161.154847] niks3-server[1038]: 2026/09/21 04:26:33 INFO Registered completed upload object_key=vz84kyfcw804d0iyx7nj61j47ms9zxmn.narinfo worker2 # [ 161.163485] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:33Z level=debug event=assigned drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 161.212755] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=1 drv=2bdcl1cxw40gyh0sjgz98vb0jixgnrd9-farm-top.drv assign_id=14 outputs=1 worker1 # [ 161.224837] nix-daemon[838]: reaped child process 2032, status = succeeded worker1 # [ 161.255867] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 161.270339] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 161.284049] nix-grpc-daemon[1764]: time=2026-09-21T04:26:33.910Z level=INFO msg="All 2 paths already cached" worker1 # [ 161.293105] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 161.306669] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 161.499026] nix-daemon[838]: accepted connection from pid 2057, user nix-grpc-daemon (trusted) worker1 # [ 161.516582] nix-daemon[838]: reaped child process 2060, status = succeeded worker1 # [ 161.688870] nix-daemon[838]: accepted connection from pid 2062, user nix-grpc-daemon (trusted) worker1 # [ 161.703560] nix-daemon[838]: reaped child process 2065, status = succeeded lb # [ 161.671614] niks3-server[1038]: 2026/09/21 04:26:34 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 161.728074] nix-grpc-daemon[1764]: time=2026-09-21T04:26:34.354Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 161.729571] nix-grpc-daemon[1764]: time=2026-09-21T04:26:34.354Z level=INFO msg="Uploading qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv (752B)" lb # [ 161.697819] niks3-server[1038]: 2026/09/21 04:26:34 INFO Registered completed upload object_key=nar/05zmsnqx4aj55yncx917mz6d3hzrvz2rx2x75313vvy1kq1zv9fv.nar.zst worker1 # [ 161.758529] nix-grpc-daemon[1764]: time=2026-09-21T04:26:34.384Z level=INFO msg="Uploading 1 narinfos" lb # [ 161.715283] niks3-server[1038]: 2026/09/21 04:26:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign lb # [ 161.726207] niks3-server[1038]: 2026/09/21 04:26:34 INFO Signed narinfos id=62 count=1 worker1 # [ 161.782240] nix-grpc-daemon[1764]: time=2026-09-21T04:26:34.408Z level=INFO msg="Upload complete. (460ms)" lb # [ 161.735402] niks3-server[1038]: 2026/09/21 04:26:34 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.ls worker1 # [ 161.788427] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 paths=1 nar_bytes_in=752 lb # [ 161.740933] niks3-server[1038]: 2026/09/21 04:26:34 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete lb # [ 161.746351] niks3-server[1038]: 2026/09/21 04:26:34 INFO Completed upload id=62 lb # [ 161.748959] niks3-server[1038]: 2026/09/21 04:26:34 INFO Registered completed upload object_key=qx10pa00pilyp5xdzd48l88d5jz143mr.narinfo worker1 # [ 161.798879] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 worker1 # [ 161.807477] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 161.809523] nix-daemon[838]: reaped child process 2055, status = succeeded worker1 # [ 161.821430] nix-daemon[838]: accepted connection from pid 1707, user nix-grpc-daemon (trusted) worker1 # [ 162.448813] nix-daemon[838]: reaped child process 2069, status = succeeded worker1 # [ 162.613837] nix-daemon[838]: accepted connection from pid 2085, user nix-grpc-daemon (trusted) worker1 # [ 162.630230] nix-daemon[838]: reaped child process 2088, status = succeeded lb # [ 162.595393] niks3-server[1038]: 2026/09/21 04:26:35 INFO Received uploads request method=POST path=/api/pending_closures worker1 # [ 162.652393] nix-grpc-daemon[1764]: time=2026-09-21T04:26:35.278Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 162.653834] nix-grpc-daemon[1764]: time=2026-09-21T04:26:35.278Z level=INFO msg="Uploading iagwbb072hnm79qb9wsrjp5907zc7aa2-farm-top (232B)" lb # [ 162.637606] niks3-server[1038]: 2026/09/21 04:26:35 INFO Registered completed upload object_key=nar/053jd22j3kv7v6j0q7cspdpc0h1c1xmywmajl6sd5hzwg50z2yj1.nar.zst lb # [ 162.649970] niks3-server[1038]: 2026/09/21 04:26:35 INFO Registered completed upload object_key=log/qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv worker1 # [ 162.705652] nix-grpc-daemon[1764]: time=2026-09-21T04:26:35.331Z level=INFO msg="Uploading 1 narinfos" lb # [ 162.661550] niks3-server[1038]: 2026/09/21 04:26:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign lb # [ 162.668957] niks3-server[1038]: 2026/09/21 04:26:35 INFO Signed narinfos id=63 count=1 lb # [ 162.671083] niks3-server[1038]: 2026/09/21 04:26:35 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.ls lb # [ 162.677286] niks3-server[1038]: 2026/09/21 04:26:35 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete lb # [ 162.682752] niks3-server[1038]: 2026/09/21 04:26:35 INFO Completed upload id=63 worker1 # [ 162.730457] nix-grpc-daemon[1764]: time=2026-09-21T04:26:35.356Z level=INFO msg="Upload complete. (301ms)" lb # [ 162.685168] niks3-server[1038]: 2026/09/21 04:26:35 INFO Registered completed upload object_key=iagwbb072hnm79qb9wsrjp5907zc7aa2.narinfo worker1 # [ 162.741060] nix-grpc-daemon[1707]: ts=2026-09-21T04:26:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44690 duration_s=0 drv=qx10pa00pilyp5xdzd48l88d5jz143mr-farm-top.drv assign_id=15 outputs=1 worker1 # [ 162.755336] nix-daemon[838]: reaped child process 2067, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.31 seconds) worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds) client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]' client # [ 162.906672] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30" --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features "[\"gpu\"]". client # Running as unit: gpu.service; invocation ID: e8a3a37b686942a798babac8754255ed client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key&restart-grace=30' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2 # [ 163.162545] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34034 client # [ 163.159012] nix[1359]: don't know how to build these paths: client # [ 163.159972] nix[1359]: /nix/store/3i1nziwpdqq19lzpqy4rywzxnm8dlps6-farm-top.drv worker2 # [ 163.173624] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.10 seconds) client # [ 163.186550] nix[1359]: warning: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu}, waiting up to 30s for a worker worker2 # [ 163.195271] nix-grpc-daemon[1393]: ts=2026-09-21T04:26:35Z level=debug event=want client=6 drv=1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv cached=0 lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) client: waiting for success: systemctl show -p Result gpu | grep -q exit-code lb # [ 169.291114] envoy[902]: conn peer=[2001:db8:1::1]:33726 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27075 tx=11457 ms=16983 client # [ 193.191442] nix[1359]: 1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv: no connected, non-draining worker for system 'aarch64-linux' offers features {gpu} client # [ 193.201045] nix[1359]: error: dependency '1jn0w6x679ijjxwcfb2gxc6lw2fxim2k-farm-a.drv' failed client # [ 193.250614] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE client # [ 193.258458] systemd[1]: gpu.service: Failed with result 'exit-code'. client # [ 193.261585] systemd[1]: gpu.service: Consumed 177ms CPU time over 30.350s wall clock time, 37.4M memory peak, 5.1K incoming IP traffic, 5K outgoing IP traffic. client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 29.25 seconds) client: must succeed: journalctl -u gpu -o cat client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds) lb: must succeed: curl -sf localhost:9901/clusters lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds) worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds) (finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 48.44 seconds) subtest: low disk drains a worker and builds go to the other worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.12 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free' worker1 # [ 195.202565] nix-grpc-daemon[1707]: ts=2026-09-21T04:27:07Z level=info event=unhealthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.12 seconds) client: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2 client # don't know how to build these paths: client # /nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 196.407407] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:34034 worker1 # [ 196.457976] nix-grpc-daemon[1707]: ts=2026-09-21T04:27:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44690 worker2 # [ 196.438871] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:09Z level=debug event=want client=7 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv cached=0 worker2 # [ 196.445789] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:09Z level=debug event=assigned drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 196.486302] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 196.501588] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34034 client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' to 'lb:50051'... worker2 # [ 196.517331] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 196.532128] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 196.744142] nix-daemon[857]: accepted connection from pid 1685, user nix-grpc-daemon (trusted) worker2 # [ 196.760691] nix-daemon[857]: reaped child process 1688, status = succeeded worker2 # [ 196.932132] nix-daemon[857]: accepted connection from pid 1690, user nix-grpc-daemon (trusted) worker2 # [ 196.947370] nix-daemon[857]: reaped child process 1693, status = succeeded lb # [ 196.961952] niks3-server[1038]: 2026/09/21 04:27:09 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 196.972366] nix-grpc-daemon[1466]: time=2026-09-21T04:27:09.612Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 196.973828] nix-grpc-daemon[1466]: time=2026-09-21T04:27:09.612Z level=INFO msg="Uploading kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv (512B)" lb # [ 197.001333] niks3-server[1038]: 2026/09/21 04:27:09 INFO Registered completed upload object_key=nar/1sfy0gcq4znfcj1f68c749r5x2jwmwsfbfp6xdflz5xkndjwjjm3.nar.zst worker2 # [ 197.025439] nix-grpc-daemon[1466]: time=2026-09-21T04:27:09.665Z level=INFO msg="Uploading 1 narinfos" lb # [ 197.016767] niks3-server[1038]: 2026/09/21 04:27:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign lb # [ 197.029166] niks3-server[1038]: 2026/09/21 04:27:09 INFO Signed narinfos id=64 count=1 lb # [ 197.035365] niks3-server[1038]: 2026/09/21 04:27:09 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.ls lb # [ 197.046384] niks3-server[1038]: 2026/09/21 04:27:09 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete lb # [ 197.054980] niks3-server[1038]: 2026/09/21 04:27:09 INFO Completed upload id=64 worker2 # [ 197.057325] nix-grpc-daemon[1466]: time=2026-09-21T04:27:09.697Z level=INFO msg="Upload complete. (508ms)" lb # [ 197.058566] niks3-server[1038]: 2026/09/21 04:27:09 INFO Registered completed upload object_key=kksl1jqfg56vabgqvrkz5vki6nq7r59r.narinfo worker2 # [ 197.066437] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=0 paths=1 nar_bytes_in=512 worker2 # [ 197.082652] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 197.092354] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 197.097300] nix-daemon[857]: reaped child process 1683, status = succeeded client # building '/nix/store/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv' on lb:50051... client # farm-a> worker2: building kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv worker2 # [ 197.112239] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) client # farm-a> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-a> LOG-farm-a-drain worker2 # [ 198.161957] nix-daemon[857]: reaped child process 1697, status = succeeded worker2 # [ 198.343271] nix-daemon[857]: accepted connection from pid 1713, user nix-grpc-daemon (trusted) worker2 # [ 198.361771] nix-daemon[857]: reaped child process 1716, status = succeeded lb # [ 198.373074] niks3-server[1038]: 2026/09/21 04:27:10 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 198.388398] nix-grpc-daemon[1466]: time=2026-09-21T04:27:11.026Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 198.389918] nix-grpc-daemon[1466]: time=2026-09-21T04:27:11.026Z level=INFO msg="Uploading 272b39wn7cbnhkcc2rrz2f6kmhhmcwnr-farm-a (128B)" lb # [ 198.418955] niks3-server[1038]: 2026/09/21 04:27:11 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst lb # [ 198.432314] niks3-server[1038]: 2026/09/21 04:27:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign worker2 # [ 198.439355] nix-grpc-daemon[1466]: time=2026-09-21T04:27:11.079Z level=INFO msg="Uploading 1 narinfos" lb # [ 198.440096] niks3-server[1038]: 2026/09/21 04:27:11 INFO Signed narinfos id=65 count=1 lb # [ 198.444104] niks3-server[1038]: 2026/09/21 04:27:11 INFO Registered completed upload object_key=log/kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv lb # [ 198.452363] niks3-server[1038]: 2026/09/21 04:27:11 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete lb # [ 198.459673] niks3-server[1038]: 2026/09/21 04:27:11 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.ls lb # [ 198.463258] niks3-server[1038]: 2026/09/21 04:27:11 INFO Completed upload id=65 lb # [ 198.465378] niks3-server[1038]: 2026/09/21 04:27:11 INFO Registered completed upload object_key=272b39wn7cbnhkcc2rrz2f6kmhhmcwnr.narinfo worker2 # [ 198.465636] nix-grpc-daemon[1466]: time=2026-09-21T04:27:11.105Z level=INFO msg="Upload complete. (339ms)" worker2 # [ 198.485077] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=1 drv=kksl1jqfg56vabgqvrkz5vki6nq7r59r-farm-a.drv assign_id=16 outputs=1 worker2 # [ 198.500256] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:11Z level=debug event=want client=7 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv cached=0 worker2 # [ 198.503848] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:11Z level=debug event=assigned drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 198.508266] nix-daemon[857]: reaped child process 1695, status = succeeded worker2 # [ 198.526023] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 198.540371] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 198.554032] nix-grpc-daemon[1466]: time=2026-09-21T04:27:11.194Z level=INFO msg="All 1 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' to 'lb:50051'... worker2 # [ 198.563957] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 198.577727] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 198.780177] nix-daemon[857]: accepted connection from pid 1722, user nix-grpc-daemon (trusted) worker2 # [ 198.797946] nix-daemon[857]: reaped child process 1725, status = succeeded worker2 # [ 198.964124] nix-daemon[857]: accepted connection from pid 1727, user nix-grpc-daemon (trusted) worker2 # [ 198.981315] nix-daemon[857]: reaped child process 1730, status = succeeded lb # [ 198.989724] niks3-server[1038]: 2026/09/21 04:27:11 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 199.000062] nix-grpc-daemon[1466]: time=2026-09-21T04:27:11.640Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 199.001923] nix-grpc-daemon[1466]: time=2026-09-21T04:27:11.641Z level=INFO msg="Uploading fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv (632B)" lb # [ 199.017022] niks3-server[1038]: 2026/09/21 04:27:11 INFO Registered completed upload object_key=nar/1ax4z88sb8d24gsvydxvgdy2lijkmhnycxhr5war1j3sq97cyzqf.nar.zst lb # [ 199.029901] niks3-server[1038]: 2026/09/21 04:27:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign worker2 # [ 199.038222] nix-grpc-daemon[1466]: time=2026-09-21T04:27:11.678Z level=INFO msg="Uploading 1 narinfos" lb # [ 199.040277] niks3-server[1038]: 2026/09/21 04:27:11 INFO Signed narinfos id=66 count=1 lb # [ 199.043415] niks3-server[1038]: 2026/09/21 04:27:11 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.ls lb # [ 199.058365] niks3-server[1038]: 2026/09/21 04:27:11 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete lb # [ 199.063598] niks3-server[1038]: 2026/09/21 04:27:11 INFO Registered completed upload object_key=fa7adcm0x8sbgmrsfx912fp8xakk99g6.narinfo lb # [ 199.068166] niks3-server[1038]: 2026/09/21 04:27:11 INFO Completed upload id=66 worker2 # [ 199.070389] nix-grpc-daemon[1466]: time=2026-09-21T04:27:11.710Z level=INFO msg="Upload complete. (476ms)" worker2 # [ 199.076261] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=0 paths=1 nar_bytes_in=632 worker2 # [ 199.089245] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 199.098790] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 199.101099] nix-daemon[857]: reaped child process 1720, status = succeeded client # building '/nix/store/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv' on lb:50051... client # farm-b> worker2: building fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv worker2 # [ 199.114860] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) lb # [ 199.297580] envoy[902]: conn peer=[2001:db8:1::1]:50188 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=897 tx=499 ms=30060 client # farm-b> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-b> LOG-farm-b-drain worker2 # [ 199.944203] nix-daemon[857]: reaped child process 1734, status = succeeded worker2 # [ 200.115078] nix-daemon[857]: accepted connection from pid 1750, user nix-grpc-daemon (trusted) worker2 # [ 200.131637] nix-daemon[857]: reaped child process 1753, status = succeeded lb # [ 200.141438] niks3-server[1038]: 2026/09/21 04:27:12 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.155960] nix-grpc-daemon[1466]: time=2026-09-21T04:27:12.792Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 200.157619] nix-grpc-daemon[1466]: time=2026-09-21T04:27:12.792Z level=INFO msg="Uploading g774lks418zc45bd9hwhinm61pwcwnr9-farm-b (176B)" lb # [ 200.174660] niks3-server[1038]: 2026/09/21 04:27:12 INFO Registered completed upload object_key=nar/1ammzz4zx9sggy8v73zxk3j08vbqxgpw14n8lx2fh57bx24yzvnj.nar.zst lb # [ 200.188310] niks3-server[1038]: 2026/09/21 04:27:12 INFO Registered completed upload object_key=log/fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv lb # [ 200.199172] niks3-server[1038]: 2026/09/21 04:27:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign worker2 # [ 200.206763] nix-grpc-daemon[1466]: time=2026-09-21T04:27:12.846Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.209645] niks3-server[1038]: 2026/09/21 04:27:12 INFO Signed narinfos id=67 count=1 lb # [ 200.215702] niks3-server[1038]: 2026/09/21 04:27:12 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.ls lb # [ 200.225004] niks3-server[1038]: 2026/09/21 04:27:12 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete lb # [ 200.229767] niks3-server[1038]: 2026/09/21 04:27:12 INFO Completed upload id=67 worker2 # [ 200.231445] nix-grpc-daemon[1466]: time=2026-09-21T04:27:12.871Z level=INFO msg="Upload complete. (307ms)" lb # [ 200.232660] niks3-server[1038]: 2026/09/21 04:27:12 INFO Registered completed upload object_key=g774lks418zc45bd9hwhinm61pwcwnr9.narinfo worker2 # [ 200.246397] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=1 drv=fa7adcm0x8sbgmrsfx912fp8xakk99g6-farm-b.drv assign_id=17 outputs=1 worker2 # [ 200.260290] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:12Z level=debug event=want client=7 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv cached=0 worker2 # [ 200.263933] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:12Z level=debug event=assigned drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 200.268347] nix-daemon[857]: reaped child process 1732, status = succeeded worker2 # [ 200.294114] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 200.307537] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 200.320771] nix-grpc-daemon[1466]: time=2026-09-21T04:27:12.960Z level=INFO msg="All 2 paths already cached" client # copying 1 paths to 'lb:50051'... client # copying path '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' to 'lb:50051'... worker2 # [ 200.330661] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 200.344211] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 200.546756] nix-daemon[857]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker2 # [ 200.563728] nix-daemon[857]: reaped child process 1762, status = succeeded worker2 # [ 200.734813] nix-daemon[857]: accepted connection from pid 1764, user nix-grpc-daemon (trusted) worker2 # [ 200.750710] nix-daemon[857]: reaped child process 1767, status = succeeded lb # [ 200.759472] niks3-server[1038]: 2026/09/21 04:27:13 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 200.770308] nix-grpc-daemon[1466]: time=2026-09-21T04:27:13.410Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 200.771749] nix-grpc-daemon[1466]: time=2026-09-21T04:27:13.410Z level=INFO msg="Uploading 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv (760B)" lb # [ 200.785045] niks3-server[1038]: 2026/09/21 04:27:13 INFO Registered completed upload object_key=nar/1hrr94bvb37dwmf1giypzl9qnff72xm540ak7q49j34fyzia9ngb.nar.zst worker2 # [ 200.800321] nix-grpc-daemon[1466]: time=2026-09-21T04:27:13.440Z level=INFO msg="Uploading 1 narinfos" lb # [ 200.798622] niks3-server[1038]: 2026/09/21 04:27:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign lb # [ 200.810667] niks3-server[1038]: 2026/09/21 04:27:13 INFO Signed narinfos id=68 count=1 lb # [ 200.816855] niks3-server[1038]: 2026/09/21 04:27:13 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.ls worker2 # [ 200.826729] nix-grpc-daemon[1466]: time=2026-09-21T04:27:13.466Z level=INFO msg="Upload complete. (466ms)" lb # [ 200.825561] niks3-server[1038]: 2026/09/21 04:27:13 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete lb # [ 200.830545] niks3-server[1038]: 2026/09/21 04:27:13 INFO Completed upload id=68 lb # [ 200.833450] niks3-server[1038]: 2026/09/21 04:27:13 INFO Registered completed upload object_key=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l.narinfo worker2 # [ 200.836195] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=0 paths=1 nar_bytes_in=760 worker2 # [ 200.839837] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 worker2 # [ 200.851664] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) worker2 # [ 200.854173] nix-daemon[857]: reaped child process 1757, status = succeeded client # building '/nix/store/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv' on lb:50051... client # farm-top> worker2: building 77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 200.866032] nix-daemon[857]: accepted connection from pid 1393, user nix-grpc-daemon (trusted) client # farm-top> disabling binary cache 'https://cache.nixos.org' for 60 seconds client # farm-top> LOG-farm-top-drain worker2 # [ 202.086603] nix-daemon[857]: reaped child process 1771, status = succeeded worker2 # [ 202.246847] nix-daemon[857]: accepted connection from pid 1787, user nix-grpc-daemon (trusted) worker2 # [ 202.266205] nix-daemon[857]: reaped child process 1790, status = succeeded lb # [ 202.277944] niks3-server[1038]: 2026/09/21 04:27:14 INFO Received uploads request method=POST path=/api/pending_closures worker2 # [ 202.290977] nix-grpc-daemon[1466]: time=2026-09-21T04:27:14.930Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 202.293826] nix-grpc-daemon[1466]: time=2026-09-21T04:27:14.932Z level=INFO msg="Uploading bzkv277k4v9r9h4aq5h13ddcavmp36fg-farm-top (232B)" lb # [ 202.315106] niks3-server[1038]: 2026/09/21 04:27:14 INFO Registered completed upload object_key=nar/0l8sy8grn9pmq2n58ag0hx791zdfyxwk9319ynjqmn7yy7wl64s7.nar.zst lb # [ 202.332949] niks3-server[1038]: 2026/09/21 04:27:14 INFO Registered completed upload object_key=log/77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv worker2 # [ 202.347902] nix-grpc-daemon[1466]: time=2026-09-21T04:27:14.987Z level=INFO msg="Uploading 1 narinfos" lb # [ 202.340907] niks3-server[1038]: 2026/09/21 04:27:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign lb # [ 202.350747] niks3-server[1038]: 2026/09/21 04:27:14 INFO Signed narinfos id=69 count=1 lb # [ 202.355785] niks3-server[1038]: 2026/09/21 04:27:14 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.ls worker2 # [ 202.365392] nix-grpc-daemon[1466]: time=2026-09-21T04:27:15.005Z level=INFO msg="Upload complete. (289ms)" lb # [ 202.363622] niks3-server[1038]: 2026/09/21 04:27:14 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete lb # [ 202.367136] niks3-server[1038]: 2026/09/21 04:27:14 INFO Completed upload id=69 lb # [ 202.370441] niks3-server[1038]: 2026/09/21 04:27:14 INFO Registered completed upload object_key=bzkv277k4v9r9h4aq5h13ddcavmp36fg.narinfo worker2 # [ 202.377072] nix-grpc-daemon[1393]: ts=2026-09-21T04:27:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34034 duration_s=1 drv=77925dzx1nz9jvb0jf5cxdn4b8gwrv5l-farm-top.drv assign_id=18 outputs=1 worker2 # [ 202.391292] nix-daemon[857]: reaped child process 1769, status = succeeded client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.pem&client-key=/nix/store/r1p0v55v6igq97giy4hh7w7h1khnwhk6-farm-certs/ci.key' --eval-store auto -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain >&2, in 6.33 seconds) client: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath client: (finished: must succeed: nix eval --raw -f /nix/store/r498lgb40xdi1s9di8nh5bgv2h8vrrp1-job.nix --argstr tag drain outPath, in 0.24 seconds) worker1: must succeed: rm /nix/.rw-store/fill worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.21 seconds) worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free' worker1 # [ 203.206601] nix-grpc-daemon[1707]: ts=2026-09-21T04:27:15Z level=info event=healthy reason=min_free worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.14 seconds) (finished: subtest: low disk drains a worker and builds go to the other, in 10.31 seconds) (finished: run the VM test script, in 205.38 seconds) test script finished in 205.65s cleanup kill QemuMachine (pid 49) client # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 50) lb # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 51) worker1 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) kill QemuMachine (pid 52) worker2 # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/lfh101cfjj8p8npcari9hk0lbqi33yvh-python3-3.14.7/bin/python3.14) (finished: cleanup, in 1.00 seconds) additionally exposed symbols: client, lb, worker1, worker2, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh